Lipopolysaccharide (LPS) is a well-known strong inducer of inflammation. However, there is little information regarding how LPS-release behavior affects cellular senescence at the affected area. In this paper, we demonstrate that a vacuum-heating technique (dehydrothermal treatment) can be utilized to prepare an LPS sustained-release gelatin sponge (LS-G). LPS sustained release from gelatin leads to the long-term existence of senescent cells in critical-sized bone defects in rat calvaria. Three types of gelatin sponges were prepared in this study: a medical-grade gelatin sponge with extremely low LPS levels (MG), LS-G, and a LPS rapid-release gelatin sponge (LR-G). Histological (H-E) and immunohistochemical (COX-2, p16, and p21) staining were utilized to evaluate inflammatory reactions and cellular senescence one to three weeks after surgery. Soft X-ray imaging was utilized to estimate new bone formation in the defects. The LR-G led to stronger swelling and COX-2 expression in defects compared to the MG and LS-G at 1 week. Despite a small inflammatory reaction, LS-G implantation led to the long-term existence of senescent cells and hampered bone formation compared to the MG and LR-G. These results suggest that vacuum heating is a viable technique for preparing different types of materials for releasing bacterial components, which is helpful for developing disease models for elucidating cellular senescence and bone regeneration.