Objective To explore the colonization of Klebsiella pneumoniae in the intensive care unit of our hospital and analyze the risk factors. Methods A total of 226 patients were actively screened in the surgical intensive care unit and neurosurgery intensive care unit from June to December 2020 in the hospital, and their clinical data were retrospectively analyzed. Results Totally, 87 strains of Klebsiella pneumoniae were screened out, 69 strains were carbapenem-resistant Klebsiella pneumoniae (CRKP), and the resistant genotype was mainly KPC genotype (79.6%). The resistance rates of meropenem were 75.0% and 77.4%, respectively. Age and pulmonary infection before admission are risk factors for CRKP colonization, while pulmonary infection before admission is an independent risk factor for CRKP colonization. Conclusions Both the CRKP colonization rate of patients and the rate of resistance to carbapenem antimicrobials are relatively high in the intensive care unit of our hospital. Pulmonary infection before admission is an independent risk factor for CRKP colonization.