Objective Sedation and/or analgesia is often applied during noninvasive positive pressure ventilation (NIPPV) to make patients comfortable, and thus improve the synchronization between patients and ventilator. Nevertheless, the effect of sedation and/or analgesia on the clinical outcome of the patients with acute exacerbation of chronic obstructive pulmonary disease (AECOPD) after extubation remains controversial. Methods A retrospective study was conducted on patients with AECOPD who received NIPPV after extubation in seven intensive care units in West China Hospital, Sichuan University between December 2013 and December 2017 . A logistic regression model was used to analyze the association between the use of sedation and/or analgesia and clinical outcomes including rate of NIPPV failure (defined as the need for reintubation and mechanical ventilation), hospital mortality, and length of intensive care unit stay after extubation. Results A total of 193 patients were included in the analysis, and 62 cases of these patients received sedation and/or analgesia during NIPPV. The usage of sedation and/or analgesia could result in failure of NIPPV (adjusted odd ratio [OR] 0.10, 95% confidence interval [CI] 0.02 - 0.52, P=0.006) and death (adjusted OR=0.13, 95%CI 0.04 - 0.42, P=0.001). Additionally, intensive care unit stay after extubation was longer in the patients who did not receive sedation and/or analgesia than those who did (11.02 d vs. 6.10 d, P< 0.01). Conclusion The usage of sedation and/or analgesia during NIPPV can decrease both the rate of NIPPV failure and hospital mortality in AECOPD patients after extubation.