Objective To develop an evaluation tool for the screening of high risk population for oral complications in critically ill patients, which can be performed accurately and scientifically. Methods Basing on the related foreign oral assessment scale, combined with the method of brainstorming, expert consultation, method of clinical status and so on, the item pool of the assessment scale was determined. Five nursing experts and two oral experts assessed the content validity and 50 ICU nurses were tested. Then, the screening accuracy of the assessment scale was proved by application in 100 critically ill patients selected randomly. Results The Cronbach’s a coefficient of final version of the High Risk Assessment Scale for Oral Complications in Critically Ill Patients (including seven parts contents of oral health assessment and oral pH value test) was 0.815, the content validity index (Sr-CVI/Ave) was 0.932. The results of 50 nurses to the 91.2% assessment items of the assessment scale were very important and important. For screening related indicators of oral complications in high-risk patients, the sensitivity of the assessment scale was 97.53%, the specificity was 94.11%, the positive predictive value was 98.75%, the negative predictive value was 88.89%, and the crude agreement was 95%. Conclusion There are good reliability, validity and a high accuracy of screening test in the High Risk Assessment Scale for Oral Complications in Critically Ill Patients. It can be used for screening patients at high risk for oral complications in critically ill patients, and help clinical nurses to complete the oral health status of the critically ill patients quickly.
ObjectivesTo evaluate the reliability and validity on quality criteria for clinical nursing practice guidelines.MethodsFive appraisers were included to assess two clinical nursing practice guidelines using the quality criteria for clinical nursing practice guidelines and AGREE Ⅱ. ICC and coefficient of consistency were adopted to assess the reliability and validity of the appraisal tools.ResultsICC for two guidelines of AIDS and infusion by the quality criteria for clinical nursing practice guidelines were 0.979 and 0.890. ICC for two guidelines of AIDS and infusion by AGREE Ⅱ were 0.957 and 0.887. The coefficient of consistency for guidelines of AIDS and infusion by the two appraisal tools were 0.880 and 0.886, both were highly consistent.ConclusionsThe quality criteria for clinical nursing practice guidelines has good reliability and validity and can be used as appraisal tool for quality evaluation of clinical nursing practice guidelines. It is strongly recommended that the users should understand the appraisal tool or should be trained to decrease the bias.
ObjectiveTo compare and evaluate the discrimination, validity, and reliability of different data envelopment analysis (DEA) models for measuring the effectiveness of models by selecting different input and output indicators of the model.MethodsData from health statistical reports and pilot program of diagnosis-related groups of tertiary hospitals in Hubei Province from 2017 to 2018 were used to analyze the discrimination, content and structure validity, and reliability of the models. Six DEA models were established by enriching the details of input and output on the basis of the input and output indicators of the conventional DEA model of hospitals.ResultsFrom the view of discrimination, the results of all models were left-skewed, the cost-efficiency model had the lowest left-skewed degree (skewness coefficient: -0.14) and was the flattest (kurtosis coefficient: -1.02). From the view of structure validity, the results of the cost-efficiency model were positively correlated with total weights, outpatient visits, and inpatient visits (r=0.328, 0.329, 0.315; P<0.05). From the perspective of content validity, the interpretation of model was more consistent with theory of production after revision of input and output indicators. From the view of reliability, the cost efficiency model had the largest correlation coefficient between the data of 2017 and 2018 (r=0.880, P<0.05).ConclusionsAfter refining the input and output indicators of the DEA model, the discrimination, validity, and reliability of the model are higher, and the results are more reasonable. Using indicators such as discrimination, validity, and reliability can measure the effectiveness of the DEA model, and then optimize the model by selecting different input and output indicators.
Objective To evaluate the reliability and validity of IBS-QOL scale in irritable bowel syndrome (IBS) patients. Methods IBS-QOL scale was applied to survey the quality of life of 123 IBS patients. The split-half and internal consistency method were used to evaluate the reliability, and with the construct method to evaluate the validity. Results The split-half reliability was 0.86. Cronbach’s α-coefficient of all domains was between 0.71 and 0.89 except body image and food avoidance; In the correlation analysis, the correlations between items and its subscale structure were above 0.60 (except interference with activity), but there were no correlations between items and other subscale structure. Eight components from factorial analysis were in accordance with theoretical structure.The cumulative contribution rate was 72.7%. Conclusions The reliability and validity of IBS-QOL scale are acceptable. It might be useful for us to assess the QOL of IBS patients in China.
【摘要】 目的 評價SF-36量表在測量地震傷殘人員生存質量中的信度和效度。 方法 利用自填法及訪談相結合的方式調查201例綿竹市某鎮地震傷殘人員，用重測信度和Cronbach’s α系數分析SF-36信度；因子分析方法分析效度。 結果 SF-36各領域的重測信度分別為:生理功能（PF）0.78、生理問題對功能的限制（RP）0.85、軀體疼痛（BP）0.92、健康總體評價（GH）0.82、活力（VT）0.77、社會功能（SF）0.71、心理問題對功能的限制（RE）0.79、精神健康（MH）0.66；各領域的Cronbach’s α系數分別為:PF 0.89、RP 0.75、BP 0.84、GH 0.86、VT 0.78、SF 0.72、RE0.86、MH 0.50。因子分析共提取了6個主成分，基本反映了量表的8個維度，與量表的結構構思基本相符。 結論 自填法及面對面訪談相結合的方式，將SF-36量表用于該地地震傷殘人員生存質量測定具有較好的信度和效度。【Abstract】 Objective To evaluate the validity and reliability of the MOS-36-item Short Form of Health Survey (SF-36) measuring the quality of life (QOL) of disabled people injured in the earthquake. Methods A total of 201 disabled people injured in the earthquake in a town of Mianzhu city were investigated via questionnaire combined with a face-to-face interview. The reliability of the SF-36 was assessed by test-retest reliability and Cronbach’s α coefficient. The validity was assessed through factor analysis. Results The test-retest reliability of the SF-36 included: physical functioning (PF) 0.78, role limitation due to physical problems (RP) 0.85, body pain (BP) 0.92, general health (GH) 0.82, vitality (VT) 0.77, social functioning (SF) 0.71, role limitation due to emotional problems (RE) 0.79, and mental health (MH) 0.66. The Cronbach’s α coefficients were as the follows: PF 0.89, RP 0.75, BP 0.84, GH 0.86, VT 0.78, SF 0.72, RE 0.86, and MH 0.50. Six principal components were extracted by factor analysis and the constructs of the obtained instrument were consistent with the conceived concept in essence. Conclusion The SF-36 survey could measure the QOL in disabled people injured in the earthquake with better reliability and validity by questionnaire combined with a face-to-face interview.
Objective To develop a behavioral assessment scale for medication management plans in women of childbearing age with epilepsy and to test its reliability and validity. Methods Based on the Theory of Planned Behavior, a pool of questionnaire items was initially drafted through literature review and focus group discussions. A two-round Delphi expert consultation was conducted with 15 experts to form a test version of the behavioral assessment scale for medication management plans in women of childbearing age with epilepsy (including 27 items and 5 dimensions). Convenience sampling was used to conduct surveys among women of childbearing age with epilepsy in some tertiary hospitals in Chuxiong, Shenzhen and Wuhan from February to May 2024 (the first time) and from June to October 2024 (the second time). ResultsThe effective recovery rates of the two rounds of questionnaires were 95.5% and 94.6%, respectively. The final scale included 24 items and 5 dimensions, with good reliability and validity: the content validity index (S-CVI) was 0.934, Cronbach's α coefficient was 0.876, split-half reliability was 0.819, and test-retest reliability was 0.901; exploratory factor analysis extracted 5 factors (cumulative variance explained rate 73.97%, item load 0.42~0.85), and confirmatory factor analysis showed that the model had good fit (χ2/df=1.849, RMSEA=0.075, CFI, GFI, AGFI, IFI, TLI all>0.85). Conclusion The scale meets the reliability and validity standards and can be used to assess the medication management plans and behaviors of women of childbearing age with epilepsy.
ObjectiveTo evaluate the reliability and validity of Guideline Implementation Success Assessment Tool (A-GIST). MethodsWith the guideline for the prevention and treatment of type 2 diabetes mellitus in China (2020 edition) as the target guideline, health care providers and patients from different hospitals across the country were investigated by questionnaire using A-GIST. Spearman-Brown coefficient and Cronbach's α coefficient were used to evaluate the split-half reliability and internal consistency reliability, while the structural validity, convergent validity and discriminant validity were investigated by confirmatory factor analysis based on structural equation. ResultsThe internal consistency reliability and split half reliability coefficients of the whole tool and each dimension ranged from 0.650 to 0.986. The scale-level content validity index (S-CVI/Ave) of content validity was 0.846. Confirmatory factor analysis showed that, the χ2/df of two sections of the tool were 8.695 and 6.123, respectively. The root mean square residual (RMR), the standard root mean square residual (SRMR) and the root mean square error of approximation (RMSEA) were under or almost under the threshold. Besides, the goodness-of-fit index (GFI) of them were 0.901 and 0.822, the adjusted goodness-of-fit index (AGFI) were 0.836 and 0.787, and the parsimonious normed fit index (PNFI) were 0.545 and 0.788, respectively. ConclusionGuideline Implementation Success Assessment Tool (A-GIST) was proved to be valid and reliable, and it shows that it is necessary to optimize the items under the dimensions of maintenance and evaluation of diagnosis and treatment effect in the future.
Objective To evaluate the reliability and validity of the three-dimensional motion capture analysis system COFT-Motion? in evaluating the active range of motion of upper limbs in healthy subjects, and provide objective basis for its clinical application. Methods From January to March 2022, healthy subjects were publicly recruited for enrollment. The evaluator applied the three-dimensional motion capture analysis system COFT-Motion? and angle ruler to evaluate the active range of motion of the shoulder joint (flexion, extension, adduction, abduction) and elbow joint (flexion, extension) in healthy subjects. Pearson correlation analysis was used to evaluate validity, and intraclass correlation coefficient (ICC) was used to evaluate reliability. Results There was a positive correlation between the measurements of COFT-Motion? and the angle ruler of the active range of motion of upper limbs in healthy subjects. The Pearson correlation coefficients for active range of motion of the shoulder joint (flexion, extension, adduction, abduction) and elbow joint (flexion, extension) were 0.913, 0.964, 0.961, 0.941, 0.864, and 0.919, respectively (P<0.05). The results of using COFT-Motion? by different evaluators to evaluate the active range of motion of healthy subjects’ shoulder joints (flexion, extension, adduction, abduction) and elbow joints (flexion, extension) showed that the ICC values were 0.892, 0.942, 0.961, 0.988, 0.989, and 0.928, respectively (P<0.05). The results of repeated evaluations by the same evaluator showed that the ICC values were 0.795, 0.916, 0.900, 0.868, 0.918, and 0.911, respectively (P<0.05). Conclusion The application of the three-dimensional motion capture analysis system COFT-Motion? in healthy subjects has good validity and reliability. However, due to the limited sample size and subject of the study, further promotion and application of the system still need to be further explored.