ObjectiveTo systematically review the research issues related to evidence quality grading methods for public health decision making. MethodsPubMed, Web of Science, CNKI, WanFang Data, CBM and VIP databases were electronically searched to collect studies related to the application of evidence quality grading methods for public health decision making from inception to December 2022. The questions were constructed according to the SPIDER model. The quality of the included literature was evaluated by using the CASP checklist, and a three-level interpretation analysis of the questions on the application of quality rating methods for public health decision making was conducted using the thematic synthesis method to establish a pool of question entries. ResultsA total of 14 papers were included, covering seven countries. GRADE was the commonly used method for grading the quality of evidence. CASP evaluation results showed eight high quality studies, four medium quality studies and two low quality studies. The thematic synthesis method summarized 13 question entries in 7 categories. ConclusionThe existing methodology for grading the quality of evidence for public health decision making suffers from the diversity of evidence sources and the underestimation of the level of evidence from complex intervention studies.
In 2014, the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) working group published guidance in BMJ to evaluate the certainty of the evidence (confidence in evidence, quality of evidence) from network meta-analysis. GRADE working group suggested rating the certainty of direct evidence, indirect evidence, and network evidence, respectively. Recently, GRADE working group has published a series of papers to improve and supplement this approach. This paper introduces the frontiers and advancement of GRADE approach to rate the certainty of evidence from network meta-analysis.
Objective To evaluate the relevant systematic reviews/meta-analyses that focused on the prevention and treatment of complications after impacted tooth extraction. Methods The systematic reviews/meta-analyses on the prevention and treatment of complications after impacted tooth extraction were searched in PubMed, The Cochrane Library, CBM, CNKI and WanFang Data from inception to September 30th, 2012, and a total of 15 professional journals and the references of included studies were also retrieved manually. Two reviewers screened the literature according to the inclusion criteria and extracted the data. Then the AMSTAR was used to evaluate the quality of the included studies, and the GRADE system was used to evaluate the quality of evidence. Results A total of twelve relevant systematic reviews/meta-analyses were included, of which five focused on the prevention and treatment of dry socket, six on the prevention of swelling, seven on the prevention and treatment of pain, six on the prevention of limitation of mouth opening, two on the prevention of infection, three on the prevention of bleeding, and one on the treatment of nerve damage after tooth extraction. Based on AMSTAR, seven studies were minor limitations and five studies were moderate limitations. Based on GRADE system, two was high quality of evidence, twelve were moderate, nine were low, and seven were very low. Conclusion Currently, the systematic reviews/meta-analyses on the prevention and treatment of complications after impacted tooth extraction can provide some references for clinical practice, which should be combined with the real condition by clinical doctors when making an evidence-based decision. However, it also suggests performing more high quality and large sample studies to prove this conclusion.
ObjectiveTo provide an overview of systematic reviews on the efficacy and safety of massage for the treatment of cervical spondylotic radiculopathy.MethodsCNKI, WanFang Data, VIP, CBM, PubMed, The Cochrane Library and EMbase databases were electronically searched to collect the systematic reviews on the efficacy and safety of massage for the treatment of cervical spondylotic radiculopathy from inception to December 30th, 2018. Two reviewers independently screened the literature and extracted the data, applied the AMSTAR2 scale to evaluate its methodological quality, and GRADE to evaluate the quality of the evidence.ResultsA total of 7 systematic reviews/meta-analysis were included. The AMSTAR2 scale evaluation showed that the quality of the included studies was extremely low. The GRADE evidence grading results showed that the quality of the VAS score outcome index of the two literatures was intermediate, and the quality of the OASCSR outcome index of one literature was intermediate. The quality of the remaining outcome indicators reported is low or very low.ConclusionThe available evidence shows that the efficacy and safety of manual treatment of cervical spondylotic radiculopathy is acceptable, but the overall methodological quality of the systematic review is extremely low, and the quality level of evidence is generally low. The future clinical trials and systematic reviews should be strictly followed. The scientific research design of the medical science provides high-quality evidence and provides reference for clinical practice.
Objective To explore the methodological characteristics of Chinese clinical practice guidelines/expert consensus based on usage of GRADE. MethodsCNKI, PubMed, WanFang Data databases, and Medlive.cn were electronically searched to collect Chinese clinical practice guidelines/expert consensus over the past 11 years from January 1st 2010 to December 31st 2020. Four reviewers independently extracted data according to the content of appraisal of guidelines quality evaluation tool AGREE Ⅱ. The clinical practice guidelines/expert consensus were divided into two groups based on whether GRADE was used or not. The changes and development of methodological quality in the past 11 years were explored between the two groups. ResultsIn recent years, the number of clinical practice guidelines/expert consensus which used the GRADE in China had increased annually. The practice guidelines/expert consensus which did not use GRADE had lower methodology quality (P<0.01). ConclusionsThe use of GRADE in clinical practice guidelines/expert consensus requires improvement, and mastering GRADE methodology can effectively improve the methodological quality of the clinical practice guidelines/expert consensus.
The approaches of rating the quality of evidence of systematic reviews of diagnostic accuracy tests are different from systematic reviews of interventional studies. This article systematically introduces the application of GRADE in systematic reviews of diagnostic accuracy tests by a case interpretation and analysis. In this article we present rating workflow in systematic reviews of diagnostic accuracy tests and introduce how to use the GDT website to display the rating results, and interpret the conclusion of systematic reviews based on GRADE results.
The focus of health equity is to enable the public to have fair access to health services and achieve satisfactory health outcomes. With research developments, guideline developers increasingly pay more attention to the fairness in the practice guidelines and have carried out exploration and practice in the relevant guidelines. The GRADE working group has begun to investigate how to use GRADE to assess health equity in practice guidelines since 2014. In 2017, the series of methodological guidelines of health equity in guideline development was officially published. It proposed 5 approaches to evaluate health equity and pointed out current methodological challenges of applying GRADE to assess health equity. This paper aims to introduce the GRADE equity guidelines, so as to provide a reference for Chinese researchers in their practice.
Objective To evaluate the effectiveness and safety of Endostar combined with chemotherapy for non-small cell lung cancer (NSCLC). Methods Randomized controlled trials (RCTs) on Endostar combined with chemotherapy for NSCLC were searched in The Cochrane Library, MEDLINE, EMbase, VIP, CNKI, CBMdisc and other electronic databases. The quality of RCTs meeting inclusion criteria was evaluated and the data were extracted; meta-analyses were performed with RevMan 5.1 software, and then the GRADE System was used to rate the level of evidence and strength of recommendation. Results Among the 18 RCTs involving 1 825 cases included, 1 816 cases met the inclusion criteria. Meta-analyses showed that: compared with the single chemotherapy, Endostar combined with chemotherapy could increase the total effective rate (RR=1.85, 95%CI 1.56 to 2.11, Plt;0.000 01), and the clinical benefit response (RR=1.21, 95%CI 1.14 to 1.29, Plt;0.000 01), but decrease the incidence risk of leukopenia (RR=0.89, 95%CI 0.82 to 0.97, P=0.006). There were no signficant differences between the two groups in decreasing thrombocytopenia (RR=0.87, 95%CI 0.74 to 1.03, P=0.10), impaired renal function (RR=0.96, 95%CI 0.69 to 1.34, P=0.82), nausea and vomiting (RR=0.92, 95%CI 0.84 to 1.01, P=0.08) and other side effects. Based on GRADE, the level of evidence was Grade C, and the strength of recommendation was 2. Conclusion The present results of clinical trials show that Endostar combined with chemotherapy for NSCLC is a safe and effective therapy without increasing the toxic reaction and side effects; and based on GRADE, the level of evidence was Grade 2C, and the strength of recommendation was 2. However, in view of the limitations of this study, it is suggested that large-scale, high-quality researches on basic and clinical fields should be performed to further verify the above conclusion by critical outcome indicators.
ObjectivesTo overview the systematic reviews of traditional Chinese herb injections for viral pneumonia.MethodsCNKI, CBM, WanFang Data, VIP, PubMed, Web of Science, The Cochrane Library and EMbase databases were electronically searched to collect systematic reviews (SRs) of traditional Chinese herb injections for viral pneumonia from inception to March 2020. Two reviewers independently screened literature and extracted data. Then, AMSTAR 2 was used to assess the methodological quality and GRADE was used to grade the outcome indicators of included SRs.ResultsA total of 10 SRs were included, containing six Chinese herb injections (Xiyanping injection, Yanhuning injection, Tanreqing injection, Reduning injection, Shuanghuanglian injection, and Chuanhuning injection). Five items of AMSTAR 2 were reported well, and two items were not reported in any of the included SRs, and the quality was unsatisfactory. The efficacy of Chinese herb injection was superior than that of western medicine in many outcome indicators, such as antipyretic time, the pulmonary rales disappearing time, and the total clinical efficiency. The quality of evidence ranged from medium to very low.ConclusionsCurrent evidence shows that the quality of SRs of Chinese herb injections for viral pneumonia requires improvement, and most of the results show that Chinese herb injections are more effective than western medicines.
ObjectivesTo evaluate the methodological bias and the reliability of the conclusions of systematic reviews (SRs) on the treatment for acute gout.MethodsPubMed, EMbase, The Cochrane Library, Epistemonikos, CBM, WanFang Data and CNKI databases were electronically searched to collect published systematic reviews and meta-analyses evaluating drug interventions therapy in acute gout from inception to April 8th 2017. Two reviewers independently screened literature, extracted data, assessed the methodological quality of included SRs by the AMSTAR tool, and assessed the quality of the body of evidence for each outcome by the GRADE approach.ResultsA total of seven relevant SRs were included, which contains three main outcome measures. Four SRs contained non-steroidal anti-inflammatory drugs (NSAIDS), three SRs contained colchicine and two SRs contained glucocorticoids. All SRs assessed risk of bias of included original studies. Two used the Jadad scale or modified Jadad scale in this assessment while others used the " assessing risk of bias” tool recommended by Cochrane Collaboration. The assessment results of AMSTAR tool suggested that: three SRs were considered high quality (scores≥9), and the other four were considered moderate quality. GRADE results showed: the quality of the evidence of 11 outcomes was low or very low, and five outcomes was moderate.ConclusionsThe current evidence confirms the effectiveness and safety of several drug interventions in the treatment of acute gout, however, the priority of these drugs is still unclear. We suggest conducting new SRs and updating relevant SRs, to systematically compare different drug interventions therapy in acute gout with the latest evidence. In addition, we still expect to put more efforts in conducting high-quality original studies, in order to fill the gap of relevant fields and improve the level of evidence quality.