ObjectiveWe constructed a real-world evidence evaluation system to provide reference for obtaining high-quality evidence in evidence-based medicine.MethodsThrough the investigation and analysis of the key factors influencing the real-world research evidence, combined with domestic and foreign literature and evaluation tools, we preliminarily constructed the indicators of the real-world evidence evaluation system, then consulted experts in related fields by the Delphi method, modified and determined the final evaluation indicators. ResultsThe indicators of the final real-world evidence evaluation system included 40 items. The recovery efficiencies of the two rounds of expert consultation were 88.2% and 100%; The expert coordination coefficients were 0.174 (P<0.001) and 0.189 (P<0.001). After the second round of consultation, the mean of Likert scale in the range of 3.73~4.93, and the coefficient of variation varied in the range of 0.05~0.21. ConclusionThe real-world evidence evaluation system constructed in this study has certain reliability and scientificity, which can provide a basis and help for the transformation of real-world research into high-quality evidence.