Real-world evidence represents critical evidence to support post-marketing drug monitoring, assessment and policy decisions, and has received extensive attentions. However, an explicit over-arching design and conceptual framework for this specific area is lacking. Divergent opinions on the production of real world evidence are often present among researchers; and understanding about their implications also differ among policy makers and evidence users. In this article, we have proposed, from the regulatory and clinical perspectives, a conceptual framework on the use of real world data for post-marketing drug studies, assessment and policy decisions.
In recent years, real-world evidence data (RWD) and real-world evidence (RWE) have gained substantial attentions from healthcare practitioners and health authorities worldwide. In particular, the needs from regulatory bodies have promoted the production and use of real-world evidence. In the context of drug and device evaluation and regulation decisions, the pattern for using real world evidence may differ. This article aimed to discuss the potential uses of RWE for pre-approval clinical evaluation, post-approval monitoring and evaluation, and associated regulatory decisions, which may ultimately improve the production and use of RWE for regulatory decisions.
Real-world data studies have experienced rapid development in recent years, however, misunderstandings persist. This paper aims to improve practice and promote standardization by updating the categorization of real-world data, proposing two conceptual frameworks for conducting real-world data studies, developing the concepts of research data infrastructure and clarifying the misconceptions on registry database, and discussing future development.
Given the growing importance of real-world data (RWD) in drug development, efficacy evaluation, and regulatory decision-making, establishing a scientific and systematic data quality regulatory framework has become a strategic priority for global pharmaceutical regulatory authorities. This paper analyzed the European Union's (EU's) advanced practices in RWD quality regulation, compared the RWD quality regulatory systems of China and the EU, and aimed to derive implications for enhancing China's own framework. The EU has made significant progress by promoting the interconnection, intercommunication, and efficient utilization of data resources, implementing a collaborative responsibility mechanism spanning the entire data lifecycle, developing a standardized, tool-based quality assessment system, and facilitating international cooperation and alignment of rules. While China has established an initial regulatory system for RWD quality, it still confronts challenges such as unclear mechanisms for data acquisition and utilization, underdeveloped operational standards, and unclear responsibility delineation. In contrast, by adapting relevant EU experience, China can refine its regulatory framework, establish mechanisms for the interconnection, intercommunication, and efficient utilization of RWD, develop more practical quality assessment toolkits, improve the lifecycle responsibility-sharing mechanism, and promote the alignment of RWD quality regulation with international standards. These enhancements will advance the standardization and refinement of RWD quality regulation in China, ultimately strengthening the scientific rigor and reliability of regulatory decisions.
Traditional randomized controlled trial and real-world study have different advantages in internal validity and external extensibility, respectively. With the development of evidence-based health decisions, randomized controlled trial was no longer the only golden standard of interventional study, the research evidence of the real world was gradually involved in health decisions. This study mainly analyzed the requirements of evidence and actual application of evidence in the evaluation of the effectiveness of NICE in the UK. It was found that NICE still used the results of randomized controlled trials as a primary basis. Although real-world research has developed rapidly in recent years, it was limited used in health decision because of its bias by design and other factors. However, in recent years, real-world evidence has played a significant role in the field of innovative drugs or diseases that lack therapeutic drugs. With the improvement of real-world research in experimental design and data analysis, it is expected that it will play a more important role in health decision-making.
ObjectiveTo compare and analyze the application of anti-vascular endothelial growth factor (VEGF) drugs for intravitreal injection in the real world before and after the establishment of one-stop intravitreal injection center, as well as the advantages and disadvantages of different management modes. MethodsA retrospective clinical study. A total of 4 015 patients (4 659 eyes) who received anti-VEGF drugs for ocular fundus diseases at the Tianjin Medical University Eye Hospital from July, 2018 to June, 2022 were included in the study. There were 2 146 males and 1 869 females. The ocular fundus diseases in this study were as follows: 1 090 eyes of 968 patients with wet age-related macular degeneration (wAMD); 855 eyes of 654 patients with diabetic macular edema (DME); 1 158 eyes of 980 patients with diabetic retinopathy (DR); 930 eyes of 916 patients with macular edema secondary to retinal vein occlusion (RVO-ME). A total of 294 eyes of 275 patients with choroidal neovascularization secondary to pathological myopia (PM-CNV); 332 eyes of 222 patients with other fundus diseases. A total of 13 796 anti-VEGF needles were injected. A total of 1 252 patients (1 403 eyes) from July 2018 to June 2020 were regarded as the control group. From July 2020 to June 2022, 2 763 patients (3 256 eyes) who received anti-VEGF treatment in the intravitreal injection center were regarded as the observation group. The total number of intravitreal injection needles, the distribution of anti-VEGF therapy in each disease according to disease classification, the proportion of patients who chose the 3+ on-demand treatment (PRN) regimen and the distribution of clinical application of different anti-VEGF drugs were compared between the control group and the observation group. The waiting time and medical experience of patients were investigated by questionnaire. χ2 test was used to compare the count data between the two groups, and t test was used to compare the measurement data. ResultsAmong the 13 796 anti-VEGF injections in 4 659 eyes, the total number of anti-VEGF drugs used in the control and observation groups were 4 762 and 9 034, respectively, with an average of (3.39±3.78) and (2.78±2.27) injections per eye (t=6.900, P<0.001), respectively. In the control and observation groups, a total of 1 728 and 2 705 injections of anti-VEGF drugs were used for wAMD with an average of (5.14±4.56) and (3.59±2.45) injections per eye, respectively; a total of 982 and 2 038 injections of anti-VEGF drugs were used for DME with an average of (4.36±4.91) and (3.24±2.77) needles per eye, respectively. Additionally, a total of 942 and 2 179 injections of anti-VEGF drugs were injected for RVO-ME with an average of (3.98±3.71) and (3.14±2.15) injections per eye, respectively; a total of 291 and 615 injections of anti-VEGF drugs were injected for PM-CNV with an average of (3.31±2.63) and (2.99±1.69) injections per eye, respectively. A total of 683 and 1 029 injections of anti-VEGF drugs were injected for DR with an average of (1.60±1.26) and (1.41±1.05) injections per eye, respectively. The clinical application and implementation of "3+PRN" treatment were as follows: 223 (66.4%, 223/336) and 431 eyes (57.2%, 431/754) in the wAMD (χ2=8.210, P=0.004), 75 (33.3%, 75/225) and 236 (37.5%, 236/630) eyes in the DME (χ2=1.220, P>0.05), and 97 (40.9%, 97/237) and 355 eyes (51.2%, 355/693) in the RVO-ME (χ2=7.498, P=0.006), 39 (44.3%, 39/88) and 111 eyes (53.9%, 111/206) in the PM-CNV ( χ2=2.258, P>0.05), respectively. In addition, the results of the questionnaire survey showed that there were significant differences between the control and observation groups regarding the time of appointment waiting for surgery (t=1.340), time from admission to entering the operating room on the day of injection (t=2.780), time from completing preoperative treatment preparation to waiting for entering the operating room (t=8.390), and time from admission to discharge (t=6.060) (P<0.05). ConclusionsThe establishment of a one-stop intravitreal injection mode greatly improved work efficiency and increased the number of injections. At the same time, the compliance, waiting time, and overall medical experience of patients significantly improved under centralized management.
Retrospective chart review (RCR) is a type of research that answers specific research questions based on the existing patient medical records or related databases through a series of research processes including data extraction, data collation, statistical analysis, etc. Relying on the development of medical big data, as well as the relatively simple implementation process and low cost of information acquisition, RCR is increasingly used in the medical research field. In this paper, we conducted the visual analysis of high-quality RCR published in the past five years, and explored and summarized the current research status and hotspots by analyzing the characteristics of the number of publications, national/regional and institutional cooperation networks, author cooperation networks, keyword co-occurrence and clustering networks. We further systematically combed the methodological core of this kind of research from eight aspects: research question and hypothesis, applicability of chart, study design, data collecting, statistical analysis, interpretation of results, and reporting specification. By summarizing the shortcomings, unique advantages and application prospects of RCR, providing guidance and suggestions for the standardized application of RCR in the medical research field in the future.
Real-world data is been increasingly valued nowadays. This paper combined with related requirements of clinical evaluation of medical devices in China, studied the role of real-world evidence in pre-marketing clinical evaluation of medical devices in terms of technical evaluation, in aim of providing reference for the future application of China's real-world evidence in pre-marketing clinical evaluation.
The formation, evaluation and grade division of real-world evidence (RWE) are bottlenecks restricting the in-depth development and scientific application of real-world study methods. This paper briefly reviewed the design grade and evidence grade of clinical medical research, and proposed the key points of evidence grade of real-world clinical research, including emphasizing the comprehensive evaluation of internal authenticity and external authenticity, determining the "starting point" of real-world evidence, and using the real-world evidence quality evaluation method. Based on the internationally recognized "grading of recommendations assessment, development, and evaluation (GRADE)", combined with the classification and characteristics of real-world evidence, a preliminary grading scheme was formed. An example was given to illustrate the grading suggestion.
ObjectiveTo evaluate changes in operational effectiveness after the implementation of ambulatory surgical management in pars plana vitrectomy (PPV). MethodsA retrospective clinical study. 17 528 surgeries in 10 895 eyes of 10 895 patients who underwent minimally invasive PPV on an ambulatory and/or inpatient basis at Tianjin Medical University Eye Hospital from August 2015 to June 2023 were included in this study. Among them, 5 346 eyes in 5 346 cases were male; 5 549 eyes in 5 549 cases were female. The age ranged from 0 to 95 years, with the mean age of (57.74±13.15) years. 6 381 surgeries in 3 615 eyes from August 2015 to December 2018 (the initial period of day surgery) were used as the control group; 11 147 surgeries in 7 280 eyes from January 2019 to June 2023 (the expanded period of day surgery) were used as the observation group. According to the management mode of ambulatory surgery, the observation group was subdivided into the decentralized management group (January 2019 to December 2020) and the centralized management group (January 2021 to June 2023), with 2 905 and 4 375 eyes and 4 646 and 6 501 surgeries, respectively. Changes in the percentage of day surgery, average hospitalization days, and average unplanned reoperation rate were compared. The Mann-Whitney U test was used to compare numerical variables between groups; the chi-square test or Fisher's exact test was used to compare categorical variables. ResultsThe number of cases of daytime PPV performed in the observation group and control group was 7 852 (70.44%, 7 852/11 147) and 24 (0.38%, 24/6 381) cases, respectively, and the average hospitalization days were 1 (1) and 5 (3) d. Compared with the control group, the observation group had a significantly higher percentage of day surgery (χ2=8 051.01) and a considerably lower mean hospitalization day (Z=4 536 844.50), and the differences were statistically significant (P<0.000 1). The mean hospitalization days in the decentralized and centralized management groups were 2 (3) and 1 (0) d, respectively, and unplanned reoperations were 34 (0.73%, 34/4 646) and 171 (2.63%, 171/6 501) eyes, respectively. Compared with the decentralized management group, average hospitalization days was significantly lower (Z=1 436.94) and unplanned reoperation rate was significantly higher (χ2=54.10) were significantly lower in the centralized management group, both of which were statistically significant (P<0.000 1). ConclusionPPV ambulatory management model can significantly reduce the average hospitalization day, but also results in higher rates of unplanned reoperations.