Research of generating real-world evidence using real world data has attracted considerable attention globally. Outcome research of treatment based on existing health and medical data or registries has become one of the most important topics. However, there exists certain confusions in this line of research on how to design and implement appropriate statistical analysis. Therefore, in the fourth chapter of the series technical guidance to develop real world evidence by China REal world data and studies Alliance (ChinaREAL), we aim to provide an guidance on statistical analysis in the study to assess therapeutic outcomes based on existing health and medical data or registries.In this chapter, we first emphasize the significance of pre-specified statistical analysis plan, recommending key components of the statistical analysis plan. We then summarize the issue of sample size calculation in this content and clarify the interpretation of statistical p-value. Secondly, we recommend procedures to be considered to tackle the issue related to the selection bias, information bias and most importantly, confounding bias. We discuss the multivariable regression analysis as well as the popular causal inference models. We also suggest that careful consideration should be made to deal with missing data in real-world databases. Finally, we list core content of the statistical report.
In 2019, the national government issued the document "Implementation Plan for Supporting the Construction of the Boao Lecheng International Medical Tourism Pilot Area", which allowed the use of innovative drugs and medical devices in medical institution of Boao Lecheng. These medical products had been designed to meet urgent clinical requirements and had been approved by regulatory authorities overseas. Through the use of these medical products, real-world data were generated in the routine clinical practice, based on which real-world evidence might be produced for regulatory decision-making by using scientific and rigorous methods. In March 2020, the first medical device product using domestic real-world data was approved, suggesting that the real-world data initiative in Boao Lecheng achieved initial success. This work also provided important experience for promoting the practice of medical device regulatory decision-making based on real-world evidence in China. Here, we shared the preliminary experiences from the study on the first approved medical device product and discussed the issues on developing a real-world data research framework in Boao Lecheng in attempt to offer insights for future studies.
To enhance the quality and transparency of oncology real-world evidence studies, the European Society for Medical Oncology (ESMO) has developed the first specific reporting guidelines for oncology RWE studies in peer-reviewed journals "the ESMO Guidance for Reporting Oncology Real-World Evidence (GROW)". To facilitate readers understanding and application of these reporting standards, this article introduces and interprets the development process and main contents of the ESMO-GROW checklist.
Retrospective chart review (RCR) is a type of research that answers specific research questions based on the existing patient medical records or related databases through a series of research processes including data extraction, data collation, statistical analysis, etc. Relying on the development of medical big data, as well as the relatively simple implementation process and low cost of information acquisition, RCR is increasingly used in the medical research field. In this paper, we conducted the visual analysis of high-quality RCR published in the past five years, and explored and summarized the current research status and hotspots by analyzing the characteristics of the number of publications, national/regional and institutional cooperation networks, author cooperation networks, keyword co-occurrence and clustering networks. We further systematically combed the methodological core of this kind of research from eight aspects: research question and hypothesis, applicability of chart, study design, data collecting, statistical analysis, interpretation of results, and reporting specification. By summarizing the shortcomings, unique advantages and application prospects of RCR, providing guidance and suggestions for the standardized application of RCR in the medical research field in the future.
Real-world data (RWD) in clinical research on specific categories of medical devices can generate sufficient quality evidence which will be used in decision making. This paper discusses the limitations of traditional randomized controlled trials in clinical research of medical devices, summarizes and analyses the applicable conditions of real-world evidence (RWE) for medical devices, interprets the new FDA guidance document on the characteristics of RWD for medical devices, in order to provide evidence for the use of RWE in medical devices in our country.
Real-world data studies have experienced rapid development in recent years, however, misunderstandings persist. This paper aims to improve practice and promote standardization by updating the categorization of real-world data, proposing two conceptual frameworks for conducting real-world data studies, developing the concepts of research data infrastructure and clarifying the misconceptions on registry database, and discussing future development.
The application of economic tools to evaluate the cost and health benefits and screen out more cost-effective drugs and technologies is an important measure to improve efficiency of medical resource allocation in China. Given the inherent differences between strict clinical trials and clinical routine practice, using trial-based economic evaluations to guide relevant medical decisions may lead to a certain risk of value deviation. Recent development of real-world data provides opportunities to assess the cost-effectiveness of drugs under the practical utilization, and has gradually become a new research hotspot. However, the complexity of the actual clinical environment also puts higher demands on researchers and decision makers to construct, understand and apply real-world evidence. In order to further prompt the normalization of economic evaluation based on real-world data and promote the scientific application of real-world evidence in medical and health decision-making, this project aims at the crucial issues including scope, research design and quality evaluation, to clarify the key considerations on the using of real-world evidence in medical decision-making. Combined with the international guidelines, the latest advancement of relevant research areas and the advice and opinions from multidisciplinary experts, we aim to provide technical references and guidance for researchers and decision makers, and to strengthen the evidence base of management policies.
A patient registry database is an important source of real-world data, and has been widely used in the assessment of drug and medical devices, as well as disease management. As the second part of the serial technical guidance for real-world data and studies, this paper introduces the concept and scope of potential uses of patient registry databases, proposes recommendations for planning and developing a patient registry database, and compares existing health and medical databases. This paper further develops essential quality indicators for developing a patient registry database, in expect to guide future studies.
Observational studies based on real-world data are providing increasing amount of evidence for evaluating therapeutic outcomes, which is important for timely decision-making. Although time and costs for data collection could be saved using real-world data, it is significantly more complex to design real world researches with lower risk of bias. In order to enhance the validity of causal inference and to reduce potential risk of bias in real world studies, the Working Group of China Real world data and studies Alliance (China REAL) has formulated recommendations for designing observational studies to evaluate therapeutic outcomes based on real-world data. This guidance introduces design types commonly used in real world research; recommends key elements to consider in observational studies, including sample selection, specifying and allocating exposures, defining study entry and endpoints, and pre-designing statistical analysis protocols; and summarizes potential biases and corresponding control measures in real-world studies. These recommendations introduces key elements in designing observational studies using real-world data, for the purpose of improving the validity of causal inference. However, the application scope of these recommendations may be limited and warrant constant improvement.
As an important source for real-world data, existing health and medical data have gained wide attentions recently. As the first part of the serial technical guidance for real-world data and studies, this report introduced the concepts, features and potential applications of existing medical and health data, proposed recommendations for planning and developing a research database using existing health and medical data, and developed essential indicators for assessing the quality of such research databases. The technical guidance may standardize and improve the development of research database using existing health and medical data in China.