ObjectiveTo describe the current status of the evaluation index for the performance of diagnostic reagents compared with gold standards in systematic reviews and develop the list of evaluation indexes. MethodsPubMed, Embase (OVID), Cochrane Library (OVID), CBM, WanFang Data and CNKI databases were searched for systematic reviews about the performance of diagnostic reagents compared with gold standards from inception to 28th April, 2023. Two reviewers independently screened literature and extracted data. The frequency and ratio were used to describe the current status, while the qualitative synthesis was used to develop the list. ResultsA total of 133 systematic reviews were included. Sensitivity (133/133, 100.0%), specificity (131/133, 98.5%) and AUC (80/133, 60.2%) were used more frequently than 50%. Q index (6/133, 4.5%), false positive rate (3/133, 2.3%), Kappa value (2/133, 1.5%), false negative rate (1/133, 5%) and Youden's index were used less frequently than 5%. In order to evaluate the performance of diagnostic reagents compared with gold standards in systematic reviews comprehensively, a total of 14 index related to validity and predictability could be considered. ConclusionThe evaluation index for the performance of diagnostic reagents in systematic reviews are inconsistent and limited, so there is an urgent need to develop standardized evaluation indicators based on expert consensus.