vix.ing · top · new · best · stats · spec

Literature search in systematic reviews: How much is good enough?

2023/12/20 by Maria J. Mathew · 1 voice
Decision Sciences · Social Sciences · Medicine · #Meta-analysis and systematic reviews #Delphi Technique in Research #Traumatic Brain Injury Research

paper · pdf · doi:10.1016/j.cegh.2023.101485

openalex publication_date 2023/12/20 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

Background Systematic reviews focus on performing exhaustive literature searches to address specific research questions. However, in practice, many reviews search a limited number of databases. Objective This analysis was undertaken to identify the potential impact of searching a limited number of databases in systematic reviews. Methods Two recently published systematic reviews addressing the same research question, but using different search strategies, were utilized as a case study. Both were published in 2023, less than 6 months apart. One of these searched Pubmed and Embase; whereas the other searched through Pubmed and the Cochrane Library. Information on the review characteristics, detailed methodology, search strategy, reviewers' results and conclusions; were extracted. Both reviews were appraised for methodological quality using the AMSTAR-2 checklist. Results The search output of the two reviews was vastly different. Using a step-wise screening process, the two reviews finally included 16 and 11 studies. Among these, only 4 studies were included in both reviews, suggesting that both reviews missed multiple eligible studies. The data on the primary outcomes were also very different in the two reviews, suggesting that neither could be considered completely reliable for decision-making by stakeholders. Conclusion This analysis highlights the risk of bias arising in systematic reviews undertaking limited literature searches, especially limited number of databases for published literature. The commonly employed practice of searching two databases in systematic reviews, needs to be rectified urgently.

Discussions

Related