2020/10/20 by Georgia Salanti, Adriani Nikolakopoulou, Salanti, Georgia +11 · 26 citations
Decision Sciences · Engineering · Mathematics · Medicine · #Alternative medicine #Computer science #Diverse Approaches in Healthcare and Education Studies #Engineering #Hierarchy #Machine learning #Mathematics #Medicine #Meta-analysis #Meta-analysis and systematic reviews #Metric (unit) #Operations management #Protocol (science) #Rank (graph theory) #Ranking (information retrieval) #Reliability and Agreement in Measurement #stat.AP #stat.ME
paper · pdf · open access · doi:10.1093/aje/kwab278
published in American Journal of Epidemiology 191(5), 930-938 (Oxford University Press)
arxiv created 2020/10/20 · arxiv updated 2020/10/22 · openalex publication_date 2021/11/18 · openalex created_date 2025/10/10 · openalex updated_date 2026/08/05
Background: Comparative effectiveness research using network meta-analysis can present a hierarchy of competing treatments, from the least to most preferable option. However, the research question associated with the hierarchy of multiple interventions is never clearly defined in published reviews. Methods and Results: We introduce the notion of a treatment hierarchy question that describes the criterion for choosing a specific treatment over one or more competing alternatives. For example, stakeholders might ask which treatment is most likely to improve mean survival by at least 2 years or which treatment is associated with the longest mean survival. The answers to these two questions are not necessarily the same. We discuss the most commonly used ranking metrics (quantities that describe or compare the estimated treatment-specific effects), how the metrics produce a treatment hierarchy and the type of treatment hierarchy question that each metric can answer. We show that the ranking metrics encompass the uncertainty in the estimation of the treatment effects in different ways, which results in different treatment hierarchies. Conclusions: Network meta-analyses that aim to rank treatments should state in the protocol the treatment hierarchy question they aim to address and employ the appropriate ranking metric to answer it.