vix.ing · top · new · best · stats · spec

The effect of estimating prevalences on the population-wise error rate

2023/04/19 by Remi Luschei, Luschei, Remi, Werner Brannath +1 · 1 citation
Economics, Econometrics and Finance · Mathematics · #Advanced Causal Inference Techniques #FOS: Computer and information sciences #Health Systems, Economic Evaluations, Quality of Life #Methodology (stat.ME) #Statistical Methods in Clinical Trials

paper · pdf · doi:10.48550/arxiv.2304.09988

openalex publication_date 2023/04/19 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

The population-wise error rate (PWER) is a type I error rate for clinical trials with multiple target populations. In such trials, a treatment is tested for its efficacy in each population. The PWER is defined as the probability that a randomly selected, future patient will be exposed to an inefficient treatment based on the study results. It can be understood and computed as an average of strata-specific family wise error rates and involves the prevalences of these strata. A major issue of this concept is that the prevalences are usually unknown in practice, so that the PWER cannot be directly controlled. Instead, one could use an estimator based on the given sample, like their maximum-likelihood estimator under a multinomial distribution. In this article, we demonstrate through simulations that this does not substantially inflate the true PWER. We differentiate between the expected PWER, which is almost perfectly controlled, and study-specific values of the PWER which are conditioned on all subgroup sample sizes and vary within a narrow range. Thereby, we consider up to eight different overlapping populations and moderate to large sample sizes. In these settings, we also consider the maximum strata-wise family wise error rate, which is found to be, on average, at least bounded by twice the significance level used for PWER control.

Cited by

Related