2019/08/12 by Panos Toulis, Toulis, Panos · 1 voice
Mathematics · #Advanced Statistical Methods and Models #Random Matrices and Applications #Statistical Methods and Inference
paper · doi:10.1093/biomet/asaf085
openalex publication_date 2025/11/25 · openalex created_date 2025/11/27 · openalex updated_date 2026/07/29
Summary Randomization tests rely on simple data transformations and possess an appealing robustness property. In addition to being finite-sample valid if the data distribution is invariant under the transformation, these tests can be asymptotically valid under a suitable studentization of the test statistic, even if the invariance does not hold. However, practical implementation often encounters noisy data, resulting in approximate randomization tests that may not be as robust. In this paper, one key theoretical contribution is a nonasymptotic bound on the discrepancy between the size of an approximate randomization test and the size of the idealized randomization test using noiseless data. This allows us to derive novel conditions for the validity of approximate randomization tests under data invariances, while being able to use existing results based on studentization if the invariance does not hold. We illustrate our theory through several examples, including significance tests in linear regression. These examples clarify key aspects of how randomization tests behave in small samples and address limitations of prior theoretical results.