2024/08/25 by Danielle Tsao, Tsao, Danielle, Ronan Perry +3
Computer Science · Mathematics · #Advanced Statistical Methods and Models #Applications (stat.AP) #Bayesian Modeling and Causal Inference #FOS: Computer and information sciences #FOS: Mathematics #Statistical Methods and Inference #Statistics Theory (math.ST)
paper · pdf · doi:10.48550/arxiv.2408.13901
openalex publication_date 2024/08/25 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28
We study conditions under which the addition of variables to a regression equation can turn a previously statistically insignificant result into a significant one. Specifically, we characterize the minimum strength of association required for these variables--both with the dependent and independent variables, or with the dependent variable alone--to elevate the observed t-statistic above a specified significance threshold. Interestingly, we show that it is considerably difficult to overturn a statistically insignificant result solely by reducing the standard error. Instead, included variables must also alter the point estimate to achieve such reversals in practice. Our results can be used to conduct sensitivity analyses against unobserved variables and to bound the maximum t-value one can obtain given different subsets of observed covariates, and may also offer algebraic explanations for patterns of reversals seen in empirical research, such as those documented by Lenz and Sahn (2021).