Statistical Control Requires Causal Justification
2022/04/01 by Anna Wysocki, Katherine M. Lawson, Mijke Rhemtulla · 4 voices · 51 citations
Mathematics · Social Sciences · #Advanced Causal Inference Techniques #Statistical Methods and Inference #Qualitative Comparative Analysis Research
paper · doi:10.1177/25152459221095823
Abstract
It is common practice in correlational or quasiexperimental studies to use statistical control to remove confounding effects from a regression coefficient. Controlling for relevant confounders can debias the estimated causal effect of a predictor on an outcome; that is, it can bring the estimated regression coefficient closer to the value of the true causal effect. But statistical control works only under ideal circumstances. When the selected control variables are inappropriate, controlling can result in estimates that are more biased than uncontrolled estimates. Despite the ubiquity of statistical control in published regression analyses and the consequences of controlling for inappropriate third variables, the selection of control variables is rarely explicitly justified in print. We argue that to carefully select appropriate control variables, researchers must propose and defend a causal structure that includes the outcome, predictors, and plausible confounders. We underscore the importance of causality when selecting control variables by demonstrating how regression coefficients are affected by controlling for appropriate and inappropriate variables. Finally, we provide practical recommendations for applied researchers who wish to use statistical control.
Citations
Cited by
- Patterns of brain-wide associations reflect socioeconomics
- Coalition bargaining time and governments’ policy‐making productivity
- Bestiary of Questionable Research Practices in Psychology
- Bridging theory and data: A computational workflow for cultural evolution
- Causal inference for psychologists who think that causal inference is not for them
- Ecology needs a causal overhaul
- What can be learned when multiple analysts arrive at different estimates
- Long-term evaluation of the association between dominance, bib size, sex and age
- Motivational signals in public sector job advertisements and how they relate to attracting and hiring candidates
- Through the lens of causal inference: Decisions and pitfalls of covariate selection
- The Causal Cookbook: Recipes for Propensity Scores, G-Computation, and Doubly Robust Standardization
- Ethnic harassment and political engagement of immigrants in Europe
- Combining Statistical and Causal Mediation Analysis
- Mental health and socio-cognitive predictors of adherence to COVID-19 social distancing rules in adolescents in England
- Causal inference on human behaviour
- Cat Ownership and Schizophrenia-Related Disorders and Psychotic-Like Experiences: A Systematic Review and Meta-Analysis
- Can the interaction of offending propensity and criminogenic exposure explain reoffending among justice-involved adolescents?
- Callous‐unemotional traits, cognitive functioning, and externalizing problems in a propensity‐matched sample from the ABCD study
- Crime propensity and lifestyle risk: The interplay of personal morality and self-control ability in determining the significance of criminogenic exposure
- Colony size as the main driver of the evolution of song diversity and composition in weaverbirds
- Ideology from topic mixture statistics: inference method and example application to carbon tax public opinion
- Looking our limitations in the eye: A call for more thorough and honest reporting of study limitations
- Psychological Predictors of Long-term Esports Success: A Registered Report
- Populist electoral success and party system concentration: A cross-national analysis
- Exploring cognitive load dynamics with an AI-based voice assistant in high school chemistry experiments
- The object of my intoxication: Examining the role of dehumanization, objectification, and alcohol consumption in intimate partner aggression perpetration
- Exploring the Multidimensional Relationship Between Medication Beliefs and Adherence to Medications Among Older Adults Living With Multimorbidity Using Polynomial Regression: An Observational Cohort Study. [europepmc]
- Evolution of the income-related gap in health with old age: evidence from 20 countries in European and Chinese panel datasets. [europepmc]
- The potential relationship between loot box spending, problem gambling, and obsessive-compulsive gamers. [europepmc]
- Coping resources and stress due to demands in parents to children with autism spectrum disorder. [europepmc]
- Aggression and Irritability in Middle Childhood: Between- and Within-Person Associations. [europepmc]
- Local Legislation is Associated With Regional Transgender Attitudes. [europepmc]
- Association of long COVID with housing insecurity in the United States, 2022-2023. [europepmc]
- The Transdiagnostic Intervention for Sleep and Circadian Dysfunction (TranS-C) for serious mental illness in community mental health part 3: study protocol to evaluate sustainment in a hybrid type 2 effectiveness-implementation cluster-randomized trial. [europepmc]
- Examining the Interrelationships Between Social Isolation and Loneliness and Their Correlates Among Older British Adults Before and During the COVID-19 Lockdown: Evidence From Four British Longitudinal Studies. [europepmc]
- Clarifying directional dependence among measures of early auditory processing and cognition in schizophrenia: leveraging Gaussian graphical models and Bayesian networks. [europepmc]
- Influence of Disease-Related Stigma on Patients' Decisions to Upload Medical Reports to the German Electronic Health Record: Randomized Controlled Trial. [europepmc]
- Human immune and metabolic biomarker levels, and stress-biomarker associations, differ by season: Implications for biomedical health research. [europepmc]
- Is musical ability related to second-language acquisition? A meta-analysis. [europepmc]
- Distinguishing cause from effect in psychological research: An independence-based approach under linear non-Gaussian models. [europepmc]
- Designing digital health interventions with causal inference and multi-armed bandits: a review. [europepmc]
- Construct validity in cross-cultural, developmental research: challenges and strategies for improvement. [europepmc]
- Perceived Inequality and Wellness: Investigating the Longitudinal Links Between Relative Deprivation, Facets of Well-Being, and Self-Rated Health. [europepmc]
- Binge drinking trajectories across adolescence and early adulthood: Associations with genetic influences for dual-systems impulsive personality traits, alcohol consumption, and alcohol use disorder. [europepmc]
- Intergenerational transmission of depression: Testing a comprehensive set of putative mediators. [europepmc]
- Does cognitive capital reduce the risk of cognitive decline in later life? [europepmc]
- Perceptual exposure influences body size perceptions and anti-fat attitudes. [europepmc]
- Development and Validation of a New Measure of Work Annoyance Using a Psychometric Network Approach. [europepmc]
- Executive Network Activation Moderates the Association between Neighborhood Threats and Externalizing Behavior in Youth. [europepmc]
- Rare CNVs and phenome-wide profiling highlight brain structural divergence and phenotypical convergence. [europepmc]
- The Transdiagnostic Intervention for Sleep and Circadian Dysfunction (TranS-C) for serious mental illness in community mental health part 1: study protocol for a hybrid type 2 effectiveness-implementation cluster-randomized trial. [europepmc]
Discussions
- Impressive blog post. I'd only add that in may cases, "Statistical control requires causal justification" (doi.org/10.1177/2515...). [bsky, 16 points, 1 comments]
- doi.org/10.1177/2515... this excellent paper argues “yes” [bsky, 15 points, 2 comments]
- 11. Talking Heads: doi.org/10.1177/2515... [bsky, 11 points, 1 comments]
- I end up citing this paper in reviews a lot: Wysocki, A. C., Lawson, K. M. & Rhemtulla, M. (2022). Statistical Control Requires Causal Justification. Advances in Methods and Practices in Psychologica [bsky, 8 points, 2 comments]
Related