Robust Nonparametric Confidence Intervals for Regression-Discontinuity Designs
2014/11/01 by Sebastian Calonico, Sebastián Calónico, Matias D. Cattaneo +2 · 125 citations
Mathematics · #Advanced Causal Inference Techniques #Statistical Methods and Inference #Statistical Methods and Bayesian Inference
paper · pdf · doi:10.3982/ecta11757
Abstract
In the regression-discontinuity (RD) design, units are assigned to treatment based on whether their value of an observed covariate exceeds a known cutoff. In this design, local polynomial estimators are now routinely employed to construct confidence intervals for treatment effects. The performance of these confidence intervals in applications, however, may be seriously hampered by their sensitivity to the specific bandwidth employed. Available bandwidth selectors typically yield a “large” bandwidth, leading to data-driven confidence intervals that may be biased, with empirical coverage well below their nominal target. We propose new theory-based, more robust confidence interval estimators for average treatment effects at the cutoff in sharp RD, sharp kink RD, fuzzy RD, and fuzzy kink RD designs. Our proposed confidence intervals are constructed using a bias-corrected RD estimator together with a novel standard error estimator. For practical implementation, we discuss mean squared error optimal bandwidths, which are by construction not valid for conventional confidence intervals but are valid with our robust approach, and consistent standard error estimators based on our new variance formulas. In a special case of practical interest, our procedure amounts to running a quadratic instead of a linear local regression. More generally, our results give a formal justification to simple inference procedures based on increasing the order of the local polynomial estimator employed. We find in a simulation study that our confidence intervals exhibit close-to-correct empirical coverage and good empirical interval length on average, remarkably improving upon the alternatives available in the literature. All results are readily available in R and STATA using our companion software packages described in Calonico, Cattaneo, and Titiunik (2014d, 2014b).
Cited by
- Evaluating compliance gains of expanding tax enforcement
- Education and Anti-Immigration Attitudes: Evidence from Compulsory Schooling Reforms across Western Europe
- The Impact of Trade Liberalization in the Presence of Political Distortions†
- Willingness to Pay for Clean Air: Evidence from Air Purifier Markets in China
- Potential Unemployment Insurance Duration and Labor Supply: The Individual and Market-Level Response to a Benefit Cut
- Lender Forbearance
- Potential Outcome and Directed Acyclic Graph Approaches to Causality: Relevance for Empirical Practice in Economics
- Marginal Returns to Public Universities
- Limited Impact of Introducing Proportional Representation on Women’s Representation: Insights from a Quasi-Experiment in Local Elections
- Does ad hoc language training improve the economic integration of refugees? Evidence from Germany’s response to the Syrian refugee crisis
- Turnout Turnaround: Ethnic Minority Victories Mobilize White Voters
- Who is affected by parental leave reforms? Women’s selection into different parental leave lengths across recent policy reforms in Germany
- Does central supervision enhance local environmental enforcement? Quasi-experimental evidence from China
- Noise-induced randomization in regression discontinuity designs
- The Direct and Indirect Effects of Genetics and Education
- Revisiting eligibility effects of voting at 16: Insights from Austria based on regression discontinuity analyses
- The effect of a woman-friendly occupation on employment: U.S. postmasters before World War II
- rd2d: Causal Inference in Boundary Discontinuity Designs
- Treatment Effect Heterogeneity in Regression Discontinuity Designs
- PLRD: Partially Linear Regression Discontinuity Inference
- Persistent polarization: The unexpected durability of political animosity around US elections
- Public mass shootings cause large surges in Americans’ engagement with gun policy
- Methods for measuring school effectiveness
- Coordination and Incumbency Advantage in Multi-Party Systems—Evidence from French Elections
- Unequal Democracies
- Spending Limits, Public Funding, and Election Outcomes
- The Effect of Compulsory Schooling Expansion on Mothers’ Attitudes Toward Domestic Violence in Turkey
- On the reliability of published findings using the regression discontinuity design in political science
- Emotional representation: Identifying the characteristics and consequences of elected officials mirroring the emotions of their constituents
- Improved inference for nonparametric regression and regression-discontinuity designs
- Treatment Effects in the Regression Discontinuity Model with Counterfactual Cutoff and Distorted Running Variables
- Labor Market Outcomes and Early Schooling: Evidence from School Entry Policies Using Exact Date of Birth
- Maternal education and child health: Causal evidence from Denmark
- Revisiting the Link between Politicians’ Salaries and Corruption
- Regression discontinuity with categorical outcomes
- Sunset time and the economic effects of social jetlag: evidence from US time zone borders
- Estimation and Inference in Boundary Discontinuity Designs: Distance-Based Methods
- Mandatory Notice of Layoff, Job Search, and Efficiency
- Political Foundations of Racial Violence in the Post-Reconstruction South
- When Can We Trust Regression Discontinuity Design Estimates from Close Elections? Evidence from Experimental Benchmarks
- The unintended composition effect of the subnational government fiscal rules: The case of Italian municipalities
- Detecting Favoritism in Public Procurement
- Does fiscal autonomy increase local income? Evidence from Italy
- Learning About Opportunity: Spillovers of Elite School Admissions in Peru
- Books or babies? The incapacitation effect of schooling on minority women
- EMERGEing Educational Opportunities: The Effects of Social Capital on Selective College Outcomes
- Women on the ballot and women at the polls: how women's representation shapes voter turnout in local elections
- The Rise of the Chinese Communist Party
- A population-based, regression discontinuity analysis examined the effects of nationwide alerting for acute kidney injury on health care and patient outcomes
- Vaccination and Risk Aversion: Evidence From a Flu Vaccination Campaign
- Press Coverage and Accountability in State Legislatures
- The Effect of School District Consolidation on Student Achievement: Evidence From Arkansas
- The Local Randomization Framework for Regression Discontinuity Designs: A Review and Some Extensions
- The long‐run effects of the imperial bureaucracy: Two tales along the Great Wall of Ming China
- Boundary estimation in the regression-discontinuity design: Evidence for a merit- and need-based financial aid program
- Political Interdependence: Evidence from Emigrant Voter Turnout in 1,267 Elections Worldwide
- Nation-Building through Military Service
- Joint Inference for the Regression Discontinuity Effect and Its External Validity
- Persuasion Effects in Regression Discontinuity Designs
- Parental Leave Benefits and Gender Inequality: Evidence from a Benefits Cap for High-Earning Mothers
- The Micro and Macro Effects of Changes in the Potential Benefit Duration
- Megaprojects as sites for resistance: the electoral effects of Mapuche attacks on highways
- Voting at 16: Does lowering the voting age lead to more political engagement? Evidence from a quasi-experiment in the city of Ghent (Belgium)
- Bangers and cash: partisan bias in local government grant allocations across Great Britain
- Working life and human capital investment: Causal evidence from a pension reform
- Patronage and Selection in Public Sector Organizations
- A natural experiment on the effect of herpes zoster vaccination on dementia
- Vaccinating Now or Vaccinating Later: Separating Pull-Forward and Net Effects Using a Dynamic Regression Discontinuity Design
- The 26‐year threshold in a high‐uninsured state: Evidence from Texas
- RETRACTED ARTICLE: Banning the purchase of sex increases cases of rape: evidence from Sweden
- Do Donors Punish Extremist Primary Nominees? Evidence from Congress and American State Legislatures
- The effects of fare-free transit on the travel behavior of older adults
- The causal effect of crop diversification obligations on crop diversity: An EU-level analysis
- Another One Rides the Bus: The Impact of School Transportation on Student Outcomes in Michigan
- Is Taxing Waste a Waste of Time? Evidence from a Supreme Court Decision
- The Normalization of the Radical Right
- Retirement Makes You Old? Causal Effect of Retirement on Biological Age
- Long-Term Effects of Equal Sharing: Evidence from Inheritance Rules for Land
- Let's stay together: The effects of repeat student-teacher matches on academic achievement
- No Evidence that Banning the Purchase of Sex Increases Rape: A Replication Study of Ciacci (2024, 2025)
- Permutation-based tests for discontinuities in event studies
- Watering Down Environmental Regulation in China*
- Effect Identification and Unit Categorization in the Multi-Score Regression Discontinuity Design with Application to LED Manufacturing
- Robust inference for geographic regression discontinuity designs: assessing the impact of police precincts
- Bias Correction and Robust Inference in Semiparametric Models
- Leveling the Playing Field: Default Policy and Its Effects on English Learner Reclassification Rates
- Treatment effects beyond the mean using GAMLSS
- Simple Local Polynomial Density Estimators
- Alternative Assumptions to Identify LATE in Fuzzy Regression Discontinuity Designs
- Regional Borders, Commuting, and Transport Network Integration
- The Permanent and Temporary Effects of Stock Splits on Liquidity in a Dynamic Semiparametric Model
- Firm Responses to Tax Audits: Regression Discontinuity Evidence from a Threshold-Based Audit Program
- Procedural Barriers to Political Candidacy: Gender, Discouragement and Candidate Persistence
- The Short- and Longer-Term Effects of a Child Labor Ban
- Leveraging Covariates in Regression Discontinuity Designs
- Local Composite Quantile Regression for Regression Discontinuity
- Placebo Discontinuity Design
- Heterogeneity of shifts in economic expectations around elections
- Are newcomers financially responsible? Evidence from close elections in Brazilian Municipalities
- Multi‐level party favoritism: The case of a discretionary grant program in Poland
- Protecting unauthorized immigrant mothers improves their children's mental health. [europepmc]
- Effects of primary care cost-sharing among young adults: varying impact across income groups and gender. [europepmc]
- Treatment effects beyond the mean using distributional regression: Methods and guidance. [europepmc]
- Precision Health-Enabled Machine Learning to Identify Need for Wraparound Social Services Using Patient- and Population-Level Data Sets: Algorithm Development and Validation. [europepmc]
- Association of the National Health Guidance Intervention for Obesity and Cardiovascular Risks With Health Outcomes Among Japanese Men. [europepmc]
- Cash Transfers and Contraceptive Use: A Regression Discontinuity Analysis. [europepmc]
- Association of Intravenous Radiocontrast With Kidney Function: A Regression Discontinuity Analysis. [europepmc]
- You Know What I Know: Interviewer Knowledge Effects in Subjective Expectation Elicitation. [europepmc]
- Conflict violence reduction and pregnancy outcomes: A regression discontinuity design in Colombia. [europepmc]
- Association of Hospital Public Quality Reporting With Electronic Health Record Medication Safety Performance. [europepmc]
- The effects of patient cost-sharing on health expenditure and health among older people: Heterogeneity across income groups. [europepmc]
- Social Pension Scheme and Health Inequality: Evidence From China's New Rural Social Pension Scheme. [europepmc]
- Political polarization and cooperation during a pandemic. [europepmc]
- The 'welcomed lockdown' hypothesis? Mental wellbeing and mobility restrictions. [europepmc]
- Comparison of Income Eligibility for Medicaid vs Marketplace Coverage for Insurance Enrollment Among Low-Income US Adults. [europepmc]
- Can the establishment of state-level urban agglomeration stimulate enterprise innovation?-Taking Yangtze River Delta and Pearl River Delta as an example. [europepmc]
- Effects of an electronic health record-based mobility assessment and automated referral for inpatient physical therapy on patient outcomes: A quasi-experimental study. [europepmc]
- Small business under the COVID-19 crisis: Expected short- and medium-run effects of anti-contagion and economic policies. [europepmc]
- Effect of no cost sharing for paediatric care on healthcare usage by household income levels: regression discontinuity design. [europepmc]
- Effectiveness of an Artificial Intelligence-Enabled Intervention for Detecting Clinical Deterioration. [europepmc]
- Assessing the Influence of Redlining on Intergenerational Wealth and Body Mass Index Through a Quasi-experimental Framework. [europepmc]
- A natural experiment on the effect of herpes zoster vaccination on dementia. [europepmc]
- Burst of gyrification in the human brain after birth. [europepmc]
- No effect of additional education on long-term brain structure, a preregistered natural experiment in thousands of individuals. [europepmc]
- The effect of shingles vaccination at different stages of the dementia disease course. [europepmc]
Related