Standard Errors for Difference‐in‐Difference Regression

2025/01/22 by Bruce E. Hansen · 1 voice · 20 citations
Mathematics · #Advanced Statistical Methods and Models #Confidence interval #Difference in differences #Econometrics #Linear regression #Mathematics #Mean difference #Regression #Regression analysis #Significant difference #Standard error #Statistical Methods and Bayesian Inference #Statistical Methods and Inference #Statistics

paper · pdf · doi:10.1002/jae.3110

published in Journal of Applied Econometrics 40(3), 291-309 (Wiley)

openalex publication_date 2025/01/22 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

ABSTRACT This paper makes a case for the use of jackknife methods for standard error, value, and confidence interval construction for difference‐in‐difference (DiD) regression. We review cluster‐robust, bootstrap, and jackknife standard error methods and show that standard methods can substantially underperform in conventional settings. In contrast, our proposed jackknife inference methods work well in broad contexts. We illustrate the relevance by replicating several influential DiD applications and showing how inferential results can change if jackknife standard error and inference methods are used.

Citations

• Using Heteroscedasticity Consistent Standard Errors in the Linear Regression Model
• A Heteroskedasticity-Consistent Covariance Matrix Estimator and a Direct Test for Heteroskedasticity
• Longitudinal data analysis using generalized linear models
• How Much Should We Trust Differences-In-Differences Estimates?
• Inference with “Difference in Differences” with a Small Number of Policy Changes
• Channeling Fisher: Randomization Tests and the Statistical Insignificance of Seemingly Significant Experimental Results*
• Bootstrap-Based Improvements for Inference with Clustered Errors

Cited by

• Testing the Significance of the Difference-in-Differences Coefficient via Doubly Randomised Inference
• Impact of domestic violence legislation on reported intimate partner violence: a difference-in-differences analysis across 16 countries. [europepmc]

Discussions

• #econsky I take a strange pleasure in there being yet another reason that prior DID papers could be wrong. [That said, failure to reject the null n.e. null is true. Your point estimate is still your [bsky, 32 points, 2 comments]

Related

• The Jackknife Estimation Method
• Semiparametric Difference-in-Differences with Potentially Many Control Variables
• Extensions for Inference in Difference-in-Differences with Few Treated Clusters
• How Much Should We Trust Differences-In-Differences Estimates?
• What's Trending in Difference-in-Differences? A Synthesis of the Recent Econometrics Literature