2013/08/16 by Andrew F. Hayes, Michael Scharkow · 3 citations
Decision Sciences · Psychology · Social Sciences · #Behavioral Health and Interventions #Decision-Making and Behavioral Economics #Social and Intergroup Psychology
paper · doi:10.1177/0956797613480187
openalex publication_date 2013/08/16 · openalex created_date 2016/06/24 · openalex updated_date 2026/07/31
A content analysis of 2 years of Psychological Science articles reveals inconsistencies in how researchers make inferences about indirect effects when conducting a statistical mediation analysis. In this study, we examined the frequency with which popularly used tests disagree, whether the method an investigator uses makes a difference in the conclusion he or she will reach, and whether there is a most trustworthy test that can be recommended to balance practical and performance considerations. We found that tests agree much more frequently than they disagree, but disagreements are more common when an indirect effect exists than when it does not. We recommend the bias-corrected bootstrap confidence interval as the most trustworthy test if power is of utmost concern, although it can be slightly liberal in some circumstances. Investigators concerned about Type I errors should choose the Monte Carlo confidence interval or the distribution-of-the-product approach, which rarely disagree. The percentile bootstrap confidence interval is a good compromise test.