Test & Roll: Profit-Maximizing A/B Tests

2018/11/30 by Elea McDonnell Feit, Ron Berman
Decision Sciences · Mathematics · #Advanced Statistical Process Monitoring #Simulation Techniques and Applications #Statistical Methods in Clinical Trials

paper · doi:10.1287/mksc.2019.1194

openalex publication_date 2019/11/01 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/31

Abstract

We reframe A/B testing as a decision problem with the goal of maximizing profit and derive the optimal sample size formula.

Related

• Beyond Basic A/B testing: Improving Statistical Efficiency for Business Growth
• Ranking by Lifts: A Cost-Benefit Approach to Large-Scale A/B Tests
• Beyond Normality: Reliable A/B Testing with Non-Gaussian Data
• Design of Bayesian A/B Tests Controlling False Discovery Rates and Power
• Strategic A/B testing via Maximum Probability-driven Two-armed Bandit