2019/01/21 by Amitabh Basu, Basu, Amitabh, Tu Nguyen +3
Computer Science · Decision Sciences · Mathematics · #62C15 #62F10 #90C15 #Applied mathematics #Bayesian Modeling and Causal Inference #Combinatorics #Dimension (graph theory) #Empirical risk minimization #Estimator #FOS: Mathematics #Mathematical optimization #Mathematics #Optimization and Control (math.OC) #Optimization problem #Risk and Portfolio Optimization #Sample (material) #Simple (philosophy) #Statistical Methods and Inference #Statistics #Statistics Theory (math.ST) #Stochastic optimization #math.OC #math.ST #msc:62C15 #msc:62F10 #msc:90C15 #stat.TH
paper · pdf · doi:10.48550/arxiv.1901.06976
published in arXiv (Cornell University) (Cornell University)
openalex publication_date 2019/01/21 · arxiv created 2020/10/21 · arxiv updated 2020/10/23 · openalex created_date 2025/10/10 · openalex updated_date 2026/08/06
We look at stochastic optimization problems through the lens of statistical decision theory. In particular, we address admissibility, in the statistical decision theory sense, of the natural sample average estimator for a stochastic optimization problem (which is also known as the empirical risk minimization (ERM) rule in learning literature). It is well known that for some simple stochastic optimization problems, the sample average estimator may not be admissible. This is known as \em Stein's paradox in the statistics literature. We show in this paper that for optimizing stochastic linear functions over compact sets, the sample average estimator is admissible. Moreover, we study problems with convex quadratic objectives subject to box constraints. Stein's paradox holds when there are no constraints and the dimension of the problem is at least three. We show that in the presence of box constraints, admissibility is recovered for dimensions 3 and 4.