2016/08/31 by Xianyi Wu, Xian Zhou
Mathematics · #Advanced Statistical Methods and Models #Estimator #Model selection #Oracle #Property (philosophy) #Sample (material) #Selection (genetic algorithm) #Statistical Methods and Bayesian Inference #Statistical Methods and Inference #math.ST #stat.TH
paper · pdf · doi:10.1007/s10463-018-0670-0
published as Annals of the Institute of Statistical Mathematics, 2018 · 29 pages, 1 fiture
openalex created_date 2016/09/16 · arxiv created 2018/05/17 · openalex publication_date 2018/06/15 · arxiv updated 2018/07/12 · openalex updated_date 2026/08/05
The oracle property of model selection procedures has attracted a large volume of favorable publications in the literature, but also faced criticisms of being ineffective and misleading in applications. In this paper, we introduce a class of estimators that can easily produce model selection procedures possessing the oracle property and discuss the merits of the oracle property by analyzing the performance of such estimators in finite sample size theoretically. Specifically, we propose a new type of Hodges' estimators capable of reducing the asymptotic variance of any given estimator over a multi-dimensional subspace of the parameter space, which can easily produce model selection procedures with the oracle and some other desired properties. This new type of oracle estimators, however, perform poorly at some values of the parameters for estimation, and there is no convincing reason to declare that oracle estimators are better than the traditional estimators such as the MLE and LSE. Consequently, the merits of the oracle property for model selection as claimed in the literature are probably grossly overstated, and the criticisms of the oracle property are justifiable.