2008/11/30 by Karine Bertin, Guillaume Lecué
Mathematics · #math.ST #stat.TH #msc:62G08
paper · pdf · doi:10.1214/08-ejs327
published as Electronic Journal of Statistics 2008, Vol. 2, 1224-1241 · Published in at http://dx.doi.org/10.1214/08-EJS327 the Electronic Journal of Statistics (http://www.i-journals.org/ejs/) by the Institute of Mathematical Statistics (http://www.imstat.org)
arxiv created 2008/12/16 · arxiv updated 2009/12/01
We consider a l1-penalization procedure in the non-parametric Gaussian regression model. In many concrete examples, the dimension d of the input variable X is very large (sometimes depending on the number of observations). Estimation of a β-regular regression function f cannot be faster than the slow rate n-2β/(2β+d). Hopefully, in some situations, f depends only on a few numbers of the coordinates of X. In this paper, we construct two procedures. The first one selects, with high probability, these coordinates. Then, using this subset selection method, we run a local polynomial estimator (on the set of interesting coordinates) to estimate the regression function at the rate n-2β/(2β+d^*), where d^*, the "real" dimension of the problem (exact number of variables whom f depends on), has replaced the dimension d of the design. To achieve this result, we used a l1 penalization method in this non-parametric setup.