2012/05/02 by Vladimir Spokoiny, Spokoiny, Vladimir · 1 citation
Mathematics · #62F10 #FOS: Computer and information sciences #Methodology (stat.ME) #msc:62F10 #stat.ME
paper · pdf · doi:10.48550/arxiv.1205.0498
arXiv admin note: text overlap with arXiv:1111.3029
arxiv created 2015/08/10 · arxiv updated 2015/08/11
This paper extends some prominent statistical results including Fisher Theorem and Wilks phenomenon to the penalized maximum likelihood estimation with a quadratic penalization. It appears that sharp expansions for the penalized MLE \(\thetavG \) and for the penalized maximum likelihood can be obtained without involving any asymptotic arguments, the results only rely on smoothness and regularity properties of the of the considered log-likelihood function. The error of estimation is specified in terms of the effective dimension \(pG \) of the parameter set which can be much smaller than the true parameter dimension and even allows an infinite dimensional functional parameter. In the i.i.d. case, the Fisher expansion for the penalized MLE can be established under the constraint "\(pG2/n\) is small" while the remainder in the Wilks result is of order \(pG3/n \).