vix.ing · top · new · best · stats · spec

Choosing Ridge Parameter for Regression Problems

2005/05/01 by Ghadban Khalaf, Ghazi Shukur · 2 citations
Computer Science · Engineering · Mathematics · #Advanced Statistical Methods and Models #Control Systems and Identification #Neural Networks and Applications

paper · doi:10.1081/sta-200056836

openalex publication_date 2005/05/01 · openalex created_date 2025/10/10 · openalex updated_date 2026/08/05

Abstract

Hoerl and Kennard (1970a Hoerl , A. E. , Kennard , R. W. ( 1970a ). Ridge regression: biased estimation for non-orthogonal problems . Tech. 12 : 55 – 67 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) introduced the ridge regression estimator as an alternative to the ordinary least squares estimator in the presence of multicollinearity. In this article, a new approach for choosing the ridge parameter (K), when multicollinearity among the columns of the design matrix exists, is suggested and evaluated by simulation techniques, in terms of mean squared errors (MSE). A number of factors that may affect the properties of these methods have been varied. The MSE from this approach has shown to be smaller than using Hoerl and Kennard (1970a Hoerl , A. E. , Kennard , R. W. ( 1970a ). Ridge regression: biased estimation for non-orthogonal problems . Tech. 12 : 55 – 67 .[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) in almost all situations.

Citations

Cited by