Ridge Regression: A Historical Context

2020/10/01 by Roger W. Hoerl · 112 citations
Decision Sciences · Mathematics · #Advanced Statistical Methods and Models #Archaeology #Cartography #Computer science #Context (archaeology) #Econometrics #Elastic net regularization #Estimator #Geography #Grey System Theory Applications #History #Lasso (programming language) #Mathematics #Regression #Regression analysis #Ridge #Statistical Methods and Inference #Statistics

paper · doi:10.1080/00401706.2020.1742207

published in Technometrics 62(4), 420-425 (Taylor & Francis)

openalex publication_date 2020/10/01 · openalex created_date 2025/10/10 · openalex updated_date 2026/08/06

Abstract

Two classical articles on Ridge Regression by Arthur Hoerl and Robert Kennard were published in Technometrics in 1970, making 2020 their 50th anniversary. The theory and practice of Ridge Regression, and of related biased shrinkage estimators, have been extensively developed over the years. Further, newer shrinkage estimators, such as the Lasso and the Elastic Net, have become popular more recently. These newer developments have led to renewed interest in the original 1970 articles. What has perhaps been lost since 1970 is the context of these classic articles. That is, who were Art Hoerl and Bob Kennard, and what led two statisticians working in the private sector to develop Ridge Regression in the first place? What are the origins of Ridge Regression? Where did the name come from? The purpose of this article is to provide this historical context by discussing the men involved, their work at DuPont, and their approach to methodological development. As Art Hoerl was my father, this is admittedly a personal viewpoint.

Citations

• Ridge Regression: Applications to Nonorthogonal Problems

Cited by

• An affordable and easy-to-use tool for automatic fish length and weight estimation in mariculture. [europepmc]
• Influencing factors and trend prediction of PM 2.5 concentration based on STRIPAT-Scenario analysis in Zhejiang Province, China. [europepmc]
• Data-driven nexus between malaria incidence and World Bank indicators in the Mekong River during 2000-2022. [europepmc]
• Exploring the potential mechanisms of Urban greenspaces providing pollution Retention and cooling benefits based on three-dimensional structure of plant communities. [europepmc]
• Exploring the potential of microscopic hyperspectral, Raman, and LIBS for nondestructive quality assessment of diverse rice samples. [europepmc]
• A Hybrid Deep Learning-Based Feature Selection Approach for Supporting Early Detection of Long-Term Behavioral Outcomes in Survivors of Cancer: Cross-Sectional Study. [europepmc]
• Machine learning frameworks to accurately estimate the adsorption of organic materials onto resin and biochar. [europepmc]
• Predicting CO2 adsorption in KOH-activated biochar using advanced machine learning techniques. [europepmc]
• Constructing a binary prediction model with incomplete data: Variable selection to balance fairness and precision. [europepmc]
• Modeling of reduction kinetics of Cr 2 O 7 -2 in FeSO 4 solution via artificial intelligence methods. [europepmc]
• Accurate prediction of green hydrogen production based on solid oxide electrolysis cell via soft computing algorithms. [europepmc]
• Development of robust machine learning models to estimate hydrochar higher heating value and yield based upon biomass proximate analysis. [europepmc]
• Adaptive regression model for Parkinson's disease diagnosis from speech signals using Box-Cox-based clustering and extremely randomization. [europepmc]
• Multimodal MRI marker of cognition explains the association between cognition and mental health in the UK Biobank. [europepmc]

Related

• Maximum Likelihood Ridge Regression
• Lecture notes on ridge regression
• Ridge Regression: Applications to Nonorthogonal Problems
• Comment: Ridge Regression, Ranking Variables and Improved Principal Component Regression
• Ridge Regularization: An Essential Concept in Data Science