Ridge Regression: Applications to Nonorthogonal Problems
1970/02/01 by Arthur E. Hoerl, Robert W. Kennard · 2,641 citations
Computer Science · Engineering · Mathematics · #Archaeology #Cartography #Computer science #Context (archaeology) #Control Systems and Identification #Econometrics #Elastic net regularization #Exposition (narrative) #Geography #Least-squares function approximation #Mathematics #Neural Networks and Applications #Ordinary least squares #Philosophy #Polynomial regression #Regression #Regression analysis #Regression diagnostic #Ridge #Statistical and numerical algorithms #Statistics #TRACE (psycholinguistics)
paper · doi:10.1080/00401706.1970.10488635
published in Technometrics 12(1), 69-82 (Taylor & Francis)
openalex publication_date 1970/02/01 · openalex created_date 2025/10/10 · openalex updated_date 2026/08/06
Abstract
This paper is an exposition of the use of ridge regression methods. Two examples from the literature are used as a base. Attention is focused on the RIDGE TRACE which is a two-dimensional graphical procedure for portraying the complex relationships in multifactor data. Recommendations are made for obtaining a better regression equation than that given by ordinary least squares estimation.
Cited by
- The Relationship Between Variable Selection and Data Agumentation and a Method for Prediction
- Ridge Regression: A Historical Context
- Generalized Inverses, Ridge Regression, Biased Linear Estimation, and Nonlinear Estimation
- Encoding EEG Signals to Examine Human-Like Next-Word Prediction Behaviour in Language Models
- High-dimensional regression in practice: an empirical study of finite-sample prediction, variable selection and ranking
- Regularized partial correlation provides reliable functional connectivity estimates while correcting for widespread confounding
- A Practical Guide to Variable Selection in Structural Equation Modeling by Using Regularized Multiple-Indicators, Multiple-Causes Models
- Using a neural network approach and starspots dependent models to predict effective temperatures and ages of young stars
- Sign Language Recognition using Parallel Bidirectional Reservoir Computing
- Exponentially weighted estimands and the exponential family: Filtering, prediction and smoothing
- Collinearity: a review of methods to deal with it and a simulation study evaluating their performance
- Predictors of adherence to exercise interventions in people with schizophrenia
- On Hyperparameter Optimization of Machine Learning Algorithms: Theory and Practice
- Doubly Robust Feature Selection with Mean and Variance Outlier Detection and Oracle Properties
- Bias Correction for Regularized Regression and its Application in Learning with Streaming Data
- Agricultural land use modeling and climate change adaptation: A reinforcement learning approach
- An inconvenient dataset: bias and inappropriate inference with the multilevel model
- Dual-sPLS: A family of Dual Sparse Partial Least Squares regressions for feature selection and prediction with tunable sparsity; evaluation on simulated and near-infrared (NIR) data
- Learning Regularizers: Learning Optimizers that can Regularize
- LLMs Lean on Priors, Not Programming Language Semantics
- Network-based analysis of fluid flows: Progress and outlook
- Representing LLMs in Prompt Semantic Task Space
- Observational evidence that a Gaia-type feedback control system with proportional-integral-derivative characteristics is operating on atmospheric surface temperature at global scale
- Penalized regression with correlation-based penalty
- Neural-Network Chemical Emulator for First-Star Formation: Robust Iterative Predictions over a Wide Density Range
- Signal Lasso with Non-Convex Penalties for Efficient Network Reconstruction and Topology Inference
- Semi-parametric genomic-enabled prediction of genetic values using reproducing kernel Hilbert spaces methods
- Penalized Regressions: The Bridge versus the Lasso
- microRNA‐based predictor for diagnosis of frontotemporal dementia
- Instrument variable detection with graph learning : an application to high dimensional GIS-census data for house pricing
- uPredict: A User-Level Profiler-Based Predictive Framework for Single VM Applications in Multi-Tenant Clouds
- The Raise Regression: Justification, properties and application
- Reinforcing Short-Length Hashing
- Cognitive Ability and Job Performance: Meta-analytic Evidence for the Validity of Narrow Cognitive Abilities
- Fast Supervised Discrete Hashing
- Performance of some ridge estimators for the gamma regression model
- ROS Regression: Integrating Regularization and Optimal Scaling Regression
- Random boosting and random2 forests -- A random tree depth injection approach
- Predicting inflation with recurrent neural networks
- Relationship Between Body Mass Index and Fracture Risk Is Mediated by Bone Mineral Density
- Distribution-dependent Generalization Bounds for Tuning Linear Regression Across Tasks
- Comparisons of penalized least squares methods by simulations
- Some Two-Step Procedures for Variable Selection in High-Dimensional Linear Regression
- Parameter Selection Algorithm For Continuous Variables
- Almost Unbiased Liu Type Estimator in Bell Regression Model: Theory, Simulation and Application
- Two-Stage Regularization-Based Structured Pruning for LLMs
- Machine learning-based q-RASAR approach for the in silico identification of novel multi-target inhibitors against Alzheimer's disease
- On the sensitivity of regression and regressors.
- Spherical Slepian functions and the polar gap in geodesy
- Comparing two samples by penalized logistic regression
- Direct and indirect least squares methods in continuous-time parameter estimation
- Deep learning for time series classification
- A Low-Cost Hybrid Reservoir Computing Model for Isolated Sign Language Video Recognition
- Multivariate convex regression with adaptive partitioning
- Tailored minimal reservoir computing: on the bidirectional connection between nonlinearities in the reservoir and in data
- A Survey Of Regression Algorithms And Connections With Deep Learning
- Misogynistic Tweet Detection: Modelling CNN with Small Datasets
- It's All Connected: A Journey Through Test-Time Memorization, Attentional Bias, Retention, and Online Optimization
- In silico models for predicting vector control chemicals targeting Aedes aegypti. [europepmc]
- Changes in correlation between promoter methylation and gene expression in cancer. [europepmc]
- The LET Procedure for Prosthetic Myocontrol: Towards Multi-DOF Control Using Single-DOF Activations. [europepmc]
- Survey of the Heritability and Sparse Architecture of Gene Expression Traits across Human Tissues. [europepmc]
- Prediction of Complex Traits: Robust Alternatives to Best Linear Unbiased Prediction. [europepmc]
- Machine Learning and Radiogenomics: Lessons Learned and Future Directions. [europepmc]
- Evaluating the Columnar Stability of Acoustic Processing in the Human Auditory Cortex. [europepmc]
- Processing complexity increases in superficial layers of human primary auditory cortex. [europepmc]
- Resting-state prefrontal EEG biomarkers in correlation with MMSE scores in elderly individuals. [europepmc]
- Ridge regression and its applications in genetic studies. [europepmc]
- Prediction of plant-level tomato biomass and yield using machine learning with unmanned aerial vehicle imagery. [europepmc]
- Prediction of life satisfaction from resting-state functional connectome. [europepmc]
- Towards Interpretable Deep Learning: A Feature Selection Framework for Prognostics and Health Management Using Deep Neural Networks. [europepmc]
- Prediction of Decline in Global Cognitive Function Using Machine Learning with Feature Ranking of Gait and Physical Fitness Outcomes in Older Adults. [europepmc]
- Lipidomic risk scores are independent of polygenic risk scores and can predict incidence of diabetes and cardiovascular disease in a large population cohort. [europepmc]
- Glycosylation-Related Genes Predict the Prognosis and Immune Fraction of Ovarian Cancer Patients Based on Weighted Gene Coexpression Network Analysis (WGCNA) and Machine Learning. [europepmc]
- Neural representation of phonological information during Chinese character reading. [europepmc]
- Evaluation of Prebiotics through an In Vitro Gastrointestinal Digestion and Fecal Fermentation Experiment: Further Idea on the Implementation of Machine Learning Technique. [europepmc]
- The False Dawn of Polygenic Risk Scores for Human Disease Prediction. [europepmc]
- Immunogenic cell death related risk model to delineate ferroptosis pathway and predict immunotherapy response of patients with GBM. [europepmc]
- Digitalizing breeding in plants: A new trend of next-generation breeding based on genomic prediction. [europepmc]
- A nutritional biomarker score of the Mediterranean diet and incident type 2 diabetes: Integrated analysis of data from the MedLey randomised controlled trial and the EPIC-InterAct case-cohort study. [europepmc]
- Thermodynamics-inspired explanations of artificial intelligence. [europepmc]
- Artificial Intelligence and Machine Learning Applications to Pharmacokinetic Modeling and Dose Prediction of Antibiotics: A Scoping Review. [europepmc]
- Benchtop Proton NMR Spectroscopy for High-Throughput Lipoprotein Quantification in Human Serum and Plasma. [europepmc]
Related