Multivariate Adaptive Regression Splines
1991/03/01 by Jerome H. Friedman · 92 citations
Computer Science · Engineering · #Neural Networks and Applications #Control Systems and Identification #Image and Signal Denoising Methods
paper · pdf · doi:10.1214/aos/1176347963
Abstract
A new method is presented for flexible regression modeling of high dimensional data. The model takes the form of an expansion in product spline basis functions, where the number of basis functions as well as the parameters associated with each one (product degree and knot locations) are automatically determined by the data. This procedure is motivated by the recursive partitioning approach to regression and shares its attractive properties. Unlike recursive partitioning, however, this method produces continuous models with continuous derivatives. It has more power and flexibility to model relationships that are nearly additive or involve interactions in at most a few variables. In addition, the model can be represented in a form that separately identifies the additive contributions and those associated with the different multivariable interactions.
Citations
Cited by
- Climate change effects on marine protected areas: Projected decline of benthic species in the North Sea
- Gaussian Processes and Limiting Linear Models
- Computing Affine Combinations, Distances, and Correlations for Recursive Partition Functions
- Ensemble Learning for Blending Gridded Satellite and Gauge-Measured Precipitation Data
- Coupling machine learning, tree-based and statistical models with cellular automata to simulate urban growth
- Contrast transfer functions help quantify neural network out-of-distribution generalization in HRTEM
- Sparse kernel learning with LASSO and Bayesian inference algorithm
- Characterization and Identification of Cloudified Mobile Network Performance Bottlenecks
- Modeling of species distributions with Maxent: new extensions and a comprehensive evaluation
- Weighting-Based Treatment Effect Estimation via Distribution Learning
- Reliable Prediction Intervals for Local Linear Regression
- Statistical comparison of classifiers through Bayesian hierarchical\n modelling
- Groundwater potential mapping using C5.0, random forest, and multivariate adaptive regression spline models in GIS
- Adaptive Risk Bounds in Univariate Total Variation Denoising and Trend Filtering
- Assessing variable activity for Bayesian regression trees
- The Future of Sensitivity Analysis: An essential discipline for systems modeling and policy support
- The SKIM-FA Kernel: High-Dimensional Variable Selection and Nonlinear\n Interaction Discovery in Linear Time
- Collinearity: a review of methods to deal with it and a simulation study evaluating their performance
- MATSuMoTo: The MATLAB Surrogate Model Toolbox For Computationally Expensive Black-Box Global Optimization Problems
- Multidimensional wavelet frames
- Optimal Design Emulators: A Point Process Approach
- An Efficient Algorithm for Automatic Structure Optimization in X-ray\n Standing-Wave Experiments
- Tree-Based Bayesian Treatment Effect Analysis
- Heterogeneous impact of motion on fundamental patterns of developmental changes in functional connectivity during youth
- Computational methods for local regression
- Predicting Nearly As Well As the Optimal Twice Differentiable Regressor
- GBDT-MO: Gradient Boosted Decision Trees for Multiple Outputs
- Confronting the Challenge of Modeling Cloud and Precipitation Microphysics
- VCBART: Bayesian Trees for Varying Coefficients
- Online Binary Space Partitioning Forests
- Climate-driven invasion risk and ecological niche overlap between non-native round goby and native European fishes
- Sample selection bias and presence‐only distribution models: implications for background and pseudo‐absence data
- Nonparametric regression using linear combinations of basis functions
- Four Generations of High-Dimensional Neural Network Potentials
- The Optimal Dynamic Treatment Rule SuperLearner: Considerations, Performance, and Application
- Analysis of purely random forests bias
- On the consistency of supervised learning with missing values
- Modeling Weather Conditions Consequences on Road Trafficking Behaviors
- Patient Returns to the Emergency Department: The Time-to-return Curve
- Bayesian Adaptive Polynomial Chaos Expansions
- Invited Commentary: Demystifying Statistical Inference When Using Machine Learning in Causal Research
- Robust Nonparametric Regression with Deep Neural Networks
- Surrogate modelling for sustainable building design – A review
- Reshuffling of Azorean Coastal Marine Biodiversity Amid Climate Change
- Trimmed Constrained Mixed Effects Models: Formulations and Algorithms
- Real-valued All-Dimensions search: Low-overhead rapid searching over subsets of attributes
- Cases for the nugget in modeling computer experiments
- A Framework for an Assessment of the Kernel-target Alignment in Tree Ensemble Kernel Learning
- Experimental Study on 164 Algorithms Available in Software Tools for Solving Standard Non-Linear Regression Problems
- A Solution for Large Scale Nonlinear Regression with High Rank and\n Degree at Constant Memory Complexity via Latent Tensor Reconstruction
- Neural Networks and the Bias/Variance Dilemma
- Bayesian Additive Regression Trees using Bayesian model averaging
- Refined gap analysis for biodiversity conservation under climate change
- A Double Machine Learning Approach for the Evaluation of COVID‐19 Vaccine Effectiveness Under the Test‐Negative Design: Analysis of Québec Administrative Data
- A Novel Feature-Based Approach to Characterize Algorithm Performance for the Traveling Salesman Problem
- Studying habitat requirements in extremely small, peripheral populations: An assessment of the barred warbler <i>Curruca nisoria</i> in the Italian Alps
- Learning Tensors in Reproducing Kernel Hilbert Spaces with Multilinear Spectral Penalties
- Bat Migration Intensifies Cave Fish Richness Loss Under Climate Change in China
- Quantitative forecasting of bed sediment load in river engineering: an investigation into machine learning methodologies for complex phenomena
- Bayesian Probabilistic Numerical Integration with Tree-Based Models
- Dynamic Trees for Learning and Design
- Using spatially‐nested hierarchical species distribution models to estimate current and future distributions of a cryptic species at a regional scale
- The Effect of Heteroscedasticity on Regression Trees
- Nonparametric Bayesian Classification
- A Simple and Effective Model-Based Variable Importance Measure
- Automated Algorithm Selection: Survey and Perspectives
- BMB-LIME: LIME with modeling local nonlinearity and uncertainty in explainability
- Stochastic spectral embedding
- Machine Learning for Variance Reduction in Online Experiments
- Hierarchical Mixtures of Experts and the EM Algorithm
- A Simple Method for Detecting Interactions between a Treatment and a Large Number of Covariates
- sdm: a reproducible and extensible R platform for species distribution modelling
- Efficient hinging hyperplanes neural network and its application in nonlinear system identification
- RobustGaSP: Robust Gaussian Stochastic Process Emulation in R
- Spline regression with automatic knot selection
- Analysis of a Random Forests Model
- Local Linear Forests
- Utilizing Ensemble Learning for Performance and Power Modeling and Improvement of Parallel Cancer Deep Learning CANDLE Benchmarks
- PaloBoost: An Overfitting-robust TreeBoost with Out-of-Bag Sample Regularization Techniques
- Adaptive Non-Parametric Regression With the K-NN Fused Lasso
- The Wrath of KAN: Enabling Fast, Accurate, and Transparent Emulation of the Global 21 cm Cosmology Signal
- Muddling Labels for Regularization, a novel approach to generalization
- Horseshoe Forests for High-Dimensional Causal Survival Analysis
- Variable Grouping Based Bayesian Additive Regression Tree
- Nonlinear variable selection with continuous outcome: a nonparametric incremental forward stagewise approach
- One-step Targeted Maximum Likelihood for Time-to-event Outcomes
- Phylogeography and ecological niche modelling reveal a geographical break in the genetic structure of <i>Boana crepitans</i> (Anura: Hylidae) during the Pleistocene in Eastern Brazil
- One-step ahead sequential Super Learning from short times series of many slightly dependent data, and anticipating the cost of natural disasters
- Fuzzy Mixed Integer Optimization Model for Regression Approach
- On Approximate Dynamic Programming with Multivariate Splines for Adaptive Control
- Generalised additive and index models with shape constraints
- Muddling Label Regularization: Deep Learning for Tabular Datasets
Related