2014/01/01 by Andreas Mayr, Harald Binder, Olaf Gefeller +1
Mathematics · Medicine · #Advanced Statistical Methods and Models #Artificial intelligence #Boosting (machine learning) #Computer science #Medicine #Statistical Methods and Bayesian Inference #Statistical Methods and Inference #stat.ME
paper · pdf · doi:10.3414/me13-01-0123
published as Methods Inf Med 2014; 53(6): 428-435
openalex publication_date 2014/01/01 · arxiv created 2014/11/18 · arxiv updated 2014/11/19 · openalex created_date 2016/06/24 · openalex updated_date 2026/08/05
BACKGROUND: Boosting algorithms to simultaneously estimate and select predictor effects in statistical models have gained substantial interest during the last decade. OBJECTIVES: This review highlights recent methodological developments regarding boosting algorithms for statistical modelling especially focusing on topics relevant for biomedical research. METHODS: We suggest a unified framework for gradient boosting and likelihood-based boosting (statistical boosting) which have been addressed separately in the literature up to now. RESULTS: The methodological developments on statistical boosting during the last ten years can be grouped into three different lines of research: i) efforts to ensure variable selection leading to sparser models, ii) developments regarding different types of predictor effects and how to choose them, iii) approaches to extend the statistical boosting framework to new regression settings. CONCLUSIONS: Statistical boosting algorithms have been adapted to carry out unbiased variable selection and automated model choice during the fitting process and can nowadays be applied in almost any regression setting in combination with a large amount of different types of predictor effects.