vix.ing · top · new · best · stats

A working guide to boosted regression trees

2008/04/08 by Jane Elith, J. Elith, J. R. Leathwick +3 · 6,522 citations
Computer Science · Environmental Science · Mathematics · #Artificial intelligence #Boosting (machine learning) #Computer science #Data Analysis with R #Data mining #Decision tree #Fish Ecology and Management Studies #Linear regression #Machine learning #Mathematics #Multivariate adaptive regression splines #Outlier #Polynomial regression #Predictive modelling #Regression #Regression analysis #Simple linear regression #Species Distribution and Climate Change #Statistical model #Statistics #Tree (set theory)

paper · pdf · doi:10.1111/j.1365-2656.2008.01390.x

published in Journal of Animal Ecology 77(4), 802-813 (Wiley)

openalex publication_date 2008/04/08 · openalex created_date 2025/10/10 · openalex updated_date 2026/08/05

Abstract

1. Ecologists use statistical models for both explanation and prediction, and need techniques that are flexible enough to express typical features of their data, such as nonlinearities and interactions. 2. This study provides a working guide to boosted regression trees (BRT), an ensemble method for fitting statistical models that differs fundamentally from conventional techniques that aim to fit a single parsimonious model. Boosted regression trees combine the strengths of two algorithms: regression trees (models that relate a response to their predictors by recursive binary splits) and boosting (an adaptive method for combining many simple models to give improved predictive performance). The final BRT model can be understood as an additive regression model in which individual terms are simple trees, fitted in a forward, stagewise fashion. 3. Boosted regression trees incorporate important advantages of tree-based methods, handling different types of predictor variables and accommodating missing data. They have no need for prior data transformation or elimination of outliers, can fit complex nonlinear relationships, and automatically handle interaction effects between predictors. Fitting multiple trees in BRT overcomes the biggest drawback of single tree models: their relatively poor predictive performance. Although BRT models are complex, they can be summarized in ways that give powerful ecological insight, and their predictive performance is superior to most traditional modelling methods. 4. The unique features of BRT raise a number of practical issues in model fitting. We demonstrate the practicalities and advantages of using BRT through a distributional analysis of the short-finned eel (Anguilla australis Richardson), a native freshwater fish of New Zealand. We use a data set of over 13 000 sites to illustrate effects of several settings, and then fit and interpret a model using a subset of the data. We provide code and a tutorial to enable the wider use of BRT by ecologists.

Cited by

Related