Multi-Target XGBoostLSS Regression

2022/10/13 by März, Alexander · 1 citation
#FOS: Computer and information sciences #Machine Learning (cs.LG)

paper · doi:10.48550/arxiv.2210.06831

Abstract

Current implementations of Gradient Boosting Machines are mostly designed for single-target regression tasks and commonly assume independence between responses when used in multivariate settings. As such, these models are not well suited if non-negligible dependencies exist between targets. To overcome this limitation, we present an extension of XGBoostLSS that models multiple targets and their dependencies in a probabilistic regression setting. Empirical results show that our approach outperforms existing GBMs with respect to runtime and compares well in terms of accuracy.

Cited by

• Multivariate Uncertainty Quantification with Tomographic Quantile Forests

Related

• Feature Interactions in XGBoost
• Distributional Gradient Boosting Machines
• A Generalized Stacking for Implementing Ensembles of Gradient Boosting Machines
• Gradient tree boosting with random output projections for multi-label classification and multi-output regression
• A Simple and Fast Baseline for Tuning Large XGBoost Models