vix.ing · top · new · best · stats · spec

Estimating the Operating Characteristics of Ensemble Methods

2017/10/24 by Anthony Gamst, Gamst, Anthony, Jay-Calvin Reyes +3
Computer Science · #Anomaly Detection Techniques and Applications #FOS: Computer and information sciences #Machine Learning (stat.ML) #Machine Learning and Data Classification #Neural Networks and Applications

paper · pdf · doi:10.48550/arxiv.1710.08952

openalex publication_date 2017/10/24 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

In this paper we present a technique for using the bootstrap to estimate the operating characteristics and their variability for certain types of ensemble methods. Bootstrapping a model can require a huge amount of work if the training data set is large. Fortunately in many cases the technique lets us determine the effect of infinite resampling without actually refitting a single model. We apply the technique to the study of meta-parameter selection for random forests. We demonstrate that alternatives to bootstrap aggregation and to considering √(d) features to split each node, where d is the number of features, can produce improvements in predictive accuracy.

Citations

Related