vix.ing · top · new · best · stats · spec

Confidence intervals for the random forest generalization error

2021/12/11 by Paulo C. Marques F., F, Paulo C. Marques
Computer Science · Environmental Science · #FOS: Computer and information sciences #Gaussian Processes and Bayesian Inference #Landslides and related hazards #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Neural Networks and Applications

paper · pdf · doi:10.48550/arxiv.2112.06101

openalex publication_date 2021/12/11 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

We show that the byproducts of the standard training process of a random forest yield not only the well known and almost computationally free out-of-bag point estimate of the model generalization error, but also give a direct path to compute confidence intervals for the generalization error which avoids processes of data splitting and model retraining. Besides the low computational cost involved in their construction, these confidence intervals are shown through simulations to have good coverage and appropriate shrinking rate of their width in terms of the training sample size.

Related