vix.ing · top · new · best · stats · spec

Information Criterion for a Large Scale Subset Regression Models

2023/09/15 by Genshiro Kitagawa, Kitagawa, Genshiro
Computer Science · Mathematics · #62F07(Primary) #62H12(Secondary) #Advanced Statistical Methods and Models #FOS: Computer and information sciences #Face and Expression Recognition #Methodology (stat.ME) #Neural Networks and Applications

paper · pdf · doi:10.48550/arxiv.2309.08110

openalex publication_date 2023/09/15 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

The information criterion for determining the number of explanatory variables in a subset regression modeling is discussed. Information criterion such as AIC is effective and frequently used in model selection for ordinary regression models and statistical models. With the recent prosperity of data science, analysis of large-scale data has become important. When constructing models heuristically from a very large number of candidate explanatory variables, there is a possibility of picking up apparent correlations and adopting inappropriate variables. In this paper, we point out the problems specific to subset regression from the viewpoint of bias correction for log-likelihood and present a correction method that takes this into account.

Related