Selective inference in regression models with groups of variables

2015/11/04 by Joshua R. Loftus, Loftus, Joshua R., Jonathan E. Taylor +1
Mathematics · #62J05 #FOS: Computer and information sciences #FOS: Mathematics #Methodology (stat.ME) #Statistics Theory (math.ST) #math.ST #msc:62J05 #stat.ME #stat.TH

paper · pdf · doi:10.48550/arxiv.1511.01478

16 pages, 4 figures

arxiv created 2015/11/04 · arxiv updated 2015/11/05

Abstract

We provide a general mathematical framework for selective inference with supervised model selection procedures characterized by quadratic forms in the outcome variable. Forward stepwise with groups of variables is an important special case as it allows models with categorical variables or factors. Models can be chosen by AIC, BIC, or a fixed number of steps. We provide an exact significance test for each group of variables in the selected model based on an appropriately truncated χ or F distribution for the cases of known and unknown σ² respectively. An efficient software implementation is available as a package in the R statistical programming language.

Related

• A significance test for forward stepwise model selection
• Selective Inference for Group-Sparse Linear Models
• Selective inference after likelihood- or test-based model selection in linear models
• Optimal Inference After Model Selection
• Significance Testing and Group Variable Selection