2020/03/15 by Chris U. Carmona, Carmona, Chris U., Geoff K. Nicholls +1 · 3 citations
Computer Science · #Bayesian Methods and Mixture Models #FOS: Computer and information sciences #FOS: Mathematics #Gaussian Processes and Bayesian Inference #Machine Learning (stat.ML) #Machine Learning and Algorithms #Methodology (stat.ME) #Statistics Theory (math.ST)
paper · pdf · doi:10.48550/arxiv.2003.06804
openalex publication_date 2020/03/15 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28
Bayesian statistical inference loses predictive optimality when generative models are misspecified. Working within an existing coherent loss-based generalisation of Bayesian inference, we show existing Modular/Cut-model inference is coherent, and write down a new family of Semi-Modular Inference (SMI) schemes, indexed by an influence parameter, with Bayesian inference and Cut-models as special cases. We give a meta-learning criterion and estimation procedure to choose the inference scheme. This returns Bayesian inference when there is no misspecification. The framework applies naturally to Multi-modular models. Cut-model inference allows directed information flow from well-specified modules to misspecified modules, but not vice versa. An existing alternative power posterior method gives tunable but undirected control of information flow, improving prediction in some settings. In contrast, SMI allows tunable and directed information flow between modules. We illustrate our methods on two standard test cases from the literature and a motivating archaeological data set.