vix.ing · top · new · best · stats · spec

Predictively Oriented Posteriors

2025/10/02 by Yann McLatchie, McLatchie, Yann, Badr-Eddine Cherief-Abdellatif +5 · 1 voice · 2 citations
Engineering · #Topology Optimization in Engineering #stat.ME #stat.ML

paper · pdf · doi:10.48550/arxiv.2510.01915

openalex publication_date 2025/10/02 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

We advocate for a new statistical principle that combines the most desirable aspects of both parameter inference and density estimation. This leads us to the predictively oriented (PrO) posterior, which expresses uncertainty as a consequence of predictive ability. We show that these posteriors converge to the predictively optimal model average and predictively dominate both classical and generalised Bayes posterior predictive distributions. Further, PrO posteriors adapt to the level of model misspecification: while they concentrate around the true model in the same way as classical and generalised Bayesian strategies if the model can recover the data-generating distribution, they do not concentrate around a single model in the presence of non-trivial forms of model misspecification. Instead, they stabilise towards a non-degenerate predictively optimal posterior distribution that represents a form of irreducible uncertainty due to model misspecification. We put forward a sampling algorithm for PrO posteriors based on mean field Langevin dynamics, and verify the practical significance of our theoretical developments on a number of numerical examples.

Cited by

Discussions

Related