Local Exchangeability

2019/06/22 by Trevor Campbell, Campbell, Trevor, Saifuddin Syed +7 · 2 citations
Computer Science · Mathematics · #Bayesian Methods and Mixture Models #Statistical Methods and Inference #Statistical Methods and Bayesian Inference

paper · pdf · doi:10.3150/22-bej1533

Abstract

Exchangeability -- in which the distribution of an infinite sequence is invariant to reorderings of its elements -- implies the existence of a simple conditional independence structure that may be leveraged in the design of statistical models and inference procedures. In this work, we study a relaxation of exchangeability in which this invariance need not hold precisely. We introduce the notion of local exchangeability -- where swapping data associated with nearby covariates causes a bounded change in the distribution. We prove that locally exchangeable processes correspond to independent observations from an underlying measure-valued stochastic process. Using this main probabilistic result, we show that the local empirical measure of a finite collection of observations provides an approximation of the underlying measure-valued process and Bayesian posterior predictive distributions. The paper concludes with applications of the main theoretical results to a model from Bayesian nonparametrics and covariate-dependent permutation tests.

Cited by

• From Partial Exchangeability to Predictive Probability: A Bayesian Perspective on Classification
• Locally Adaptive Conformal Inference for Operator Models

Related

• Tractability through Exchangeability: A New Perspective on Efficient Probabilistic Inference
• Exchangeable Variable Models
• On a notion of partially conditionally identically distributed sequences
• Exchangeability and randomness for infinite and finite sequences
• Separate Exchangeability as Modeling Principle in Bayesian Nonparametrics