2023/12/13 by Nicolás García Trillos, Trillos, Nicolas Garcia, Bodhisattva Sen +1 · 2 citations
Environmental Science · Mathematics · #FOS: Computer and information sciences #FOS: Mathematics #Groundwater flow and contamination studies #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Markov Chains and Monte Carlo Methods #Optimization and Control (math.OC) #Statistical Methods and Inference #Statistics Theory (math.ST)
paper · pdf · doi:10.48550/arxiv.2312.08135
openalex publication_date 2023/12/13 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28
In the standard formulation of the denoising problem, one is given a probabilistic model relating a latent variable Θ∈ Ω⊂ ℝm (m≥ 1) and an observation Z ∈ ℝd according to: Z | Θ∼ p(⋅| Θ) and Θ∼ G^*, and the goal is to construct a map to recover the latent variable from the observation. The posterior mean, a natural candidate for estimating Θ from Z, attains the minimum Bayes risk (under the squared error loss) but at the expense of over-shrinking the Z, and in general may fail to capture the geometric features of the prior distribution G^* (e.g., low dimensionality, discreteness, sparsity, etc.). To rectify these drawbacks, we take a new perspective on this denoising problem that is inspired by optimal transport (OT) theory and use it to study a different, OT-based, denoiser at the population level setting. We rigorously prove that, under general assumptions on the model, this OT-based denoiser is mathematically well-defined and unique, and is closely connected to the solution to a Monge OT problem. We then prove that, under appropriate identifiability assumptions on the model, the OT-based denoiser can be recovered solely from information of the marginal distribution of Z and the posterior mean of the model, after solving a linear relaxation problem over a suitable space of couplings that is reminiscent of standard multimarginal OT problems. In particular, thanks to Tweedie's formula, when the likelihood model \ p(⋅ | θ) \θ∈ Ω is an exponential family of distributions, the OT based-denoiser can be recovered solely from the marginal distribution of Z. In general, our family of OT-like relaxations is of interest in its own right and for the denoising problem suggests alternative numerical methods inspired by the rich literature on computational OT.