vix.ing · top · new · best · stats · spec

Evaluating Aleatoric Uncertainty via Conditional Generative Models

2022/06/09 by Ziyi Huang, Huang, Ziyi, Henry Lam +3 · 3 citations
Computer Science · #FOS: Computer and information sciences #Gaussian Processes and Bayesian Inference #Generative Adversarial Networks and Image Synthesis #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Music and Audio Processing

paper · pdf · doi:10.48550/arxiv.2206.04287

openalex publication_date 2022/06/09 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

Aleatoric uncertainty quantification seeks for distributional knowledge of random responses, which is important for reliability analysis and robustness improvement in machine learning applications. Previous research on aleatoric uncertainty estimation mainly targets closed-formed conditional densities or variances, which requires strong restrictions on the data distribution or dimensionality. To overcome these restrictions, we study conditional generative models for aleatoric uncertainty estimation. We introduce two metrics to measure the discrepancy between two conditional distributions that suit these models. Both metrics can be easily and unbiasedly computed via Monte Carlo simulation of the conditional generative models, thus facilitating their evaluation and training. We demonstrate numerically how our metrics provide correct measurements of conditional distributional discrepancies and can be used to train conditional models competitive against existing benchmarks.

Cited by

Related