vix.ing · top · new · best · stats · spec

Self-explaining variational posterior distributions for Gaussian Process models

2021/09/08 by Sarem Seitz, Seitz, Sarem
Computer Science · Engineering · #Advanced Multi-Objective Optimization Algorithms #FOS: Computer and information sciences #Gaussian Processes and Bayesian Inference #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Reservoir Engineering and Simulation Methods

paper · pdf · doi:10.48550/arxiv.2109.03708

openalex publication_date 2021/09/08 · openalex created_date 2021/09/13 · openalex updated_date 2026/07/28

Abstract

Bayesian methods have become a popular way to incorporate prior knowledge and a notion of uncertainty into machine learning models. At the same time, the complexity of modern machine learning makes it challenging to comprehend a model's reasoning process, let alone express specific prior assumptions in a rigorous manner. While primarily interested in the former issue, recent developments intransparent machine learning could also broaden the range of prior information that we can provide to complex Bayesian models. Inspired by the idea of self-explaining models, we introduce a corresponding concept for variational GaussianProcesses. On the one hand, our contribution improves transparency for these types of models. More importantly though, our proposed self-explaining variational posterior distribution allows to incorporate both general prior knowledge about a target function as a whole and prior knowledge about the contribution of individual features.

Citations

Related