vix.ing · top · new · best · stats · spec

Prediction Using a Bayesian Heteroscedastic Composite Gaussian Process

2019/06/25 by Casey Davis, Davis, Casey B., Christopher M. Hans +3
Computer Science · Decision Sciences · #Advanced Multi-Objective Optimization Algorithms #FOS: Computer and information sciences #Gaussian Processes and Bayesian Inference #Methodology (stat.ME) #Probabilistic and Robust Engineering Design

paper · pdf · doi:10.48550/arxiv.1906.10737

openalex publication_date 2019/06/25 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

This research proposes a flexible Bayesian extension of the composite Gaussian process (CGP) model of Ba and Joseph (2012) for predicting (stationary or) non-stationary y(x). The CGP generalizes the regression plus stationary Gaussian process (GP) model by replacing the regression term with a GP. The new model, Y(x), can accommodate large-scale trends estimated by a global GP, local trends estimated by an independent local GP, and a third process to describe heteroscedastic data in which Var(Y(x)) can depend on the inputs. This paper proposes a prior which ensures that the fitted global mean is smoother than the local deviations, and extends the covariance structure of the CGP to allow for differentially-weighted global and local components. A Markov chain Monte Carlo algorithm is proposed to provide posterior estimates of the parameters, including the values of the heteroscedastic variance at the training and test data locations. The posterior distribution is used to make predictions and to quantify the uncertainty of the predictions using prediction intervals. The method is illustrated using both stationary and non-stationary y(x).

Related