Derivation of Output Correlation Inferences for Multi-Output (aka Multi-Task) Gaussian Process

2025/01/14 by Watanabe, Shuhei · 1 citation
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)

paper · doi:10.48550/arxiv.2501.07964

Abstract

Gaussian process (GP) is arguably one of the most widely used machine learning algorithms in practice. One of its prominent applications is Bayesian optimization (BO). Although the vanilla GP itself is already a powerful tool for BO, it is often beneficial to be able to consider the dependencies of multiple outputs. To do so, Multi-task GP (MTGP) is formulated, but it is not trivial to fully understand the derivations of its formulations and their gradients from the previous literature. This paper serves friendly derivations of the MTGP formulations and their gradients.

Cited by

• From Local Interactions to Global Operators: Scalable Gaussian Process Operator for Physical Systems

Related

• Multi-Output Robust and Conjugate Gaussian Processes
• A conditional one-output likelihood formulation for multitask Gaussian processes
• Heterogeneous Multi-output Gaussian Process Prediction
• Ensemble Multi-task Gaussian Process Regression with Multiple Latent Processes
• Large Linear Multi-output Gaussian Process Learning