The Vizier Gaussian Process Bandit Algorithm

2024/08/21 by Xingyou Song, Song, Xingyou, Qiuyi Zhang +20 · 3 voices · 6 citations
Computer Science · Decision Sciences · Mathematics · #Advanced Bandit Algorithms Research #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC) #cs.AI #cs.LG #math.OC

paper · pdf · doi:10.48550/arxiv.2408.11527

openalex publication_date 2024/08/21 · arxiv published 2024/08/21 · arxiv updated 2024/12/06 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

Google Vizier has performed millions of optimizations and accelerated numerous research and production systems at Google, demonstrating the success of Bayesian optimization as a large-scale service. Over multiple years, its algorithm has been improved considerably, through the collective experiences of numerous research efforts and user feedback. In this technical report, we discuss the implementation details and design choices of the current default algorithm provided by Open Source Vizier. Our experiments on standardized benchmarks reveal its robustness and versatility against well-established industry baselines on multiple practical modes.

Cited by

• GPTOpt: Towards Efficient LLM-Based Black-Box Optimization
• Efficient Heteroscedastic Bayesian Optimization for Risk-Aware AutoRL
• ZeroShotOpt: Towards Zero-Shot Pretrained Models for Efficient Black-Box Optimization
• RoboBallet: Planning for Multi-Robot Reaching with Graph Neural Networks and Reinforcement Learning
• FoMEMO: Towards Foundation Models for Expensive Multi-objective Optimization
• Performance Prediction for Large Systems via Text-to-Text Regression

Discussions

• The Vizier Gaussian Process Bandit Algorithm [hn, 2 points, 0 comments]
• Regarding 3, one of my favorite things is described at arxiv.org/abs/2408.11527 and is available at github.com/google/vizier. I use this on a near daily basis in my work. [bsky, 1 points, 0 comments]
• The Vizier Gaussian Process Bandit Algorithm [hn, 1 points, 1 comments]

Related

• Open Source Vizier: Distributed Infrastructure and API for Reliable and Flexible Blackbox Optimization
• Optimization as Estimation with Gaussian Processes in Bandit Settings
• Time-Varying Gaussian Process Bandit Optimization
• Taking the Human Out of the Loop: A Review of Bayesian Optimization
• Time-varying Gaussian Process Bandit Optimization with Non-constant Evaluation Time