vix.ing · top · new · best · stats · spec

Online Learning in Case of Unbounded Losses Using the Follow Perturbed Leader Algorithm

2010/08/25 by Vladimir V. V’yugin, V'yugin, Vladimir V.
Computer Science · Decision Sciences · #Advanced Bandit Algorithms Research #Auction Theory and Applications #FOS: Computer and information sciences #Machine Learning (cs.LG) #Reinforcement Learning in Robotics

paper · pdf · doi:10.48550/arxiv.1008.4232

openalex publication_date 2010/08/25 · openalex created_date 2016/06/24 · openalex updated_date 2026/07/28

Abstract

In this paper the sequential prediction problem with expert advice is considered for the case where losses of experts suffered at each step cannot be bounded in advance. We present some modification of Kalai and Vempala algorithm of following the perturbed leader where weights depend on past losses of the experts. New notions of a volume and a scaled fluctuation of a game are introduced. We present a probabilistic algorithm protected from unrestrictedly large one-step losses. This algorithm has the optimal performance in the case when the scaled fluctuations of one-step losses of experts of the pool tend to zero.

Citations

Related