vix.ing · top · new · best · stats

Top-Two Thompson Sampling for Contextual Top-mc Selection Problems

2023/06/30 by Xinbo Shi, Shi, Xinbo, Peng, Yijie +2 · 1 citation
Computer Science · Decision Sciences · Mathematics · #62F07 (Primary) 62C10 #62L10 (Secondary) #Advanced Multi-Objective Optimization Algorithms #Advanced Statistical Process Monitoring #Asymptotically optimal algorithm #Bayesian probability #Computer science #Context (archaeology) #Convergence (economics) #FOS: Computer and information sciences #FOS: Mathematics #Importance sampling #Machine learning #Mathematical optimization #Mathematics #Methodology (stat.ME) #Optimal Experimental Design Methods #Optimal design #Sample (material) #Sample size determination #Sampling (signal processing) #Sampling design #Selection (genetic algorithm) #Statistics #Statistics Theory (math.ST) #Thompson sampling

paper · pdf · doi:10.48550/arxiv.2306.17704

published in arXiv (Cornell University) (Cornell University)

openalex publication_date 2023/06/30 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

We aim to efficiently allocate a fixed simulation budget to identify the top-mc designs for each context among a finite number of contexts. The performance of each design under a context is measured by an identifiable statistical characteristic, possibly with the existence of nuisance parameters. Under a Bayesian framework, we extend the top-two Thompson sampling method designed for selecting the best design in a single context to the contextual top-mc selection problems, leading to an efficient sampling policy that simultaneously allocates simulation samples to both contexts and designs. To demonstrate the asymptotic optimality of the proposed sampling policy, we characterize the exponential convergence rate of the posterior distribution for a wide range of identifiable sampling distribution families. The proposed sampling policy is proved to be consistent, and asymptotically satisfies a necessary condition for optimality. In particular, when selecting contextual best designs (i.e., mc = 1), the proposed sampling policy is proved to be asymptotically optimal. Numerical experiments demonstrate the good finite sample performance of the proposed sampling policy.

Related