2024/02/29 by Martin Larsson, Aaditya Ramdas, Larsson, Martin +3 · 6 citations
Agricultural and Biological Sciences · Computer Science · Decision Sciences · #Agriculture and Rural Development Research #Constraint Satisfaction and Optimization #FOS: Computer and information sciences #FOS: Mathematics #Methodology (stat.ME) #Scheduling and Timetabling Solutions #Statistics Theory (math.ST)
paper · pdf · doi:10.48550/arxiv.2402.18810
openalex publication_date 2024/02/29 · openalex created_date 2024/03/26 · openalex updated_date 2026/07/28
We consider testing a composite null hypothesis P against a point alternative Q using e-variables, which are nonnegative random variables X such that 𝔼P[X] ≤ 1 for every P ∈ P. This paper establishes a fundamental result: under no conditions whatsoever on P or Q, there exists a special e-variable X^* that we call the numeraire, which is strictly positive and satisfies 𝔼Q[X/X^*] ≤ 1 for every other e-variable X. In particular, X^* is log-optimal in the sense that 𝔼Q[log(X/X^*)] ≤ 0. Moreover, X^* identifies a particular sub-probability measure P^* via the density d P^*/d Q = 1/X^*. As a result, X^* can be seen as a generalized likelihood ratio of Q against P. We show that P^* coincides with the reverse information projection (RIPr) when additional assumptions are made that are required for the latter to exist. Thus P^* is a natural definition of the RIPr in the absence of any assumptions on P or Q. In addition to the abstract theory, we provide several tools for finding the numeraire and RIPr in concrete cases. We discuss several nonparametric examples where we can indeed identify the numeraire and RIPr, despite not having a reference measure. Our results have interpretations outside of testing in that they yield the optimal Kelly bet against P if we believe reality follows Q. We end with a more general optimality theory that goes beyond the ubiquitous logarithmic utility. We focus on certain power utilities, leading to reverse Rényi projections in place of the RIPr, which also always exist.