Relative Deviation Learning Bounds and Generalization with Unbounded\n Loss Functions

2013/10/22 by Corinna Cortes, Cortes, Corinna, Spencer Greenberg +3 · 1 citation
Decision Sciences · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multi-Criteria Decision Making

paper · pdf · doi:10.48550/arxiv.1310.5796

openalex publication_date 2013/10/22 · openalex created_date 2022/10/04 · openalex updated_date 2026/07/28

Abstract

We present an extensive analysis of relative deviation bounds, including\ndetailed proofs of two-sided inequalities and their implications. We also give\ndetailed proofs of two-sided generalization bounds that hold in the general\ncase of unbounded loss functions, under the assumption that a moment of the\nloss is bounded. These bounds are useful in the analysis of importance\nweighting and other learning tasks such as unbounded regression.\n

Cited by

• Complexity Dependent Error Rates for Physics-informed Statistical Learning via the Small-ball Method

Related

• Relative Deviation Margin Bounds
• Uniform Deviation Bounds for Unbounded Loss Functions like k-Means
• Tight Lower Bound on the Probability of a Binomial Exceeding its\n Expectation
• Generalization Bounds via Convex Analysis
• Distribution-dependent concentration inequalities for tighter generalization bounds