Large Margin Distribution Machine

2013/11/05 by Teng Zhang, Zhi‐Hua Zhou, Zhang, Teng +1 · 1 citation
Computer Science · #Face and Expression Recognition #Machine Learning and ELM #Text and Document Classification Technologies

paper · pdf · doi:10.48550/arxiv.1311.0989

Abstract

Support vector machine (SVM) has been one of the most popular learning algorithms, with the central idea of maximizing the minimum margin, i.e., the smallest distance from the instances to the classification boundary. Recent theoretical results, however, disclosed that maximizing the minimum margin does not necessarily lead to better generalization performances, and instead, the margin distribution has been proven to be more crucial. In this paper, we propose the Large margin Distribution Machine (LDM), which tries to achieve a better generalization performance by optimizing the margin distribution. We characterize the margin distribution by the first- and second-order statistics, i.e., the margin mean and variance. The LDM is a general learning approach which can be used in any place where SVM can be applied, and its superiority is verified both theoretically and empirically in this paper.

Citations

• A Decision-Theoretic Generalization of On-Line Learning and an Application to Boosting

Cited by

• Structure-Preserving Margin Distribution Learning for High-Order Tensor Data with Low-Rank Decomposition

Related

• Near-Tight Margin-Based Generalization Bounds for Support Vector\n Machines
• On the Precise Error Analysis of Support Vector Machines
• Effects of the optimisation of the margin distribution on generalisation in deep architectures
• Scalable Optimal Margin Distribution Machine
• Comparison theorems on large-margin learning