vix.ing · top · new · best · stats · spec

Discriminative Learning of the Prototype Set for Nearest Neighbor Classification

2015/09/27 by Shin Ando, Ando, Shin
Computer Science · Mathematics · #Advanced Statistical Methods and Models #Face and Expression Recognition #Machine Learning and Data Classification #cs.LG

paper · pdf · doi:10.48550/arxiv.1509.08102

arxiv created 2018/01/06 · arxiv updated 2018/01/09

Abstract

The nearest neighbor rule is a classic yet essential classification model, particularly in problems where the supervising information is given by pairwise dissimilarities and the embedding function are not easily obtained. Prototype selection provides means of generalization and improving efficiency of the nearest neighbor model, but many existing methods assume and rely on the analyses of the input vector space. In this paper, we explore a dissimilarity-based, parametrized model of the nearest neighbor rule. In the proposed model, the selection of the nearest prototypes is influenced by the parameters of the respective prototypes. It provides a formulation for minimizing the violation of the extended nearest neighbor rule over the training set in a tractable form to exploit numerical techniques. We show that the minimization problem reduces to a large-margin principle learning and demonstrate its advantage by empirical comparisons with other prototype selection methods.

Related