vix.ing · top · new · best · stats · spec

Clustering with a Reject Option: Interactive Clustering as Bayesian Prior Elicitation

2016/06/19 by Akash Srivastava, James Zou, Srivastava, Akash +5
Computer Science · Mathematics · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #cs.LG #stat.ML

paper · pdf · doi:10.48550/arxiv.1606.05896

presented at 2016 ICML Workshop on Human Interpretability in Machine Learning (WHI 2016), New York, NY

arxiv created 2016/06/19 · arxiv updated 2016/06/21

Abstract

A good clustering can help a data analyst to explore and understand a data set, but what constitutes a good clustering may depend on domain-specific and application-specific criteria. These criteria can be difficult to formalize, even when it is easy for an analyst to know a good clustering when they see one. We present a new approach to interactive clustering for data exploration called TINDER, based on a particularly simple feedback mechanism, in which an analyst can reject a given clustering and request a new one, which is chosen to be different from the previous clustering while fitting the data well. We formalize this interaction in a Bayesian framework as a method for prior elicitation, in which each different clustering is produced by a prior distribution that is modified to discourage previously rejected clusterings. We show that TINDER successfully produces a diverse set of clusterings, each of equivalent quality, that are much more diverse than would be obtained by randomized restarts.

Related