vix.ing · top · new · best · stats

Abstaining Classification When Error Costs are Unequal and Unknown

2018/06/09 by Hongjiao Guan, Yingtao Zhang, Guan, Hongjiao +6 · 2 citations
Computer Science · Mathematics · #Algorithm #Anomaly Detection Techniques and Applications #Artificial intelligence #Bounded function #Computer Vision and Pattern Recognition (cs.CV) #Computer science #FOS: Computer and information sciences #Imbalanced Data Classification Techniques #Mathematics #Power (physics) #Receiver operating characteristic #Reliability (semiconductor) #Software Engineering Research #Statistics #Type I and type II errors #Word error rate #cs.CV

paper · pdf · doi:10.48550/arxiv.1806.03445

published in arXiv (Cornell University) (Cornell University)

openalex publication_date 2018/06/09 · arxiv created 2018/07/25 · arxiv updated 2018/07/26 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

Abstaining classificaiton aims to reject to classify the easily misclassified examples, so it is an effective approach to increase the clasificaiton reliability and reduce the misclassification risk in the cost-sensitive applications. In such applications, different types of errors (false positive or false negative) usaully have unequal costs. And the error costs, which depend on specific applications, are usually unknown. However, current abstaining classification methods either do not distinguish the error types, or they need the cost information of misclassification and rejection, which are realized in the framework of cost-sensitive learning. In this paper, we propose a bounded-abstention method with two constraints of reject rates (BA2), which performs abstaining classification when error costs are unequal and unknown. BA2 aims to obtain the optimal area under the ROC curve (AUC) by constraining the reject rates of the positive and negative classes respectively. Specifically, we construct the receiver operating characteristic (ROC) curve, and stepwise search the optimal reject thresholds from both ends of the curve, untill the two constraints are satisfied. Experimental results show that BA2 obtains higher AUC and lower total cost than the state-of-the-art abstaining classification methods. Meanwhile, BA2 achieves controllable reject rates of the positive and negative classes.

Citations

Related