2023/08/25 by Zekun Li, Li, Zekun, Qi Lei +5 · 6 citations
Computer Science · Mathematics · #Anomaly Detection Techniques and Applications #Anomaly detection #Artificial intelligence #Classifier (UML) #Computer Vision and Pattern Recognition (cs.CV) #Computer science #Data mining #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Imbalanced Data Classification Techniques #Leverage (statistics) #Machine Learning (cs.LG) #Machine learning #Mathematics #Open set #Outlier #Pattern recognition (psychology)
paper · pdf · doi:10.48550/arxiv.2308.13168
published in arXiv (Cornell University) (Cornell University)
openalex publication_date 2023/08/25 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28
Semi-supervised learning (SSL) aims to leverage massive unlabeled data when labels are expensive to obtain. Unfortunately, in many real-world applications, the collected unlabeled data will inevitably contain unseen-class outliers not belonging to any of the labeled classes. To deal with the challenging open-set SSL task, the mainstream methods tend to first detect outliers and then filter them out. However, we observe a surprising fact that such approach could result in more severe performance degradation when labels are extremely scarce, as the unreliable outlier detector may wrongly exclude a considerable portion of valuable inliers. To tackle with this issue, we introduce a novel open-set SSL framework, IOMatch, which can jointly utilize inliers and outliers, even when it is difficult to distinguish exactly between them. Specifically, we propose to employ a multi-binary classifier in combination with the standard closed-set classifier for producing unified open-set classification targets, which regard all outliers as a single new class. By adopting these targets as open-set pseudo-labels, we optimize an open-set classifier with all unlabeled samples including both inliers and outliers. Extensive experiments have shown that IOMatch significantly outperforms the baseline methods across different benchmark datasets and different settings despite its remarkable simplicity. Our code and models are available at https://github.com/nukezil/IOMatch.