vix.ing · top · new · best · stats · spec

Learning from a Complementary-label Source Domain: Theory and Algorithms

2020/08/04 by Yiyang Zhang, Feng Liu, Zhang, Yiyang +10 · 2 citations
Computer Science · Mathematics · Medicine · #COVID-19 diagnosis using AI #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Multimodal Machine Learning Applications #cs.LG #stat.ML

paper · pdf · doi:10.48550/arxiv.2008.01454

arXiv admin note: text overlap with arXiv:2007.14612

arxiv created 2020/08/04 · openalex publication_date 2020/08/04 · arxiv updated 2021/03/05 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

In unsupervised domain adaptation (UDA), a classifier for the target domain is trained with massive true-label data from the source domain and unlabeled data from the target domain. However, collecting fully-true-label data in the source domain is high-cost and sometimes impossible. Compared to the true labels, a complementary label specifies a class that a pattern does not belong to, hence collecting complementary labels would be less laborious than collecting true labels. Thus, in this paper, we propose a novel setting that the source domain is composed of complementary-label data, and a theoretical bound for it is first proved. We consider two cases of this setting, one is that the source domain only contains complementary-label data (completely complementary unsupervised domain adaptation, CC-UDA), and the other is that the source domain has plenty of complementary-label data and a small amount of true-label data (partly complementary unsupervised domain adaptation, PC-UDA). To this end, a complementary label adversarial network (CLARINET) is proposed to solve CC-UDA and PC-UDA problems. CLARINET maintains two deep networks simultaneously, where one focuses on classifying complementary-label source data and the other takes care of source-to-target distributional adaptation. Experiments show that CLARINET significantly outperforms a series of competent baselines on handwritten-digits-recognition and objects-recognition tasks.

Citations

Cited by

Related