vix.ing · top · new · best · stats

Teacher-Student Competition for Unsupervised Domain Adaptation

2020/10/19 by Ruixin Xiao, Xiao, Ruixin, Zhilei Liu +3
Computer Science · Medicine · #COVID-19 diagnosis using AI #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #cs.CV #cs.LG

paper · pdf · doi:10.48550/arxiv.2010.09572

Accepted by ICPR 2020

openalex publication_date 2020/10/19 · arxiv created 2020/10/20 · arxiv updated 2020/10/21 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

With the supervision from source domain only in class-level, existing unsupervised domain adaptation (UDA) methods mainly learn the domain-invariant representations from a shared feature extractor, which causes the source-bias problem. This paper proposes an unsupervised domain adaptation approach with Teacher-Student Competition (TSC). In particular, a student network is introduced to learn the target-specific feature space, and we design a novel competition mechanism to select more credible pseudo-labels for the training of student network. We introduce a teacher network with the structure of existing conventional UDA method, and both teacher and student networks compete to provide target pseudo-labels to constrain every target sample's training in student network. Extensive experiments demonstrate that our proposed TSC framework significantly outperforms the state-of-the-art domain adaptation methods on Office-31 and ImageCLEF-DA benchmarks.

Citations

Related