Domain Adaptation via Transfer Component Analysis

2010/11/23 by Sinno Jialin Pan, Ivor W. Tsang, James T. Kwok +1 · 14 citations
Computer Science · #Domain Adaptation and Few-Shot Learning #Speech Recognition and Synthesis #Speech and Audio Processing

paper · doi:10.1109/tnn.2010.2091281

openalex publication_date 2010/11/23 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/15

Abstract

Domain adaptation allows knowledge from a source domain to be transferred to a different but related target domain. Intuitively, discovering a good feature representation across domains is crucial. In this paper, we first propose to find such a representation through a new learning method, transfer component analysis (TCA), for domain adaptation. TCA tries to learn some transfer components across domains in a reproducing kernel Hilbert space using maximum mean miscrepancy. In the subspace spanned by these transfer components, data properties are preserved and data distributions in different domains are close to each other. As a result, with the new representations in this subspace, we can apply standard machine learning methods to train classifiers or regression models in the source domain for use in the target domain. Furthermore, in order to uncover the knowledge hidden in the relations between the data labels from the source and target domains, we extend TCA in a semisupervised learning setting, which encodes label information into transfer components learning. We call this extension semisupervised TCA. The main contribution of our work is that we propose a novel dimensionality reduction framework for reducing the distance between domains in a latent space for domain adaptation. We propose both unsupervised and semisupervised feature extraction approaches, which can dramatically reduce the distance between domain distributions by projecting data onto the learned transfer components. Finally, our approach can handle large datasets and naturally lead to out-of-sample generalization. The effectiveness and efficiency of our approach are verified by experiments on five toy datasets and two real-world applications: cross-domain indoor WiFi localization and cross-domain text classification.

Cited by

• DAMSDAN: Distribution-Aware Multi-Source Domain Adaptation Network for Cross-Domain EEG-based Emotion Recognition
• Machine Learning Workflows in Climate Modeling: Design Patterns and Insights from Case Studies
• VDM-DA: Virtual Domain Modeling for Source Data-free Domain Adaptation
• A Survey on Transfer Learning
• An Advanced Convolutional Neural Network for Bearing Fault Diagnosis under Limited Data
• "A 6 or a 9?": Ensemble Learning Through the Multiplicity of Performant Models and Explanations
• MATL-DC: A Multi-domain Aggregation Transfer Learning Framework for EEG Emotion Recognition with Domain-Class Prototype under Unseen Targets
• Uncertainty Awareness on Unsupervised Domain Adaptation for Time Series Data
• Open Set Domain Adaptation for Image and Action Recognition
• Subspace Alignment For Domain Adaptation
• Align, Don't Divide: Revisiting the LoRA Architecture in Multi-Task Learning
• Model Recycling Framework for Multi-Source Data-Free Supervised Transfer Learning
• MPCA-based Domain Adaptation for Transfer Learning in Ultrasonic Guided Waves
• Learning from Heterogeneous Structural MRI via Collaborative Domain Adaptation for Late-Life Depression Assessment
• Partial Domain Adaptation via Importance Sampling-based Shift Correction

Related

• Cross Domain Adaptation by Learning Partially Shared Classifiers and Weighting Source Data Points in the Shared Subspaces
• A novel transfer learning method based on common space mapping and weighted domain matching
• TLR: Transfer Latent Representation for Unsupervised Domain Adaptation
• Unsupervised Domain Adaptation for Extra Features in the Target Domain Using Optimal Transport
• Domain-Augmented Domain Adaptation