A Comprehensive Survey on Transfer Learning

2020/07/07 by Fuzhen Zhuang, Zhiyuan Qi, Keyu Duan +5 · 167 citations
Computer Science · #Domain Adaptation and Few-Shot Learning #Machine Learning and ELM #Multimodal Machine Learning Applications

paper · doi:10.1109/jproc.2020.3004555

openalex publication_date 2020/07/07 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/31

Abstract

Transfer learning aims at improving the performance of target learners on target domains by transferring the knowledge contained in different but related source domains. In this way, the dependence on a large number of target-domain data can be reduced for constructing target learners. Due to the wide application prospects, transfer learning has become a popular and promising area in machine learning. Although there are already some valuable and impressive surveys on transfer learning, these surveys introduce approaches in a relatively isolated way and lack the recent advances in transfer learning. Due to the rapid expansion of the transfer learning area, it is both necessary and challenging to comprehensively review the relevant studies. This survey attempts to connect and systematize the existing transfer learning research studies, as well as to summarize and interpret the mechanisms and the strategies of transfer learning in a comprehensive way, which may help readers have a better understanding of the current research status and ideas. Unlike previous surveys, this survey article reviews more than 40 representative transfer learning approaches, especially homogeneous transfer learning approaches, from the perspectives of data and model. The applications of transfer learning are also briefly introduced. In order to show the performance of different transfer learning models, over 20 representative transfer learning models are used for experiments. The models are performed on three different data sets, that is, Amazon Reviews, Reuters-21578, and Office-31, and the experimental results demonstrate the importance of selecting appropriate transfer learning models for different applications in practice.

Citations

• On Information and Sufficiency
• ImageNet classification with deep convolutional neural networks

Cited by

• Mind the Gap: Does Brain Age Improve Alzheimer’s Disease Prediction?
• MemBrain v2: an end-to-end tool for the analysis of membranes in cryo-electron tomography
• Mind the Gap: Does Brain Age Improve Alzheimer’s Disease Prediction?
• Updating methods for artificial intelligence–based clinical prediction models: a scoping review
• Touchless fingerprint recognition: A survey of recent developments and challenges
• PIER: Physics-Informed Environmental Retrieval for Time-Series Modeling
• LC-SLab -- An object-based deep learning framework for large-scale land cover classification from satellite imagery and sparse in-situ labels
• Parameter-Efficient Continual Fine-Tuning: A Survey
• The PanAf-SBR Dataset: Social Behaviour Recognition for Wild Great Apes
• Leveraging Large Language Models for Generating Research Topic Ontologies: A Multi-Disciplinary Study
• opXRD: Open Experimental Powder X-ray Diffraction Database
• A Theory of Label Propagation for Subpopulation Shift
• AutoFreeze: Automatically Freezing Model Blocks to Accelerate Fine-tuning
• Exploring Syn-to-Real Domain Adaptation for Military Target Detection
• OpenSpliceAI: An efficient, modular implementation of SpliceAI enabling easy retraining on non-human species
• LIGAR: Lightweight General-purpose Action Recognition
• AutoFed: Personalized Federated Traffic Prediction via Adaptive Prompt
• Cross-Semantic Transfer Learning for High-Dimensional Linear Regression
• A Turn Toward Better Alignment: Few-Shot Generative Adaptation with Equivariant Feature Rotation
• Application of deep learning approaches for medieval historical documents transcription
• Inverse-Designed Phase Prediction in Digital Lasers Using Deep Learning and Transfer Learning
• From entropic constraints to reinforced processes: a probabilistic origin of multiscale measures
• Transfer Learning-Based Surrogate Modeling for Nonlinear Time-History Response Analysis of High-Fidelity Structural Models
• Type II and Type III Solar Radio Burst Classification Using Transfer Learning
• LogICL: Distilling LLM Reasoning to Bridge the Semantic Gap in Cross-Domain Log Anomaly Detection
• Enhancing Knowledge Transfer in Hyperspectral Image Classification via Cross-scene Knowledge Integration
• Phase-OTDR Event Detection Using Image-Based Data Transformation and Deep Learning
• Unsupervised domain adaptation via double classifiers based on high confidence pseudo label
• Feature Engineering vs. Deep Learning for Automated Coin Grading: A Comparative Study on Saint-Gaudens Double Eagles
• ASCIIBench: Evaluating Language-Model-Based Understanding of Visually-Oriented Text
• Empowering Things with Intelligence: A Survey of the Progress, Challenges, and Opportunities in Artificial Intelligence of Things
• MorphingDB: A Task-Centric AI-Native DBMS for Model Management and Inference
• MetaRank: Task-Aware Metric Selection for Model Transferability Estimation
• Escaping Optimization Stagnation: Taking Steps Beyond Task Arithmetic via Difference Vectors
• Deep Learning Framework for Enhanced Neutrino Reconstruction of Single-line Events in the ANTARES Telescope
• A Physics Informed Machine Learning Framework for Optimal Sensor Placement and Parameter Estimation
• Testing relevant difference in high-dimensional linear regression with applications to detect transferability
• DCL-SE: Dynamic Curriculum Learning for Spatiotemporal Encoding of Brain Imaging
• GREAT: Generalizable Representation Enhancement via Auxiliary Transformations for Zero-Shot Environmental Prediction
• Identifying Layers Susceptible to Adversarial Attacks
• Goal-Oriented Multi-Agent Reinforcement Learning for Decentralized Agent Teams
• Toward Dignity-Aware AI: Next-Generation Elderly Monitoring from Fall Detection to ADL
• Differentially Private Federated Multi-Task Learning Framework for Enhancing Human-to-Virtual Connectivity in Human Digital Twin
• OpenSpliceAI provides an efficient modular implementation of SpliceAI enabling easy retraining across nonhuman species
• Escaping the Big Data Paradigm with Compact Transformers
• Context-aware Learned Mesh-based Simulation via Trajectory-Level Meta-Learning
• Archaeological Classification of Small Datasets Using Meta- and Transfer Learning Methods: A Case Study on Hittite Stele Fragments
• Learning with less: label-efficient land cover classification at very high spatial resolution using self-supervised deep learning
• An Efficient and Generalizable Transfer Learning Method for Weather Condition Detection on Ground Terminals
• Active transfer learning for structural health monitoring
• A Three-Stage Bayesian Transfer Learning Framework to Improve Predictions in Data-Scarce Domains
• Multi-random ensemble on Partial Least Squares regression to predict wheat yield and its losses across water and nitrogen stress with hyperspectral remote sensing
• Learning by Cheating : An End-to-End Zero Shot Framework for Autonomous\n Drone Navigation
• Recent Advances in Named Entity Recognition: A Comprehensive Survey and Comparative Study
• Multi-hazard risk assessment and management: pathways for the Sendai Framework and beyond
• Artificial neural network fine-tuning to increase accuracy of low-thrust space trajectory cost approximators
• CvS: Classification via Segmentation For Small Datasets
• Dos and Don'ts of Machine Learning in Computer Security
• Automatic detection for bioacoustic research: a practical guide from and for biologists and computer scientists
• Stepwise Transfer Learning for Expert-level Pediatric Brain Tumor MRI Segmentation in a Limited Data Scenario
• Hierarchical Graph Networks for Accurate Weather Forecasting via Lightweight Training
• Learning Upper Lower Value Envelopes to Shape Online RL: A Principled Approach
• FedMicro-IDA: A Federated Learning and Microservices-based Framework for IoT Data Analytics
• Transfer Learning Beyond the Standard Model
• Adaptive transfer learning for surgical tool presence detection in laparoscopic videos through gradual freezing fine-tuning
• Regularizing Nighttime Weirdness: Efficient Self-supervised Monocular Depth Estimation in the Dark
• Transfer learning graph representations of molecules for pKa, ¹³ C-NMR, and solubility
• Adaptive Sample Sharing for Linear Regression
• A Preliminary Exploration of the Differences and Conjunction of Traditional PNT and Brain-inspired PNT
• Transfer Learning for Benign Overfitting in High-Dimensional Linear Regression
• Current state and prospects of artificial intelligence in allergy
• Transfer Learning with Distance Covariance for Random Forest: Error Bounds and an EHR Application
• Image-to-Video Transfer Learning based on Image-Language Foundation Models: A Comprehensive Survey
• Artificial intelligence-driven approaches in antibiotic stewardship programs and optimizing prescription practices: A systematic review
• Few-shot Molecular Property Prediction: A Survey
• Beyond Real Data: Synthetic Data through the Lens of Regularization
• On the Role of Calibration in Benchmarking Algorithmic Fairness for Skin Cancer Detection
• CGO-ensemble: Chaos game optimization algorithm-based fusion of deep neural networks for accurate Mpox detection
• Agentic Context Engineering: Evolving Contexts for Self-Improving Language Models
• Cross-Modal Reconstruction Pretraining for Ramp Flow Prediction at Highway Interchanges
• Time series predictions in unmonitored sites: a survey of machine learning techniques in water resources
• Identifying Transfer Learning in the Reshaping of Inductive Biases
• Category Discovery: An Open-World Perspective
• Enhancing Vehicle Detection under Adverse Weather Conditions with Contrastive Learning
• POEM: Explore Unexplored Reliable Samples to Enhance Test-Time Adaptation
• Prompt-Aware Scheduling for Low-Latency LLM Serving
• Statistical Inference Leveraging Synthetic Data with Distribution-Free Guarantees
• SMILES-Inspired Transfer Learning for Quantum Operators in Generative Quantum Eigensolver
• epiGPTope: A Machine Learning-Based Epitope Generator and Classifier
• Arm2Air: Cross-Embodiment Skeleton Transfer for 3D Relay Formation
• Reprogramming pretrained language models for protein sequence representation learning
• Literature review on vulnerability detection using NLP technology
• No Labels Needed: Zero-Shot Image Classification with Collaborative Self-Learning
• VQEzy: An Open-Source Dataset for Parameter Initialization in Variational Quantum Eigensolvers
• IPF-RDA: An Information-Preserving Framework for Robust Data Augmentation
• SETrLUSI: Stochastic Ensemble Multi-Source Transfer Learning Using Statistical Invariant
• Simulating a Bias Mitigation Scenario in Large Language Models
• Merging Physics-Based Synthetic Data and Machine Learning for Thermal Monitoring of Lithium-ion Batteries: The Role of Data Fidelity
• The compressible Neural Particle Method for Simulating Compressible Viscous Fluid Flows
• Multi-Label Transfer Learning in Non-Stationary Data Streams
• IP-Basis PINNs: Efficient Multi-Query Inverse Parameter Estimation
• Robust and Adaptive Spectral Method for Representation Multi-Task Learning with Contamination
• Repeating vs. Non-Repeating FRBs: A Deep Learning Approach To Morphological Characterization
• SPINN: An Optimal Self-Supervised Physics-Informed Neural Network Framework
• An Analysis of Layer-Freezing Strategies for Enhanced Transfer Learning in YOLO Architectures
• Artificial intelligence for representing and characterizing quantum systems
• Delta Activations: A Representation for Finetuned Large Language Models
• A Neural Network Approach to Multi-radionuclide TDCR Beta Spectroscopy
• Towards Out-Of-Distribution Generalization: A Survey
• Automatic Identification and Description of Jewelry Through Computer Vision and Neural Networks for Translators and Interpreters
• DINE: Domain Adaptation from Single and Multiple Black-box Predictors
• Deep CNNs for Peripheral Blood Cell Classification
• One Joke to Rule them All? On the (Im)possibility of Generalizing Humor
• Efficient Multi-Source Knowledge Transfer by Model Merging
• Learning a Universal Template for Few-shot Dataset Generalization
• Cross-Cancer Knowledge Transfer in WSI-based Prognosis Prediction
• Transfer Learning for Neutrino Scattering: Domain Adaptation with GANs
• CryptPEFT: Efficient and Private Neural Network Inference via Parameter-Efficient Fine-Tuning
• ViPTT-Net: Video pretraining of spatio-temporal model for tuberculosis type classification from chest CT scans
• Holistic Bioprocess Development Across Scales Using Multi-Fidelity Batch Bayesian Optimization
• A dataset and model for recognition of audiologically relevant environments for hearing aids: AHEAD-DS and YAMNet+
• rETF-semiSL: Semi-Supervised Learning for Neural Collapse in Temporal Data
• Online Data Generation for MIMO-OFDM Channel Denoising: Transfer Learning vs. Meta Learning
• Cross-Subject and Cross-Montage EEG Transfer Learning via Individual Tangent Space Alignment and Spatial-Riemannian Feature Fusion
• From Source to Target: Leveraging Transfer Learning for Predictive Process Monitoring in Organizations
• ProteoKnight: Convolution-based phage virion protein classification and uncertainty analysis
• An Interpretable Multi-Plane Fusion Framework With Kolmogorov-Arnold Network Guided Attention Enhancement for Alzheimer's Disease Diagnosis
• From Detection to Correction: Backdoor-Resilient Face Recognition via Vision-Language Trigger Detection and Noise-Based Neutralization
• No Masks Needed: Explainable AI for Deriving Segmentation from Classification
• Model Recycling Framework for Multi-Source Data-Free Supervised Transfer Learning
• The hierarchical barycenter: conditional probability simulation with structured and unobserved covariates
• Formal Bayesian Transfer Learning via the Total Risk Prior
• Generalized few-shot transfer learning architecture for modeling the EDFA gain spectrum
• Bridging AI Innovation and Healthcare Needs: Lessons Learned from Incorporating Modern NLP at The BC Cancer Registry
• Handling Out-of-Distribution Data: A Survey
• A Concept for Efficient Scalability of Automated Driving Allowing for Technical, Legal, Cultural, and Ethical Differences
• A CNN-based intelligent optimization framework for bleaching powder production
• Synergistic Integration of Flood Inundation Modeling Methods: A Review of Computational, Data‐Driven, Observational and Experimental, and Conceptual Models
• A Comprehensive Survey on Source-Free Domain Adaptation
• Conceptually Diverse Base Model Selection for Meta-Learners in Concept\n Drifting Data Streams
• Thermal state monitoring of lithium-ion batteries: Progress, challenges, and opportunities
• Mining Program Properties From Neural Networks Trained on Source Code Embeddings
• Skin Lesion Segmentation and Multiclass Classification Using Deep Learning Features and Improved Moth Flame Optimization. [europepmc]
• Deep transfer learning and data augmentation improve glucose levels prediction in type 2 diabetes patients. [europepmc]
• Transfer Learning in Magnetic Resonance Brain Imaging: A Systematic Review. [europepmc]
• Dynamic memory to alleviate catastrophic forgetting in continual learning with medical imaging. [europepmc]
• Opportunities and Challenges for Machine Learning in Rare Diseases. [europepmc]
• A Novel Multistage Transfer Learning for Ultrasound Breast Cancer Image Classification. [europepmc]
• A review of some techniques for inclusion of domain-knowledge into deep neural networks. [europepmc]
• Classification of brain tumours in MR images using deep spatiospatial models. [europepmc]
• Deep Learning With Radiomics for Disease Diagnosis and Treatment: Challenges and Potential. [europepmc]
• Deep Learning for Smart Healthcare-A Survey on Brain Tumor Detection from Medical Imaging. [europepmc]
• Microbiome-based disease prediction with multimodal variational information bottlenecks. [europepmc]
• A Machine-Learning-Based Risk-Prediction Tool for HIV and Sexually Transmitted Infections Acquisition over the Next 12 Months. [europepmc]
• Transfer learning for medical image classification: a literature review. [europepmc]
• Automatic Classification System for Periapical Lesions in Cone-Beam Computed Tomography. [europepmc]
• Transfer learning: a friendly introduction. [europepmc]
• Applications of Artificial Intelligence to Obesity Research: Scoping Review of Methodologies. [europepmc]
• Deep learning methods for drug response prediction in cancer: Predominant and emerging trends. [europepmc]
• A systematic review of neurophysiological sensing for the assessment of acute pain. [europepmc]
• Recent Advances in Deep Learning for Protein-Protein Interaction Analysis: A Comprehensive Review. [europepmc]
• Deep Learning for Medical Image-Based Cancer Diagnosis. [europepmc]
• The past, current, and future of neonatal intensive care units with artificial intelligence: a systematic review. [europepmc]
• Machine-learned wearable sensors for real-time hand-motion recognition: toward practical applications. [europepmc]
• Transfer learning with graph neural networks for improved molecular property prediction in the multi-fidelity setting. [europepmc]
• Screening and diagnosis of cardiovascular disease using artificial intelligence-enabled cardiac magnetic resonance imaging. [europepmc]
• Predicting Pseudomonas aeruginosa drug resistance using artificial intelligence and clinical MALDI-TOF mass spectra. [europepmc]

Related

• A Comprehensive Survey on Transfer Learning
• A Concise Review of Transfer Learning
• A Survey on Transfer Learning
• Research Frontiers in Transfer Learning -- a systematic and bibliometric review
• Learning to Transfer