A Survey on Transfer Learning
Top Cited Papers
- 16 October 2009
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Knowledge and Data Engineering
- Vol. 22 (10), 1345-1359
- https://doi.org/10.1109/tkde.2009.191
Abstract
A major assumption in many machine learning and data mining algorithms is that the training and future data must be in the same feature space and have the same distribution. However, in many real-world applications, this assumption may not hold. For example, we sometimes have a classification task in one domain of interest, but we only have sufficient training data in another domain of interest, where the latter data may be in a different feature space or follow a different data distribution. In such cases, knowledge transfer, if done successfully, would greatly improve the performance of learning by avoiding much expensive data-labeling efforts. In recent years, transfer learning has emerged as a new learning framework to address this problem. This survey focuses on categorizing and reviewing the current progress on transfer learning for classification, regression, and clustering problems. In this survey, we discuss the relationship between transfer learning and other related machine learning techniques such as domain adaptation, multitask learning and sample selection bias, as well as covariate shift. We also explore some potential future issues in transfer learning research.Keywords
This publication has 50 references indexed in Scilit:
- Actively Transfer Domain KnowledgeLecture Notes in Computer Science, 2008
- Kernel-Based Inductive TransferLecture Notes in Computer Science, 2008
- Modeling Transfer Relationships Between Learning Tasks for Improved Inductive TransferLecture Notes in Computer Science, 2008
- An Algorithm for Transfer Learning in a Heterogeneous EnvironmentLecture Notes in Computer Science, 2008
- Transferring Knowledge from Another Domain for Learning Action ModelsLecture Notes in Computer Science, 2008
- Top 10 algorithms in data miningKnowledge and Information Systems, 2007
- Transfer Learning in Reinforcement Learning Problems Through Partial Policy RecyclingLecture Notes in Computer Science, 2006
- 10 CHALLENGING PROBLEMS IN DATA MINING RESEARCHInternational Journal of Information Technology & Decision Making, 2006
- Markov logic networksMachine Learning, 2006
- Improving predictive inference under covariate shift by weighting the log-likelihood functionJournal of Statistical Planning and Inference, 2000