Regularized multi--task learning
- 22 August 2004
- conference paper
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 109-117
- https://doi.org/10.1145/1014052.1014067
Abstract
Past empirical work has shown that learning multiple related tasks from data simultaneously can be advantageous in terms of predictive performance relative to learning these tasks independently. In this paper we present an approach to multi--task learning based on the minimization of regularization functionals similar to existing ones, such as the one for Support Vector Machines (SVMs), that have been successfully used in the past for single--task learning. Our approach allows to model the relation between tasks in terms of a novel kernel function that uses a task--coupling parameter. We implement an instance of the proposed approach similar to SVMs and test it empirically using simulated as well as real data. The experimental results show that the proposed method performs better than existing multi--task learning methods and largely outperforms single--task learning using SVMs.Keywords
This publication has 15 references indexed in Scilit:
- Exploiting Task Relatedness for Multiple Task LearningLecture Notes in Computer Science, 2003
- Modeling Consumer Demand for VarietyMarketing Science, 2002
- A theoretical framework for learning from a pool of disparate data sourcesPublished by Association for Computing Machinery (ACM) ,2002
- Improving Parameter Estimates and Model Prediction by Aggregate Customization in Choice ExperimentsJournal of Consumer Research, 2001
- Regularization Networks and Support Vector MachinesAdvances in Computational Mathematics, 2000
- 10.1162/153244304322765658Applied Physics Letters, 2000
- Marketing models of consumer heterogeneityJournal of Econometrics, 1998
- A Hierarchical Bayes Model of Primary and Secondary DemandMarketing Science, 1998
- The Parallel Transfer of Task Knowledge Using Dynamic Learning Rates Based on a Measure of RelatednessConnection Science, 1996
- Hierarchical Mixtures of Experts and the EM AlgorithmNeural Computation, 1994