Solving Nonstationary Classification Problems With Coupled Support Vector Machines
- 9 November 2010
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks
- Vol. 22 (1), 37-51
- https://doi.org/10.1109/tnn.2010.2083684
Abstract
Many learning problems may vary slowly over time: in particular, some critical real-world applications. When facing this problem, it is desirable that the learning method could find the correct input-output function and also detect the change in the concept and adapt to it. We introduce the time-adaptive support vector machine (TA-SVM), which is a new method for generating adaptive classifiers, capable of learning concepts that change with time. The basic idea of TA-SVM is to use a sequence of classifiers, each one appropriate for a small time window but, in contrast to other proposals, learning all the hyperplanes in a global way. We show that the addition of a new term in the cost function of the set of SVMs (that penalizes the diversity between consecutive classifiers) produces a coupling of the sequence that allows TA-SVM to learn as a single adaptive classifier. We evaluate different aspects of the method using appropriate drifting problems. In particular, we analyze the regularizing effect of changing the number of classifiers in the sequence or adapting the strength of the coupling. A comparison with other methods in several problems, including the well-known STAGGER dataset and the real-world electricity pricing domain, shows the good performance of TA-SVM in all tested situations.Keywords
This publication has 40 references indexed in Scilit:
- Learn$^{++}$.NC: Combining Ensemble of Classifiers With Dynamically Weighted Consult-and-Vote for Efficient Incremental Learning of New ClassesIEEE Transactions on Neural Networks, 2008
- Time-Adaptive Support Vector MachinesINTELIGENCIA ARTIFICIAL, 2008
- Dynamic integration of classifiers for handling concept driftInformation Fusion, 2008
- Online Learning with KernelsIEEE Transactions on Signal Processing, 2004
- An introduction to kernel-based learning algorithmsIEEE Transactions on Neural Networks, 2001
- An overview of statistical learning theoryIEEE Transactions on Neural Networks, 1999
- Exponentiated Gradient versus Gradient Descent for Linear PredictorsInformation and Computation, 1997
- Experience with a learning personal assistantCommunications of the ACM, 1994
- The Weighted Majority AlgorithmInformation and Computation, 1994
- Incremental learning from noisy dataMachine Learning, 1986