Kernel Logistic Regression and the Import Vector Machine
- 1 March 2005
- journal article
- Published by Taylor & Francis Ltd in Journal of Computational and Graphical Statistics
- Vol. 14 (1), 185-205
- https://doi.org/10.1198/106186005x25619
Abstract
The support vector machine (SVM) is known for its good performance in two-class classification, but its extension to multiclass classification is still an ongoing research issue. In this article, we propose a new approach for classification, called the import vector machine (IVM), which is built on kernel logistic regression (KLR). We show that the IVM not only performs as well as the SVM in two-class classification, but also can naturally be generalized to the multiclass case. Furthermore, the IVM provides an estimate of the underlying probability. Similar to the support points of the SVM, the IVM model uses only a fraction of the training data to index kernel basis functions, typically a much smaller fraction than the SVM. This gives the IVM a potential computational advantage over the SVM.Keywords
This publication has 14 references indexed in Scilit:
- Multicategory Support Vector MachinesJournal of the American Statistical Association, 2004
- Boosting With theL2LossJournal of the American Statistical Association, 2003
- The Consistency of Greedy Algorithms for ClassificationLecture Notes in Computer Science, 2002
- Support Vector Machines and the Bayes Rule in ClassificationData Mining and Knowledge Discovery, 2002
- Tensor product space ANOVA modelsThe Annals of Statistics, 2000
- Prediction Games and Arcing AlgorithmsNeural Computation, 1999
- Multicategory Classification by Support Vector MachinesComputational Optimization and Applications, 1999
- A Decision-Theoretic Generalization of On-Line Learning and an Application to BoostingJournal of Computer and System Sciences, 1997
- Hybrid Adaptive SplinesJournal of the American Statistical Association, 1997
- Some results on Tchebycheffian spline functionsJournal of Mathematical Analysis and Applications, 1971