Projection-Based Ensemble Learning for Ordinal Regression
Open Access
- 27 June 2013
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Cybernetics
- Vol. 44 (5), 681-694
- https://doi.org/10.1109/tcyb.2013.2266336
Abstract
The classification of patterns into naturally ordered labels is referred to as ordinal regression. This paper proposes an ensemble methodology specifically adapted to this type of problem, which is based on computing different classification tasks through the formulation of different order hypotheses. Every single model is trained in order to distinguish between one given class (k) and all the remaining ones, while grouping them in those classes with a rank lower than k, and those with a rank higher than k. Therefore, it can be considered as a reformulation of the well-known one-versus-all scheme. The base algorithm for the ensemble could be any threshold (or even probabilistic) method, such as the ones selected in this paper: kernel discriminant analysis, support vector machines and logistic regression (LR) (all reformulated to deal with ordinal regression problems). The method is seen to be competitive when compared with other state-of-the-art methodologies (both ordinal and nominal), by using six measures and a total of 15 ordinal datasets. Furthermore, an additional set of experiments is used to study the potential scalability and interpretability of the proposed method when using LR as base methodology for the ensemble.Keywords
This publication has 23 references indexed in Scilit:
- Exploitation of Pairwise Class Distances for Ordinal ClassificationNeural Computation, 2013
- Can Machine Learning Techniques Help to Improve the Common Fisheries Policy?Lecture Notes in Computer Science, 2013
- Ordinal extreme learning machineNeurocomputing, 2010
- Ensemble-based classifiersArtificial Intelligence Review, 2009
- The WEKA data mining softwareACM SIGKDD Explorations Newsletter, 2009
- Support Vector Ordinal RegressionNeural Computation, 2007
- A Cost Sensitive Technique for Ordinal Classification ProblemsLecture Notes in Computer Science, 2004
- A comparison of methods for multiclass support vector machinesIEEE Transactions on Neural Networks, 2002
- On combining classifiersIeee Transactions On Pattern Analysis and Machine Intelligence, 1998
- Support-vector networksMachine Learning, 1995