Graph-Based Approaches for Over-Sampling in the Context of Ordinal Regression
- 30 October 2014
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Knowledge and Data Engineering
- Vol. 27 (5), 1233-1245
- https://doi.org/10.1109/tkde.2014.2365780
Abstract
The classification of patterns into naturally ordered labels is referred to as ordinal regression or ordinal classification. Usually, this classification setting is by nature highly imbalanced, because there are classes in the problem that are a priori more probable than others. Although standard over-sampling methods can improve the classification of minority classes in ordinal classification, they tend to introduce severe errors in terms of the ordinal label scale, given that they do not take the ordering into account. A specific ordinal over-sampling method is developed in this paper for the first time in order to improve the performance of machine learning classifiers. The method proposed includes ordinal information by approaching over-sampling from a graph-based perspective. The results presented in this paper show the good synergy of a popular ordinal regression method (a reformulation of support vector machines) with the graph-based proposed algorithms, and the possibility of improving both the classification and the ordering of minority classes. A cost-sensitive version of the ordinal regression method is also introduced and compared with the over-sampling proposals, showing in general lower performance for minority classes.Keywords
Funding Information
- Ministerial Commission of Science and Technology (TIN2011-22794)
- “Junta de Andalucía” (P11-TIC-7508)
- EPSRC (EP/J017515/1)
This publication has 26 references indexed in Scilit:
- Metrics to guide a multi-objective evolutionary algorithm for ordinal classificationNeurocomputing, 2014
- An organ allocation system for liver transplantation based on ordinal regressionApplied Soft Computing, 2013
- Exploitation of Pairwise Class Distances for Ordinal ClassificationNeural Computation, 2013
- Projection-Based Ensemble Learning for Ordinal RegressionIEEE Transactions on Cybernetics, 2013
- Towards a theoretical foundation for Laplacian-based manifold methodsJournal of Computer and System Sciences, 2008
- A study of the behaviour of linguistic fuzzy rule based classification systems in the framework of imbalanced data-setsFuzzy Sets and Systems, 2007
- Support Vector Ordinal RegressionNeural Computation, 2007
- Modelling ordinal relations with SVMs: An application to objective aesthetic evaluation of breast cancer conservative treatmentNeural Networks, 2005
- Support-vector networksMachine Learning, 1995
- A note on two problems in connexion with graphsNumerische Mathematik, 1959