Interclass Interference Suppression in Multi-Class Problems
Open Access
- 5 January 2021
- journal article
- research article
- Published by MDPI AG in Applied Sciences
- Vol. 11 (1), 450
- https://doi.org/10.3390/app11010450
Abstract
Multi-classifiers are widely applied in many practical problems. But the features that can significantly discriminate a certain class from others are often deleted in the feature selection process of multi-classifiers, which seriously decreases the generalization ability. This paper refers to this phenomenon as interclass interference in multi-class problems and analyzes its reason in detail. Then, this paper summarizes three interclass interference suppression methods including the method based on all-features, one-class classifiers and binary classifiers and compares their effects on interclass interference via the 10-fold cross-validation experiments in 14 UCI datasets. Experiments show that the method based on binary classifiers can suppress the interclass interference efficiently and obtain the best classification accuracy among the three methods. Further experiments were done to compare the suppression effect of two methods based on binary classifiers including the one-versus-one method and one-versus-all method. Results show that the one-versus-one method can obtain a better suppression effect on interclass interference and obtain better classification accuracy. By proposing the concept of interclass inference and studying its suppression methods, this paper significantly improves the generalization ability of multi-classifiers.Funding Information
- National Natural Science Foundation of China (No. 51976042)
This publication has 36 references indexed in Scilit:
- Multiclass From Binary: Expanding One-Versus-All, One-Versus-One and ECOC-Based ApproachesIEEE Transactions on Neural Networks and Learning Systems, 2013
- Dynamic classifier selection for One-vs-One strategy: Avoiding non-competent classifiersPattern Recognition, 2013
- Recognition of human activities using SVM multi-class classifierPattern Recognition Letters, 2010
- Interference-less neural network trainingNeurocomputing, 2008
- Comparing mathematical and heuristic approaches for scientific data analysisArtificial Intelligence for Engineering Design, Analysis and Manufacturing, 2007
- Integrated patch model: A generative model for image categorization based on feature selectionPattern Recognition Letters, 2007
- Rudiments of rough setsInformation Sciences, 2007
- Generalization error for multi-class margin classificationElectronic Journal of Statistics, 2007
- Support Vector Data DescriptionMachine Learning, 2004
- KERNEL WHITENING FOR ONE-CLASS CLASSIFICATIONInternational Journal of Pattern Recognition and Artificial Intelligence, 2003