An adaptive classifier design for high-dimensional data analysis with a limited training data set
- 1 December 2001
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Geoscience and Remote Sensing
- Vol. 39 (12), 2664-2679
- https://doi.org/10.1109/36.975001
Abstract
Proposes a self-learning and self-improving adaptive classifier to mitigate the problem of small training sample size that can severely affect the recognition accuracy of classifiers when the dimensionality of the multispectral data is high. This proposed adaptive classifier utilizes classified samples (referred to as semilabeled samples) in addition to original training samples iteratively. In order to control the influence of semilabeled samples, the proposed method gives full weight to the training samples and reduced weight to semilabeled samples. The authors show that by using additional semilabeled samples that are available without extra cost, the additional class label information may be extracted and utilized to enhance statistics estimation and hence improve the classifier performance, and therefore the Hughes phenomenon (peak phenomenon) may be mitigated. Experimental results show this proposed adaptive classifier can improve the classification accuracy as well as representation of estimated statistics significantly.This publication has 4 references indexed in Scilit:
- The effect of unlabeled samples in reducing the small sample size problem and mitigating the Hughes phenomenonIEEE Transactions on Geoscience and Remote Sensing, 1994
- Mixture Densities, Maximum Likelihood and the EM AlgorithmSIAM Review, 1984
- Information and mixtures of two normal distributionsJournal of Statistical Computation and Simulation, 1977
- On the mean accuracy of statistical pattern recognizersIEEE Transactions on Information Theory, 1968