Incremental Learning of Chunk Data for Online Pattern Classification Systems
- 12 March 2008
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks
- Vol. 19 (6), 1061-1074
- https://doi.org/10.1109/tnn.2007.2000059
Abstract
This paper presents a pattern classification system in which feature extraction and classifier learning are simultaneously carried out not only online but also in one pass where training samples are presented only once. For this purpose, we have extended incremental principal component analysis (IPCA) and some classifier models were effectively combined with it. However, there was a drawback in this approach that training samples must be learned one by one due to the limitation of IPCA. To overcome this problem, we propose another extension of IPCA called chunk IPCA in which a chunk of training samples is processed at a time. In the experiments, we evaluate the classification performance for several large-scale data sets to discuss the scalability of chunk IPCA under one-pass incremental learning environments. The experimental results suggest that chunk IPCA can reduce the training time effectively as compared with IPCA unless the number of input attributes is too large. We study the influence of the size of initial training data and the size of given chunk data on classification accuracy and learning time. We also show that chunk IPCA can obtain major eigenvectors with fairly good approximation.Keywords
This publication has 33 references indexed in Scilit:
- Incremental Hierarchical Discriminant RegressionIEEE Transactions on Neural Networks, 2007
- Parameter Incremental Learning Algorithm for Neural NetworksIEEE Transactions on Neural Networks, 2006
- An Incremental Subspace Learning Algorithm to Categorize Large Scale Text DataLecture Notes in Computer Science, 2005
- Candid covariance-free incremental principal component analysisIEEE Transactions on Pattern Analysis and Machine Intelligence, 2003
- An incremental learning method for face recognition under continuous video streamPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Kernel Eigenfaces vs. Kernel Fisherfaces: Face recognition using kernel methodsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Merging and splitting eigenspace modelsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2000
- Incremental learning methods with retrieving of interfered patternsIEEE Transactions on Neural Networks, 1999
- Learning to LearnPublished by Springer Science and Business Media LLC ,1998
- Incremental Induction of Decision TreesMachine Learning, 1989