Reacting to Different Types of Concept Drift: The Accuracy Updated Ensemble Algorithm
Top Cited Papers
- 4 April 2013
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks and Learning Systems
- Vol. 25 (1), 81-94
- https://doi.org/10.1109/tnnls.2013.2251352
Abstract
Data stream mining has been receiving increased attention due to its presence in a wide range of applications, such as sensor networks, banking, and telecommunication. One of the most important challenges in learning from data streams is reacting to concept drift, i.e., unforeseen changes of the stream's underlying data distribution. Several classification algorithms that cope with concept drift have been put forward, however, most of them specialize in one type of change. In this paper, we propose a new data stream classifier, called the Accuracy Updated Ensemble (AUE2), which aims at reacting equally well to different types of drift. AUE2 combines accuracy-based weighting mechanisms known from block-based ensembles with the incremental nature of Hoeffding Trees. The proposed algorithm is experimentally compared with 11 state-of-the-art stream methods, including single classifiers, block-based and online ensembles, and hybrid approaches in different drift scenarios. Out of all the compared algorithms, AUE2 provided best average classification accuracy while proving to be less memory consuming than other ensemble approaches. Experimental results show that AUE2 can be considered suitable for scenarios, involving many types of drift as well as static environments.Keywords
This publication has 23 references indexed in Scilit:
- Incremental Learning of Concept Drift in Nonstationary EnvironmentsIEEE Transactions on Neural Networks, 2011
- The Impact of Diversity on Online Ensemble Learning in the Presence of Concept DriftIEEE Transactions on Knowledge and Data Engineering, 2009
- New ensemble methods for evolving data streamsPublished by Association for Computing Machinery (ACM) ,2009
- A Practical Approach to Classify Evolving Data Streams: Training with Limited Amount of Labeled DataPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2008
- Learning from Time-Changing Data with Adaptive WindowingPublished by Society for Industrial & Applied Mathematics (SIAM) ,2007
- ACE: Adaptive Classifiers-Ensemble System for Concept-Drifting EnvironmentsLecture Notes in Computer Science, 2005
- Systematic data selection to mine concept-drifting data streamsPublished by Association for Computing Machinery (ACM) ,2004
- Active Mining of Data StreamsPublished by Society for Industrial & Applied Mathematics (SIAM) ,2004
- Mining concept-drifting data streams using ensemble classifiersPublished by Association for Computing Machinery (ACM) ,2003
- Learning in the presence of concept drift and hidden contextsMachine Learning, 1996