An Analysis of Rule Deletion Scheme in XCS on Reinforcement Learning Problem
- 20 September 2017
- journal article
- Published by Fuji Technology Press Ltd. in Journal of Advanced Computational Intelligence and Intelligent Informatics
- Vol. 21 (5), 876-884
- https://doi.org/10.20965/jaciii.2017.p0876
Abstract
The XCS classifier system is an evolutionary rule-based learning technique powered by a Q-learning like learning mechanism. It employs a global deletion scheme to delete rules from all rules covering all state-action pairs. However, the optimality of this scheme remains unclear owing to the lack of intensive analysis. We here introduce two deletion schemes: 1) local deletion, which can be applied to a subset of rules covering each state (a match set), and 2) stronger local deletion, which can be applied to a more specific subset covering each state-action pair (an action set). The aim of this paper is to reveal how the above three deletion schemes affect the performance of XCS. Our analysis shows that the local deletion schemes promote the elimination of inaccurate rules compared with the global deletion scheme. However, the stronger local deletion scheme occasionally deletes a good rule. We further show that the two local deletion schemes greatly improve the performance of XCS on a set of noisy maze problems. Although the localization strength of the proposed deletion schemes may require consideration, they can be adequate for XCS rather than the original global deletion scheme.Keywords
This publication has 17 references indexed in Scilit:
- Theoretical XCS parameter settings of learning accurate classifiersPublished by Association for Computing Machinery (ACM) ,2017
- A modified XCS classifier system for sequence labelingPublished by Association for Computing Machinery (ACM) ,2014
- Salient object detection using learning classifiersystems that compute action mappingsPublished by Association for Computing Machinery (ACM) ,2014
- Reusing Building Blocks of Extracted Knowledge to Solve Complex, Large-Scale Boolean ProblemsIEEE Transactions on Evolutionary Computation, 2013
- Learning classifier systems: then and nowEvolutionary Intelligence, 2008
- Learning Classifier Systems in Data MiningPublished by Springer Science and Business Media LLC ,2008
- A Self-Adaptive XCSLecture Notes in Computer Science, 2002
- An Analysis of Generalization in the XCS Classifier SystemEvolutionary Computation, 1999
- Reinforcement Learning: An IntroductionIEEE Transactions on Neural Networks, 1998
- Classifier Fitness Based on AccuracyEvolutionary Computation, 1995