A Multiobjective Evolutionary Approach to Concurrently Learn Rule and Data Bases of Linguistic Fuzzy-Rule-Based Systems
- 15 May 2009
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Fuzzy Systems
- Vol. 17 (5), 1106-1122
- https://doi.org/10.1109/tfuzz.2009.2023113
Abstract
In this paper, we propose the use of a multiobjective evolutionary approach to generate a set of linguistic fuzzy-rule-based systems with different tradeoffs between accuracy and interpretability in regression problems. Accuracy and interpretability are measured in terms of approximation error and rule base (RB) complexity, respectively. The proposed approach is based on concurrently learning RBs and parameters of the membership functions of the associated linguistic labels. To manage the size of the search space, we have integrated the linguistic two-tuple representation model, which allows the symbolic translation of a label by only considering one parameter, with an efficient modification of the well known (2 + 2) Pareto archived evolution strategy (PAES). We tested our approach on nine real world datasets of different sizes and with different numbers of variables. Besides the (2 + 2)PAES, we have also used the well known nondominated sorting genetic algorithm (NSGA-II) and an accuracy-driven single-objective evolutionary algorithm (EA). We employed these optimization techniques both to concurrently learn rules and parameters and to learn only rules. We compared the different approaches by applying a nonparametric statistical test for pairwise comparisons, thus taking into consideration three representative points from the obtained Pareto fronts in the case of the multiobjective EAs. Finally, a data complexity measure, which is typically used in pattern recognition to evaluate the data density in terms of average number of patterns per variable, has been introduced to characterize regression problems. Results confirm the effectiveness of our approach, particularly for (possibly high dimensional) datasets with high values of the complexity metric.Keywords
This publication has 43 references indexed in Scilit:
- A study of statistical techniques and performance measures for genetics-based machine learning: accuracy and interpretabilitySoft Computing, 2008
- Context adaptation of fuzzy systems through a multi-objective evolutionary approach based on a novel interpretability indexSoft Computing, 2008
- Adaptation and application of multi-objective evolutionary algorithms for rule reduction and parameter tuning of fuzzy rule-based systemsSoft Computing, 2008
- A study on the use of non-parametric tests for analyzing the evolutionary algorithms’ behaviour: a case study on the CEC’2005 Special Session on Real Parameter OptimizationJournal of Heuristics, 2008
- Data Complexity in Pattern RecognitionPublished by Springer Science and Business Media LLC ,2006
- Multi-objective genetic local search algorithmPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- A multi-objective evolutionary algorithm for fuzzy modelingPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Complexity measures of supervised classification problemsIeee Transactions On Pattern Analysis and Machine Intelligence, 2002
- Accurate, Transparent, and Compact Fuzzy Models for Function Approximation and Dynamic Modeling through Multi-objective Evolutionary OptimizationLecture Notes in Computer Science, 2001
- A 2-tuple fuzzy linguistic representation model for computing with wordsIEEE Transactions on Fuzzy Systems, 2000