Exploiting Data Reliability and Fuzzy Clustering for Journal Ranking
Open Access
- 21 September 2016
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Fuzzy Systems
- Vol. 25 (5), 1306-1319
- https://doi.org/10.1109/tfuzz.2016.2612265
Abstract
Journal impact indicators are widely accepted as possible measurements of academic journal quality. However, much debate has recently surrounded their use, and alternative journal impact evaluation techniques are desirable. Aggregation of multiple indicators offers a promising method to produce a more robust ranking result, avoiding the possible bias caused by the use of a single impact indicator. In this paper, fuzzy aggregation and fuzzy clustering, especially the ordered weighted averaging (OWA) operators are exploited to aggregate the quality scores of academic journals that are obtained from different impact indicators. Also, a novel method for linguistic term-based fuzzy cluster grouping is proposed to rank academic journals. The paper allows for the construction of distinctive fuzzy clusters of academic journals on the basis of their performance with respect to different journal impact indicators, which may be subsequently combined via the use of the OWA operators. Journals are ranked in relation to their memberships in the resulting combined fuzzy clusters. In particular, the nearest-neighbor guided aggregation operators are adopted to characterize the reliability of the indicators, and the fuzzy clustering mechanism is utilized to enhance the interpretability of the underlying ranking procedure. The ranking results of academic journals from six subjects are systematically compared with the outlet ranking used by the Excellence in Research for Australia, demonstrating the significant potential of the proposed approach.Keywords
Funding Information
- Fundamental Research Funds for the Central Universities, China (2016MS120)
- Aberystwyth University
This publication has 36 references indexed in Scilit:
- ViewpointResearch evaluation for computer scienceCommunications of the ACM, 2009
- A new map for knowledge dissemination channelsCommunications of the ACM, 2009
- The Eigenfactor™ Metrics: Figure 1.Journal of Neuroscience, 2008
- CONSENSUS-BASED ENSEMBLES OF SOFT CLUSTERINGSApplied Artificial Intelligence, 2008
- Can scientific journals be classified in terms of aggregated journal‐journal citation relations using the Journal Citation Reports?Journal of the American Society for Information Science and Technology, 2006
- Web-enabled spatial decision analysis using Ordered Weighted Averaging (OWA)Journal of Geographical Systems, 2002
- Reducing the time complexity of the fuzzy c-means algorithmIEEE Transactions on Fuzzy Systems, 2002
- Families of OWA operatorsFuzzy Sets and Systems, 1993
- On ordered weighted averaging aggregation operators in multicriteria decisionmakingIEEE Transactions on Systems, Man, and Cybernetics, 1988
- Least squares quantization in PCMIEEE Transactions on Information Theory, 1982