Scholarometer: A Social Framework for Analyzing Impact across Disciplines
Open Access
- 12 September 2012
- journal article
- research article
- Published by Public Library of Science (PLoS) in PLOS ONE
- Vol. 7 (9), e43235
- https://doi.org/10.1371/journal.pone.0043235
Abstract
The use of quantitative metrics to gauge the impact of scholarly publications, authors, and disciplines is predicated on the availability of reliable usage and annotation data. Citation and download counts are widely available from digital libraries. However, current annotation systems rely on proprietary labels, refer to journals but not articles or authors, and are manually curated. To address these limitations, we propose a social framework based on crowdsourced annotations of scholars, designed to keep up with the rapidly evolving disciplinary and interdisciplinary landscape. We describe a system called Scholarometer, which provides a service to scholars by computing citation-based impact measures. This creates an incentive for users to provide disciplinary annotations of authors, which in turn can be used to compute disciplinary metrics. We first present the system architecture and several heuristics to deal with noisy bibliographic and annotation data. We report on data sharing and interactive visualization services enabled by Scholarometer. Usage statistics, illustrating the data collected and shared through the framework, suggest that the proposed crowdsourcing approach can be successful. Secondly, we illustrate how the disciplinary bibliometric indicators elicited by Scholarometer allow us to implement for the first time a universal impact measure proposed in the literature. Our evaluation suggests that this metric provides an effective means for comparing scholarly impact across disciplinary boundaries.This publication has 10 references indexed in Scilit:
- The social bookmark and publication management system bibsonomyThe VLDB Journal, 2010
- h-Index: A review focused in its variants, computation and standardization for different scientific fieldsJournal of Informetrics, 2009
- Universality of citation distributions: Toward an objective measure of scientific impactProceedings of the National Academy of Sciences of the United States of America, 2008
- Galaxy Zoo: morphologies derived from visual inspection of galaxies from the Sloan Digital Sky SurveyMonthly Notices of the Royal Astronomical Society, 2008
- Successive h-indicesScientometrics, 2007
- Theory and practise of the g-indexScientometrics, 2006
- Games with a PurposeComputer, 2006
- Usage patterns of collaborative tagging systemsJournal of Information Science, 2006
- An index to quantify an individual's scientific research outputProceedings of the National Academy of Sciences of the United States of America, 2005
- Graph drawing by force‐directed placementSoftware: Practice and Experience, 1991