Prediction of citation counts for clinical articles at two years using data available within three weeks of publication: retrospective cohort study
Open Access
- 21 February 2008
- Vol. 336 (7645), 655-657
- https://doi.org/10.1136/bmj.39482.526713.be
Abstract
Objective To determine if citation counts at two years could be predicted for clinical articles that pass basic criteria for critical appraisal using data within three weeks of publication from external sources and an online article rating service. Design Retrospective cohort study. Setting Online rating service, Canada. Participants 1274 articles from 105 journals published from January to June 2005, randomly divided into a 60:40 split to provide derivation and validation datasets. Main outcome measures 20 article and journal features, including ratings of clinical relevance and newsworthiness, routinely collected by the McMaster online rating of evidence system, compared with citation counts at two years. Results The derivation analysis showed that the regression equation accounted for 60% of the variation (R2=0.60, 95% confidence interval 0.538 to 0.629). This model applied to the validation dataset gave a similar prediction (R2=0.56, 0.476 to 0.596, shrinkage 0.04; shrinkage measures how well the derived equation matches data from the validation dataset). Cited articles in the top half and top third were predicted with 83% and 61% sensitivity and 72% and 82% specificity. Higher citations were predicted by indexing in numerous databases; number of authors; abstraction in synoptic journals; clinical relevance scores; number of cited references; and original, multicentred, and therapy articles from journals with a greater proportion of articles abstracted. Conclusion Citation counts can be reliably predicted at two years using data within three weeks of publication.This publication has 23 references indexed in Scilit:
- Characteristics Associated with Citation Rate of the Medical LiteraturePLOS ONE, 2007
- Multiple publication on a single research study: Does it pay? The influence of number of research articles on total citation counts in biomedicineJournal of the American Society for Information Science and Technology, 2007
- Citation Advantage of Open Access ArticlesPLoS Biology, 2006
- Second-Order Peer Review of the Medical Literature for Clinical PractitionersJAMA, 2006
- Automated Assessment of the Quality of Depression WebsitesJournal of Medical Internet Research, 2005
- Top of the charts: Download versus citations in the International Journal of CardiologyInternational Journal of Cardiology, 2005
- Relative Citation Impact of Various Study Designs in the Health SciencesJAMA, 2005
- Consumer health information on the Internet about carpal tunnel syndrome: Indicators of accuracyAmerican Journal Of Medicine, 2005
- What determines the citation frequency of ecological papers?Trends in Ecology & Evolution, 2005
- Relation between online “hit counts” and subsequent citations: prospective study of research papers in the BMJBMJ, 2004