An Analysis of Preliminary and Post-Discussion Priority Scores for Grant Applications Peer Reviewed by the Center for Scientific Review at the NIH
Open Access
- 17 November 2010
- journal article
- research article
- Published by Public Library of Science (PLoS) in PLOS ONE
- Vol. 5 (11), e13526
- https://doi.org/10.1371/journal.pone.0013526
Abstract
There has been the impression amongst many observers that discussion of a grant application has little practical impact on the final priority scores. Rather the final score is largely dictated by the range of preliminary scores given by the assigned reviewers. The implication is that the preliminary and final scores are the same and the discussion has little impact. The purpose of this examination of the peer review process at the National Institutes of Health is to describe the relationship between preliminary priority scores of the assigned reviewers and the final priority score given by the scientific review group. This study also describes the practical importance of any differences in priority scores. Priority scores for a sample of standard (R01) research grant applications were used in this assessment. The results indicate that the preliminary meeting evaluation is positively correlated with the final meeting outcome but that they are on average significantly different. The results demonstrate that discussion at the meeting has an important practical impact on over 13% of the applications.Keywords
This publication has 6 references indexed in Scilit:
- Statistical analysis of the National Institutes of Health peer review systemProceedings of the National Academy of Sciences, 2008
- Why Are Peer Review Outcomes Less Favorable for Clinical Science than for Basic Science Grant Applications?American Journal Of Medicine, 2008
- Sample Size and Precision in NIH Peer ReviewPLOS ONE, 2008
- Peer review: a flawed process at the heart of science and journalsJournal of the Royal Society of Medicine, 2006
- Outcomes of National Institutes of Health Peer Review of Clinical Grant ApplicationsJournal of Investigative Medicine, 2006
- NIH Peer Review of Grant Applications for Clinical ResearchJAMA, 2004