A checklist designed to aid consistency and reproducibility of GRADE assessments: development and pilot validation
Top Cited Papers
Open Access
- 24 July 2014
- journal article
- research article
- Published by Springer Science and Business Media LLC in Systematic Reviews
- Vol. 3 (1), 82
- https://doi.org/10.1186/2046-4053-3-82
Abstract
The grading of recommendation, assessment, development and evaluation (GRADE) approach is widely implemented in health technology assessment and guideline development organisations throughout the world. GRADE provides a transparent approach to reaching judgements about the quality of evidence on the effects of a health care intervention, but is complex and therefore challenging to apply in a consistent manner. We developed a checklist to guide the researcher to extract the data required to make a GRADE assessment. We applied the checklist to 29 meta-analyses of randomised controlled trials on the effectiveness of health care interventions. Two reviewers used the checklist for each paper and used these data to rate the quality of evidence for a particular outcome. For most (70%) checklist items, there was good agreement between reviewers. The main problems were for items relating to indirectness where considerable judgement is required. There was consistent agreement between reviewers on most items in the checklist. The use of this checklist may be an aid to improving the consistency and reproducibility of GRADE assessments, particularly for inexperienced users or in rapid reviews without the resources to conduct assessments by two researchers independently.Keywords
This publication has 51 references indexed in Scilit:
- GRADE guidelines: 14. Going from evidence to recommendations: the significance and presentation of recommendationsJournal of Clinical Epidemiology, 2013
- Care management for Type 2 diabetes in the United States: a systematic review and meta-analysisBMC Health Services Research, 2012
- Interventions to Influence Consulting and Antibiotic Use for Acute Respiratory Tract Infections in Children: A Systematic Review and Meta-AnalysisPLOS ONE, 2012
- The Cochrane Collaboration's tool for assessing risk of bias in randomised trialsBMJ, 2011
- Computer Therapy for the Anxiety and Depressive Disorders Is Effective, Acceptable and Practical Health Care: A Meta-AnalysisPLOS ONE, 2010
- Reboxetine for acute treatment of major depression: systematic review and meta-analysis of published and unpublished placebo and selective serotonin reuptake inhibitor controlled trialsBMJ, 2010
- Brief psychological therapies for anxiety and depression in primary care: meta-analysis and meta-regressionBMC Medicine, 2010
- Efficacy and acceptability of selective serotonin reuptake inhibitors for the treatment of depression in Parkinson's disease: a systematic review and meta-analysis of randomized controlled trialsBMC Neurology, 2010
- GRADE: an emerging consensus on rating quality of evidence and strength of recommendationsBMJ, 2008
- Effectiveness of physiotherapy exercise after knee arthroplasty for osteoarthritis: systematic review and meta-analysis of randomised controlled trialsBMJ, 2007