Conflict between Guideline Methodologic Quality and Recommendation Validity: A Potential Problem for Practitioners
Open Access
- 1 January 2006
- journal article
- review article
- Published by Oxford University Press (OUP) in Clinical Chemistry
- Vol. 52 (1), 65-72
- https://doi.org/10.1373/clinchem.2005.056952
Abstract
Background: It is not clear if good methodologic quality in current practice guidelines necessarily leads to more valid recommendations, i.e., those that are supported with consistent research evidence or, when evidence is conflicting or lacking, with sufficient consensus among the guideline development team. To help clarify this issue, we assessed whether there is a link between methodologic quality and recommendation validity in practice guidelines for the use of laboratory tests in the management of patients with non-small cell lung cancer (NSCLC). Methods: We conducted a systematic review of data on laboratory tests in NSCLC published in English or in French within the last 10 years and retrieved 11 practice guidelines for the use of these tests. The guidelines were critically appraised and scored for methodologic quality and recommendation validity based on the Appraisal of Guidelines Research and Evaluation (AGREE) criteria and on the systematic review. Results: Overall, these 11 guidelines had considerable shortcomings in methodologic quality and, to a lesser extent, in recommendation validity. Practice guidelines with the best methodologic quality were not necessarily the most valid in their recommendations, and conversely. Conclusions: Poor methodologic quality and lack of recommendation validity in laboratory medicine call for methodologic standards of guideline development and for international collaboration of guideline development agencies. We advise readers of guidelines to critically evaluate the methods used as well as the content of the recommendations before adopting them for use in practice.Keywords
This publication has 31 references indexed in Scilit:
- Quality of Evidence-Based Pediatric GuidelinesPEDIATRICS, 2005
- International Assessment of the Quality of Clinical Practice Guidelines in Oncology Using the Appraisal of Guidelines and Research and Evaluation InstrumentJournal of Clinical Oncology, 2004
- A review of guidelines on benign prostatic hyperplasia and lower urinary tract symptoms: are all guidelines the same?BJU International, 2003
- An independent assessment of chiropractic practice guidelinesJournal of Manipulative and Physiological Therapeutics, 2003
- Assessment of the Scope and Quality of Clinical Practice Guidelines in Lung Cancer*Social psychiatry. Sozialpsychiatrie. Psychiatrie sociale, 2003
- Inside GuidelinesDiabetes Care, 2002
- Systematic assessment of the quality of osteoporosis guidelines.BMC Musculoskeletal Disorders, 2002
- Practice guidelines developed by specialty societies: the need for a critical appraisalThe Lancet, 2000
- Are Guidelines Following Guidelines?JAMA, 1999
- Clinical guidelines: quantity without quality.Heart, 1997