Assessing the Quality of Publications Evaluating the Accuracy of Blood Glucose Monitoring Systems
- 1 March 2013
- journal article
- review article
- Published by Mary Ann Liebert Inc in Diabetes Technology & Therapeutics
- Vol. 15 (3), 253-259
- https://doi.org/10.1089/dia.2012.0265
Abstract
Many studies determine the performance of blood glucose monitoring (BG) systems. Correct evaluation is, however, complex, and apparent contradiction of results creates confusion. This study aimed to provide an overview of frequently made errors and to develop easy-to-use checklists to verify the quality of such studies. Building on the work from Mahoney and Ellison and subsequent re-evaluation, study designs of accuracy studies were assessed, and best practice and internationally accepted norms were determined. Key issues were collated, and two simplified checklists were developed: one for the assessment of analytical accuracy studies and a second for guidance with studies assessing the influence of interferences. The checklists have been used in a feasibility study with 20 representative studies selected from a literature search between 2007 and 2012. This check revealed that limitations in the designs and methods of studies assessing the performance of BG systems are common. The use of the accuracy checklist with the 20 representative studies showed that only 20% were in agreement with most of the issues deemed important and that 40% showed clear nonconcordance with ISO 15197. The use of the interference checklist showed that only 50% of the publications were in good agreement with the quality checks. In agreement with previous studies, which concluded many evaluations are performed poorly and present questionable conclusions, the use of these checklists demonstrated that few publications adhered to international guidelines and recommendations. Taking this into consideration, it becomes obvious that the publications must be examined in more detail to establish their quality and the validity of conclusions drawn.Keywords
This publication has 25 references indexed in Scilit:
- Accuracy Evaluation of Five Blood Glucose Monitoring Systems Obtained from the Pharmacy: A European Multicenter Study with 453 SubjectsDiabetes Technology & Therapeutics, 2012
- Effect of Ambient Temperature on Analytical Performance of Self-Monitoring Blood Glucose SystemsDiabetes Technology & Therapeutics, 2011
- Can One Point-Of-Care Glucose Meter Be Used for All Pediatric and Adult Hospital Patients? Evaluation of Three Meters, Including Recently Modified Test StripsDiabetes Technology & Therapeutics, 2011
- Evaluation of the Analytical Specificity and Clinical Application of a New Generation Hospital-Based Glucose Meter in a Dialysis SettingPoint of Care: The Journal of Near-Patient Testing & Technology, 2009
- An Evaluation of the Analytical Performance of a New-Generation Hospital-Based Glucose Meter and an Assessment of Its Clinical Reliability in a Neonatal Care UnitPoint of Care: The Journal of Near-Patient Testing & Technology, 2009
- Assessing Glucose Monitor Performance—A Standardized ApproachDiabetes Technology & Therapeutics, 2007
- Assessing the Quality of Glucose Monitor Studies: A Critical Evaluation of Published ReportsClinical Chemistry, 2007
- Diverse Influences on Blood Glucose Measurements in the ICU SettingSocial psychiatry. Sozialpsychiatrie. Psychiatrie sociale, 2005
- What Is Accuracy and How Close Must the Agreement Be?Diabetes Technology & Therapeutics, 2005
- Performance Evaluation of Blood Glucose Monitoring DevicesDiabetes Technology & Therapeutics, 2003