Data quality evaluation for observational multiple sclerosis registries
- 1 August 2016
- journal article
- research article
- Published by SAGE Publications in Multiple Sclerosis Journal
- Vol. 23 (5), 647-655
- https://doi.org/10.1177/1352458516662728
Abstract
Objective: Objective and reproducible evaluation of data quality is of paramount importance for studies of ‘real-world’ observational data. Here, we summarise a standardised data quality, density and generalisability process implemented by MSBase, a global multiple sclerosis (MS) cohort study. Methods: Error rate, data density score and generalisability score were developed using all 35,869 patients enrolled in MSBase as of November 2015. The data density score was calculated across six domains (follow-up, demography, visits, MS relapses, paraclinical data and therapy) and emphasised data completeness. The error rate evaluated syntactic accuracy and consistency of data. The generalisability score evaluated believability of the demographic and treatment information. Correlations among the three scores and the number of patients per centre were evaluated. Results: Errors were identified at the median rate of 3 per 100 patient-years. The generalisability score indicated the samples’ representativeness of the known MS epidemiology. Moderate correlation between the density and generalisability scores (ρ = 0.58) and a weak correlation between the error rate and the other two scores (ρ = −0.32 to −0.33) were observed. The generalisability score was strongly correlated with centre size (ρ = 0.79). Conclusion: The implemented scores enable objective evaluation of the quality of observational MS data, with an impact on the design of future analyses.This publication has 19 references indexed in Scilit:
- Observational data: Understanding the real MS worldMultiple Sclerosis Journal, 2016
- Effect of invasive EEG monitoring on cognitive outcome after left temporal lobe epilepsy surgeryNeurology, 2015
- Fingolimod versus interferon beta/glatiramer acetate after natalizumab suspension in multiple sclerosisBrain, 2015
- Safety and efficacy of digoxin: systematic review and meta-analysis of observational and controlled trial dataBMJ, 2015
- Multiple Sclerosis Relapses: Epidemiology, Outcomes and Management. A Systematic ReviewNeuroepidemiology, 2015
- Switch to natalizumab versus fingolimod in active relapsing–remitting multiple sclerosisAnnals of Neurology, 2014
- Can we measure long-term treatment effects in multiple sclerosis?Nature Reviews Neurology, 2014
- Sex as a determinant of relapse incidence and progressive course of multiple sclerosisBrain, 2013
- Methodologies for data quality assessment and improvementACM Computing Surveys, 2009
- PROBLEMS OF EXPERIMENTAL TRIALS OF THERAPY IN MULTIPLE SCLEROSIS: REPORT BY THE PANEL ON THE EVALUATION OF EXPERIMENTAL TRIALS OF THERAPY IN MULTIPLE SCLEROSISAnnals of the New York Academy of Sciences, 1965