Applying probabilistic temporal and multisite data quality control methods to a public health mortality registry in Spain: a systematic approach to quality control of repositories
- 23 April 2016
- journal article
- research article
- Published by Oxford University Press (OUP) in Journal of the American Medical Informatics Association
- Vol. 23 (6), 1085-1095
- https://doi.org/10.1093/jamia/ocw010
Abstract
Objective To assess the variability in data distributions among data sources and over time through a case study of a large multisite repository as a systematic approach to data quality (DQ). Materials and Methods Novel probabilistic DQ control methods based on information theory and geometry are applied to the Public Health Mortality Registry of the Region of Valencia, Spain, with 512 143 entries from 2000 to 2012, disaggregated into 24 health departments. The methods provide DQ metrics and exploratory visualizations for (1) assessing the variability among multiple sources and (2) monitoring and exploring changes with time. The methods are suited to big data and multitype, multivariate, and multimodal data. Results The repository was partitioned into 2 probabilistically separated temporal subgroups following a change in the Spanish National Death Certificate in 2009. Punctual temporal anomalies were noticed due to a punctual increment in the missing data, along with outlying and clustered health departments due to differences in populations or in practices. Discussion Changes in protocols, differences in populations, biased practices, or other systematic DQ problems affected data variability. Even if semantic and integration aspects are addressed in data sharing infrastructures, probabilistic variability may still be present. Solutions include fixing or excluding data and analyzing different sites or time periods separately. A systematic approach to assessing temporal and multisite variability is proposed. Conclusion Multisite and temporal variability in data distributions affects DQ, hindering data reuse, and an assessment of such variability should be a part of systematic DQ procedures.Keywords
Funding Information
- Spanish Ministry of Economy and Competitiveness (RTC-2014-1530-1, TIN-2013-43457-R)
- Universitat Politècnica de València (SP20141432)
This publication has 35 references indexed in Scilit:
- SHRINE: Enabling Nationally Scalable Multi-Site Disease StudiesPLOS ONE, 2013
- Practices and perspectives on building integrated data repositories: results from a 2010 CTSA surveyJournal of the American Medical Informatics Association, 2012
- Direct2Experts: a pilot national network to demonstrate interoperability among research-networking platformsJournal of the American Medical Informatics Association, 2011
- The Shared Health Research Information Network (SHRINE): A Prototype Federated Query Tool for Clinical Data RepositoriesJournal of the American Medical Informatics Association, 2009
- Evaluation of data quality in the cancer registry: Principles and methods. Part I: Comparability, validity and timelinessEuropean Journal of Cancer, 2009
- Multiproject–multicenter evaluation of automatic brain tumor classification by magnetic resonance spectroscopyMagnetic Resonance Materials in Physics, Biology and Medicine, 2008
- Spatio-temporal evolution of female lung cancer mortality in a region of Spain, is it worth taking migration into account?BMC Cancer, 2008
- Guidelines for Quality Assurance in Multicenter Trials: A Position PaperControlled Clinical Trials, 1998
- Divergence measures based on the Shannon entropyIEEE Transactions on Information Theory, 1991