The Effect of Random Error on Diagnostic Accuracy Illustrated with the Anthropometric Diagnosis of Malnutrition
Open Access
- 28 December 2016
- journal article
- research article
- Published by Public Library of Science (PLoS) in PLOS ONE
- Vol. 11 (12), e0168585
- https://doi.org/10.1371/journal.pone.0168585
Abstract
It is often thought that random measurement error has a minor effect upon the results of an epidemiological survey. Theoretically, errors of measurement should always increase the spread of a distribution. Defining an illness by having a measurement outside an established healthy range will lead to an inflated prevalence of that condition if there are measurement errors. A Monte Carlo simulation was conducted of anthropometric assessment of children with malnutrition. Random errors of increasing magnitude were imposed upon the populations and showed that there was an increase in the standard deviation with each of the errors that became exponentially greater with the magnitude of the error. The potential magnitude of the resulting error of reported prevalence of malnutrition were compared with published international data and found to be of sufficient magnitude to make a number of surveys and the numerous reports and analyses that used these data unreliable. The effect of random error in public health surveys and the data upon which diagnostic cut-off points are derived to define “health” has been underestimated. Even quite modest random errors can more than double the reported prevalence of conditions such as malnutrition. Increasing sample size does not address this problem, and may even result in less accurate estimates. More attention needs to be paid to the selection, calibration and maintenance of instruments, measurer selection, training & supervision, routine estimation of the likely magnitude of errors using standardization tests, use of statistical likelihood of error to exclude data from analysis and full reporting of these procedures in order to judge the reliability of survey reports.Keywords
This publication has 35 references indexed in Scilit:
- A systematic review of Demographic and Health Surveys: data availability and utilization for researchBulletin of the World Health Organization, 2012
- Who should be undertaking population-based surveys in humanitarian emergencies?Emerging Themes in Epidemiology, 2007
- A review of methodology and analysis of nutrition and mortality surveys conducted in humanitarian emergencies from October 1993 to April 2004Emerging Themes in Epidemiology, 2007
- Reliability of anthropometric methods and replicate measurementsAmerican Journal of Physical Anthropology, 1989
- On error due to graduation of scaling for anthropometryAmerican Journal of Physical Anthropology, 1982
- Factors Affecting Reliability in Age Estimation in Rural West Africa: A Statistical AnalysisPopulation Studies, 1981
- One cause? Many causes? The argument from the bimodal distributionJournal of Chronic Diseases, 1964
- One cause? Many causes?: The argument from the bimodal distributionJournal of Chronic Diseases, 1964
- GROWTH CHANGES IN BODILY SIZE AND PROPORTIONS DURING THE FIRST THREE YEARS: A DEVELOPMENTAL STUDY OF SIXTY-ONE CHILDREN BY REPEATED MEASUREMENTSBiometrika, 1935
- Physical Growth from Birth to PubertyReview of Educational Research, 1933