Non-confirming replication of "Performance of InSilicoVA for assigning causes of death to verbal autopsies: multisite validation study using clinical diagnostic gold standards," by Flaxman et al.
Open Access
- 26 March 2020
- journal article
- research article
- Published by Springer Science and Business Media LLC in BMC Medicine
- Vol. 18 (1), 1-5
- https://doi.org/10.1186/s12916-020-01518-9
Abstract
Background A verbal autopsy (VA) is an interview conducted with the caregivers of someone who has recently died to describe the circumstances of the death. In recent years, several algorithmic methods have been developed to classify cause of death using VA data. The performance of one method-InSilicoVA-was evaluated in a study by Flaxman et al., published in BMC Medicine in 2018. The results of that study are different from those previously published by our group. Methods Based on the description of methods in the Flaxman et al. study, we attempt to replicate the analysis to understand why the published results differ from those of our previous work. Results We failed to reproduce the results published in Flaxman et al. Most of the discrepancies we find likely result from undocumented differences in data pre-processing, and/or values assigned to key parameters governing the behavior of the algorithm. Conclusion This finding highlights the importance of making replication code available along with published results. All code necessary to replicate the work described here is freely available on GitHub.This publication has 9 references indexed in Scilit:
- Non-confirming replication of "Performance of InSilicoVA for assigning causes of death to verbal autopsies: multisite validation study using clinical diagnostic gold standards," by Flaxman et al.BMC Medicine, 2020
- Performance of InSilicoVA for assigning causes of death to verbal autopsies: multisite validation study using clinical diagnostic gold standardsBMC Medicine, 2018
- Probabilistic Cause-of-Death Assignment Using Verbal AutopsiesJournal of the American Statistical Association, 2016
- Improving performance of the Tariff Method for assigning causes of death to verbal autopsiesBMC Medicine, 2015
- Measuring causes of death in populations: a new metric that corrects cause-specific mortality fractions for chancePopulation Health Metrics, 2015
- Usefulness of the Population Health Metrics Research Consortium gold standard verbal autopsy data for general verbal autopsy methodsBMC Medicine, 2014
- Prospects for automated diagnosis of verbal autopsiesBMC Medicine, 2014
- Strengthening standardised interpretation of verbal autopsy data: the new InterVA-4 toolGlobal Health Action, 2012
- Population Health Metrics Research Consortium gold standard verbal autopsy validation study: design, implementation, and development of analysis datasetsPopulation Health Metrics, 2011