Measuring causes of death in populations: a new metric that corrects cause-specific mortality fractions for chance
Open Access
- 12 October 2015
- journal article
- research article
- Published by Springer Science and Business Media LLC in Population Health Metrics
- Vol. 13 (1), 28
- https://doi.org/10.1186/s12963-015-0061-1
Abstract
Verbal autopsy is gaining increasing acceptance as a method for determining the underlying cause of death when the cause of death given on death certificates is unavailable or unreliable, and there are now a number of alternative approaches for mapping from verbal autopsy interviews to the underlying cause of death. For public health applications, the population-level aggregates of the underlying causes are of primary interest, expressed as the cause-specific mortality fractions (CSMFs) for a mutually exclusive, collectively exhaustive cause list. Until now, CSMF Accuracy is the primary metric that has been used for measuring the quality of CSMF estimation methods. Although it allows for relative comparisons of alternative methods, CSMF Accuracy provides misleading numbers in absolute terms, because even random allocation of underlying causes yields relatively high CSMF accuracy. Therefore, the objective of this study was to develop and test a measure of CSMF that corrects this problem. We developed a baseline approach of random allocation and measured its performance analytically and through Monte Carlo simulation. We used this to develop a new metric of population-level estimation accuracy, the Chance Corrected CSMF Accuracy (CCCSMF Accuracy), which has value near zero for random guessing, and negative quality values for estimation methods that are worse than random at the population level. The CCCSMF Accuracy formula was found to be CCSMF Accuracy = (CSMF Accuracy - 0.632) / (1 - 0.632), which indicates that, at the population-level, some existing and commonly used VA methods perform worse than random guessing. CCCSMF Accuracy should be used instead of CSMF Accuracy when assessing VA estimation methods because it provides a more easily interpreted measure of the quality of population-level estimates.This publication has 26 references indexed in Scilit:
- Using verbal autopsy to measure causes of death: the comparative performance of existing methodsBMC Medicine, 2014
- Performance of InterVA for assigning causes of death to verbal autopsies: multisite validation study using clinical diagnostic gold standardsPopulation Health Metrics, 2011
- Direct estimation of cause-specific mortality fractions from verbal autopsies: multisite validation study using clinical diagnostic gold standardsPopulation Health Metrics, 2011
- Performance of physician-certified verbal autopsies: multisite validation study using clinical diagnostic gold standardsPopulation Health Metrics, 2011
- Performance of the Tariff Method: validation of a simple additive algorithm for analysis of verbal autopsiesPopulation Health Metrics, 2011
- Simplified Symptom Pattern Method for verbal autopsy analysis: multisite validation study using clinical diagnostic gold standardsPopulation Health Metrics, 2011
- Random forests for verbal autopsy analysis: multisite validation study using clinical diagnostic gold standardsPopulation Health Metrics, 2011
- Robust metrics for assessing the performance of different verbal autopsy cause assignment methods in validation studiesPopulation Health Metrics, 2011
- Population Health Metrics Research Consortium gold standard verbal autopsy validation study: design, implementation, and development of analysis datasetsPopulation Health Metrics, 2011
- Prospective Study of One Million Deaths in India: Rationale, Design, and Validation ResultsPLoS Medicine, 2005