Improving performance of the Tariff Method for assigning causes of death to verbal autopsies
Open Access
- 8 December 2015
- journal article
- research article
- Published by Springer Science and Business Media LLC in BMC Medicine
- Vol. 13 (1), 1-13
- https://doi.org/10.1186/s12916-015-0527-9
Abstract
Reliable data on the distribution of causes of death (COD) in a population are fundamental to good public health practice. In the absence of comprehensive medical certification of deaths, the only feasible way to collect essential mortality data is verbal autopsy (VA). The Tariff Method was developed by the Population Health Metrics Research Consortium (PHMRC) to ascertain COD from VA information. Given its potential for improving information about COD, there is interest in refining the method. We describe the further development of the Tariff Method. This study uses data from the PHMRC and the National Health and Medical Research Council (NHMRC) of Australia studies. Gold standard clinical diagnostic criteria for hospital deaths were specified for a target cause list. VAs were collected from families using the PHMRC verbal autopsy instrument including health care experience (HCE). The original Tariff Method (Tariff 1.0) was trained using the validated PHMRC database for which VAs had been collected for deaths with hospital records fulfilling the gold standard criteria (validated VAs). In this study, the performance of Tariff 1.0 was tested using VAs from household surveys (community VAs) collected for the PHMRC and NHMRC studies. We then corrected the model to account for the previous observed biases of the model, and Tariff 2.0 was developed. The performance of Tariff 2.0 was measured at individual and population levels using the validated PHMRC database. For median chance-corrected concordance (CCC) and mean cause-specific mortality fraction (CSMF) accuracy, and for each of three modules with and without HCE, Tariff 2.0 performs significantly better than the Tariff 1.0, especially in children and neonates. Improvement in CSMF accuracy with HCE was 2.5 %, 7.4 %, and 14.9 % for adults, children, and neonates, respectively, and for median CCC with HCE it was 6.0 %, 13.5 %, and 21.2 %, respectively. Similar levels of improvement are seen in analyses without HCE. Tariff 2.0 addresses the main shortcomings of the application of the Tariff Method to analyze data from VAs in community settings. It provides an estimation of COD from VAs with better performance at the individual and population level than the previous version of this method, and it is publicly available for use.This publication has 16 references indexed in Scilit:
- Usefulness of the Population Health Metrics Research Consortium gold standard verbal autopsy data for general verbal autopsy methodsBMC Medicine, 2014
- Using verbal autopsy to measure causes of death: the comparative performance of existing methodsBMC Medicine, 2014
- Strengthening standardised interpretation of verbal autopsy data: the new InterVA-4 toolGlobal Health Action, 2012
- Assessing quality of medical death certification: Concordance between gold standard diagnosis and underlying cause of death in selected Mexican hospitalsPopulation Health Metrics, 2011
- Performance of physician-certified verbal autopsies: multisite validation study using clinical diagnostic gold standardsPopulation Health Metrics, 2011
- Performance of the Tariff Method: validation of a simple additive algorithm for analysis of verbal autopsiesPopulation Health Metrics, 2011
- Random forests for verbal autopsy analysis: multisite validation study using clinical diagnostic gold standardsPopulation Health Metrics, 2011
- Robust metrics for assessing the performance of different verbal autopsy cause assignment methods in validation studiesPopulation Health Metrics, 2011
- Population Health Metrics Research Consortium gold standard verbal autopsy validation study: design, implementation, and development of analysis datasetsPopulation Health Metrics, 2011
- Verbal Autopsy Methods with Multiple Causes of DeathStatistical Science, 2008