“What gets measured better gets done better”: The landscape of validation of global maternal and newborn health indicators through key informant interviews
Open Access
- 5 November 2019
- journal article
- research article
- Published by Public Library of Science (PLoS) in PLOS ONE
- Vol. 14 (11), e0224746
- https://doi.org/10.1371/journal.pone.0224746
Abstract
A large number of indicators are currently used to monitor the state of maternal and newborn health, including those capturing dimensions of health system and input, care access and availability, care quality and safety, coverage and outcomes, and impact. Validity of these indicators is a key issue in the process of assessing indicator performance and suitability. This paper aims to understand the meaning of indicator validity in the field of maternal and newborn health, and to identify key recommendations for future research. This qualitative study used purposive sampling to identify key informants until thematic saturation was achieved. We interviewed 32 respondents from a variety of backgrounds using semi-structured interviews covering five themes: the meaning of indicator validity, methodological approaches to assessing validity, acceptable levels of indicator validity, gaps in validation research, and recommendations for addressing these gaps. Interview transcripts were analysed data using thematic content approach. Three conceptually different definitions of indicator validity were described by respondents. They considered indicator validity to encompass meaning and potential to spur action, going beyond diagnostic validity. Indicator validation was seen as an ongoing process of building and synthesising a wide range of evidence rather than a one-size-fits-all cut-off in diagnostic validity tests. Gaps identified included assessing validity of indicators of quality of care and indicators based on facility-level data, as well as expanding studies to a broader range of global settings. The key recommendation was to develop a coordinated approach to summarising and evaluating research on indicator validity, including capacity building in appraising and communicating the available evidence for country-specific needs. The findings will inform future recommendations around indicator testing and validation.Keywords
Funding Information
- Bill and Melinda Gates Foundation (Grant to MoNITOR)
This publication has 26 references indexed in Scilit:
- National, regional, and worldwide estimates of stillbirth rates in 2015, with trends from 2000: a systematic analysisThe Lancet. Global Health, 2016
- Global, regional, and national levels and trends in maternal mortality between 1990 and 2015, with scenario-based projections to 2030: a systematic analysis by the UN Maternal Mortality Estimation Inter-Agency GroupThe Lancet, 2015
- Confronting Diminished Epistemic Privilege and Epistemic Injustice in Pregnancy by Challenging a “Panoptics of the Womb”Journal of Medicine and Philosophy, 2014
- Measuring Coverage in MNCH: Indicators for Global Tracking of Newborn CarePLoS Medicine, 2013
- The effect of interview recording on quality of data obtained: a methodological reflectionNurse Researcher, 2012
- Quality, quality, quality: gaps in the continuum of careThe Lancet, 2012
- Building the Field of Health Policy and Systems Research: Social Science MattersPLoS Medicine, 2011
- Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groupsInternational Journal for Quality in Health Care, 2007
- Challenges in measuring obstetric fistulaInternational Journal of Gynecology & Obstetrics, 2007
- Reliability of data on caesarean sections in developing countries.2005