Questionnaire validation practice within a theoretical framework: a systematic descriptive literature review of health literacy assessments
Open Access
- 1 June 2020
- Vol. 10 (6), e035974
- https://doi.org/10.1136/bmjopen-2019-035974
Abstract
Objective Validity refers to the extent to which evidence and theory support the adequacy and appropriateness of inferences based on score interpretations. The health sector is lacking a theoretically-driven framework for the development, testing and use of health assessments. This study used the Standards for Educational and Psychological Testing framework of five sources of validity evidence to assess the types of evidence reported for health literacy assessments, and to identify studies that referred to a theoretical validity testing framework. Methods A systematic descriptive literature review investigated methods and results in health literacy assessment development, application and validity testing studies. Electronic searches were conducted in EBSCOhost, Embase, Open Access Theses and Dissertations and ProQuest Dissertations. Data were coded to the Standards’ five sources of validity evidence, and for reference to a validity testing framework. Results Coding on 46 studies resulted in 195 instances of validity evidence across the five sources. Only nine studies directly or indirectly referenced a validity testing framework. Evidence based on relations to other variables is most frequently reported. Conclusions The health and health equity of individuals and populations are increasingly dependent on decisions based on data collected through health assessments. An evidence-based theoretical framework provides structure and coherence to existing evidence and stipulates where further evidence is required to evaluate the extent to which data are valid for an intended purpose. This review demonstrates the use of the Standards’ theoretical validity testing framework to evaluate sources of evidence reported for health literacy assessments. Findings indicate that theoretical validity testing frameworks are rarely used to collate and evaluate evidence in validation practice for health literacy assessments. Use of the Standards’ theoretical validity testing framework would improve evaluation of the evidence for inferences derived from health assessment data on which public health and health equity decisions are based.Funding Information
- National Health and Medical Research Council (APP1150679, APP1155125)
This publication has 119 references indexed in Scilit:
- The grounded psychometric development and initial validation of the Health Literacy Questionnaire (HLQ)BMC Public Health, 2013
- A commentary on studies presenting projections of the future prevalence of dementiaBMC Public Health, 2013
- Health literacy and public health: A systematic review and integration of definitions and modelsBMC Public Health, 2012
- Performance of Health Literacy Tests Among Older Adults with DiabetesJournal of General Internal Medicine, 2011
- Rating the methodological quality in systematic reviews of studies on measurement properties: a scoring system for the COSMIN checklistQuality of Life Research, 2011
- A theoretical framework for patient-reported outcome measuresTheoretical Medicine and Bioethics, 2010
- The METER: A Brief, Self-Administered Measure of Health LiteracyJournal of General Internal Medicine, 2009
- The evolving concept of health literacySocial Science & Medicine (1982), 2008
- Validation of Screening Questions for Limited Health Literacy in a Large VA Outpatient PopulationJournal of General Internal Medicine, 2008
- Brief Report: screening items to identify patients with limited health literacy skillsJournal of General Internal Medicine, 2006