Reliability assessments in qualitative health promotion research
Open Access
- 10 May 2011
- journal article
- research article
- Published by Oxford University Press (OUP) in Health Promotion International
- Vol. 27 (1), 90-101
- https://doi.org/10.1093/heapro/dar027
Abstract
This article contributes to the debate about the use of reliability assessments in qualitative research in general, and health promotion research in particular. In this article, I examine the use of reliability assessments in qualitative health promotion research in response to health promotion researchers’ commonly held misconception that reliability assessments improve the rigor of qualitative research. All qualitative articles published in the journal Health Promotion International from 2003 to 2009 employing reliability assessments were examined. In total, 31.3% (20/64) articles employed some form of reliability assessment. The use of reliability assessments increased over the study period, ranging from <20% in 2003/2004 to 50% and above in 2008/2009, while at the same time the total number of qualitative articles decreased. The articles were then classified into four types of reliability assessments, including the verification of thematic codes, the use of inter-rater reliability statistics, congruence in team coding and congruence in coding across sites. The merits of each type were discussed, with the subsequent discussion focusing on the deductive nature of reliable thematic coding, the limited depth of immediately verifiable data and the usefulness of such studies to health promotion and the advancement of the qualitative paradigm.Keywords
This publication has 37 references indexed in Scilit:
- Creating community action plans for obesity prevention using the ANGELO (Analysis Grid for Elements Linked to Obesity) FrameworkHealth Promotion International, 2009
- Beyond evidence--to ethics: a decision-making framework for health promotion, public health and health improvementHealth Promotion International, 2008
- Learning what matters for patients: qualitative evaluation of a health promotion program for those with serious mental illnessHealth Promotion International, 2008
- Achieving organizational change: findings from case studies of 20 California healthy cities and communities coalitionsHealth Promotion International, 2008
- HIV prevention in sub-Saharan Africa: a multilevel analysis of message frames and their social determinantsHealth Promotion International, 2007
- What makes for sustainable Healthy Cities initiatives?--a review of the evidence from Noarlunga, Australia after 18 yearsHealth Promotion International, 2006
- Mixed messages: a qualitative study of the meanings and context of high school students' tobacco use in TurkeyHealth Promotion International, 2005
- Implementation of a Health Impact Assessment (HIA) tool in a regional health organization in Sweden—a feasibility studyHealth Promotion International, 2005
- Using Critical Ethnography to Explore Issues in Health PromotionQualitative Health Research, 2005
- "Perfectly Healthy, but Dead": The Myth of Inter-Rater ReliabilityQualitative Health Research, 1997