Methodological Reporting in Qualitative, Quantitative, and Mixed Methods Health Services Research Articles
- 8 November 2011
- journal article
- Published by Wiley in Health Services Research
- Vol. 47 (2), 721-745
- https://doi.org/10.1111/j.1475-6773.2011.01344.x
Abstract
Methodologically sound mixed methods research can improve our understanding of health services by providing a more comprehensive picture of health services than either method can alone. This study describes the frequency of mixed methods in published health services research and compares the presence of methodological components indicative of rigorous approaches across mixed methods, qualitative, and quantitative articles. All empirical articles (n = 1,651) published between 2003 and 2007 from four top-ranked health services journals. All mixed methods articles (n = 47) and random samples of qualitative and quantitative articles were evaluated to identify reporting of key components indicating rigor for each method, based on accepted standards for evaluating the quality of research reports (e.g., use of p-values in quantitative reports, description of context in qualitative reports, and integration in mixed method reports). We used chi-square tests to evaluate differences between article types for each component. Mixed methods articles comprised 2.85 percent (n = 47) of empirical articles, quantitative articles 90.98 percent (n = 1,502), and qualitative articles 6.18 percent (n = 102). There was a statistically significant difference (χ(2) (1) = 12.20, p = .0005, Cramer's V = 0.09, odds ratio = 1.49 [95% confidence interval = 1,27, 1.74]) in the proportion of quantitative methodological components present in mixed methods compared to quantitative papers (21.94 versus 47.07 percent, respectively) but no statistically significant difference (χ(2) (1) = 0.02, p = .89, Cramer's V = 0.01) in the proportion of qualitative methodological components in mixed methods compared to qualitative papers (21.34 versus 25.47 percent, respectively). Few published health services research articles use mixed methods. The frequency of key methodological components is variable. Suggestions are provided to increase the transparency of mixed methods studies and the presence of key methodological components in published reports.Keywords
This publication has 46 references indexed in Scilit:
- The Adoption and Practice of Mixed Methods: U.S. Trends in Federally Funded Health-Related ResearchQualitative Inquiry, 2010
- A scoring system for appraising mixed methods research, and concomitantly appraising qualitative, quantitative and mixed methods primary studies in Mixed Studies ReviewsInternational Journal of Nursing Studies, 2009
- Qualitative Data Analysis for Health Services Research: Developing Taxonomy, Themes, and TheoryHealth Services Research, 2007
- Consumer Enrollment and Experiences in the Cash and Counseling ProgramHealth Services Research, 2007
- Making Pay-For-Performance Work In MedicaidHealth Affairs, 2007
- Defining Interdisciplinary Research: Conclusions from a Critical Review of the LiteratureHealth Services Research, 2006
- “This Case Is Closed”: Family Caregivers and the Termination of Home Health Care Services for Stroke PatientsThe Milbank Quarterly, 2006
- Perceptions of the Influence of Prescription Medicine Samples on Prescribing by Family PhysiciansMedical Care, 2006
- Development of the Patient Activation Measure (PAM): Conceptualizing and Measuring Activation in Patients and ConsumersHealth Services Research, 2004
- Factors relevant to the validity of experiments in social settings.Psychological Bulletin, 1957