Numbers and Narrative: Combining Their Strengths in Research Reviews

Abstract

When several independent research studies examine the same program or treatment,conflicting findings often result, making it difficult to draw overall conclusions. Recent methodological work has created procedures, sometimes called meta-analysis, for combining quantitative results across studies. In this article, Richard Light and David Pillemer argue that qualitative information is equally important for explaining conflicting or puzzling outcomes. They discuss six ways in which qualitative information is essential to the process of literature review. The authors outline three broad strategies for combining different types of information in a review: quantifying descriptive reports, presenting quantitative outcomes narratively, and allying statistical and descriptive evidence while maintaining the integrity of each. They suggest that reviews organized to ally both forms of information will ultimately maximize our knowledge about the complexities of program success.