Alternatives to Randomized Control Trial Designs for Community-Based Prevention Evaluation
- 6 September 2016
- journal article
- research article
- Published by Springer Science and Business Media LLC in Prevention Science
- Vol. 18 (6), 671-680
- https://doi.org/10.1007/s11121-016-0706-8
Abstract
Multiple factors may complicate evaluation of preventive interventions, particularly in situations where the randomized controlled trial (RCT) is impractical, culturally unacceptable, or ethically questionable, as can occur with community-based efforts focused on inner-city neighborhoods or rural American Indian/Alaska Native communities. This paper is based in the premise that all research designs, including RCTs, are constrained by the extent to which they can refute the counterfactual and by which they can meet the challenge of proving the absence of effects due to the intervention—that is, showing what is prevented. Yet, these requirements also provide benchmarks for valuing alternatives to RCTs, those that have shown abilities to estimate preventive effects and refute the counterfactual with limited bias acting in congruence with community values about implementation. In this paper, we describe a number of research designs with attending examples, including regression discontinuity, interrupted time series designs, and roll-out randomization designs. We also set forth procedures and practices that can enhance their utility. Alternative designs, when combined with such design strengths, can provide valid evaluations of community-based interventions as viable alternatives to the RCT.Keywords
Funding Information
- Centers for Disease Control and Prevention
- National Institute of Nursing Research
- Robert W. McCormick Foundation
This publication has 30 references indexed in Scilit:
- Combining the regression discontinuity design and propensity score‐based weighting to improve causal inference in program evaluationJournal of Evaluation in Clinical Practice, 2012
- Conducting Research with Tribal Communities: Sovereignty, Ethics, and Data-Sharing IssuesEnvironmental Health Perspectives, 2012
- Alternatives to the Randomized Controlled TrialAmerican Journal of Public Health, 2008
- Randomized trial of a gatekeeper program for suicide prevention: 1-year impact on secondary school staff.Journal of Consulting and Clinical Psychology, 2008
- The performance of different propensity score methods for estimating marginal odds ratiosStatistics in Medicine, 2006
- The Propensity Score with Continuous TreatmentsPublished by Wiley ,2004
- Comparison of a Randomized and Two Quasi-Experimental Designs in a Single Outcome EvaluationEvaluation Review, 1998
- Cluster Suicide in American Indian AdolescentsAmerican Indian and Alaska Native Mental Health Research, 1988
- The central role of the propensity score in observational studies for causal effectsBiometrika, 1983
- Capitalizing on Nonrandom Assignment to Treatments: A Regression-Discontinuity Evaluation of a Crime-Control ProgramJournal of the American Statistical Association, 1983