Do Evidence-Based Interventions Work When Tested in the “Real World?” A Systematic Review and Meta-analysis of Parent Management Training for the Treatment of Child Disruptive Behavior
- 19 February 2013
- journal article
- review article
- Published by Springer Science and Business Media LLC in Clinical Child and Family Psychology Review
- Vol. 16 (1), 18-34
- https://doi.org/10.1007/s10567-013-0128-0
Abstract
Evidence-based interventions are often unavailable in everyday clinical settings. This may partly reflect practitioners’ assumptions that research evidence does not reflect “real-world” conditions. To examine this further, we systematically assessed the clinical effectiveness of parent management training (PMT) for the treatment of child disruptive behavior across different real-world practice contexts. We identified 28 relevant randomized controlled trials from a systematic search of electronic bibliographic databases and conducted a meta-analysis of child outcomes across trials. Planned subgroup analyses involved comparisons between studies grouped according to individual real-world practice criteria and total real-world practice criteria scores, reflecting the extent to which PMT was delivered by non-specialist therapists, to a clinic-referred population, in a routine setting, and as part of a routine service. Meta-analysis revealed a significant overall advantage for PMT compared with waitlist control conditions. Subgroup analyses did not demonstrate significant differences in effect size estimates according to the total number of real-world practice criteria met by studies. Moreover, no consistent relationships were found between specific practice criteria and effect size estimates. In conclusion, PMT appears to be an effective treatment for children with disruptive behavior problems. There was no clear evidence that conducting PMT in real-world practice contexts is a deterrent to achieving effective child behavior outcomes, although relative advantage to “usual care” was not directly examined and the power of the analysis was limited as a result of significant heterogeneity. More research is needed to investigate whether this finding is generalizable to other psychological interventions. Suggestions are also made for developing more differentiated criteria to assist with evaluating the specific applicability of research evidence to different care providers.Keywords
This publication has 87 references indexed in Scilit:
- Internet-based parent management training: A randomized controlled studyBehaviour Research and Therapy, 2012
- How usual is usual care in pragmatic intervention studies in primary care? An overview of recent trialsBritish Journal of General Practice, 2010
- Methodological Challenges of Characterizing Usual Care Psychotherapeutic PracticeAdministration and Policy in Mental Health and Mental Health Services Research, 2009
- The clinical effectiveness of different parenting programmes for children with conduct problems: a systematic review of randomised controlled trialsChild and Adolescent Psychiatry and Mental Health, 2009
- Developing and evaluating complex interventions: the new Medical Research Council guidanceBMJ, 2008
- Parenting intervention in Sure Start services for children at risk of developing conduct disorder: pragmatic randomised controlled trialBMJ, 2007
- Assessment of generalisability in trials of health interventions: suggested framework and systematic reviewBMJ, 2006
- Diffusion of Innovations in Service Organizations: Systematic Review and RecommendationsThe Milbank Quarterly, 2004
- Efficacy of Parent-Child Interaction Therapy: Interim Report of a Randomized Trial with Short-Term MaintenanceJournal of Clinical Child Psychology, 1998
- Meta-analysis in clinical trialsControlled Clinical Trials, 1986