Meta-Analysis
- 1 March 2009
- journal article
- research article
- Published by Ovid Technologies (Wolters Kluwer Health) in Medical Care
- Vol. 47 (3), 356-363
- https://doi.org/10.1097/mlr.0b013e3181893f6b
Abstract
Background: Audit and feedback (A&F) has long been used to improve quality of care, albeit with variable results. This meta-analytic study tested whether Feedback Intervention Theory, a framework from industrial/organizational psychology, explains the observed variability in health care A&F research. Method: Data source: studies cited by Jamtvedt's 2006 Cochrane systematic review of A&F, followed by database searches using the Cochrane review's search strategy to identify more recent studies. Inclusion criteria: Cochrane review criteria, plus: presence of a treatment group receiving only A&F; a control group receiving no intervention; a quantitatively measurable outcome; minimum n of 10 per arm; sufficient statistics for effect size calculations. Moderators: presence of discouragement and praise; correct solution, attainment level, velocity, frequency, and normative information; feedback format (verbal, textual, graphic, public, computerized, group vs. individual); goal setting activity. Procedure: meta-analytic procedures using the Hedges-Olkin method. Results: Of 519 studies initially identified, 19 met all inclusion criteria. Studies were most often excluded due to the lack of a feedback-only arm. A&F has a modest, though significant positive effect on quality outcomes (d = 0.40, 95% confidence interval = ±0.20); providing specific suggestions for improvement, written, and more frequent feedback strengthened this effect, whereas graphical and verbal feedback attenuated this effect. Conclusions: A&F effectiveness is improved when feedback is delivered with specific suggestions for improvement, in writing, and frequently. Other feedback characteristics could also potentially improve effectiveness; however, research with stricter experimental controls is needed to identify the specific feedback characteristics that maximize its effectiveness.Keywords
This publication has 27 references indexed in Scilit:
- Provider feedback to improve 5A's tobacco cessation in primary care: A cluster randomized clinical trialNicotine & Tobacco Research, 2007
- Clinical Practice Guideline Implementation Strategy Patterns in Veterans Affairs Primary Care ClinicsHealth Services Research, 2006
- Provider Attitudes toward Pay‐for‐Performance Programs: Development and Validation of a Measurement InstrumentHealth Services Research, 2006
- Audit and feedback: effects on professional practice and health care outcomesPublished by Wiley ,2006
- Not of One Mind: Mental Models of Clinical Practice Guidelines in the Veterans Health AdministrationHealth Services Research, 2005
- Implementing clinical guidelines: Current evidence and future implicationsJournal of Continuing Education in the Health Professions, 2004
- The effects of feedback interventions on performance: A historical review, a meta-analysis, and a preliminary feedback intervention theory.Psychological Bulletin, 1996
- Clustering estimates of effect magnitude from independent studies.Psychological Bulletin, 1983
- Motivational effects of knowledge of results: Knowledge or goal setting?Journal of Applied Psychology, 1967
- Knowledge of results and incorrect recall of plausible multiple-choice alternatives.Journal of Educational Psychology, 1967