Evaluation of a Peer-to-Peer Data Transparency Intervention for Mohs Micrographic Surgery Overuse
Open Access
- 1 August 2019
- journal article
- research article
- Published by American Medical Association (AMA) in JAMA Dermatology
- Vol. 155 (8), 906-913
- https://doi.org/10.1001/jamadermatol.2019.1259
Abstract
Key PointsQuestionCan the use of benchmarked peer-to-peer reports reduce overuse in Mohs micrographic surgery (MMS)? FindingsIn this nonrandomized controlled intervention study including 2329 US surgeons, sharing individual reports of MMS practice patterns with physicians resulted in an immediate and sustained reduction in mean stages per case among outlier physicians and an associated cost savings compared with physicians who did not receive these reports. MeaningA nonpunitive, confidential audit-and-feedback intervention may represent an opportunity to reduce overuse of MMS among physicians identified as outliers by their clinical specialty society. This nonrandomized controlled intervention study compares Mohs micrographic surgery use by US surgeons who received confidential reports including stages-per-case performance data benchmarked to their peers nationally with physicians who did not receive these reports. ImportanceMohs micrographic surgery (MMS) is a skin cancer treatment that uses staged excisions based on margin status. Wide surgeon-level variation exists in the mean number of staged resections used to treat a tumor, resulting in a cost disparity and question of appropriateness. ObjectiveTo evaluate the effectiveness of a behavioral intervention aimed at reducing extreme overuse in MMS, as defined by the specialty society, by confidentially sharing stages-per-case performance data with individual surgeons benchmarked to their peers nationally. Design, Setting, and ParticipantsThis nonrandomized controlled intervention study included 2329 US surgeons who performed MMS procedures from January 1, 2016, to March 31, 2018. Physicians were identified using a 100% capture of Medicare Part B claims. The intervention group included physicians affiliated with the American College of Mohs Surgery, and the control group included physicians not affiliated with the American College of Mohs Surgery. InterventionsIndividualized performance reports were delivered to all outlier surgeons, defined by the specialty society as those with mean stages per case 2 SDs above the mean, and inlier surgeons in the intervention group. Main Outcomes and MeasuresThe primary outcome was surgeon-level change in mean stages per case between the prenotification (January 2016 to January 2017) and postnotification (March 2017 to March 2018) periods. A multivariable linear regression model was used to evaluate the association of notification with this surgeon-level outcome. The surgeon-level metric of mean stages per case was not risk adjusted. The mean Medicare cost savings associated with changes in practice patterns were calculated. ResultsOf the 2329 included surgeons, 1643 (70.5%) were male and 2120 (91.0%) practiced in metropolitan areas. In the intervention group (n=1045), 53 surgeons (5.1%) were outliers; in the control group (n=1284), 87 surgeons (6.8%) were outliers. Among the outliers in the intervention group, 44 (83%) demonstrated a reduction in mean stages per case compared with 60 outliers in the control group (69%; difference, 14%; 95% CI of difference, -1 to 27; P=.07). There was a mean stages-per-case reduction of 12.6% among outliers in the intervention group compared with 9.0% among outliers in the control group, and outliers in the intervention group had an adjusted postintervention differential decrease of 0.14 stages per case (95% CI, -0.19 to -0.09; P=.002). The total administrative cost of the intervention program was $150000, and the estimated reduction in Medicare spending was $11.1 million. Conclusions and RelevanceSharing personalized practice pattern data with physicians benchmarked to their peers can reduce overuse of MMS among outlier physicians.Keywords
This publication has 38 references indexed in Scilit:
- Printed educational materials: effects on professional practice and healthcare outcomesCochrane Database of Systematic Reviews, 2012
- Too Little? Too Much? Primary Care Physicians' Views on US Health CareArchives of Internal Medicine, 2011
- An overview of reviews evaluating the effectiveness of financial incentives in changing healthcare professional behaviours and patient outcomesCochrane Database of Systematic Reviews, 2011
- What Is Value in Health Care?New England Journal of Medicine, 2010
- Developing a computer delivered, theory based intervention for guideline implementation in general practiceBMC Family Practice, 2010
- Mohs Surgery Is Effective for High-Risk Cutaneous Squamous Cell CarcinomaDermatologic Surgery, 2010
- Surgical excision versus Mohs' micrographic surgery for primary and recurrent basal-cell carcinoma of the face: a prospective randomised controlled trial with 5-years' follow-upThe Lancet Oncology, 2008
- Lost in knowledge translation: Time for a map?Journal of Continuing Education in the Health Professions, 2006
- Cutaneous squamous cell carcinoma treated with Mohs micrographic surgery in Australia I. Experience over 10 yearsJournal of the American Academy of Dermatology, 2005
- Why Don't Physicians Follow Clinical Practice Guidelines?JAMA, 1999