Meaningful Variation in Performance
- 1 February 2010
- journal article
- research article
- Published by Ovid Technologies (Wolters Kluwer Health) in Medical Care
- Vol. 48 (2), 133-139
- https://doi.org/10.1097/mlr.0b013e3181c15a6e
Abstract
Variance reduction is sometimes considered as a goal of clinical quality improvement. Variance among physicians, hospitals, or health plans has been evaluated as the proportion of total variance (or intraclass correlation, ICC) in a quality measure; low ICCs have been interpreted to indicate low potential for quality improvement at that level. However, the absolute amount of variation, expressed in clinically meaningful units, is less frequently reported. Moreover, changes in variance components have not been studied as quality improves. To examine changes in variance components at primary care physician and medical facility levels as performance improved for 4 quality indicators: systolic blood pressure levels in hypertension; low-density lipoprotein-cholesterol levels in hyperlipidemia; patient-reported care experience scores after primary care visits; and mammography screening rates. Adult members (n = 62,596-410,976) of Kaiser Permanente in Northern California, served by more than 1000 primary care physicians in 35 facilities, from 2001 to 2006. Multilevel linear and logistic regression to examine the interphysician and interfacility variances in 4 quality indicators over 6 years, after case-mix adjustment. ICCs were low for all 4 indicators at both levels (0.0021-0.086). Nevertheless, variances at both levels were statistically and clinically significant. For systolic blood pressure and the care experience score, interfacility and interphysician variance as well as ICCs decreased further as quality improved; declines were greater at the facility level. For low-density lipoprotein-cholesterol, variability at both levels increased with quality improvement; and for screening mammography, small declines were not statistically significant for either physicians or facilities. Low proportions of variance do not predict low potential for quality improvement. Despite low ICCs for facilities, quality improvement efforts directed primarily at facilities improved quality for all 4 indicators.Keywords
This publication has 32 references indexed in Scilit:
- Meaningful Variation in PerformanceMedical Care, 2010
- Evaluating Health Care Performance: Strengths and Limitations of Multilevel AnalysisBiometrical Journal, 2007
- Using hierarchical models to attribute sources of variation in consumer assessments of health careStatistics in Medicine, 2007
- Are There Detectable Differences in Quality of Care or Outcome of Depression Across Primary Care Providers?Medical Care, 2000
- The Unreliability of Individual Physician "Report Cards" for Assessing the Costs and Quality of Care of a Chronic DiseaseJAMA, 1999
- Patient Satisfaction with the General PractitionerMedical Care, 1998
- Hierarchical polytomous regression models with applications to health services researchStatistics in Medicine, 1997
- Multilevel Models: Applications to Health DataJournal of Health Services Research & Policy, 1996
- Do Attending or Resident Physician Practice Styles Account for Variations in Hospital Resource Use?Medical Care, 1994
- Controlling Variation in Health CareMedical Care, 1991