Limitations to Health Care Quality Measurement: Assessing Hospital Variation in Risk of Cardiac Events After Noncardiac Surgery
- 12 September 2022
- journal article
- research article
- Published by Mary Ann Liebert Inc in Population Health Management
- Vol. 25 (6), 712-720
- https://doi.org/10.1089/pop.2022.0147
Abstract
Limited sample size, incomplete measures, and inadequate risk adjustment adversely influence accurate health care quality measurements, surgical quality measurements, and accurate comparisons among hospitals. Since these measures are linked to resources for quality improvement and reimbursement, improving the accuracy of measurement has substantial implications for patients, clinicians, hospital administrators, insurers, and purchasers. The team examined risk-adjusted differences of postoperative cardiac events among 20 geographically dispersed, community-based medical centers within an integrated health care system and compared it with the National Surgical Quality Improvement Program (NSQIP) hospital-specific differences. The exposure included the hospital at which patients received noncardiac surgical care, with stratification of patients by the acuity of surgery (elective vs. urgent/emergent). Among 157,075 surgery patients, the unadjusted risk of cardiac event per 1000 ranged among hospitals from 2.1 to 6.9 for elective surgery and from 10.3 to 44.5 for urgent/emergent surgery. Across the 20 hospitals, hospital rankings estimated in the present analysis differed significantly from ranking reported by NSQIP (P for difference: elective, P = 0.0001; urgent/emergent, P < 0.0001) with significantly and substantially lower variation after risk adjustment. Current surgical quality measures may not adequately account for limitations of sample size, data capture, adequate risk adjustment, and surgical acuity in a given hospital, particularly for rare outcomes. These differences have implications for quality reporting and may introduce bias into hospital comparisons, particularly for hospitals with incomplete capture of their patients' baseline risk and acuity.Keywords
This publication has 21 references indexed in Scilit:
- Optimizing ACS NSQIP Modeling for Evaluation of Surgical Quality and Risk: Patient Risk Adjustment, Procedure Mix Adjustment, Shrinkage Adjustment, and Surgical FocusJournal of the American College of Surgeons, 2013
- The Importance of Improving the Quality of Emergency Surgery for a Regional Quality CollaborativeAnnals of Surgery, 2013
- Comparison of 30-day outcomes after emergency general surgery procedures: Potential for targeted improvementSurgery, 2010
- Meaningful Variation in PerformanceMedical Care, 2010
- Does Surgical Quality Improve in the American College of Surgeons National Surgical Quality Improvement ProgramAnnals of Surgery, 2009
- Surrounded by quality metrics: What do surgeons think of ACS-NSQIP?Surgery, 2009
- The NSQIP: A new frontier in surgerySurgery, 2005
- Measuring the quality of surgical care: structure, process, or outcomes?Journal of the American College of Surgeons, 2004
- Association of Perioperative Myocardial Ischemia with Cardiac Morbidity and Mortality in Men Undergoing Noncardiac SurgeryThe New England Journal of Medicine, 1990
- Multifactorial Index of Cardiac Risk in Noncardiac Surgical ProceduresThe New England Journal of Medicine, 1977