Does delayed measurement affect patient reports of provider performance? Implications for performance measurement of medical assistance with tobacco cessation: A Dental PBRN study
Open Access
- 8 May 2008
- journal article
- research article
- Published by Springer Science and Business Media LLC in BMC Health Services Research
- Vol. 8 (1), 100
- https://doi.org/10.1186/1472-6963-8-100
Abstract
We compared two methods of measuring provider performance of tobacco control activities: immediate "exit cards" versus delayed telephone follow-up surveys. Current standards, e.g. HEDIS, use delayed patient measures that may over or under-estimate overall performance. Patients completed exit cards in 60 dental practices immediately after a visit to measure whether the provider "asked" about tobacco use, and "advised" the patient to quit. One to six months later patients were asked the same questions by telephone survey. Using the exit cards as the standard, we quantified performance and calculated sensitivity (agreement of those responding yes on telephone surveys compared with exit cards) and specificity (agreement of those responding no) of the delayed measurement. Among 150 patients, 21% reporting being asked about tobacco use on the exit cards and 30% reporting being asked in the delayed surveys. The sensitivity and specificity were 50% and 75%, respectively. Similarly, among 182 tobacco users, 38% reported being advised to quit on the exit cards and this increased to 51% on the delayed surveys. The sensitivity and specificity were 75% and 64%, respectively. Increasing the delay from the visit to the telephone survey resulted in increasing disagreement. Patient reports differed considerably in immediate versus delayed measures. These results have important implications because they suggest that our delayed measures may over-estimate performance. The immediate exit cards should be included in the armamentarium of tools for measuring providers' performance of tobacco control, and perhaps other service delivery.Keywords
This publication has 28 references indexed in Scilit:
- Clinical Practice Guidelines and Quality of Care for Older Patients With Multiple Comorbid DiseasesJama-Journal Of The American Medical Association, 2005
- Immediate antecedents of cigarette smoking: An analysis from ecological momentary assessment.Journal of Abnormal Psychology, 2002
- Immediate antecedents of cigarette smoking: An analysis from ecological momentary assessment.Journal of Abnormal Psychology, 2002
- Patient recall versus physician documentation in report of smoking cessation counselling performed in the inpatient settingTobacco Control, 2000
- The patient exit interview as an assessment of physician-delivered smoking intervention: A validation study.Health Psychology, 1999
- The patient exit interview as an assessment of physician-delivered smoking intervention: A validation study.Health Psychology, 1999
- Data Collection Mode and Social Desirability Bias in Self-Reported Religious AttendanceAmerican Sociological Review, 1998
- Physicians counseling smokers. A population-based survey of patients' perceptions of health care provider-delivered smoking cessation interventionsArchives of Internal Medicine, 1997
- Patients as Reliable Reporters of Medical Care ProcessMedical Care, 1992
- Answering Autobiographical Questions: The Impact of Memory and Inference on SurveysScience, 1987