Multisource Feedback in Evaluating the Performance of Doctors
Open Access
- 1 December 2012
- journal article
- research article
- Published by Ovid Technologies (Wolters Kluwer Health) in Academic Medicine
- Vol. 87 (12), 1668-1678
- https://doi.org/10.1097/acm.0b013e3182724cc0
Abstract
Purpose Internationally, there is increasing interest in monitoring and evaluating doctors' professional practice. Multisource feedback (MSF) offers one way of collecting information about doctors' performance. The authors investigated the psychometric properties of two questionnaires developed for this purpose and explored the biases that may exist within data collected via such instruments. Method A cross-sectional study was conducted in 11 UK health care organizations during 2008-2011. Patients (n = 30,333) and colleagues (n = 17,012) rated the professional performance of 1,065 practicing doctors, using the General Medical Council Patient Questionnaire (PQ) and Colleague Questionnaire (CQ). The psychometric properties of the questionnaires were assessed, and regression modeling was used to explore factors that influenced patient and colleague responses on the core questionnaire items. Results Although the questionnaires demonstrated satisfactory internal consistency, test-retest reliability, and convergent validity, patient and colleague ratings were highly skewed toward favorable impressions of doctor performance. At least 34 PQs and 15 CQs were required to achieve acceptable reliability (G > 0.70). Item ratings were influenced by characteristics of the patient and colleague respondents and the context in which their feedback was provided. Conclusions The PQ and CQ are acceptable for the provision of formative feedback on a doctor's professional practice within an appraisal process. However, biases identified in the questionnaire data suggest that caution is required when interpreting and acting on this type of information. MSF derived from these questionnaires should not be used in isolation to inform decisions about a doctor's fitness to practice medicine.Full TexKeywords
This publication has 30 references indexed in Scilit:
- Multisource feedback questionnaires in appraisal and for revalidation: a qualitative study in UK general practiceBritish Journal of General Practice, 2012
- Patient feedback in revalidation: an exploratory study using the consultation satisfaction questionnaireBritish Journal of General Practice, 2011
- Understanding why some ethnic minority patients evaluate medical care more negatively than white patients: a cross sectional analysis of a routine patient survey in English general practicesBMJ, 2009
- A multi-method analysis of free-text comments from the UK General Medical Council Colleague QuestionnairesMedical Education, 2009
- Satisfaction with care among low-income female outpatientsPsychology, Health & Medicine, 2007
- Influences on patients’ ratings of physicians: Physicians demographics and personalityPatient Education and Counseling, 2007
- Development and reliability testing of TAB a form for 360° assessment of Senior House Officers’ professional behaviour, as specified by the General Medical CouncilMedical Teacher, 2005
- Multisource feedback in the assessment of physician competenciesJournal of Continuing Education in the Health Professions, 2003
- Qualitative Comparison of the Reliability of Health Status Assessments With the EuroQol and SF-36 Questionnaires After StrokeStroke, 1998
- Validating the SF-36 health survey questionnaire: new outcome measure for primary care.BMJ, 1992