A systematic review of evaluation in formal continuing medical education
- 1 January 2007
- journal article
- review article
- Published by Ovid Technologies (Wolters Kluwer Health) in Journal of Continuing Education in the Health Professions
- Vol. 27 (1), 16-27
- https://doi.org/10.1002/chp.89
Abstract
Physicians spend a considerable amount of time in Continuing Medical Education (CME) to maintain their medical licenses. CME evaluation studies vary greatly in evaluation methods, levels of evaluation, and length of follow-up. Standards for CME evaluation are needed to enable comparison among different studies and to detect factors influencing CME evaluation. A review of the CME evaluation literature was conducted on primary research studies published from January 2000 to January 2006. Studies assessing only satisfaction with CME were excluded, as were studies where fewer than 50% of the participants were practicing physicians. Thirty-two studies were included in the analyses. Determinations were made about evaluation methods, outcome measures, and follow-up assessment. Only 2 of 32 reviewed studies addressed all evaluation levels: physician changes in knowledge and attitudes (level 2), practices (level 3), and improved patient health status (level 4). None of the studies using self-developed instruments (n = 10) provided reliability and validity information. Only 6 studies used validated scales. Twenty studies had a follow-up period of 6 months or less, and 11 had a follow-up period between 1 and 2 years. A gold standard for evaluating the effectiveness of CME would include assessment of all 4 levels of evaluation. A valid, reliable, and adaptable CME evaluation questionnaire addressing variables in the second level is needed to allow comparison of effectiveness across CME interventions. A minimum 1-year postintervention follow-up period may also be indicated to investigate the sustainability of intervention outcomes.Keywords
This publication has 36 references indexed in Scilit:
- Accuracy of Physician Self-assessment Compared With Observed Measures of CompetenceJAMA, 2006
- Effects of continuing medical education on improving physician clinical care and patient health: A review of systematic reviewsInternational Journal of Technology Assessment in Health Care, 2005
- A review of evaluation outcomes of web-based continuing medical educationMedical Education, 2005
- Propriétés métrologiques des questionnaires de connaissances et de pratiques des professionnels de santé concernant les patients ayant des conduites d’alcoolisation pathologiqueL'Encéphale, 2004
- An Interview with Sam Brooks, Senior Vice-President of Sales & Marketing, EBSCO PublishingJournal of Business & Finance Librarianship, 2004
- eLearning: A review of Internet-based continuing medical educationJournal of Continuing Education in the Health Professions, 2004
- Short-term training increases diagnostic and treatment rate for insomnia in general practiceArchiv Fur Psychiatrie Und Nervenkrankheiten, 2002
- Randomized controlled trials of continuing medical education: What makes them most effective?Journal of Continuing Education in the Health Professions, 2002
- Recommendations of the Canadian Consensus Conference on Dementia--dissemination, implementation, and evaluation of impact.Canadian Journal of Neurological Sciences / Journal Canadien des Sciences Neurologiques, 2001
- Impact of Formal Continuing Medical EducationJAMA, 1999