Rubric Evaluation of Pediatric Emergency Medicine Fellows
- 1 December 2010
- journal article
- Published by Journal of Graduate Medical Education in Journal of Graduate Medical Education
- Vol. 2 (4), 523-529
- https://doi.org/10.4300/jgme-d-10-00083.1
Abstract
Objectives: To develop and validate a rubric assessment instrument for use by pediatric emergency medicine (PEM) faculty to evaluate PEM fellows and for fellows to use to self-assess.Methods: This is a prospective study at a PEM fellowship program. The assessment instrument was developed through a multistep process: (1) development of rubric format items, scaled on the modified Dreyfus model proficiency levels, corresponding to the 6 Accreditation Council for Graduate Medical Education core competencies; (2) determination of content and construct validity of the items through structured input and item refinement by subject matter experts and focus group review; (3) collection of data using a 61-item form; (4) evaluation of psychometrics; (5) selection of items for use in the final instrument.Results: A total of 261 evaluations were collected from 2006 to 2007; exploratory factor analysis yielded 5 factors with Eigenvalues >1.0; each contained ≥4 items, with factor loadings >0.4 corresponding with the following competencies: (1) medical knowledge and practice-based learning and improvement, (2) patient care and systems-based practice, (3) interpersonal skills, (4) communication skills, and (5) professionalism. Cronbach α for the final 53-item instrument was 0.989. There was also significant responsiveness of the tool to the year of training.Conclusion: A substantively and statistically validated rubric evaluation of PEM fellows is a reliable tool for formative and summative evaluation.Keywords
This publication has 33 references indexed in Scilit:
- The Development of a Competency-Based Assessment Rubric to Measure Resident MilestonesJournal of Graduate Medical Education, 2009
- Student perceptions and use of an assessment rubric for a group concept map in physiologyAdvances in Physiology Education, 2008
- A Rubric for Improving the Quality of Online CoursesInternational Journal of Nursing Education Scholarship, 2008
- Rubrics: Tools for Making Learning Goals and Evaluation Criteria Explicit for Both Teachers and LearnersCBE—Life Sciences Education, 2006
- Using student feedback to construct an assessment rubric for a concept map in physiologyAdvances in Physiology Education, 2005
- Quantitative Validation of a General Competency Composite Assessment EvaluationAcademic Emergency Medicine, 2004
- Why People Fail to Recognize Their Own IncompetenceCurrent Directions in Psychological Science, 2003
- Evaluating Systems‐based Practice in Emergency MedicineAcademic Emergency Medicine, 2002
- Classroom Rubrics: Systematizing What Teachers Do NaturallyThe Clearing House: A Journal of Educational Strategies, Issues and Ideas, 2000
- Interrater agreement and predictive validity of faculty ratings of pediatric residentsAcademic Medicine, 1986