Methods to assess students’ acquisition, application and integration of basic science knowledge in an innovative competency-based curriculum
Open Access
- 1 January 2008
- journal article
- Published by Taylor & Francis Ltd in Medical Teacher
- Vol. 30 (7), e171-e177
- https://doi.org/10.1080/01421590802139740
Abstract
The Cleveland Clinic Lerner College of Medicine was designed to encourage medical students to pursue careers as physician investigators. Our faculty decided that assessment should enhance learning and adopted only formative assessments to document student performance in relation to nine broad-based competencies. No grades are used to judge student performance throughout the 5-year program. Instead, assessments are competency-based, relate directly to performance standards, and are stored in e-Portfolios to track progress and document student achievement. The class size is limited to 32 students a year. Schools with competency-based curricula must provide students with formative feedback to identify performance gaps and monitor progress. We describe a systematic approach to assess medical knowledge using essay-type questions (CAPPs) and multiple choice questions (SAQs) to provide medical students with weekly, formative feedback about their abilities to acquire, apply and integrate basic and clinical science concepts. Processes for developing performance standards, creating assessment items, training faculty, reporting student performance and monitoring outcomes are described. A case study of a Year 1 course is presented with specific examples of CAPPs and SAQs to illustrate how formative assessment data are interpreted and reported in students' e-Portfolios. Preliminary evidence suggests that CAPPs and SAQs have a positive impact on students' education, a justifiable cost in light of obtained benefits and growing acceptance among stakeholders. Two student cohorts performed significantly above the population mean on USMLE Step 1, which suggests that these assessment methods have not disadvantaged students. More evidence is needed to assess the reliability and validity of these tools for formative purposes. Using assessment data for formative purposes may encourage application and integration of knowledge, help students identify performance gaps, foster student development of learning plans and promote student responsibility for learning. Discussion provides applications for institutions with larger classes to consider.Keywords
This publication has 15 references indexed in Scilit:
- A Unique, Innovative, and Clinically Oriented Approach to Anatomy EducationAcademic Medicine, 2007
- The Portfolio Approach to Competency-Based Assessment at the Cleveland Clinic Lerner College of MedicineAcademic Medicine, 2007
- Cleveland Clinic Lerner College of Medicine: An Innovative Approach to Medical Education and the Training of Physician InvestigatorsAcademic Medicine, 2007
- The New Formal Competency-Based Curriculum and Informal Curriculum at Indiana University School of Medicine: Overview and Five-Year AnalysisAcademic Medicine, 2007
- Pay for Performance at the Tipping PointThe New England Journal of Medicine, 2007
- American Medical Education 100 Years after the Flexner ReportThe New England Journal of Medicine, 2006
- A Survey of Student Assessment in U.S. Medical Schools: The Balance of Breadth Versus FidelityTeaching and Learning in Medicine, 2001
- Validating Measures of PerformanceEducational Measurement: Issues and Practice, 1999
- AMEE Guide No. 14: Outcome-based education: Part 3-Assessment in outcome-based educationMedical Teacher, 1999
- Assessment and Classroom Learning: a role for summative assessment?Assessment in Education: Principles, Policy & Practice, 1998