Measuring learning gain during a one-day introductory bronchoscopy course
Open Access
- 29 June 2010
- journal article
- research article
- Published by Springer Science and Business Media LLC in Surgical Endoscopy
- Vol. 25 (1), 207-216
- https://doi.org/10.1007/s00464-010-1161-4
Abstract
Background Rigorous assessment of medical knowledge and technical skill inspires learning, reinforces confidence, and reassures the public. Identifying curricular effectiveness using objective measures of learning is therefore crucial for competency-oriented program development in a learner-centric educational environment. The aim of this study was to determine whether various measures of learning, including class-average normalized gain , can be used to assess the effectiveness of a one-day introductory bronchoscopy course curriculum. Methods We conducted a quasi-experimental one-group pre-test/post-test study at the University of California, Irvine. The group comprised 24 first-year pulmonary and critical care trainees from eight training institutions in southern California. Class-average normalized gain, single-student normalized gain, absolute gain, and relative gain were used as objective measures of cognitive knowledge and bronchoscopy technical skill learning. A class-average normalized gain of 30% was used to determine curricular effectiveness. Perceived educational value using Likert-scale surveys and post-course questionnaires was determined during and 3 months after course participation. Results Mean test scores of cognitive knowledge improved significantly from 48 to 66% ( p = 0.043). Absolute gain for the class was 18%, relative gain was 37%, class average normalized gain 〈g〉 was 34%, and the average of the single-student normalized gains g(ave) was 29%. Mean test scores of technical skill improved significantly from 43 to 77% ( p = 0.017). Absolute gain was 34%, relative gain was 78%, class average normalized gain 〈g〉 was 60%, and the average of the single-student normalized gains g(ave) was 59%. Statistically significant improvements in absolute gain were noted in all five elements of technical skill ( p < 0.05). Likert-scale surveys, questionnaires, and surveys demonstrated strong perceived educational value. Conclusion The effectiveness of a one-day introductory bronchoscopy curriculum was demonstrated using a pre-test/post-test model with calculation of normalized gain and related metrics.Keywords
This publication has 31 references indexed in Scilit:
- Teaching Feedback to First-year Medical Students: Long-term Skill Retention and Accuracy of Student Self-assessmentJournal of General Internal Medicine, 2009
- A national study assessing the teaching and learning of introductory astronomy. Part I. The effect of interactive instructionAmerican Journal of Physics, 2009
- Developing Technical Expertise in Emergency Medicine—The Role of Simulation in Procedural Skill AcquisitionAcademic Emergency Medicine, 2008
- Should simulator use become mandatory in endoscopy training?Journal of Gastroenterology and Hepatology, 2008
- Validation of Two Instruments to Assess Technical Bronchoscopic Skill Using Virtual Reality SimulationRespiration, 2008
- The Evolution of Bronchoscopy TrainingRespiration, 2008
- Perceptions of surgical specialists in general surgery, orthopaedic surgery, urology and gynaecology on teaching endoscopic surgery in The NetherlandsSurgical Endoscopy, 2007
- Transforming Physics EducationPhysics Today, 2005
- The assessment of clinical skills/competence/performanceAcademic Medicine, 1990
- How we should measure "change": Or should we?Psychological Bulletin, 1970