The Best of Both Worlds: Building on the COPUS and RTOP Observation Protocols to Easily and Reliably Measure Various Levels of Reformed Instructional Practice
Open Access
- 1 June 2015
- journal article
- Published by American Society for Cell Biology (ASCB) in CBE—Life Sciences Education
- Vol. 14 (2), ar18
- https://doi.org/10.1187/cbe.14-10-0168
Abstract
Researchers, university administrators, and faculty members are increasingly interested in measuring and describing instructional practices provided in science, technology, engineering, and mathematics (STEM) courses at the college level. Specifically, there is keen interest in comparing instructional practices between courses, monitoring changes over time, and mapping observed practices to research-based teaching. While increasingly common observation protocols (Reformed Teaching Observation Protocol [RTOP] and Classroom Observation Protocol in Undergraduate STEM [COPUS]) at the postsecondary level help achieve some of these goals, they also suffer from weaknesses that limit their applicability. In this study, we leverage the strengths of these protocols to provide an easy method that enables the reliable and valid characterization of instructional practices. This method was developed empirically via a cluster analysis using observations of 269 individual class periods, corresponding to 73 different faculty members, 28 different research-intensive institutions, and various STEM disciplines. Ten clusters, called COPUS profiles, emerged from this analysis; they represent the most common types of instructional practices enacted in the classrooms observed for this study. RTOP scores were used to validate the alignment of the 10 COPUS profiles with reformed teaching. Herein, we present a detailed description of the cluster analysis method, the COPUS profiles, and the distribution of the COPUS profiles across various STEM courses at research-intensive universities.Keywords
This publication has 19 references indexed in Scilit:
- Cottrell Scholars Collaborative New Faculty Workshop: Professional Development for New Chemistry Faculty and Initial Assessment of Its EfficacyJournal of Chemical Education, 2014
- Instructional Systems of Practice: A Multidimensional Analysis of Math and Science Undergraduate Course Planning and Classroom TeachingJournal of the Learning Sciences, 2013
- Organizational Factors and Instructional Decision-Making: A Cognitive PerspectiveThe Review of Higher Education, 2012
- Peer observations among faculty in a college of education: investigating the summative and formative uses of the Reformed Teaching Observation Protocol (RTOP)Educational Assessment, Evaluation and Accountability, 2011
- What We Say Is Not What We Do: Effective Evaluation of Faculty Professional Development ProgramsBioScience, 2011
- Pedagogical practices and instructional change of physics facultyAmerican Journal of Physics, 2010
- Barriers to the use of research-based instructional strategies: The influence of both individual and situational characteristicsPhysical Review Special Topics - Physics Education Research, 2007
- Educational Reform, Personal Practical Theories, and Dissatisfaction: The Anatomy of Change in College Science TeachingAmerican Educational Research Journal, 2003
- Why so many clustering algorithmsACM SIGKDD Explorations Newsletter, 2002
- Peer Instruction: Ten years of experience and resultsAmerican Journal of Physics, 2001