Assessing and Benchmarking Learning Outcomes of Robotics-Enabled STEM Education
Open Access
- 21 February 2021
- journal article
- research article
- Published by MDPI AG in Education Sciences
- Vol. 11 (2), 84
- https://doi.org/10.3390/educsci11020084
Abstract
Experienced middle school mathematics and science teachers were recruited for a pilot study. The teachers separately responded to a survey related to determining expected learning outcomes based on their traditional teaching, classroom experiences and observations, and self-brainstorming. The teachers then received training on how to design, develop, and implement robotics-enabled lessons under a design-based research approach for experiential learning, and taught robotics-enabled lessons to a selected student population in classroom settings. The teachers then responded to the survey for the robotics-enabled teaching. For each case (traditional and robotics-enabled), the survey responses were analyzed, and a set of expected learning outcomes of math and science lessons was derived separately. The thematic analysis results showed that the expected learning outcomes for the robotics-enabled lessons were not only related to the educational gains (content knowledge) observed in traditional teaching, but also to the improvements in the behavioral, social, scientific, cognitive, and intellectual aptitudes of the students. Then, a set of metrics and methods were proposed for assessing the learning outcomes separately. To validate the assessment metrics and methods, teachers from different schools taught two selected robotics-enabled lessons (one math, one science) to same grade students, and separately assessed the learning outcomes of each student using the proposed metrics and methods. The learning outcomes were then compared and benchmarked between schools and subjects. The results of a user study with the teachers showed user acceptance, effectiveness, and suitability of the assessment metrics and methods. The proposed scheme of assessing learning outcomes can be used to assess and justify the benefits and advantages of robotics-enabled STEM education, benchmark the outcomes, help improve teaching preparations, motivate decision-makers to confer on robotics-enabled STEM education and curricula development, and promote robotics-enabled STEM education.This publication has 44 references indexed in Scilit:
- Assessing Creativity in the ClassroomThe Open Education Journal, 2011
- Work sampling: Methodological advances and new applicationsHuman Factors and Ergonomics in Manufacturing & Service Industries, 2009
- eVALUate: an evaluation instrument for measuring students’ perceptions of their engagement and learning outcomesAssessment & Evaluation in Higher Education, 2008
- Learning outcomes for sustainable development in higher educationInternational Journal of Sustainability in Higher Education, 2008
- Higher education for sustainability: seeking affective learning outcomesInternational Journal of Sustainability in Higher Education, 2008
- Assignments as a Pedagogical Tool in Learning to Teach Science: A Case StudyJournal of Early Childhood Teacher Education, 2007
- Student-centred and teacher-centred learning environments: what students thinkTeaching in Higher Education, 2007
- The Role and Integration of Learning Outcomes into the Educational ProcessActive Learning in Higher Education, 2002
- Situated Learning and EducationEducational Researcher, 1996
- Facilitating Internalization: The Self‐Determination Theory PerspectiveJournal of Personality, 1994