Behavior-Based Grade Prediction for MOOCs via Time Series Neural Networks
- 2 May 2017
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Selected Topics in Signal Processing
- Vol. 11 (5), 1
- https://doi.org/10.1109/jstsp.2017.2700227
Abstract
We present a novel method for predicting the evolution of a students grade in massive open online courses (MOOCs). Performance prediction is particularly challenging in MOOC settings due to per-student assessment response sparsity and the need for personalized models. Our method overcomes these challenges by incorporating another, richer form of data collected from each student—lecture video-watching clickstreams—into the machine learning feature set, and using that to train a time series neural network that learns from both prior performance and clickstream data. Through evaluation on two MOOC datasets, we find that our algorithm outperforms a baseline of average past performance by more than 60% on average, and a lasso regression baseline by more than 15%. Moreover, the gains are higher when the student has answered fewer questions, underscoring their ability to provide instructors with early detection of struggling and/or advanced students. We also show that despite these gains, when taken alone, none of the behavioral features are particularly correlated with performance, emphasizing the need to consider their combined effect and nonlinear predictors. Finally, we discuss how course instructors can use these predictive learning analytics to stage student interventions.Keywords
This publication has 21 references indexed in Scilit:
- MOOC performance prediction via clickstream data and social learning networksPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2015
- eTutor: Online learning for personalized educationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2015
- Motivation as a Lens to Understand Online LearnersACM Transactions on Computer-Human Interaction, 2015
- Individualization for Education at Scale: MIIC Design and Preliminary EvaluationIEEE Transactions on Learning Technologies, 2014
- Learning about Social Learning in MOOCs: From Statistical Analysis to Generative ModelIEEE Transactions on Learning Technologies, 2014
- Your click decides your fate: Inferring Information Processing and Attrition Behavior from MOOC Video Clickstream InteractionsPublished by Association for Computational Linguistics (ACL) ,2014
- Predicting MOOC Dropout over Weeks Using Machine Learning MethodsPublished by Association for Computational Linguistics (ACL) ,2014
- Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine TranslationPublished by Association for Computational Linguistics (ACL) ,2014
- Predicting students' final performance from participation in on-line discussion forumsComputers & Education, 2013
- Long Short-Term MemoryNeural Computation, 1997