Lifelong Personalization via Gaussian Process Modeling for Long-Term HRI
Open Access
- 7 June 2021
- journal article
- research article
- Published by Frontiers Media SA in Frontiers in Robotics and AI
Abstract
Across a wide variety of domains, artificial agents that can adapt and personalize to users have potential to improve and transform how social services are provided. Because of the need for personalized interaction data to drive this process, long-term (or longitudinal) interactions between users and agents, which unfold over a series of distinct interaction sessions, have attracted substantial research interest. In recognition of the expanded scope and structure of a long-term interaction, researchers are also adjusting the personalization models and algorithms used, orienting toward “continual learning” methods, which do not assume a stationary modeling target and explicitly account for the temporal context of training data. In parallel, researchers have also studied the effect of “multitask personalization,” an approach in which an agent interacts with users over multiple different tasks contexts throughout the course of a long-term interaction and learns personalized models of a user that are transferrable across these tasks. In this paper, we unite these two paradigms under the framework of “Lifelong Personalization,” analyzing the effect of multitask personalization applied to dynamic, non-stationary targets. We extend the multi-task personalization approach to the more complex and realistic scenario of modeling dynamic learners over time, focusing in particular on interactive scenarios in which the modeling agent plays an active role in teaching the student whose knowledge the agent is simultaneously attempting to model. Inspired by the way in which agents use active learning to select new training data based on domain context, we augment a Gaussian Process-based multitask personalization model with a mechanism to actively and continually manage its own training data, allowing a modeling agent to remove or reduce the weight of observed data from its training set, based on interactive context cues. We evaluate this method in a series of simulation experiments comparing different approaches to continual and multitask learning on simulated student data. We expect this method to substantially improve learning in Gaussian Process models in dynamic domains, establishing Gaussian Processes as another flexible modeling tool for Long-term Human-Robot Interaction (HRI) Studies.This publication has 25 references indexed in Scilit:
- Continued Progress: Promising Evidence on Personalized LearningPublished by Rand Corporation ,2015
- Improving Students’ Long-Term Knowledge Retention Through Personalized ReviewPsychological Science, 2014
- Social Robots for Long-Term Interaction: A SurveyInternational Journal of Social Robotics, 2013
- Individualized Bayesian Knowledge Tracing ModelsLecture Notes in Computer Science, 2013
- Computational Aeroacoustics Prediction of Acoustic Transmission Through a Realistic 2D StatorPublished by American Institute of Aeronautics and Astronautics (AIAA) ,2011
- A Survey on Transfer LearningIEEE Transactions on Knowledge and Data Engineering, 2009
- More Accurate Student Modeling through Contextual Estimation of Slip and Guess Probabilities in Bayesian Knowledge TracingLecture Notes in Computer Science, 2008
- Components of phonological awarenessReading and Writing, 1995
- Real Robots, Real Learning ProblemsPublished by Springer Science and Business Media LLC ,1993
- Rhyme recognition and phonemic perception in young childrenJournal of Psycholinguistic Research, 1981