Humanoid robots communication with participants using sign language: An interaction based sign language game
- 1 November 2013
- conference paper
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE) in 2013 IEEE Workshop on Advanced Robotics and its Social Impacts
Abstract
This work presents the preliminary results of an ongoing project which aims to use humanoid robots as sign language tutors. The study mainly focuses on children who have some problems when they are communicating with other individuals such as hearing-impaired or autistic children. In this paper, an interactive game, which is based on sign language, between a humanoid robot and a human participant is introduced. The game consists of an imitation based learning phase where the signs are taught in the first step and they are tested in the second step within the frame of an interaction game. The goal of the interactive game is to reinforce the semantic meaning of the signs in a motivating and engaging way, as well as to test the learning performance of the participants. We aim to design a comfortable learning environment by using the humanoid robot as an educational medium. The game also improves the participants' imitation and turn-taking skills and teaches the semantic meanings of the signs.Keywords
This publication has 21 references indexed in Scilit:
- Facial expressions in American sign language: Tracking and recognitionPattern Recognition, 2012
- A phoneme based sign language recognition system using 2D moment invariant interleaving feature and Neural NetworkPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2011
- Simon plays Simon says: The timing of turn-taking in an imitation gamePublished by Institute of Electrical and Electronics Engineers (IEEE) ,2011
- Sign language recognition using a combination of new vision based featuresPattern Recognition Letters, 2011
- Hand gesture recognition based on dynamic Bayesian network frameworkPattern Recognition, 2010
- Modelling and recognition of the linguistic components in American Sign LanguageImage and Vision Computing, 2009
- Using ICT to Teach Sign LanguagePublished by Institute of Electrical and Electronics Engineers (IEEE) ,2008
- Visual Processing of Rock, Scissors, Paper Game for Human Robot InteractionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2006
- An adaptive WWW-based system to teach British sign languagePublished by Institute of Electrical and Electronics Engineers (IEEE) ,2005
- The MathSigner: an interactive learning tool for American sign language K-3 mathematicsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2004