Waving Real Hand Gestures Recorded by Wearable Motion Sensors to a Virtual Car and Driver in a Mixed-Reality Parking Game
- 1 January 2007
- conference paper
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
Abstract
We envision to add context awareness and ambient intelligence to edutainment and computer gaming applications in general. This requires mixed-reality setups and ever-higher levels of immersive human-computer interaction. Here, we focus on the automatic recognition of natural human hand gestures recorded by inexpensive, wearable motion sensors. To study the feasibility of our approach, we chose an educational parking game with 3D graphics that employs motion sensors and hand gestures as its sole game controls. Our implementation prototype is based on Java-3D for the graphics display and on our own CRN Toolbox for sensor integration. It shows very promising results in practice regarding game appeal, player satisfaction, extensibility, ease of interfacing to the sensors, and - last but not least - sufficient accuracy of the real-time gesture recognition to allow for smooth game control. An initial quantitative performance evaluation confirms these notions and provides further support for our setupKeywords
This publication has 16 references indexed in Scilit:
- Detection of eating and drinking arm gestures using inertial body-worn sensorsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2005
- Development of an American Sign Language game for deaf childrenPublished by Association for Computing Machinery (ACM) ,2005
- Martial arts in artificial realityPublished by Association for Computing Machinery (ACM) ,2005
- The HandWave Bluetooth Skin Conductance SensorLecture Notes in Computer Science, 2005
- Continuous Recognition of Arm Activities With Body-Worn Inertial SensorsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2004
- "Killer App" of wearable computingPublished by Association for Computing Machinery (ACM) ,2004
- CHI-ball, an interactive device assisting martial arts education for childrenPublished by Association for Computing Machinery (ACM) ,2003
- An online algorithm for segmenting time seriesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Recognition of walking behaviors for pedestrian navigationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- MIND-WARPINGPublished by Association for Computing Machinery (ACM) ,2000