An Approach to Ballet Dance Training through MS Kinect and Visualization in a CAVE Virtual Reality Environment
- 31 March 2015
- journal article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Intelligent Systems and Technology
- Vol. 6 (2), 1-37
- https://doi.org/10.1145/2735951
Abstract
This article proposes a novel framework for the real-time capture, assessment, and visualization of ballet dance movements as performed by a student in an instructional, virtual reality (VR) setting. The acquisition of human movement data is facilitated by skeletal joint tracking captured using the popular Microsoft (MS) Kinect camera system, while instruction and performance evaluation are provided in the form of 3D visualizations and feedback through a CAVE virtual environment, in which the student is fully immersed. The proposed framework is based on the unsupervised parsing of ballet dance movement into a structured posture space using the spherical self-organizing map (SSOM). A unique feature descriptor is proposed to more appropriately reflect the subtleties of ballet dance movements, which are represented as gesture trajectories through posture space on the SSOM. This recognition subsystem is used to identify the category of movement the student is attempting when prompted (by a virtual instructor) to perform a particular dance sequence. The dance sequence is then segmented and cross-referenced against a library of gestural components performed by the teacher. This facilitates alignment and score-based assessment of individual movements within the context of the dance sequence. An immersive interface enables the student to review his or her performance from a number of vantage points, each providing a unique perspective and spatial context suggestive of how the student might make improvements in training. An evaluation of the recognition and virtual feedback systems is presented.Keywords
This publication has 44 references indexed in Scilit:
- Real‐time mocap dance recognition for an interactive dancing gameComputer Animation and Virtual Worlds, 2011
- Ground reaction forces and knee mechanics in the weight acceptance phase of a dance leap take-off and landingJournal of Sports Sciences, 2011
- Influence of vision and motor imagery styles on equilibrium control during whole-body rotationsSomatosensory & Motor Research, 2009
- Gender and Limb Differences in Healthy Elite Dancers: Passé KinematicsJournal of Motor Behavior, 2006
- Comparison of Repetitive Movements Between Ballet Dancers and Martial Artists: Risk Assessment of Muscle Overuse Injuries and Prevention StrategiesResearch in Sports Medicine, 2005
- Ankle biomechanics of ballet Dancers in relevé en pointé danceResearch in Sports Medicine, 2005
- Modeling Effects of Rhythmic Context on Perceived Duration: A Comparison of Interval and Entrainment Approaches to Short-Interval Timing.Journal of Experimental Psychology: Human Perception and Performance, 2003
- Implementation and Evaluation of “Just Follow Me”: An Immersive, VR-Based, Motion-Training SystemPRESENCE: Virtual and Augmented Reality, 2002
- The recognition of human movement using temporal templatesIeee Transactions On Pattern Analysis and Machine Intelligence, 2001
- Imagery and Conditioning Practices for DancersDance Research Journal, 1997