WR-Hand
- 9 September 2021
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Vol. 5 (3), 1-27
- https://doi.org/10.1145/3478112
Abstract
This paper presents WR-Hand, a wearable-based system tracking 3D hand pose of 14 hand skeleton points over time using Electromyography (EMG) and gyroscope sensor data from commercial armband. This system provides a significant leap in wearable sensing and enables new application potentials in medical care, human-computer interaction, etc. A challenge is the armband EMG sensors inevitably collect mixed EMG signals from multiple forearm muscles because of the fixed sensor positions on the device, while prior bio-medical models for hand pose tracking are built on isolated EMG signal inputs from isolated forearm spots for different muscles. In this paper, we leverage the recent success of neural networks to enhance the existing bio-medical model using the armband's EMG data and visualize our design to understand why our solution is effective. Moreover, we propose solutions to place the constructed hand pose reliably in a global coordinate system, and address two practical issues by providing a general plug-and-play version for new users without training and compensating for the position difference in how users wear their armbands. We implement a prototype using different commercial armbands, which is lightweight to execute on user's phone in real-time. Extensive evaluation shows the efficacy of the WR-Hand design.Keywords
Funding Information
- Research Grants Council of Hong Kong (CityU 11217420)
This publication has 56 references indexed in Scilit:
- Motion reconstruction using very few accelerometers and ground contactsGraphical Models, 2015
- Real-Time Continuous Pose Recovery of Human Hands Using Convolutional NetworksACM Transactions on Graphics, 2014
- Use it freePublished by Association for Computing Machinery (ACM) ,2014
- Continuous and simultaneous estimation of finger kinematics using inputs from an EMG-to-muscle activation modelJournal of NeuroEngineering and Rehabilitation, 2014
- Surface EMG Signal Amplification and FilteringInternational Journal of Computer Applications, 2013
- Synergy-based hand pose sensing: Optimal glove designThe International Journal of Robotics Research, 2013
- Secure unlocking of mobile touch screen devices by simple gesturesPublished by Association for Computing Machinery (ACM) ,2013
- Neural network committees for finger joint angle estimation from surface EMG signalsBioMedical Engineering OnLine, 2009
- The AcceleGlovePublished by Association for Computing Machinery (ACM) ,2002
- A spectral entropy method for distinguishing regular and irregular motion of Hamiltonian systemsJournal of Physics A: General Physics, 1979