Variable frame rate for low power mobile sign language communication
- 15 October 2007
- conference paper
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 163-170
- https://doi.org/10.1145/1296843.1296872
Abstract
The MobileASL project aims to increase accessibility by enabling Deaf people to communicate over video cell phones in their native language, American Sign Language (ASL). Real-time video over cell phones can be a computationally intensive task that quickly drains the battery, rendering the cell phone useless. Properties of conversational sign language allow us to save power and bits: namely, lower frame rates are possible when one person is not signing due to turn-taking, and signing can potentially employ a lower frame rate than fingerspelling. We conduct a user study with native signers to examine the intelligibility of varying the frame rate based on activity in the video. We then describe several methods for automatically determining the activity of signing or not signing from the video stream in real-time. Our results show that varying the frame rate during turn-taking is a good way to save power without sacrificing intelligibility, and that automatic activity analysis is feasible.Keywords
This publication has 12 references indexed in Scilit:
- LIBSVMACM Transactions on Intelligent Systems and Technology, 2011
- "Can you see me now?" An objective metric for predicting intelligibility of compressed American Sign Language videoPublished by SPIE-Intl Soc Optical Eng ,2007
- MobileASL:Published by Association for Computing Machinery (ACM) ,2006
- Automatic Sign Language Analysis: A Survey and the Future beyond Lexical MeaningIeee Transactions On Pattern Analysis and Machine Intelligence, 2005
- Image change detection algorithms: a systematic surveyIEEE Transactions on Image Processing, 2005
- Biomechanical and perceptual constraints on the bandwidth requirements of sign languageIEEE Transactions on Neural Systems and Rehabilitation Engineering, 2004
- Power evaluation of a handheld computerIEEE Micro, 2003
- Recent developments in human motion analysisPattern Recognition, 2002
- Investigating the energy consumption of a wireless network interface in an ad hoc networking environmentPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Turn‐taking patterns in deaf conversationJournal of Sociolinguistics, 2001