Design and development of hand gesture recognition system for speech impaired people

Abstract

All over world, deaf and dumb people face struggle in expressing their feelings to other people. There are various challenges experienced by speech and hearing impaired people at public places in expressing themselves to normal people. The solution to this problem is determined in this paper, by the usage of the Indian sign language symbols which are generic to all deaf and dumb people in India. The gestures illustrated by the Indian sign language symbols will be conquered with the support of the flex sensors and accelerometer. The movements included during gesture representation are rotation, angle tilt, and direction changes. The flex sensor and the accelerometer are incorporated over fingers and wrist respectively to acquire their dynamics, a these sensors are fitted over the data glove. These voltage signals will then be processed by microcontroller and sent to voice module, where the words voice outputs are stored and play backed equivalent to each word values to produce the appropriate voice words with the help of the speaker.