Visual capture and understanding of hand pointing actions in a 3-D environment
- 22 July 2003
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics)
- Vol. 33 (4), 677-686
- https://doi.org/10.1109/tsmcb.2003.814281
Abstract
We present a nonintrusive system based on computer vision for human-computer interaction in three-dimensional (3-D) environments controlled by hand pointing gestures. Users are allowed to walk around in a room and manipulate information displayed on its walls by using their own hands as pointing devices. Once captured and tracked in real-time using stereo vision, hand pointing gestures are remapped onto the current point of interest, thus reproducing in an advanced interaction scenario the "drag and click" behavior of traditional mice. The system, called PointAt (patent pending), enjoys a careful modeling of both user and optical subsystem, and visual algorithms for self-calibration and adaptation to both user peculiarities and environmental changes. The concluding sections provide an insight into system characteristics, performance, and relevance for real applications.Keywords
This publication has 17 references indexed in Scilit:
- Real-time, 3D estimation of human body postures from trinocular imagesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- Perceptual user interfaces: things that seeCommunications of the ACM, 2000
- Interfacing through Visual PointersPublished by Cambridge University Press (CUP) ,1998
- GestureComputer – History, Design and ApplicationsPublished by Cambridge University Press (CUP) ,1998
- A brief history of human-computer interaction technologyInteractions, 1998
- Pfinder: real-time tracking of the human bodyIEEE Transactions on Pattern Analysis and Machine Intelligence, 1997
- Vision for man-machine interactionRobotics and Autonomous Systems, 1997
- Visually guided grasping in unstructured environmentsRobotics and Autonomous Systems, 1997
- A finger-mounted, direct pointing device for mobile computingPublished by Association for Computing Machinery (ACM) ,1997
- Interacting with paper on the DigitalDeskCommunications of the ACM, 1993