Visual gesture interfaces for virtual environments
- 1 April 2002
- journal article
- Published by Oxford University Press (OUP) in Interacting with Computers
- Vol. 14 (3), 231-250
- https://doi.org/10.1016/s0953-5438(01)00050-9
Abstract
Virtual environments provide a whole new way of viewing and manipulating 3D data. Current technology moves the images out of desktop monitors and into the space immediately surrounding the user. Users can literally put their hands on the virtual objects. Unfortunately, techniques for interacting with such environments are yet to mature. Gloves and sensor-based trackers are unwieldy, constraining and uncomfortable to use. A natural, more intuitive method of interaction would be to allow the user to grasp objects with their hands and manipulate them as if they were real objects. We are investigating the use of computer vision in implementing a natural interface based on hand gestures. A framework for a gesture recognition system is introduced along with results of experiments in colour segmentation, feature extraction and template matching for finger and hand tracking, and simple hand pose recognition. Implementation of a gesture interface for navigation and object manipulation in virtual environments is presented.Keywords
This publication has 16 references indexed in Scilit:
- Gestural interface to a visual computing environment for molecular biologistsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Making graphics physically tangibleCommunications of the ACM, 1999
- Formalizing the Design, Evaluation, and Application of Interaction Techniques for Immersive Virtual EnvironmentsJournal of Visual Languages & Computing, 1999
- Glove-TalkII-a neural-network interface which maps gestures to parallel formant speech synthesizer controlsIEEE Transactions on Neural Networks, 1998
- A survey of 3D interaction techniquesComputer Graphics Forum, 1997
- Cutting planes and beyondComputers & Graphics, 1997
- 3D Deformable Hand ModelsPublished by Springer Science and Business Media LLC ,1997
- Advanced interaction techniques in virtual environmentsComputers & Graphics, 1993
- Closed-form solution of absolute orientation using unit quaternionsJournal of the Optical Society of America A, 1987
- “Put-that-there”ACM SIGGRAPH Computer Graphics, 1980