Speech-filtered bubble ray
- 12 November 2007
- conference paper
- conference paper
- Published by Association for Computing Machinery (ACM) in Proceedings of the ninth international conference on Multimodal interfaces - ICMI '07
- p. 307-314
- https://doi.org/10.1145/1322192.1322245
Abstract
The rapid development of large interactive wall displays has been accompanied by research on methods that allow people to interact with the display at a distance. The basic method for target acquisition is by ray casting a cursor from one's pointing finger or hand position; the problem is that selection is slow and error-prone with small targets. A better method is the bubble cursor that resizes the cursor's activation area to effectively enlarge the target size. The catch is that this technique's effectiveness depends on the proximity of surrounding targets: while beneficial in sparse spaces, it is less so when targets are densely packed together. Our method is the speech-filtered bubble ray that uses speech to transform a dense target space into a sparse one. Our strategy builds on what people already do: people pointing to distant objects in a physical workspace typically disambiguate their choice through speech. For example, a person could point to a stack of books and say "the green one". Gesture indicates the approximate location for the search, and speech 'filters' unrelated books from the search. Our technique works the same way; a person specifies a property of the desired object, and only the location of objects matching that property trigger the bubble size. In a controlled evaluation, people were faster and preferred using the speech-filtered bubble ray over the standard bubble ray and ray casting approach.Keywords
This publication has 15 references indexed in Scilit:
- How pairs interact over a multimodal digital tablePublished by Association for Computing Machinery (ACM) ,2007
- Fitts' law and expanding targetsACM Transactions on Computer-Human Interaction, 2005
- Distant freehand pointing and clicking on very large, high resolution displaysPublished by Association for Computing Machinery (ACM) ,2005
- The vacuumPublished by Association for Computing Machinery (ACM) ,2005
- The bubble cursorPublished by Association for Computing Machinery (ACM) ,2005
- TractorBeam Selection Aids: Improving Target Acquisition for Pointing Input on Tabletop DisplaysLecture Notes in Computer Science, 2005
- Semantic pointingPublished by Association for Computing Machinery (ACM) ,2004
- Mutual disambiguation of 3D multimodal interaction in augmented and virtual realityPublished by Association for Computing Machinery (ACM) ,2003
- DiamondTouchPublished by Association for Computing Machinery (ACM) ,2001
- A Note on the Information-Theoretic Basis for Fitts’ LawJournal of Motor Behavior, 1989