Using haptic cues to aid nonvisual structure recognition
Open Access
- 19 May 2008
- journal article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Applied Perception
- Vol. 5 (2), 1-14
- https://doi.org/10.1145/1279920.1279922
Abstract
Retrieving information presented visually is difficult for visually disabled users. Current accessibility technologies, such as screen readers, fail to convey presentational layout or structure. Information presented in graphs or images is almost impossible to convey through speech alone. In this paper, we present the results of an experimental study investigating the role of touch (haptic) and auditory cues in aiding structure recognition when visual presentation is missing. We hypothesize that by guiding users toward nodes in a graph structure using force fields, users will find it easier to recognize overall structure. Nine participants were asked to explore simple 3D structures containing nodes (spheres or cubes) laid out in various spatial configurations and asked to identify the nodes and draw their overall structure. Various combinations of haptic and auditory feedback were explored. Our results demonstrate that haptic cues significantly helped participants to quickly recognize nodes and structure. Surprisingly, auditory cues alone did not speed up node recognition; however, when they were combined with haptics both node identification and structure recognition significantly improved. This result demonstrates that haptic feedback plays an important role in enabling people to recall spatial layout.Keywords
This publication has 11 references indexed in Scilit:
- Tac-tilesPublished by Association for Computing Machinery (ACM) ,2006
- Feeling what you hearPublished by Association for Computing Machinery (ACM) ,2006
- Non-visual overviews of complex data setsPublished by Association for Computing Machinery (ACM) ,2006
- MultiVisPublished by Association for Computing Machinery (ACM) ,2006
- Designing haptic computer interfaces for blind peoplePublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- A generic approach for augmenting tactile diagrams with spatial non-speech soundsPublished by Association for Computing Machinery (ACM) ,2002
- Haptic Cues for Image DisambiguationComputer Graphics Forum, 2000
- Haptic virtual reality for blind computer usersPublished by Association for Computing Machinery (ACM) ,1998
- MoBIC: An Aid to Increase the Independent Mobility of Blind TravellersBritish Journal of Visual Impairment, 1997
- Hand movements: A window into haptic object recognitionCognitive Psychology, 1987