Capti-speak
- 18 May 2015
- conference paper
- conference paper
- Published by Association for Computing Machinery (ACM)
Abstract
People with vision impairments interact with web pages via screen readers that provide keyboard shortcuts for navigating through the content. However, web browsing with screen readers can be a frustrating experience mainly due to time and effort spent on locating the desired content through the extensive use of keyboard shortcuts. This gets even worse if users have limited shortcut vocabulary or are not familiar with the structure of a particular webpage. Augmenting screen readers with a speech input interface has the potential to alleviate the above limitations. This paper describes the design, implementation, and evaluation of Capti-Speak, a speech-enabled screen reader for web browsing, capable of translating speech utterances into browsing actions, executing the actions, and providing audio feedback. The novelty of Capti-Speak is that it leverages a custom dialog model, designed exclusively for non-visual web access, for interpreting speech utterances. A user study with 20 blind subjects showed that Capti-Speak was significantly more usable and efficient compared to the regular screen reader, especially for ad-hoc browsing, searching, and navigating to the content of interest.Keywords
Funding Information
- National Institutes of Health (1R43EY021962)
This publication has 13 references indexed in Scilit:
- A voice-controlled web browser to navigate hierarchical hidden menus of web pages in a smart-tv environmentPublished by Association for Computing Machinery (ACM) ,2014
- Wizard-of-Oz evaluation of speech-driven web browsing interface for people with vision impairmentsPublished by Association for Computing Machinery (ACM) ,2014
- Dialogue Act Modeling for Non-Visual Web AccessPublished by Association for Computational Linguistics (ACL) ,2014
- Predictive web automation assistant for people with vision impairmentsPublished by Association for Computing Machinery (ACM) ,2013
- A conversational interface to web automationPublished by Association for Computing Machinery (ACM) ,2010
- More than meets the eyePublished by Association for Computing Machinery (ACM) ,2010
- Here's what i didPublished by Association for Computing Machinery (ACM) ,2010
- CoScripterPublished by Association for Computing Machinery (ACM) ,2008
- What Frustrates Screen Reader Users on the Web: A Study of 100 Blind UsersInternational Journal of Human–Computer Interaction, 2007
- Accurate unlexicalized parsingPublished by Association for Computational Linguistics (ACL) ,2003