Web Screen Reading Automation Assistance Using Semantic Abstraction | Proceedings of the 22nd International Conference on Intelligent User Interfaces
- 7 March 2017
- conference paper
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 407-418
- https://doi.org/10.1145/3025171.3025229
Abstract
A screen reader's sequential press-and-listen interface makes for an unsatisfactory and often times painful web-browsing experience for blind people. To help alleviate this situation, we introduce Web Screen Reading Automation Assistant (SRAA) for automating users' screen-reading actions (e.g., finding price of an item) on demand, thereby letting them focus on what they want to do rather than on how to get it done. The key idea is to elevate the interaction from operating on (syntactic) HTML elements, as is done now, to operating on web entities (which are semantically meaningful collections of related HTML elements, e.g., search results, menus, widgets, etc.). SRAA realizes this idea of semantic abstraction by constructing a Web Entity Model (WEM), which is a collection of web entities of the underlying webpage, using an extensive generic library of custom-designed descriptions of commonly occurring web entities across websites. The WEM brings blind users closer to how sighted people perceive and operate on web entities, and together with a natural-language user interface, SRAA relieves users from having to press numerous shortcuts to operate on low-level HTML elements - the principal source of tedium and frustration. This paper describes the design and implementation of SRAA. Evaluation with 18 blind subjects demonstrates its usability and effectiveness.Keywords
Funding Information
- National Institute on Disability, Independent Living, and Rehabilitation Research (90BI0023-01-00)
This publication has 20 references indexed in Scilit:
- Capti-speakPublished by Association for Computing Machinery (ACM) ,2015
- Widget Classification with Applications to Web AccessibilityPublished by Springer Science and Business Media LLC ,2014
- Generation Y, web design, and eye trackingInternational Journal of Human-Computer Studies, 2010
- TrailBlazerPublished by Elsevier BV ,2010
- Finding and Extracting Data Records from Web PagesJournal of Signal Processing Systems, 2008
- CsurfPublished by Association for Computing Machinery (ACM) ,2007
- What Frustrates Screen Reader Users on the Web: A Study of 100 Blind UsersInternational Journal of Human–Computer Interaction, 2007
- Automation and customization of rendered web pagesPublished by Association for Computing Machinery (ACM) ,2005
- Fitts' Law as a Research and Design Tool in Human-Computer InteractionHuman–Computer Interaction, 1992
- On the Rate of Gain of InformationQuarterly Journal of Experimental Psychology, 1952