Rotate-and-Press: A Non-visual Alternative to Point-and-Click?
- 25 September 2020
- book chapter
- conference paper
- Published by Springer Science and Business Media LLC
- Vol. 12426, 291-305
- https://doi.org/10.1007/978-3-030-60149-2_23
Abstract
Most computer applications manifest visually rich and dense graphical user interfaces (GUIs) that are primarily tailored for an easy-and-efficient sighted interaction using a combination of two default input modalities, namely the keyboard and the mouse/touchpad. However, blind screen-reader users predominantly rely only on keyboard, and therefore struggle to interact with these applications, since it is both arduous and tedious to perform the visual ‘point-and-click’ tasks such as accessing the various application commands/features using just keyboard shortcuts supported by screen readers. In this paper, we investigate the suitability of a ‘rotate-and-press’ input modality as an effective non-visual substitute for the visual mouse to easily interact with computer applications, with specific focus on word processing applications serving as the representative case study. In this regard, we designed and developed bTunes, an add-on for Microsoft Word that customizes an off-the-shelf Dial input device such that it serves as a surrogate mouse for blind screen-reader users to quickly access various application commands and features using a set of simple rotate and press gestures supported by the Dial. Therefore, with bTunes, blind users too can now enjoy the benefits of two input modalities, as their sighted counterparts. A user study with 15 blind participants revealed that bTunes significantly reduced both the time and number of user actions for doing representative tasks in a word processing application, by as much as \(65.1\%\) and \(36.09\%\) respectively. The participants also stated that they did not face any issues switching between keyboard and Dial, and furthermore gave a high usability rating (84.66 avg. SUS score) for bTunes.
Keywords
This publication has 19 references indexed in Scilit:
- Speed-DialPublished by Association for Computing Machinery (ACM) ,2017
- Web Screen Reading Automation Assistance Using Semantic Abstraction | Proceedings of the 22nd International Conference on Intelligent User InterfacesPublished by Association for Computing Machinery (ACM) ,2017
- Capti-speakPublished by Association for Computing Machinery (ACM) ,2015
- Employment Outcomes for Blind and Visually Impaired AdultsJournal of Blindness Innovation and Research, 2015
- From screen reading to aural glancingPublished by Association for Computing Machinery (ACM) ,2014
- Making Microsoft Excel™Published by Association for Computing Machinery (ACM) ,2009
- New accessibility model for Microsoft Windows and cross platform developmentACM SIGACCESS Accessibility and Computing, 2005
- An investigation into formatting and layout errors produced by blind word-processor users and an evaluation of prototype error prevention and correction techniquesIEEE Transactions on Neural Systems and Rehabilitation Engineering, 2003
- User interface of a Home Page ReaderPublished by Association for Computing Machinery (ACM) ,1998
- Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical ResearchPublished by Elsevier BV ,1988