Investigating the Dexterity of Multi-Finger Input for Mid-Air Text Entry
- 18 April 2015
- conference paper
- conference paper
- Published by Association for Computing Machinery (ACM)
Abstract
This paper investigates an emerging input method enabled by progress in hand tracking: input by free motion of fingers. The method is expressive, potentially fast, and usable across many settings as it does not insist on physical contact or visual feedback. Our goal is to inform the design of high-performance input methods by providing detailed analysis of the performance and anatomical characteristics of finger motion. We conducted an experiment using a commercially available sensor to report on the speed, accuracy, individuation, movement ranges, and individual differences of each finger. Findings show differences of up to 50% in movement times and provide indices quantifying the individuation of single fingers. We apply our findings to text entry by computational optimization of multi-finger gestures in mid-air. To this end, we define a novel objective function that considers performance, anatomical factors, and learnability. First investigations of one optimization case show entry rates of 22 words per minute (WPM). We conclude with a critical discussion of the limitations posed by human factors and performance characteristics of existing markerless hand trackers.Keywords
Funding Information
- Academy of Finland
- European Research Council (Starting Grant CapReal, Starting Grant COMPUTED (637991))
This publication has 36 references indexed in Scilit:
- Reducing legacy bias in gesture elicitation studiesInteractions, 2014
- Design and evaluation of finger-count interaction: Combining multitouch gestures and menusInternational Journal of Human-Computer Studies, 2012
- Usable gestures for mobile interfacesPublished by Association for Computing Machinery (ACM) ,2010
- Fingerspelling Recognition through Classification of Letter-to-Letter TransitionsLecture Notes in Computer Science, 2010
- Tilt techniquesPublished by Association for Computing Machinery (ACM) ,2009
- Experimental Evaluations of the Twiddler One-Handed Chording Mobile KeyboardHuman–Computer Interaction, 2006
- Towards a standard for pointing device evaluation, perspectives on 27 years of Fitts’ law research in HCIInternational Journal of Human-Computer Studies, 2004
- Intermediate motor learning as decreasing active (dynamical) degrees of freedomHuman Movement Science, 1998
- Fitts' Law as a Research and Design Tool in Human-Computer InteractionHuman–Computer Interaction, 1992
- An Investigation of Fitts’ Law Using a Wide Range of Movement AmplitudesJournal of Motor Behavior, 1976