How pairs interact over a multimodal digital table
- 29 April 2007
- conference paper
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 215-218
- https://doi.org/10.1145/1240624.1240659
Abstract
Co-located collaborators often work over physical tabletops using combinations of expressive hand gestures and verbal utterances. This paper provides the first observations of how pairs of people communicated and interacted in a multimodal digital table environment built atop existing single user applications. We contribute to the understanding of these environments in two ways. First, we saw that speech and gesture commands served double duty as both commands to the computer, and as implicit communication to others. Second, in spite of limitations imposed by the underlying single-user application, people were able to work together simultaneously, and they performed interleaving acts: the graceful mixing of inter-person speech and gesture actions as commands to the system. This work contributes to the intricate understanding of multi-user multimodal digital table interaction.Keywords
This publication has 10 references indexed in Scilit:
- GSI demoPublished by Association for Computing Machinery (ACM) ,2006
- Collaborative coupling over tabletop displaysPublished by Association for Computing Machinery (ACM) ,2006
- Enabling interaction with single user applications through speech and gestures on a multi-user tabletopPublished by Association for Computing Machinery (ACM) ,2006
- Territoriality in collaborative tabletop workspacesPublished by Association for Computing Machinery (ACM) ,2004
- Task analysis for groupware usability evaluationACM Transactions on Computer-Human Interaction, 2003
- Multimodal interaction during multiparty dialogues: initial resultsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- Ten myths of multimodal interactionCommunications of the ACM, 1999
- STAMP: a suite of tools for analyzing multimodal system processingPublished by International Speech Communication Association ,1998
- Using LanguagePublished by Cambridge University Press (CUP) ,1996
- Findings from observational studies of collaborative workInternational Journal of Man-Machine Studies, 1991