Enabling interaction with single user applications through speech and gestures on a multi-user tabletop

Proceedings of the Workshop on Advanced Visual Interfaces

Volumn 2006, Issue , 2006, Pages 336-343

  Tse, Edward ^a,b   Shen, Chia ^a   Greenberg, Saul ^b   Forlines, Clifton ^a  

^a MITSUBISHI ELECTRIC RESEARCH LABORATORIES   (United States)

^b UNIVERSITY OF CALGARY   (Canada)

Author keywords

Computer supported cooperative work; Multimodal speech and gesture interfaces; Tabletop interaction; Visual spatial displays

Indexed keywords

COMPUTER SUPPORTED COOPERATIVE WORK; GESTURE RECOGNITION; SEARCH ENGINES; USER INTERFACES;

DIGITAL TABLE DESIGN; GEOSPATIAL INFORMATION; GESTURE INTERFACES; TABLETOP INTERACTION;

SPEECH RECOGNITION;

EID: 34247196538     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1133265.1133336     Document Type: Conference Paper

References (26)

1. Bolt, R.A., Put-that-there: Voice and gesture at the graphics interface. Proc ACM Conf. Computer Graphics and Interactive Techniques Seattle, 1980, 262-270.
2. Clark, H. Using language. Cambridge Univ. Press, 1996.
3. Cohen, P. Speech can't do everything: A case for multimodal systems. Speech Technology Magazine, 5(4), 2000.
4. Cohen, P.R., Coulston, R. and Krout, K., Multimodal interaction during multiparty dialogues: Initial results. Proc IEEE Int'l Conf. Multimodal Interfaces, 2002, 448-452.
5. Cohen, P.R., Johnston, M., McGee, D., Oviatt, S., Pittman, J., Smith, I., Chen, L. and Clow, J., QuickSet: Multimodal interaction for distributed applications. Proc. ACM Multimedia, 1997, 31-40.
6. Dietz, P. and Leigh, D. DiamondTouch: a multi-user touch technology. Proc ACM UIST, 2001, 219-226.
7. Dix, A., Finlay, J. Abowd, G. and Beale, R. Human-Computer Interaction. 2nd ed. Prentice Hall, 1998.
8. Greenberg, S. and Boyle, M. Customizable physical interfaces for interacting with conventional applications. Proc ACM UIST, 2002, 31-40.
9. Greenberg, S., Sharing views and interactions with single-user applications. Proc ACM COIS, 1990, 227-237
10. Greenberg, S. Personalizable groupware: Accommodating individual roles and group differences. Proc ECSCW, 1991, 17-32.
11. Gutwin, C., and Greenberg, S. The importance of awareness for team cognition in distributed collaboration. In E. Salas, S. Fiore (Eds) Team Cognition: Understanding the Factors that Drive Process and Performance, APA Press, 2004, 177-201.
12. Gutwin, C. and Greenberg, S. Design for individuals, design for groups: Tradeoffs between power and workspace awareness. Proc ACM CSCW. 1998, 207-216
13. Heath, C.C. and Luff, P. Collaborative activity and technological design: Task coordination in London Underground control rooms. Proc ECSCW, 1991, 65-80
14. Ishii, H., Kobayashi, M. and Grudin, J. Integration of interpersonal space and shared workspace: ClearBoard design and experiments. ACM TOIS, 11 (4), 1993, 349-375.
15. Kruger, R., Carpendale, M.S.T., Scott, S. and Greenberg, S. Roles of orientation in tabletop collaboration: Comprehension, coordination and communication. J CSCW, 13(5-6), 2004, 501-537.
16. McGee, D.R. and Cohen, P.R., Creating tangible interfaces by augmenting physical objects with multimodal language. Proc ACM Conf Intelligent User Interfaces, 2001, 113-119.
17. Oviatt, S. L. Ten myths of multimodal interaction, Comm. ACM, 42(11), 1999, 74-81.
18. Oviatt, S. Multimodal interactive maps: Designing for human performance. Human-Computer Interaction 12, 1997.
19. Pinelle, D., Gutwin, C. and Greenberg, S. Task analysis for groupware usability evaluation: Modeling shared-workspace tasks with the mechanics of collaboration. ACM TOCHI, 10(4), 2003, 281-311.
20. Rekimoto, J. SmartSkin: An infrastructure for freehand manipulation on interactive surfaces. Proc ACM CHI, 2002.
21. Ringel-Morris, M., Ryall, K., Shen, C., Forlines, C., Vernier, F. Beyond social protocols: Multi-user coordination policies for co-located groupware. Proc ACM CSCW, 262-265, 2004.
22. Segal, L. Effects of checklist interface on non-verbal crew communications, NASA Ames Research Center, Contractor Report 177639. 1994
23. Tang, J. Findings from observational studies of collaborative work. Int. J. Man-Machine. Studies. 34 (2), 1991, 143-160.
24. Wigdor, D., Balakrishnan, R. Empirical investigation into the effect of orientation on text readability in tabletop displays. Proc ECSCW, 2005.
25. Wu, M., Shen, C., Ryall, K., Forlines, C., and Balakrishnan, R. Gesture registration, relaxation, and reuse for multi-point direct-touch surfaces. IEEE Int'l Workshop Horizontal Interactive Human-Computer Systems (TableTop). 2006.
26. Wu, M. and Balakrishnan, R. Multi-finger and whole hand gestural interaction techniques for multi-user tabletop displays. Proc ACM UIST, 193-202. 2003.