An evaluation of an augmented reality multimodal interface using speech and paddle gestures

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 4282 LNCS, Issue , 2006, Pages 272-283

  Irawati, Sylvia ^a,c   Green, Scott ^b   Billinghurst, Mark ^b   Duenser, Andreas ^b   Ko, Heedong ^a  

^a Korea Institute of Science and Technology   (South Korea)

^b UNIVERSITY OF CANTERBURY   (New Zealand)

^c University of Science and Technology (UST)   (South Korea)

Author keywords

Augmented reality; Evaluation; Gesture input; Multimodal interaction; Paddles gestures; Speech input

Indexed keywords

AUGMENTED REALITY; HUMAN COMPUTER INTERACTION; INTERACTIVE COMPUTER SYSTEMS; SEMANTICS; USER INTERFACES;

EVALUATION; GESTURE INPUT; MULTI-MODAL INTERACTIONS; PADDLES GESTURES; SPEECH INPUT;

SPEECH;

EID: 76649119918     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/11941354_28     Document Type: Conference Paper

References (28)

1. Hannes Kaufmann: Collaborative Augmented Reality in Education. Keynote Speech at Imagina Conference (2003)
2. Istvan Barakonyi, Dieter Schmalstieg: Augmented Reality Agents in the Development Pipeline of Computer Entertainment. In Proceedings of the 4th International Conference on Entertainment Compute (2005)
3. Anthony Webster, Steven Feiner, Blair Maclntyre,William Massie, Theodore Krueger: Augmented reality in architectural construction, inspection and renovation. In Proceedings of ASCE Third Congress on Computing in Civil Engineering, Anaheim, CA (1996) 913-919
4. Christian Geiger, Leif Oppermann, Christian Reimann: 3D-Registered InteractionSurfaces in Augmented Reality Space. In Proceedings of 2nd IEEE International Augmented Reality Toolkit Workshop (2003)
5. Kiyoshi Kiyokawa, Haruo Takemura, Naokazu Yokoya: A Collaboration Support Technique by Integrating a Shared Virtual Reality and a Shared Augmented Reality. In Proceedings of IEEE International Conference on Systems Man and Cybernetics (1999) 48-53
6. H. Kato, M. Billinghurst, I. Poupyrev, N. Tetsutani, K. Tachibana: Tangible Augmented Reality for Human Computer Interaction. In Proceedings of Nicograph, Nagoya, Japan (2001)
7. Zsolt Szalavari, Michael Gervautz: The Personal Interaction Panel - A Two-Handed Interface for Augmented Reality. In Proceedings of EUROGRAPHICS, Computer Graphics Forum, Vol.16, 3 (1997) 335-346.
8. nd International Conference on Computer Graphics and Interactive Techniques (2004) 212-221
9. Richard A. Bolt: Put-That-There: Voice and Gesture at the Graphics Interface. In Proceedings of the International conference on Computer graphics and interactive techniques, Vol, 14 (1980) 262-270
10. M. W. Salisbury, J. H. Hendrickson, T. L. Lammers, C. Fu, S. A. Moody: Talk and Draw: Bundling Speech and Graphics. IEEE Computer, Vol.23, issue 8 (1990) 59-65
11. P.R. Cohen, M. Johnston, D.R. McGee, S.L. Oviatt, J.A. Pittman, I. Smith, L. Chen, J. Clow: Quickset: Multimodal Interaction for Distributed Applications. In Proceedings of the Fifth Annual International Multimodal Conference (1997) 31-40
12. P.R. Cohen, M. Dalrymple, F.C.N. Pereira, J.W. Sullivan, R.A. Gargan Jr., J.L. Schlossberg, S.W. Tyler: Synergistic Use of Direct Manipulation and Natural Language. In Proceedings of ACM Conference on Human Factors in Computing Systems (1989) 227-233
13. P.R. Cohen: The Role of Natural Language in a Multimodal Interface. In Proceedings of the fifth symposium on user interface software and technology (1992) 143-149
14. C. Schmandt, M.S. Ackerman, D. Hndus: Augmenting a Window System with Speech Input. IEEE Computer, Vol.23, issue 8, (1990) 50-56
15. P. Kay: Speech Driven Graphics: a User Interface, Journal of Microcomputer Applications, Vol.16 (1993) 223-231
16. Alexander. G. Hauptmann: Speech and Gestures for Graphic Image Manipulation. In Proceedings of ACM Conference on Human Factors in Computing Systems (1989) 241-245
17. P. R. Cohen, D. McGee, S. L. Oviatt, L. Wu, J. Clow, R. King, S. Julier, L. Rosenblum: Multimodal interactions for 2D and 3D environments. IEEE Computer Graphics and Applications (1999) 10-13
18. Joseph J. Laviola Jr.: Whole-Hand and Speech Input in Virtual Environments. Master Thesis, Brown University (1996)
19. Jan Ciger, Mario Gutierrez, Frederic Vexo, Daniel Thalmann: The Magic Wand. In Proceedings of the 19th Spring Conference on Computer Graphics (2003) 119-124
20. M.E. Latoschik, M. Schilling: Incorporating VR Databases into AI Knowledge Representations: A Framework for Intelligent Graphics Applications. In Proceedings of the 6th International Conference on Computer Graphics and Imaging (2003)
21. Hartwig Holzapfel, Kai Nickel, Rainer Stiefelhagen: Implementation and Evaluation of a Constraint-based Multimodal Fusion System for Speech and 3D Pointing Gestures. In Proceedings of the 6th International Conference on Multimodal Interfaces (2004) 175-182
22. David R. McGee, Philip R. Cohen: Creating Tangible Interfaces by Augmenting Physical Objects with Multimodal Language. In Proceedings of the 6th International Conference on Intelligent User Interfaces (2001) 113-119
23. Gunther Heidemann, Ingo Bax, Holger Bekel: Multimodal Interaction in an Augmented Reality Scenario. In Proceedings of the 6th International Conference on Multimodal Interfaces (2004) 53-60
24. Alex Olwal, Hrvoje Benko, Steven Feiner: SenseShapes: Using Statistical Geometry for Object Selection in a Multimodal Augmented Reality System. In Proceedings of the second IEEE and ACM International Symposium on Mixed and Augmented Reality (2003) 300-301
25. Ed Kaiser, Alex Olwal, David McGee, Hrvoje Benko, Andrea Corradini, Li Xiaoguang, Phil Cohen, Steven Feiner: Mutual Disambiguation of 3D Multimodal Interaction in Augmented and Virtual Reality. In Proceedings of the fifth International Conference on Multimodal Interfaces (2003) 12-19
26. H. Kato, M. Billinghurst, I. Poupyrev, K. Imamoto, K. Tachibana: Virtual Object Manipulation on a Table-Top AR Environment. In Proceedings of the International Symposium on Augmented Reality (2000) 111-119
27. ARToolKit, http://www.hitl.washington.edu/artoolkit
28. Matthias Denecke: Rapid Prototyping for Spoken Dialogue Systems. In Proceedings of the 19th international conference on Computational Linguistics, Vol.1 (2002) 1-7