Move the couch where? : Developing an augmented reality multimodal interface

Proceedings - ISMAR 2006: Fifth IEEE and ACM International Symposium on Mixed and Augmented Reality

Volumn , Issue , 2006, Pages 183-186

  Irawati, Sylvia ^a,c,d   Green, Scott ^b,d   Billinghurst, Mark ^b,d   Duenser, Andreas ^b,d   Ko, Heedong ^a,d  

^a Korea Institute of Science and Technology   (South Korea)

^b UNIVERSITY OF CANTERBURY   (New Zealand)

^c University of Science and Technology

^d NONE   (New Zealand)

Author keywords

Augmented reality; Gesture input; Multimodal interaction; Paddle gestures; Speech input

Indexed keywords

AUGMENTED REALITY; INTERACTIVE COMPUTER SYSTEMS;

GESTURE INPUT; MULTI-MODAL FUSION; MULTI-MODAL INTERACTIONS; MULTI-MODAL INTERFACES; MULTIMODAL INPUTS; PADDLE GESTURES; SEMANTIC TECHNIQUES; SPEECH INPUT;

SEMANTICS;

EID: 45149097509     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ISMAR.2006.297812     Document Type: Conference Paper

References (24)

1. Anthony Webster, Steven Feiner, Blair MacIntyre,William Massie, and Theodore Krueger. Augmented reality in architectural construction, inspection and renovation. In Proceedings of .ASCE Third Congress on Computing in Civil Engineering, Anaheim, CA, June 1996, pp. 913-919.
2. Hannes Kaufmann. Collaborative Augmented Reality in Education. Keynote Speech at Imagina Conference, 2003.
3. Istvan Barakonyi and Dieter Schmalstieg. Augmented Reality Agents in the Development Pipeline of Computer Entertainment. In Proceedings of the 4th International Conference on Entertainment Compute, September 2005.
4. Christian Geiger, Leif Oppermann, and Christian Reimann. 3D-Registered Interaction-Surfaces in Augmented Reality Space. In Proceedings of 2nd IEEE International Augmented Reality Toolkit Workshop, 2003.
5. Zsolt Szalavári and Michael Gervautz. The Personal Interaction Panel - A Two-Handed Interface for Augmented Reality. In Proceedings of EUROGRAPHICS, Computer Graphics Forum, volume 16, issue 3, 1997, pp. 335-346.
6. Kiyoshi Kiyokawa, Haruo Takemura and Naokazu Yokoya. A Collaboration Support Technique by Integrating a Shared Virtual Reality and a Shared Augmented Reality. In Proceedings of IEEE International Conference on Systems Man and Cybernetics, 1999, pp. 48-53.
7. H. Kato, M. Billinghurst, I. Poupyrev, N. Tetsutani, and K. Tachibana. Tangible Augmented Reality for Human Computer Interaction. In Proceedings of Nicograph 2001, Nagoya, Japan.
8. nd; International Conference on Computer Graphics and Interactive Techniques, 2004, pp. 212-221.
9. Richard A. Bolt. Put-That-There: Voice and Gesture at the Graphics Interface. In Proceedings of ACM SIGGRAPH, 1980, Computer Graphics, volume 14, pp 262-270.
10. M. W. Salisbury, J. H. Hendrickson, T. L. Lammers, C. Fu, S. A. Moody. Talk and Draw: Bundling Speech and Graphics. IEEE Compute, volume 23, issue 8, August, 1990, pp. 59-65.
11. P.R. Cohen, M. Johnston, D.R. McGee, S.L. Oviatt, J.A. Pittman, I. Smith, L. Chen, and J. Clow. Quickset: Multimodal Interaction for Distributed Applications. In Proceedings of the Fifth Annual International Multimodal Conference, 1997, pp. 31-40.
12. D. Weimer and S.K. Ganapathy. A Synthetic Visual Environment with Hand Gesturing and Voice Input. In Proceedings of ACM Conference on Human Factors in Computing Systems, 1989, pp. 235-240.
13. Joseph J. Laviola Jr. Whole-Hand and Speech Input in Virtual Environments. Master Thesis, Brown University, 1996.
14. Jan Ciger, Mario Gutierrez, Frederic Vexo, Daniel Thalmann. The Magic Wand. In Proceedings of the 19th Spring Conference on Computer Graphics, 2003, pp. 119-124.
15. M.E. Latoschik, and M. Schilling. Incorporating VR Databases into AI Knowledge Representations: A Framework for Intelligent Graphics Applications. In Proceedings of the 6th International Conference on Computer Graphics and Imaging, 2003.
16. Hartwig Holzapfel, Kai Nickel, and Rainer Stiefelhagen. Implementation and Evaluation of a Constraint-based Multimodal Fusion System for Speech and 3D Pointing Gestures. In Proceedings of the 6th International Conference on Multimodal Interfaces, 2004, ACM Press, pp. 175-182
17. David R. McGee and Philip R. Cohen. Creating Tangible Interfaces by Augmenting Physical Objects with Multimodal Language. In Proceedings of the 6th International Conference on Intelligent User Interfaces, 2001, pp. 113-119.
18. Gunther Heidemann, Ingo Bax, Holger Bekel, Multimodal Interaction in an Augmented Reality Scenario. In Proceedings of the 6th International Conference on Multimodal Interfaces, 2004, pp. 53-60.
19. Alex Olwal, Hrvoje Benko, and Steven Feiner. SenseShapes: Using Statistical Geometry for Object Selection in a Multimodal Augmented Reality System. In Proceedings of The Second IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR 2003). October 2003, pp. 300-301.
20. Ed Kaiser, Alex Olwal, David McGee, Hrvoje Benko, Andrea Corradini, Li Xiaoguang, Phil Cohen and Steven Feiner. Mutual Dissambiguation of 3D Multimodal Interaction in Augmented and Virtual Reality. In Proceedings of The Fifth International Conference on Multimodal Interfaces (ICMI 2003), 2003, pp. 12-19.
21. H. Kato, M. Billinghurst, I. Poupyrev, K. Imamoto and K. Tachibana. Virtual Object Manipulation on a Table-Top AR Environment. In Proceedings of the International Symposium on Augmented Reality (ISAR 2000), October 2000, pp. 111-119.
22. Matthias Denecke. Rapid Prototyping for Spoken Dialogue Systems. In Proceedings of the 19th international conference on Computational Linguistics, volume 1, 2002, pp. 1-7.
23. ARToolKit, http://www.hitl.washington.edu/artoolkit
24. ICE, http://www.zeroc.com/ice.html