A Wizard of Oz Study for an AR Multimodal Interface

ICMI'08: Proceedings of the 10th International Conference on Multimodal Interfaces

Volumn , Issue , 2008, Pages 249-256

  Lee, Minkyung ^a   Billinghurst, Mark ^a  

^a UNIVERSITY OF CANTERBURY   (New Zealand)

Author keywords

AR; Augmented reality; HCI; Multimodal interaction; Multimodal interface; User study; Wizard of Oz; WOz

Indexed keywords

ARGON; INTERACTIVE COMPUTER SYSTEMS; VIRTUAL REALITY;

AR; HCI; MULTIMODAL INTERACTION; MULTIMODAL INTERFACE; USER STUDY; WIZARD OF OZ; WOZ;

AUGMENTED REALITY;

EID: 63449113322     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1452392.1452444     Document Type: Conference Paper

References (31)

1. Swan II, J.E. and Gabbard, J. L. 2005. Survey of User-Based Experimentation in Augmented Reality. In Proc. of 1st Int'l Conf. on Virtual Reality. HCI International 2005, 2005.
2. Broll, W., Stoerring, M., and Mottram, C. 2003. The Augmented Round Table - a New Interface to Urban Planning and Architectural Design, In Proc. INTERACT'03, pp. 1103- 1104.
3. Nakashima, K., Machida, T., Kiyokawa, K., and Takemura, H., 2005. A 2D-3D Integrated Environment for Cooperative Work, In Proc. VRST'05, pp. 16-22.
4. Bolt, R. A. 1980. "Put-That-There": Voice and Gesture at the Graphics Interface. In Proc. Annual Conf. on Computer Graphics and Interactive Techniques, 262-270.
5. Cohen, P. R. and Sullivan, J. W. 1989. Synergistic User of Direct Manipulation and Natural Language. In Proc. CHI'89, 227-233.
6. Oviatt, S., Coulson, R., and Lunsford, R. 2004. When Do We Interact Multimodally? Cognitive Load and Multimodal Communication Patterns. In Proc ICMI'04, 129-136.
7. Hauptmann, A. G. 1989. Speech and gestures for graphic image manipulation. In Proc CHI'89, 241-245.
8. Cohen, P. R., Johnston, M., McGee, D., and Oviatt, S. 1997. QuickSet: Multimodal Interaction for Distributed Applications. In Proc. Int'l Conf. on Multimedia, 31-40.
9. Rauschert, I., Agrawal, P., Sharmar, R., Fuhrmann, S., Brewer, I., MacEachren, A., Wang, H., and Cai, G. 2002. Designing a Human-Centered, Multimodal GIS Interface to Support Emergency Management. In Proc. GIS'02, 119-124.
10. Tse, E., Greenberg, S., and Shen, C. 2006. GSI DEMO: Multiuser Gesture/Speech Interaction over Digital Tables by Wrapping Single User Applications. In Proc. ICMI'06, 76-83.
11. Olwal, A., Benko, H., and Feiner, S. 2003. SenseShapes: Using Statistical Geometry for Object Selection in a Multimodal Augmented Reality System. In Proc. ISMAR'03, 300-301.
12. Weimer, D., and Genapathy, S.K. 1989. A Synthetic Visual Environment with Hand Gesturing and Voice Input. In Proc. CHI'89, 235-240.
13. Koons, D. B., and Sparrell, C. J. 1994. ICONIC: Speech and Depictive Gestures at the Human-Machine Interface. In Proc. CHI'94, 453-454.
14. Lucente, M., Zwart, G. J., and George, A. D. 1998. Visualization Space: A Testbed for Deviceless Multimodal User Interface. In AAAI Spring Symposium on Intelligent Environments. AAAI TR SS-98-02.
15. Irawati, S., Green, S., Billinghurst, M., Duenser, A., and Ko, H. 2006. "Move the Couch Where?": Developing an Augmented Reality Multimodal Interface". In Proc. ISMAR'06, 183-186.
16. Billinghurst, M., Kato, H., Poupyrev, I., Imamoto, K., and Tachibana, K. 2000. Virtual Object Manipulation on a Table-Top AR Environment. In Proc. ISAR'00, 111-119.
17. Irawati, S., Green, S., Billinghurst, M., Duenser, A., and Ko, H. 2006. An Evaluation of an Augmented Reality Multimodal Interface Using Speech and Paddle Gestures. In Proc. ICAT'06, 272-283.
18. Kölsch, M., Turk, M., and Tobias, H. 2006. Multimodal Interaction with a Wearable Augmented Reality System. IEEE Computer Graphics and Applications, 26, 3, 62-71.
19. Kölsch, M., Turk, M., and Tobias, H. 2004. Vision-Based Interfaces for Mobility. In Proc. MobiQuitous'04, 86- 94.
20. Salber, D., and Coutaz, J. 1993. Applying the Wizard of Oz Technique to the Study of Multimodal Systems. In Proc. HCI'93, 219-230.
21. Coutaz, J., Salber, D., Carraux, E., and Portolan, N. 1996. NEIMO, a multiworkstation usability lab for observing and analyzing multimodal interaction. In Proc. Conf. Companion on Human Factors in Computing Systems, 402-403.
22. Oviatt, S. L., Cohen, P. R., Fong, M. W., and Frank, M. P. 1992. A rapid semi-automatic simulation technique for interactive speech and handwriting. In Proc. Int'l Conf. on Spoken Language Processing, 2, 1351-1354.
23. Oviatt, S.L., Cohen, P.R., and Wang, M. 1994. Toward interface design for human language technology: Modality and structure as determinants of linguistic complexity. Speech Communication, 15, 3-4, 283-300.
24. Corradini, A. and Cohen, P. R. 2002. On the Relationships among Speech, Gestures, and Object Manipulation in Virtual Environments: Initial Evidence. In Proc. Int'l CLASS Workshop on Natural, Intelligent and Effective Interaction in Multimodal Dialogue Systems, 52-61.
25. Molin, L. 2004. Wizard-of-Oz Prototyping for Cooperative Interaction Design of Graphical User Interfaces. In Proc. NordiCHI'04, 425-428.
26. OpenCV Library. 2008. http://sourceforge.net/projects/opencvlibrary/
27. Freeman, H. 1974. Computer processing of line-drawing images. Computing Surveys, 6, 157-97.
28. Borgefors, G. 1986. Distance Transformations in Digital Images. Computer Vision, Graphics and Image Processing, 34, 344-371.
29. Looser, J., Grasset, R., Seichter, H., and Billinghurst, M. 2006. OSGART - A Pragmatic Approach to MR. In Proc. Industrial AR Workshop, ISMAR'06.
30. Billinghurst, M., Campbell, S., Chinthammit, W., Hendrickson, D., Poupyrev, I., Takahashi, K., and Kato, H. 2000. Magic book: Exploring transitions in collaborative AR interfaces. Emerging Technologies Proposal, SIGGRAPH'00.
31. McNeil, D. 1992. Hand and Mind: What gestures reveal about thought. University of Chicago Press, Chicago, IL, USA.