8 A survey of multimodal interfaces for mobile mapping applications

Lecture Notes in Geoinformation and Cartography

Volumn 0, Issue 9783540371090, 2008, Pages 146-167

  Doyle, Julie ^a   Bertolotto, Michela ^a   Wilson, David ^b  

^a UNIVERSITY COLLEGE DUBLIN   (Ireland)

^b University of North Carolina at Charlotte   (United States)

Author keywords

Multimodal interaction; Multimodal interface; Multimodal system; Speech recognition; Voice command

Indexed keywords

INTERACTIVE COMPUTER SYSTEMS; MAPPING; SPEECH RECOGNITION; SURVEYS;

EFFICIENT INTERACTION; INTERACTION MODES; MAPPING APPLICATIONS; MULTI-MODAL INTERACTIONS; MULTI-MODAL INTERFACES; MULTIMODAL SYSTEM; USER INTERACTION; VOICE COMMAND;

USER INTERFACES;

EID: 77954086343     PISSN: 18632246     EISSN: 18632351     Source Type: Book Series    
DOI: 10.1007/978-3-540-37110-6_8     Document Type: Chapter

References (34)

1. Benoit, C., Martin, J.C., Pelachaud, C., Schomaker, L. and Suhm, B. (2000): Audio-visual and Multimodal Speech-based Systems. In Handbook of Multimodal and Spoken Dialogue Systems: Resources, Terminology and Product Evaluation, D. Gibbon, I. Mertins and R. Moore (Eds.), pp. 102-203
2. th ACM Symposium on Advances in Geographic Information Systems, pp. 152-157, Kansas City, Kansas.
3. th International Conference on Computer Graphics and Interactive Techniques, pp. 262-270, Seattle, Washington.
4. th ACM Conference on Multimedia, pp. 31-40, New York, New York.
5. th International Conference on Applied Natural Language Processing, pp 331-338, Seattle, Washington.
6. th International Conference on Intelligent User Interfaces, pp. 20-27, San Diego, California.
7. th International Conference on Enterprise Information Systems, in press, Paphos, Cyprus.
8. Doyle, J. (2007a): Multimodal Interface Design for Mobile GIS. A PhD thesis submitted to University College Dublin, January 2007.
9. Doyle, J., Bertolotto, M. and Wilson, D. (2007b): Multimodal Interface Design for Geospatial LBS. Under review for the Journal of Location Based Services.
10. Fuhrmann, S., MacEachren, A., Dou, J., Wang, K. and Cox, A. (2005): Gesture and Speech-based Maps to Support Use of GIS for Crisis Management: A User Study. In AutoCarto 2005, Las Vegas, Nevada.
11. IBM ViaVoice™ (2006): http://www-306.ibm.com/software/info1/websphere/index.jsp?tab=products/mobilespeech
12. th International Conference on Intelligent User Interfaces, pp. 59-66, San Diego, California.
13. th International Conference on Intelligent User Interfaces (IUI 04), pp. 161-168, Madeira, Portugal, ACM press.
14. Lynch, D., Bertolotto, M. and Wilson, D. (2005): Spatial Annotations in a Mapping Environment. In GISRUK ‘05, GIS Research UK, pp. 524-528, Glasgow, Scotland.
15. th International Conference on Intelligent User Interfaces, pp. 310-312, Madeira, Portugal.
16. th International Conference on Multimodal Interfaces, pp. 140-146, Vancouver, Canada.
17. OpenMap™ (2006): http://openmap.bbn.com/
18. Oviatt, S. (1996a): Multimodal Interfaces for Dynamic Interactive Maps. In SIGCHI Conference on Human Factors in Computing Systems, pp. 95-102, Vancouver, Canada.
19. Oviatt, S. (1999): Mutual Disambiguation of Recognition Errors in a Multimodal Architecture. In The Conference on Human Factors in Computing Systems (CHI ’99), pp. 576-583, Pittsburgh, Pennsylvania.
20. Oviatt, S. (2000a): Taming Recognition Errors with a Multimodal Interface. In Communica-tions of the ACM, Vol. 43, No. 9, pp.45-51.
21. Oviatt, S. (2000b): Multimodal System Processing in Mobile Environments. In 13th Annual ACM Symposium on User Interface Software and Technology, pp. 21-30, San Diego, California.
22. Oviatt, S. (2003): Multimodal Interfaces. In Handbook of Human-computer Interaction, J. Jacko and A. Sears (Eds.), pp. 286-304, New Jersey.
23. Qvarfordt, P. (2003): Spoken Feedback in Multimodal Interaction: Effects on Users Experience of Qualities of Interaction. In 1st Nordic Symposium on Multimodal Communication, pp. 21-34.
24. Qvarfordt, P. and Zhai, S. (2005): Conversing with the User based on Eye-Gaze Patterns. In SIGCHI Conference on Human Factors in Computing Systems, pp. 221-230, Portland, Oregon.
25. Rauschert, I., Agrawal, P., Sharma, R., Fuhrmann, S., Brewer, I., MacEachren, A., Wang, H. and Cai, G. (2002a): Designing a Human-Centered, Multimodal GIS Interface to Support Emergency Management. In 10th ACM International Symposium on Advances in Geographic Information Systems, pp. 119-124, Virginia.
26. Rauschert, I., Sharma, R., Fuhrmann, S., Brewer, I. And MacEachren, A. (2002b): Approaching a New Multimodal Interface. In 2nd International Conference on GIS (GIScience), Colorado.
27. Rugelbak, J. and Hamnes, K. (2003): Multimodal Interaction – Will Users Tap and Speak Simultaneously? In Telektronikk ’03, pp. 118-124.
28. Schapira, E. and Sharma, R. (2001): Experimental Evaluation of Vision and Speech based Multimodal Interfaces. In Workshop on Perceptive User Interfaces, pp. 1-9, Florida.
29. Suhm, B., Myers, B. and Waibel, A. (2001): Multimodal Error Correction for Speech User Interfaces. In ACM Transactions on Computer-Human Interaction, Vol. 8, No. 1, pp. 60-98.
30. Wasinger, R. and Kreuger, A. (2004): Multimodal Interaction with Mobile Navigation Systems. In Information Technology, Vol. 46, No. 6, pp. 322-331, Oldenbourg Publishers.
31. th International Symposium on Human Computer Interaction with Mobile Devices (Mobile HCI 03), pp. 481-485, Udine, Italyl, Springer-Verlag LNCS.
32. Wasinger, R., Stahl, C. and Kreuger, A. (2003b): Robust Speech Interaction through the use of Multiple and Different Media Input Types. In Eurospeech 2003, pp. 1049-1052.
33. Weakliam, J., Bertolotto, M. and Wilson, D. (2005a): Implicit Interaction Profiling for Recommending Spatial Content. In ACMGIS ’05, pp. 285-294, Bremen, Germany.
34. th International Workshop on Web and Wireless Geographic Information Systems, pp. 194-205, Lausanne, Switzerland.