The WAMI toolkit for developing, deploying, and evaluating Web-Accessible multimodal interfaces

ICMI'08: Proceedings of the 10th International Conference on Multimodal Interfaces

Volumn , Issue , 2008, Pages 141-148

  Gruenstein, Alexander ^a   McGraw, Ian ^a   Badr, Ibrahim ^a  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

Dialogue system; Multimodal interface; Speech recognition; Voice over IP; World wide web

Indexed keywords

GRAPHICAL USER INTERFACES; INTERACTIVE COMPUTER SYSTEMS; INTERNET PROTOCOLS; INTERNET TELEPHONY; LAPTOP COMPUTERS; MOBILE DEVICES; SPEECH ANALYSIS; SPEECH PROCESSING; VOICE/DATA COMMUNICATION SYSTEMS; WORLD WIDE WEB;

BROWSER-BASED APPLICATIONS; DIALOGUE SYSTEM; INPUT AND OUTPUTS; MULTI MODALS; MULTIMODAL APPLICATIONS; MULTIMODAL INTERFACE; PROGRAMMING TECHNIQUES; TABLET PCS; USAGE DATUM; USER INTERACTIONS; VOICE OVER IP;

SPEECH RECOGNITION;

EID: 63449089374     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1452392.1452420     Document Type: Conference Paper

References (20)

1. A. Acero, N. Bernstein, R. Chambers, Y. C. Jui, X. Li, J. Odell, P. Nguyen, O. Scholz, and G. Zweig. Live search for mobile: Web services by voice on the cellphone. In Proc. of ICASSP, 2008.
2. G. Aist, J. Allen, E. Campana, C. G. Gallo, S. Stoness, M. Swift, and M. K. Tanenhaus. Incremental understanding in human-computer dialogue and experimental evidence for advantages over nonincremental methods. In R. Artstein and L. Vieu, editors, Proc. of the 11th Workshop on the Semantics and Pragmatics of Dialogue, pages 149-154, 2007.
3. J. Axelsson, C. Cross, J. Ferrans, G. McCobb, T. V. Raman, and L. Wilson. Mobile X+V 1.2. Technical report, 2005. http://www.voicexml.org/specs/ multimodal/x+v/mobile/12/.
4. A. Gruenstein, B.-J. P. Hsu, J. Glass, S. Seneff, L. Hetherington, S. Cyphers, I. Badr, C. Wang, and S. Liu. A multimodal home entertainment interface via a mobile device. In Proc. of the ACL Workshop on Mobile Language Processing, 2008.
5. A. Gruenstein, S. Seneff, and C. Wang. Scalable and portable web-based multimodal dialogue interaction with geographical databases. In Proc. of INTERSPEECH, 2006.
6. A. Hjalmarsson. Evaluating AdApt, a multi-modal conversational dialogue system using PARADISE. Master's thesis, KTH, Stockhom, Sweden, 2002.
7. M. Honkala and M. Pohja. Multimodal interaction with XForms. In Proc. of the 6th International Conference on Web Engineering, pages 201-208, 2006.
8. Java speech grammar format. http://java.sun.com/products/javamedia/ speech/forDevelopers/JSGF/.
9. M. Johnston, S. Bangalore, G. Vasireddy, A. Stent, P. Ehlen, M. Walker, S. Whittaker, and P. Maloor. MATCH: An architecture for multimodal dialogue systems. In Proc. of ACL, 2002.
10. K. Katsurada, Y. Nakamura, H. Yamada, and T. Nitta. XISL: a language for describing multimodal interaction scenarios. In Proc. of the 5th International Conference on Multimodal Interfaces, 2003.
11. R. Lau, G. Flammia, C. Pao, and V. Zue. WebGALAXY: beyond point and click - a conversational interface to a browser. Computer Networks and ISDN Systems, 29:1385-1393, 1997.
12. O. Lemon and A. Gruenstein. Multithreaded context for robust conversational interfaces: context-sensitive speech recognition and interpretation of corrective fragments. ACM Transactions on Computer-Human Interaction, 11(3):241-267, 2004.
13. I. McGraw and S. Seneff. Speech-enabled card games for language learners. In Proc. of the 23rd AAAI Conference on Artificial Intelligence, 2008.
14. A. Raux, D. Bohus, B. Langner, A. Black, and M. Eskenazi. Doing research on a deployed spoken dialogue system: One year of Let's Go! experience. In Proc. of INTERSPEECH-ICSLP, 2006.
15. S. Seneff, E. Hurley, R. Lau, C. Pao, P. Schmid, and V. Zue. Galaxy-II: A reference architecture for conversational system development. In Proc. ICSLP, 1998.
16. A. Stent, J. Dowding, J. M. Gawron, E. O. Bratt, and R. Moore. The CommandTalk spoken dialogue system. In Proc. of ACL, 1999.
17. Tellme mobile. http://m.tellme.com.
18. K. Wang. SALT: A spoken language interface for web-based multimodal dialog systems. In Proc. of the 7th International Conference on Spoken Language Processing, 2002.
19. Yahoo onesearch. http://mobile.yahoo.com.
20. V. Zue, S. Seneff, J. Glass, J. Polifroni, C. Pao, T. J. Hazen, and L. Hetherington. JUPITER: A telephone-based conversational interface for weather information. IEEE Transactions on Speech and Audio Processing, 8(1), January 2000.