Building multimodal applications with EMMA

ICMI-MLMI'09 - Proceedings of the International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interfaces

Volumn , Issue , 2009, Pages 47-54

  Johnston, Michael ^a  

^a AT AND T LABS RESEARCH   (United States)

Author keywords

Gesture; Multimodal; Prototyping; Speech; Standards

Indexed keywords

GESTURE; MULTI-MODAL INTERFACES; MULTIMODAL; MULTIMODAL APPLICATION; MULTIMODAL PROTOTYPING; MULTIMODAL SYSTEM; PLUG-AND-PLAY; REPRESENTATION LANGUAGES; SYSTEM COMPONENTS;

CONCURRENT ENGINEERING; HUMAN COMPUTER INTERACTION; INTERACTIVE COMPUTER SYSTEMS; JOB ANALYSIS; LEARNING SYSTEMS; MOBILE DEVICES; RAPID PROTOTYPING; STANDARDS;

GRAPHICAL USER INTERFACES;

EID: 74049130289     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1647314.1647325     Document Type: Conference Paper

References (19)

1. J. Axelsson, C. Cross, J. Ferrans, G. McCobb, T. V. Raman, and L. Wilson. Mobile X+V 1.2, 2005. http://openstandardswork.net/specs/multimodal/x+v/mobile/ 12/.
2. S. Bangalore and M. Johnston. Robust understanding in multimodal interfaces. Computational Linguistics (Forthcoming).
3. A. Cheyer and L. Julia. Multimodal Maps: An Agent-Based Approach. Lecture Notes in Computer Science, 1374:103-113, 1998.
4. P. Cohen, M. Johnston, D. McGee, S. L. Oviatt, J. Pittman, I. Smith, L. Chen, and J. Clow. Multimodal interaction for distributed interactive simulation. In M. Maybury and W. Wahlster, editors, Readings in Intelligent Interfaces. Morgan Kaufmann Publishers, 1998.
5. G. D. Fabbrizio, J. Wilpon, and T. Okken. A speech mashup framework for multimodal mobile services. In Proceedings of ICMI, Boston, USA, 2009.
6. V. Goffin, C. Allauzen, E. Bocchieri, D. Hakkani-Tur, A. Ljolje, S. Parthasarathy, M. Rahim, G. Riccardi, and M. Saraclar. The AT&T WATSON Speech Recognizer. In Proceedings of ICASSP, Philadelphia, PA, 2005.
7. A. Gruenstein, I. McGraw, and I. Badr. The WAMI toolkit for developing, deploying, and evaluating web-accessible multimodal interfaces. In Proceedings of ICMI, pages 141-148, 2008.
8. A. Gruenstein, J. Orszulak, S. Liu, S. Roberts, J. Zabel, B. Reimer, B. Mehler, S. Seneff, J. Glass, and J. Coughlin. City browser: developing a conversational automotive HMI. In Proceedings CHI '09 Extended Abstracts, pages 4291-4296. ACM, 2009.
9. J. Gustafson, L. Bell, J. Beskow, J. Boye, R. Carlson, J. Edlund, B. Granström, D. House, and M. Wirén. AdApt - a multimodal conversational dialogue system in an apartment domain. In Proceedings of ICSLP, pages 134-137, Beijing, China, 2000.
10. A. Hunt and S. McGlashan. Speech Recognition Grammar Specification Version 1.0, March 2004. http://www.w3.org/TR/2004/REC-speech-grammar-20040316/.
11. M. Johnston, P. Baggia, D. C. Burnett, J. Carter, D. A. Dahl, G. McCobb, and D. Raggett. EMMA: Extensible MultiModal Annotation markup language, February 2009. http://www.w3.org/TR/2009/REC-emma-20090210.
12. M. Johnston and S. Bangalore. Finite-state multimodal integration and understanding. Journal of Natural Language Engineering, 11(2):159-187, 2005.
13. M. Johnston, S. Bangalore, G. Vasireddy, A. Stent, P. Ehlen, M. Walker, S. Whittaker, and P. Maloor. MATCH: An architecture for multimodal dialog systems. In Proceedings of ACL, pages 376-383, Philadelphia, 2002.
14. M. Johnston, L.-F. D'Haro, M. Levine, and B. Renger. A multimodal interface for access to content in the home. In Proceedings of ACL, pages 376-383, 2007.
15. N. Reithinger, S. Bergweiler, R. Engel, G. Herzog, N. Pfleger, M. Romanelli, and D. Sonntag. A look under the hood: design and development of the first SmartWeb system demonstrator. In Proceedings of ICMI, pages 159-166, Trento, Italy, 2005.
16. L. V. Tichelen and D. Burke. Semantic Interpretation for Speech Recognition (SISR) Version 1.0, April 2007. http://www.w3.org/TR/2007/REC- semantic-interpretation-20070405/.
17. W. Wahlster. SmartKom: Fusion and fission of speech, gestures, and facial expressions. In Proceedings of the 1st International Workshop on Man-Machine Symbiotic Systems, pages 213-225, Kyoto, Japan, 2002.
18. K. Wang. SALT: A spoken language interface for web-based multimodal dialog systems. In Proceedings of ICASSP, pages 2241-2244, 2002.
19. K. Wittenburg, T. Lanning, D. Schwenke, H. Shubin, and A. Vetro. The prospects for unrestricted speech input for TV content search. In AVI '06: Proceedings of the working conference on Advanced visual interfaces, pages 352-359, New York, NY, USA, 2006. ACM.