The NESPOLE! System for multilingual speech communication over the Internet

IEEE Transactions on Audio, Speech and Language Processing

Volumn 14, Issue 5, 2006, Pages 1664-1673

  Lavie, Alon ^a   Pianesi, Fabio ^b   Levin, Lori ^a  

^a Carnegie Mellon University ^*  (United States)

^b ITC IRST   (Italy)

Author keywords

Distributed processing; Machine translation; Multimodal interfaces; Speech communication

Indexed keywords

COMMUNICATION SYSTEMS; ELECTRONIC COMMERCE; INTERNET; WEBSITES;

DISTRIBUTED PROCESSING; MACHINE TRANSLATION; MULTILINGUAL INTERACTION; MULTIMODAL INTERFACES;

SPEECH COMMUNICATION;

EID: 34047266373     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSA.2005.858520     Document Type: Article

References (29)

1. L. Levin, A. Lavie, M. Woszczyna, and A. Waibel, "The JANUS-III translation system," Mach. Transl., vol. 15, no. 1-2, pp. 3-25.
2. W. Wahlster, Verbmobil: Foundations of Speech-to-Speech Translation. Berlin, Germany: Springer, 2000.
3. A. Lavie, C. Langley, A. Waibel, F. Pianesi, G. Lazzari, P. Coletti, L. Taddei, and F. Balducci, "Architecture and design considerations in NESPOLE!: a speech translation system for E-commerce applications," in Proc. Human Language Technology Conf. (HLT-2001), San Diego, CA, 2001, pp. 31-34.
4. L. Taddei, E. Costantini, and A. Lavie, "The nESPOLE! multimodal interface for cross-lingual communication: experience and lessons learned," in Proc. IEEE Int. Conf. Multimodal Interfaces (ICMI-2002), Pittsburgh, PA, Oct. 2002, pp. 223-228.
5. J. Grudin, "Computer-supported cooperative work: history and focus," Computer, vol. 27, no. 5, pp. 19-26, May 1994.
6. E. Costantini, F. Pianesi, and S. Burger, "The added value of multi-modality in the NESPOLE! speech-to-speech translation system: an experimental study," in Proc. IEEE Int. Conf. Multimodal Interfaces (ICMI 2002), Pittsburgh, PA, Oct. 2002, pp. 235-240.
7. B. J. Dorr, Machine Translation: A View From the Lexicon. Cambridge, MA: MIT Press, 1993.
8. S. Nirenburg, J. Carbonell, M. Tomita, and K. Goodman, Machine Translation: A Knowledge-Based Approach. San Mateo, CA: Morgan Kaufmann, 1992.
9. L. Levin and S. Nirenburg, "The correct place of lexical semantics in interlingual MT," in Proc. 15th Int. Conf. Computational Linguistics (COLING-94), Kyoto, Japan, pp. 349-355.
10. B. J. Dorr, "Machine translation divergences: a formal description and proposed solution," Comput. Linguist., vol. 20, no. 4, pp. 597-633.
11. L. Levin, D. Gates, A. Lavie, and A. Waibel, "An interlingua based on domain actions for machine translation of task-oriented dialogues," in Proc. Int. Conf. Speech and Language Processing (ICSLP-98), vol. 4, Sydney, Australia, Nov. 1998, pp. 1155-1158.
12. L. Levin, D. Gates, A. Lavie, F. Pianesi, D. Wallace, T. Watanabe, and M. Woszczyna, "Evaluation of a practical interlingua for task-oriented dialogue," in Proc. ANLP/NAACL-2000 Workshop on Applied Interlinguas, Seattle, WA, Apr. 2000, pp. 18-23.
13. L. Levin, D. Gates, D. Wallace, K. Peterson, A. Lavie, F. Pianesi, E. Pianta, R. Cattoni, and N. Mana, "Balancing expressiveness and simplicity in an interlingua for task-based dialogue," in Proc. Speech-to-Speech Translation Workshop at the 40th Annu. Meeting of the Association of Computational Linguistics (ACL-02), Philadelphia, PA, Jul. 2002, pp. 53-60.
14. L. Levin, D. Gates, D. Wallace, K. Peterson, E. Pianta, and N. Mana. The NESPOLE! interchange format. Deliverable D13. [Online] Available: http://nespole.itc.it.
15. A. L. Gorin, G. Riccardi, and J. H. Wright, "How may I help you?," Speech Commun., vol. 2, no. 3, pp. 113-127, 1997.
16. R. Carpenter and J. Chu-Carroll, "Natural language call routing: a robust, self-organizing approach," in Proc. Int. Conf. Speech and Language Processing, vol. 5, Sydney, Australia, 1998, pp. 2059-2062.
17. R. Cattoni, M. Federico, and A. Lavie, "Robust analysis of spoken input combining statistical and knowledge-based information sources," in Proc. Automatic Speech Recognition and Understanding (ASRU-200]), Dec. 2001.
18. M. Gavaldà, "SOUP: a parser for real-world spontaneous speech," in Proc. 6th Int. Workshop on Parsing Technologies (IWPT-2000), Trento, Italy, 2000, pp. 101-110.
19. W. Daelemans, J. Zavrel, K. van der Sloot, and A. van den Bosch, "TiMBL: Tilburg Memory Based Learner, Version 4.3, Reference Guide,", ILK Tech. Rep., 02-10http://ilk.kub.nl/downloads/pub/papers/ilk0210.ps.gz, 2002.
20. C. Langley, A. Lavie, L. Levin, D. Wallace, D. Gates, and K. Peterson, "Spoken language parsing using phrase-level grammars and trainable classifiers," in Proc. Workshop on Algorithms for Speech-to-Speech Machine Translation at ACL-02, Philadelphia, PA, 2002, pp. 15-22.
21. C. Langley and A. Lavie, "Parsing domain actions with phrase-level grammars and memory-based learners," in Proc. 8th Int. Workshop on Parsing Technologies (IWPT-2003), Nancy, France, 2003, pp. 127-136.
22. L. Levin, C. Langley, A. Lavie, D. Gates, D. Wallace, and K. Peterson, "Domain specific speech acts for spoken language translation," in Proc. 4th SIGdial Workshop on Discourse and Dialogue (SIGDIAL-2003), Sapporo, Japan, Jul. 2003.
23. F. Metze, J. McDonough, and H. Soltau, "Speech recognition over Net-Meeting connections," in Proc. Eurospeech 2001, Aalborg, Denmark, 2001.
24. A. Lavie, F. Metze, R. Cattoni, and E. Costantini, "A multi-perspective evaluation of the NESPOLE! speech-to-speech translation system," in Proc. Speech-to-Speech Translation Workshop at the 40th Annual Meeting of the Association of Computational Linguistics (ACL-02), Philadelphia, PA, Jul. 2002, pp. 121-128.
25. S. Burger, E. Constantini, and F. Pianesi, "Communicative strategies and patterns of multimodal integration in a speech-to-speech translation system," in Proc. MT Summit IX, New Orleans, LA, 2003, pp. 32-39.
26. _, "Communicative strategies in a speech-to-speech translation system," Intelligenza Artificiale, vol. 1, no. 1, pp. 52-56, Feb. 2004.
27. J. Carletta, S. Isard, A. H. Anderson, G. Doherty-Sneddon, A. Isard, and J. C. Kowtko, "The reliability of a dialogue structure coding scheme," in Computational Linguistics. Cambridge, MA: MIT Press, 1997, vol. 23, pp. 13-21.
28. J. Carletta et al., "HCRC Dialogue Coding Manual,", HCRC/TR-82 TEch. Rep., 1996.
29. A. Lavie et al. Evaluation of the NESPOLE! Showcase-2a system. Deliverable DIS. [Online] Available: http://nespole.itc.it.