Information seeking spoken dialogue systems - Part II: Multimodal dialogue

IEEE Transactions on Multimedia

Volumn 9, Issue 3, 2007, Pages 550-566

  Potamianos, Alexandros ^a,b   Fosler Lussier, Eric ^a,c   Ammicht, Egbert ^d   Perakakis, Manolis ^a,b  

^a IEEE   (Greece)

^b TECHNICAL UNIVERSITY OF CRETE   (Greece)

^c Ohio State University   (United States)

^d LUCENT TECHNOLOGIES   (United States)

Author keywords

Multimedia communication; Natural language interfaces; Speech communication

Indexed keywords

MULTIMEDIA COMMUNICATION; MULTIMODAL DIALOGUE SYSTEMS; NATURAL LANGUAGE INTERFACES; PRAGMATIC MODULES;

ERROR CORRECTION; INFORMATION RETRIEVAL; PROBLEM SOLVING; SEMANTICS; SPEECH COMMUNICATION; USER INTERFACES;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 33947608807     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2006.887999     Document Type: Article

References (48)

1. A. Abella and A. Gorin, "Construct algebra: Analytical dialog management," in Proc. Annu. Meeting Association of Computational Linguists (ACL), Washington, D.C., Jun. 1999.
2. A. Abella, M. K. Brown, and B. Buntschuh, "Development principles for dialog-based interfaces," in Proc. Eur. Conf. Artificial Intelligence, Budapest, Hungary, 1996.
3. E. Ammicht, A. Potamianos, and E. Fosler-Lussier, "Ambiguity representation and resolution in spoken dialogue systems," in Proc. European Conf. on Speech Communication and Technology, Aalborg, Denmark, Sep. 2001.
4. E. Ammicht, E. Fosler-Lussier, and A. Potamianos, "Information seeking spoken dialogue systems - Part I: Semantics and Pragmatics," IEEE Trans. Multimedia, vol. 9, no. 3, Apr. 2007, to be published.
5. N. O. Bernsen and L. Dybkjaer, "Is speech the right thing for your application?," in Proc. Int. Conf. Speech Language Processing, Oct. 1998.
6. V. Bilici, E. Krahmer, S. te Riele, and R. Veldhuis, "Preferred modalities in dialogue systems," in Proc. Int. Conf. Speech Language Processing'2000, Beijing, China, Oct. 2000.
7. B. Carpenter, Type-Logical Semantics. Cambridge, MA: MIT Press, 1998.
8. J. Chu-Carroll, "MIMIC: An adaptive mixed initiative spoken dialogue system for information queries," in Proc. of the 6th ACL Conference on Applied Natural Language Processing, Seattle, WA, May 2000.
9. _, "Form-based reasoning for mixed-initiative dialogue management in information-query systems," in Proc. Eur. Conf. Speech Communication and Technology, Budapest, Hungary, Sep. 1999, pp. 1519-1522.
10. P. Cohen, M. Johnston, D. McGee, S. Oviatt, J. Clow, and J. Smith, "The efficiency of multimodal interaction: A case study," in Proc. Int. Conf. Speech Language Processing, Sydney, Australia, 1998.
11. M. Denecke, "Rapid prototyping for spoken dialogue systems," in Proc. Int. Conf. Computational Linguistics, Taipei, Taiwan, R.O.C., Aug. 2002.
12. M. Denecke and A. Waibel, "Dialogue strategies guiding users to their communicative goals," in Proc. Eur. Conf. on Speech Communication and Technology, Rhodes, Greece, Sep. 1999.
13. FreeTTS : A Speech Synthesizer, [Online]. Available: http://freetts.sourceforge.net/docs/
14. M. Galley, E. Fosler-Lussier, and A. Potamianos, "Hybrid natural language generation for spoken dialogue systems," in Proc. Eur. Conf. Speech Communication and. Technology, Aalborg, Denmark, Oct. 2001.
15. D. Goddeau, H. Meng, J. Polifroni, S. Seneff, and S. Busayapongchai, "A form-based dialogue manager for spoken language applications," in Proc. Int. Conf. Speech Language Processing, Philadelphia, PA, Oct. 1996.
16. X. Huang, A. Acero, C. Chelba, L. Deng, D. Duchene, J. Goodman, H.-W. Hon, D. Jacoby, L. Jiang, R. Loynd, M. Mahajan, P. Mau, S. Meredith, S. Mughal, S. Neto, M. Plumpe, K. Wand, and Y. Wang, "MIPAD: A next generation PDA prototype," in Proc. Int. Conf. Speech Language Processing, Beijing, China, Oct. 2000.
17. M. Johnston and S. Bangalore, "Finite-state multimodal integration and understanding," J. Nat. Lang. Eng., vol. 11, no. 2, pp. 159-187, 2005.
18. M. Johnston, S. Bangalore, G. Vasireddy, A. Stent, P. Ehlen, M. Walker, S. Whittaker, and P. Maloor, "MATCH: An architecture for multimodal dialogue systems," in Proc. Annu. Meeting of the Association for Computational Linguistics, 2002.
19. L. B. Larsen, "Combining objective and subjective data in evaluation of spoken dialogues," in Proc. ESCA Workshop on Interactive Dialogue in Multi-Modal Systems, Kloster Irsee, Germany, Jun. 1999.
20. S. Larsson and D. Traum, "Information state and dialogue management in the TRINDI dialogue move engine toolkit," Nat. Lang. Eng., vol. 6, pp. 323-340, 2000.
21. S. Lee, E. Ammicht, E. Fosler-Lussier, J. Kuo, and A. Potamianos, "Spoken dialogue evaluation for the bell labs communicator system," in Proc. Human Language Technology Conf., San Diego, CA, Mar. 2002.
22. E. Levin, R. Pieraccini, W. Eckert, G. D. Fabbrizio, and S. Narayanan, "Spoken language dialogue: From theory to practice," in Proc. Workshop on Automatic Speech Recognition and Understanding, Keystone, CO, Dec. 1999.
23. E. Levin, R. Pieraccini, and W. Eckert, "A stochastic model of human-machine interaction for learning dialogue strategies," IEEE Trans. Speech Audio Process., vol. 8, no. 1, pp. 11-14, 2000.
24. C. Matheson, M. Poesio, and D. Traum, "Modelling grounding and discourse obligations using update rules," in Proc. Annu. Meeting North American Association for Computational Linguistics, May 2000.
25. M. F. McTear, "Modelling spoken dialogues with state transitions diagrams: Experiences with the CSLU toolkit," in Proc. Int. Conf. Speech Language Processing, Sydney, Australia, Dec. 1998.
26. S. Narayanan and A. Potamianos, "Creating conversational interfaces for children," IEEE Trans. Speech Audio Process., vol. 10, pp. 65-78, Feb. 2002.
27. S. L. Oviatt, P. R. Cohen, L. Wu, J. Vergo, L. Duncan, B. Suhm, J. Bers, T. Holzman, T. Winograd, J. Landay, J. Larson, and D. Ferro, "Designing the user interface for multimodal speech and gesture applications: State-of-the-art systems and research directions," Hum. Comput. Interaction, vol. 15, no. 4, pp. 263-322, 2000.
28. M. Perakakis, M. Toutoudakis, and A. Potamianos, "Modality selection for multimodal dialogue systems," in Proc. Int. Conf. Multimodal Interfaces, Trento, Italy, Oct. 2005.
29. A. Potamianos, E. Ammicht, and H.-K. Kuo, "Dialogue management in the bell labs communicator system," in Proc. Int. Conf. Speech Language Processing, Beijing, China, Oct. 2000.
30. A. Potamianos, H.-K. Kuo, C.-H. Lee, A. Pargellis, A. Saad, and Q. Zhou, "Design principles and tools for multimodal dialog systems," in Proc. ESCA Workshop Interact. Dialog. Multi-Modal Syst., Kloster Irsee, Germany, Jun. 1999.
31. A. Potamianos and H.-K. Kuo, "Speech understanding using finite state transducers," in Proc. Int. Conf. Speech Language Processing, Beijing, China, Oct. 2000.
32. A. Rudnicky, E. Thayer, P. Constantinides, C. Tchou, R. Shern, K. Lenzo, W. Xu, and A. Oh, "Creating natural dialogs in the Carnegie Mellon communicator system," in Proc. Eur. Conf. Speech Communication and Technology, Budapest, Hungary, Sep. 1999.
33. A. Rudnicky and W. Xu, "An agenda-based dialog management architecture for spoken language systems," in Proc. Workshop on Automatic Speech Recognition and Understanding, Keystone, CO, Dec. 1999.
34. D. Sadek and R. D. Mori, "Dialogue systems," in Spoken Dialogues with Computers, R. D. Mon, Ed. London, U.K.: Academic, 1998, pp. 523-561.
35. S. Seneff, E. Hurley, R. Lau, C. Pao, P. Schmid, and V. Zue, "Galaxy-11: A reference architecture for conversational system development," in Proc. Int. Conf. Speech Language Processing, Sydney, Australia, Dec. 1998.
36. E. Shortliffe, Computer-Based Medical Consultation: MYCIN. New York: Elsevier, 1976.
37. M. Tsangaris and A. Potamianos, "AGORA: A GUI approach to multimodal user interfaces," in Proc. Human Language Technology Conf., San Diego, CA, Mar. 2002.
38. M. Walker, L. Hirschman, and J. Aberdeen, "Evaluation for DARPA communicator dialog systems," in Proc. Int. Conf. on Language Resources and Evaluation, Athens, Greece, Jun. 2000.
39. M. A. Walker, J. Aberdeen, J. Borland, E. Bratt, J. S. Garofolo, A. N. Le, S. Lee, S. Narayanan, K. Papineni, B. Pellom, J. Polifroni, A. Potamianos, P. Prabhu, A. I. Rudnicky, G. Sanders, S. Seneff, D. Stallard, and S. Whittaker, "DARPA communicator dialog travel planning systems: The June 2000 data collection," in Proc. Eur. Conf. Speech Communication and Technology, Aalborg, Denmark, Sep. 2001.
40. M. A. Walker, R. J. Passonneau, and J. E. Boland, "Quantitative and qualitative evaluation of DARPA communicator spoken dialogue systems," in Proc. Annu. Meeting of the Association for Computational Linguistics, 2001.
41. M. A. Walker, A. I. Rudnicky, R. Prasad, J. Aberdeen, E. O. Bratt, J. S. Garofolo, H. Hastie, A. N. Le, B. Pellom, A. Potamianos, R. Passonneau, S. Roukos, G. A. Sanders, S. Seneff, and D. Stallard, "DARPA communicator evaluation: Progress from 2000 to 2001," in Proc. Int. Conf. Speech Language Processing, Sep. 2002.
42. _, "DARPA communicator: Cross-system results for the 2001 evaluation," in Proc. Int. Conf. Speech Language Processing, Sep. 2002.
43. M. Walker, C. Kamm, and D. Litman, "Towards developing general models of usability with PARADISE," Nat. Lang. Eng.: Special Issue, on Best Practice in Spoken Dialogue Systems, 2000.
44. W. Ward and S. Issar, "The CMU AT1S system," in Proc. 1995 ARPA Spoken Language Systems Technology Workshop, Austin, TX, Jan. 1995.
45. W. Ward and B. Pellom, "The CU communicator system," in Proc. Workshop on Automatic Speech Recognition and. Understanding, Keystone, CO, Dec. 1999.
46. W. Xu, B. Xu, T. Huang, and H. Xia, "Bridging the gap between dialogue management and dialogue models," in Proc. 3rd SIGdial Workshop on Discourse and Dialogue, Philadephia, PA, Jul. 2002.
47. Q. Zhou, A. Saad, and S. Abdou, "An enhanced BLSTIP dialogue research platform," in Proc. Int. Conf. Speech Language Processing, Beijing, China, Oct. 2000.
48. M. Perakakis, M. Toutoudakis, and A. Potamianos, "Blending speech and visual input in multimodal dialogue systems," in IEEE/ACM Workshop on Spoken Language Technology, Aruba, Dec. 2006.