Speech and language processing for next-millennium communications services

Proceedings of the IEEE

Volumn 88, Issue 8, 2000, Pages 1314-1336

  Cox, Richard V ^a   Kamm, Candace A ^a   Rabiner, Lawrence R ^a   Schroeter, Juergen ^a   Wilpon, Jay G ^a  

^a AT AND T LABS RESEARCH   (United States)

Author keywords

Dialogue management; Speaker recognition; Speech coding; Speech processing; Speech recognition; Speech synthesis; Spoken language understanding

Indexed keywords

EID: 0042660763     PISSN: 00189219     EISSN: None     Source Type: Journal    
DOI: 10.1109/5.880086     Document Type: Article

References (81)

1. J. C. Ramming, "P.ML: A language interface to networked voice response anils," in Proc. Workshop on Internet Programming Languages, Chicago, IL, May 1998.
2. H. Dudley, "The vocoder," Bell Lab. Rec., vol. IS, pp. 122-126, 1939.
3. D. W. Petr, "32 kb/s ADPCM-DLQ coding for network applications," in Proc. IEEE GLOBECOM, Dec. 1982, pp. A8.3-1 -A8.3-5.
4. P. Kroon and W. B. Kleijn, "Linear-prediction based anaiysis-by-synthesis coding," in Speech Coding and Synthesis, W. B. Kleijn and K. K. Paliwal, Eds. Asterdam, The Netherlands: Elsevier, J995, pp. 79-119.
5. R. E. Crochiere and J. M. Tribolet, "Frequency domain coding of speech," IEEE Trans. Acoust., Speech, Signal Processing, vol. ASSP-27, pp. 512-530, 1979.
6. A. Crossman, "A variable bit rale audio coder for videoconferencing," in Proc. IEEE Workshop on Speech Coding for Telecommunications, Sept. 1993, pp. 29-30.
7. A. McCree, K.. Truong, E. George, T. Barnweli, and V. Viswanathan, "A 2.4 kbit/s MELP coder candidate for the new US Federal Standard," in Proc. ICASSP'96, vol. 1, 1996, pp. 200-203.
8. R. J. McAulay and T. F. Quatieri, "Sinusoidal coding," in Speech Coding and Synthesis, W. B. Kleijn and K. K. Paiiwal, Eds. Asterdam, The Netherlands: Elsevier,' 1995, pp. 121-173.
9. W. B. Kleijn and J. Haagen, "Waveform interpolation for coding and synthesis," in Speech Coding and Synthesis, W. B. Kleijn and K. K. Paiiwal, Eds. Asterdam, The Netherlands: Elsevier, 1995, pp. 175-207.
10. A Packe! Lass Concealment Technique for Use with ITU-T Recommendation G.7/1, ANSI Standard Tl.521-1999, May 1999.
11. J. M. Picket!, J. Schroeter, C. Bicldey, A. Syrdal, and D. KewleyPort, "Speech technology,'' in The Acoustics of Speech Communication, J. M. Picket, Ed. Boston, MA: Allyn and Bacon, 1998, ch. 17, pp. 324-342.
12. A. Hunt and A. Black, "Unit selection in a concatenate speech synthesis system using a large speech database," in Proc. ICASSP'96, 1996, pp. 373-376.
13. M. Beutnagel, A. Conkie, J. Schroeter, Y. Stylianou, and A. Syrdal, "The AT&T next-gen TTS system," J. Acoust. Soc. Amer., pt. 2, vol. 105, no. 2, p 1030, 1999.
14. J. Ostennann, "Animated talking head with personalized 3D Head Model," J. VLSI Signal Process., vol. 20, pp. 97-105, 1998.
15. E. Cosatto and H. P. Grat', "Sample-based synthesis of photo-realistic talking-heads," in Proc. Computer Animation, 1998, pp. 103-110.
16. J. Ostcrmann, "Animation of synthetic faces in M PEG-4," in Proc. Computer Animation, 1998, pp. 49-55.
17. L. Rabiner and B. H. Juang. Fundamentals of Speech Recognition. Englewood Cliffs, NJ: Prentice-Hall, 1993.
18. J. Makhoul and J. Schwanz, "State of the art in continuous speech recognition," in Voice Communication between Humans and Machines., D. Roe and J. Wilpon, Eds. Washington, DC: National Academy Press, 1994, pp. 165-188.
19. O. Riccardi, R. Pieraccini, and E. Bocchieri, "Stochastic automata for language modeling," Comput. Speech Lang., vol. 10, pp. 265-293, 1996.
20. G. Riccardi and A. Gorin, "Stochastic language models for speech recognition and understanding," in Proc. ICSLP 98. 199S, pp. 2087-2090.
21. R. Rose and E. Lleida, "Utterance verification in continuous speech recognition: Decoding and training procedures," IEEE Trans. Speech Audio Processing, vol. 8, pp. 126-139, Mar 2000.
22. M. Mohri and M. Riley, "NetworK optimization fo large-vocabulary speech recognition," Speech Commun., vol. 2X. pp. 1-12, 1999.
23. M. Mohri. F. Pereira, and ,V1. Riley, " Weighed automata in text and speech processing," presented at the Proc. ECAI-96 Workshop, Budapest, Hungary, 1996.
24. M. Rahim, G. Riccurdi, j. Wright, B. Buntschuh, and A. Gorin, "Robust automatic speech recognition in a natural spoken dialogue," presented at the Proc. Workshop Robust Methods for Speech Recognition in Adverse Conditions, Tampere, Finland, 1999.
25. D. S. Pallet, J. G. Fiscus, J. S. Garofolo, A. Martin, and M. A. Przyhocki, "1998 Broadcast News Benchmark Test Results," presented at the 1999 DARPA Broadcast News Workshop. Herndon, VA, 1999.
26. A. Martin, .1. Fiscus, M. Przybocki, and W. Fisher, "The evaluation: Ward error rates and confidence analysis," presented at the Proc. 9th Hub-5 Conversational Speech Recognition Workshop, Linchicum Heights, MD. Sept. 24-25, 1998.
27. D. Pallet, e! a!.. "1994 benchmark tests for the ARPA spoken language understanding program," in Proc. ARPA Spoken Language Svstems Technolog Workshop, Austin, TX, Jan. 22-25, 1995, pp. 5-36.
28. M. Mohri and VI. Riley, "integrated context-dependent networks in very large vocabulary speech recognition," in Proc. 6th Euro. Cor.f. Speech Communication and Technologe. Budapest, Hungary, 1999, pp. 811-814.
29. M. Mohri, M. Riiey, D. Hindle, A. Ljolje, and F. Pereira, "Full expansion of context-dependent networks in large vocabulary speech recognition," presented at the Proc. ICASSP'9S, vol. Il, I998, pp. 665-668.
30. Proc. DARPA Speech Recognition Workshop. Harriman, NY. Feb. 18-21, 1996.
31. A. Corazza and R. De Mori, "On the use of formal grammars," in Spoken Dialogues w/'uh Computers. R. De Mori, Ed. London, U.K.: Academic, 1998, pp. 461-484.
32. R. Kuhn and R. De Mori, "Sentence interpretation," in Spoken Dialogues with Computers. R. De Mori, Ed. London, U.K.: Academic, 1998, pp. 486-522.
33. B. C. Hruce, "Natural communication between person and computer," in Strategies for Natural Language Processing. W. G. Lehnen and M. H. Ringle, Eds. Hillsdale, NJ: Lawrence Eribaum, 1982, pp. 55-88.
34. M. Bates, "Models of natural language understanding," in Voice Communication Between Humans and Machines. D. Roe and J. Wilpon, Eds. Washington, DC: National Academy Press. 1994, pp. 238-253.
35. L. Hirschman, "The roles of language processing in a spoken language interface," in Voice Communication Between Humans and Machines, D. Roe and J. Wilpon, Eds. Washington, DC: National Academy Press, 1994, pp. 217-237.
36. S. Scncff, "Robust parsing for spoken language systems," in Proc. ICASSP, 1992, pp. 189-192.
37. M. K. Brown and B. Bunlschuh, "A context-free grammar compiler for speech understanding systems," in Proc. 1CSLP 94, 1994, pp. 21-24.
38. R. Pieraccini and E. Levin, "A spontaneous understanding system for database query applications," presented at the Proc. KSCA Workshop on Spoken Dialogue Systems-Theories and Applications, Vigso, Denmark, 1995.
39. J. Wright. A. Gorin, and A. Abella, "Spoken language understanding within dialogs using a graphical model of task structure," presented at the Proc. JCSLP 9X, 1998.
40. A. L. Gorin, G. Riccardi, and J. H. Wrignt, "How may 1 help you?," Speech Commun., vol. 23, pp. 113-127, 1997.
41. A. Gorin, S. Levinson, L. Miller, A. Germer, E. Goldman, and A. Ljolje, "On adaptive acquisition of language," in Proc. ICASSP'90, 1990, pp. 601-604.
42. A. L. Gorin, "On automated language acquisition," J. Acoust. Soc. Amer., vol. 97. pp. 3441-3461, 1995.
43. M. Denecke and A. Waibel, "Dialogue strategies guiding users to their communicative goals," in Proc. Eurosoeech 1997, 1997. pp. 1339-1342.
44. G. Riccardi and A. L. Gorin, "Stochastic language adaptation over time and state in natural spoken dialogue systems," IEEE Trans. Speech Audio Processing, vol. 8, pp. 3-10, Jan. 2000.
45. C. Sorin and R. De Mori, "Sentence generation," in Spoken Dialogues with Computers, R. De Mori, Ed. London, L.K.: Academic, 1998, pp. 503-582.
46. C. A. McCann, W. Edmoason, and R. K. Moore, "Practical issues in dialogue design," in The Structure of \lidtii:;oij.iil Dialogue, M. .VI. Tayior, F. Xeel, and D G. Bouwhuis, Eds. Amsterdam, The Netherlands: Eisevier, 1989, pp. 467-480.
47. E. Levin, R. Pieraccini, and W. Eckert, "Learning dialogue strategies within the Markov decision process framework," in Proc. 1997 IEEE Workshop on Automatic Speech Recognition and Undemanding, 1997, pp. 72-79.
48. M. Walker, D. Kindle, J. Fromer, G. DiFabbrizio, and C. Mestel, "Evaluating competing agent strategies for a voice email agent," presented at the Proc. 5th Euro. Coni. Speech Communication and Technology (EUROSPEECH97), 1997.
49. R. Billi, G. Castagp.eri, and M. Danieli, "Field trial evaluations of two different information inquiry systems." in Proc. I\TTA, 1996, pp. 129-134.
50. D. J. Liiman and S. Pan, "Empirically evaluating an adaptable spoken dialogue system," presented at the Proc. 7;h In!. Conf. User Modeling, 1999.
51. S. Carberry, J. Chu-Carroll, and L. Lambert, "Modeiing intention: Issues for spoken language dialogue systems," in Proc. 1996 bn. Symp. Spoken Dialogue. ISSD 96,'1996, pp. 13-24.
52. M. Walker, "A peak, a plateau, or a stiff climb'.'," ELSNEWS 8.1, pp. 1-3. Winter 1999.
53. S. E. Brennan, "The grounding problem in conversation with and through computers," in Soda! and Cognitive Psychological Approaches to Interpersonal Communication, S. R. Fussell and R. J. Keutz, Eds. Hillsd'ale, NJ: Lawrence Erlbaum, i998, pp. 201-255.
54. M. Walker, D. Litman, C. Kamm, and A. Abclla, "PARADISE: A general framework for evaluation spoken dialogue agents," in Proc. 35th Annu. Meeting of the Association of Computational Linguistics, ACUEACL 97, 1991, pp. 271-280.
55. C. Kamm. M. Walker, and D. Litman, "Evaluating spoken language systems," in Proc. AVIOS 1999, 1999, pp. 187-197.
56. K. Yu and J. Mason, "On-une incremental adaptation for speaker verification using maximum likelihood eslimates of CDHMM parameters," in Proc. 1CSLP 96, 1996, pp. 1752-1755.
57. A. E. Rosenberg and S. Parthasarathy, "Speaker identification with user-selected password phrases," in Proc. Eurospeech'97, 1997, pp. 1371-1374.
58. T. Nordstrom, H. Melin, and J. Lindbcrg, "A comparative study of speaker verification systems using the Polycast database," in Proc. 1CSLP'98, 1998, pp. 1359-1362.
59. Y. Gu and T. Thomas, "An implementation and evaluation of an on-line speaker verification system for field trials," in Proc. ICSLP'98, 1998, pp. 125-128.
60. J. Choi, D. Hindie, .1. Hirschberg, I. Magrin-Chagnolleau, C. Nakatani, F. Pereira, A. Singhal, and S. WhiUaker, "SCAN-Speech content based audio navigator: A systems overview," in Proc. 1CSEP98, 1998, pp. 2861-2864.
61. R. V. Cox. B. Haskell, Y. LeCun, B. Shahraray, and L. Rabiner, "On the application of multimedia processing to telecommunications," Proc. IEEE, vol. 86, pp. 755-824, May 1998.
62. Q. Huang, Z. Liu, A. Rosenberg, D. Gibbon, and B. Shahraray, "Automated generation of news content hierarchy by integrating audio, video, and text information," in Proc. ICASSP'99, vol. VI, 1999, pp. 3025-3028.
63. Z. Liu and Q. Huang, "Classification of audio events for broadcast news," in IEEE Workshop Multimedia Signal Processing, Los Angeles, CA, Dec. 1998, pp. 364-369.
64. R. Nakatsu, "ANShR: An application of speech technology to the Japanese banking industry," Computer, vol. 23, pp. 43-48, Aug. 1990.
65. S. Furui, private communication.
66. M. Lenniz, "Putting speech recognition to work in the telephone network," Computer, vol. 23. pp. 35-41, Aug. 1990.
67. J. G. Wiipon, L. Rabiner, C.-H. Lee, and E. Goldman, "Automatic recognition of keywords in unconstrained speech using hidden Markov models," IEEE 'frans. ACOUSL, Speech, Signal Processing, vol. 38, pp. 1870-1878, Nov. 1990.
68. M. Yuschik, E. Schwab, and L. Griffith, "ACNA-The Ameritech customer name and address servicer." J. AVIOS. vol. 15, pp. 21-33, 1994.
69. D, Yashchin, S. Basson, A. Kalyanswamy, and K. Silveiman, "Results from automating a name & address service with speech synthesis," in Proc. AVIOS, 1992.
70. A. Sanderman, E. den Os, A. Cremers, L. Boves, and J. Sturm, "Evaluation of the dutch train timetable information system developed in the ARISE project," in Proc. IVTfA 98, 1998, pp. 91-96.
71. G. Casiagneri. P. Baggia, and M. Danieli, "Field trials of the Italian ARISE train timetable system." in Proc. IVTTA 98. 1998, pp. 97-102.
72. L. Lamel, S. Rossett, J. L. Gauvain, S. Bennacef, M. Gamier-Rizet, and B. Prouts, "The L1MSI ARISE system," in Proc. 1VTTA 98, 1998, pp. 209-214.
73. S. M. Marcus, D. W. Brown, R. G. Goldberg, IV!. S. Schoeffler, W. R. Wetzel, and R. R. Rosinski, "Prompt constrained natural language-Evolving the next generation of telephony services," in Proc. ISSD 96, 1996.
74. M. Leimig, G. Bielby, and J. Massicote, "Director)' assistance automation in Bell Canada: Trial results," in Proc. 1VTTA 94, 1994, pp. 8-12.
75. V. Gupta, S. Robillard, and C. Pelletier, "Automation of locality recognition in ADAS Plus," in Proc. IVTFA 98, 1998, pp. M.
76. R. Billi, F. Canavcsto, and C. Rullent, "Automation of telecora Italia directory assistance service: Field trial results," in Proc. IVTTA 98, 1998, pp. 11-14.
77. B. Buntschuh. C. Kamm, G. DiFabbrizio, A. Abella, M. Mohri, S. Narayanan, 1. Zeljkovic, R. D. Shaip, J. Wright, J. Shaffer, R. Duncan, and J. Wilpon, "VPQ: A spoken language interface to large scale directory information," presented at the Proc. ICSLP 98, 1998.
78. M. Johnston, P. R. Cohen, D. McGee, S. L. Oviatt, J. A. Pittman, and i. Smith, "Unification-based multimodal integration," presented at the Proc. 35th Annu. Meeting Association of Computational Linguistics, ACL/EACL, 1997.
79. H. Dudley, "The vocoder-Electrical re-creation of speech," J. Soc. Motion Pict. Eng., vol. 34, pp. 272-278, 1940.
80. Appendix !-A high quality low-complexity algorithm for packet !oss concealment with G.711, ITU-T Recommendation G.711, May 1999.
81. M. Beutnagel, A. Conkie, J. Schroeter, Y. Stylianou, and A. Syrdal. The AT&T next-gen TTS system, presented at Proc. Joint Meeting of ASA. EAA, and DEC A. [CD-ROM] Available: http://www.research.att.com/projects/tts