Verbmobil: The use of prosody in the linguistic components of a speech understanding system

IEEE Transactions on Speech and Audio Processing

Volumn 8, Issue 5, 2000, Pages 519-531

  Noth, Elmar ^a,d   Batliner, Anton ^a   Kießling, Andreas ^b   Kompe, Ralf ^a   Niemann, Heinrich ^c  

^a UNIVERSITY OF ERLANGEN NUREMBERG   (Germany)

^b ERICSSON RESEARCH   (Germany)

^c Stuttgart Technology Center   (Germany)

^d Lehrstuhl fr Informatik 5   (China)

Author keywords

Dialogue; Intonation; Prosodie phrase boundaries and accents; Prosody; Spccch to spccch translation; Speech understanding; Spontaneous speech; Syntax

Indexed keywords

COMPUTATIONAL LINGUISTICS; MAXIMUM LIKELIHOOD ESTIMATION; SPEECH COMMUNICATION; SPEECH INTELLIGIBILITY; SPEECH PROCESSING; SPEECH RECOGNITION; SPEECH SYNTHESIS;

DIALOUGE; INTONATION; PROSODIC PHASE BOUNDARIES; PROSODY; SPEECH TO SPEECH TRANSLATION; SPEECH UNDERSTANDING SYSTEM; SPONTANEOUS SPEECH; SYNTAX;

SPEECH ANALYSIS;

EID: 0034274273     PISSN: 10636676     EISSN: None     Source Type: Journal    
DOI: 10.1109/89.861370     Document Type: Article

References (57)

1. A. Batliner, "Fokus, Modus und die große Zahl. Zur intonatorischen Indizierung des Fokus im Deutschen," in Zur Intonation von Modus und Fokus im Deutschen, H. Altmann, A. Batliner, and W. Oppenrieder, Eds. Tübingen, Germany: Niemeyer, 1989, pp. 21-70.
2. A. Batliner, J. Buckow, R. Huber, V. Wamke, E. Moth, and H. Niemann, "Prosodie feature evaluation: Brute force or well designed?," in Proc. 14th Int. Cony. Phonetic Sciences, vol. 3, San Francisco, CA, 1999, pp. 2315-2318.
3. A. Batliner, A. Feldhaus, S. Geisler, A. Kießling, T. Kiss, R. Kompe, and E. Nöth, "Integrating syntactic and prosodie information for the efficient detection of empty categories," in Proc. Int. Conf. Computational Linguistics, vol. 1, Copenhagen, Denmark, 1996, pp. 71-76.
4. A. Batliner, A. Feldhaus, S. Geißler, T. Kiss, R. Kompe, and E. Nöth, "Prosody, empty categories and parsing-A success story," in Int. Conf. Spoken Language Processing, vol. 2, Philadelphia, PA, 1996, pp. 1169-1172.
5. A. Batliner, A. Kießling, R. Kompe, H. Niemann, and E. Nöth, "Can we tell apart intonation from prosody (if we look at accents and boundaries)?," in Proc. ESCA Workshop Intonation, G. Kouroupetroglou, Ed., Athens, Greece, 1997, pp. 39-12. Dept. Informatics, Univ. Athens, Greece.
6. "Tempo and its change in spontaneous speech," in Proc. Eur. Conf. Speech Communication Technology, vol. 2, Rhodes, Greece, 1997, pp. 763-766.
7. A. Batliner, R. Kompe, A. Kießling, M. Mast, H. Niemann, and E. Nöth, "M = Syntax+Prosody: A syntactic-prosodic labeling scheme for large spontaneous speech databases," Speech Commun., vol. 25, no. 4, pp. 193-222, 1998.
8. A. Batliner, R. Kompe, A. Kießling, H. Niemann, and E. Nöth, "Syntactic-prosodic labeling of large spontaneous speech data-bases," in Int. Conf. Spoken Language Processing, vol. 3, Philadelphia, PA, 1996, pp. 1720-1723.
9. A. Batliner, R. Kompe, A. Kießling, E. Nöth, H. Niemann, and U. Kilian, "The prosodie marking of phrase boundaries: Expectations and results," in Speech Recognition and Coding. New Advances and Trends, Vol. 147 of NATO ASI Series F, A. J. Rubio Ayuso and J. M. López Soler, Eds. Berlin, Germany: Springer, 1995, pp. 325-328.
10. J. Bear and P. J. Price, "Prosody, syntax, and parsing," in Proc. 28th Conf. Assoc. Computational Lingustics, Banff, AB, Canada, 1990, pp. 17-22.
11. H. U. Block, "The language components in Verbmobil," in Proc. Int. Conf. on Acoustics, Speech and Signal Processing, vol. l, M̈nchen, Germany, 1997, pp. 79-82.
12. H. U. Block and S. Schachtl, "Trace and unification grammar," in Proc. Int. Conf. Computational Linguistics, vol. 1, Nantes, France, 1992, pp. 87-93.
13. J. Bos, private communication, July 1996.
14. J. Bos, B. Gamback, Ch. Lieske, Y. Mon, M. Pinkal, and K. Worm, "Compositional semantics in Verbmobil," in Proc. Int. Conf. Computational Linguistics,vol. 1, Copenhagen, Denmark, 1996, pp. 131-136.
15. T. Bub and J. Schwinn, "Verbmobil: The evolution of a complex large speech-to-speech translation system," in Int. Conf. Spoken Language Processing, vol. 4, Philadelphia, PA, 1996, pp. 1026-1029.
16. K. Eberle, "Disambiguation by information structure in DRT," in Proc. of the Int. Conf. Computational Linguistics, vol. 1, Copenhagen, Denmark, 1996, pp. 334-339.
17. W. Eckert, E. N̈th, H. Niemann, and E. Schukat-Talamazzini, "Real users behave weird-Experiences made collecting large human-machine-dialog corpora," in Proc. ESCA Tutorial Research Workshop Spoken Dialogue Systems, P. Dalsgaard, L. B. Larsen, L. Boves, and I. Thomsen, Eds., Vigs0, Denmark, 1995, pp. 193-196.
18. S. E. Fahlman, "An empirical study of learning speed in back-propagation networks," Carnegie Mellon Univ., Pittsburgh, PA, Tech. Rep. CMU-CS-88-62, 1988.
19. A. Feldhaus and T. Kiss, "Kategoriale Etikettierung der Karlsruher Dialoge," Verbmobil Memo 94, 1995.
20. A. Hunt, "A generalized model for utilising prosodie information in continuous speech recognition," in Proc. Int. Conf. Acoustics, Speech, Signal Processing, vol. 2, Adelaide, Australia, 1994, pp. 169-172.
21. "A prosodie recognition module based on linear discriminant analysis," in Int. Conf. Spoken Language Processing, vol. 3, Yokohama, Japan, 1994, pp. 1119-1122.
22. "Models of prosody and syntax and their application to automatic speech recognition," Ph.D. dissertation, Univ. Sydney, Sydney, Australia, 1995.
23. "Syntactic influence on prosodie phrasing in the framework of the link grammar," in Proc. Eur. Conf. Speech Communication Technology, vol. 2, Madrid, Spain, 1995, pp. 997-1000.
24. H. Kamp and U. Reyle, From Discourse to Logic and DRT; An Intorduction to Modeltheoretic Semantics of Natural Language. Dordrecht, The Netherlands: Kluwer, 1993.
25. A. Kießling, Extraktion und Klassifikation prosodischer Merkmale in der automatischen Sprachrerarbeitung. Aachen, Germany: Shaker, 1997.
26. A. Kießling, R. Kompe, H. Niemann, E. Nöth, and A. Batliner, ""Roger", "sorry", "I'm still listening": Dialog guiding signals in information retrieval dialogs," in Proc. ESCA Workshop Prosody, D. House and P. Touati, Eds, Lund, Sweden, 1993, pp. 140-143.
27. R. Kompe, Prosody in Speech Understanding Systems. Berlin, Germany: Springer, 1997.
28. R. Kompe, A. Batliner, A. Kießling, U. Kilian, H. Niemann, E. Nöth, and P. Regel-Brietzmann, "Automatic classification of prosodically marked phrase boundaries in German," in Proc. Int. Conf. Acoustics, Speech, Signal Processing, vol. 2, Adelaide, Australia, 1994, pp. 173-176.
29. R. Kompe, A. Kieling, H. Niemann, E. N̈th, A. Batliner, S. Schachtl, T. Ruland, and H. U. Block, "Improving parsing of spontaneous speech with the help of prosodie boundaries," in Proc. Int. Conf. Acoustics, Speech, Signal Processing, vol. 2, M̈nchen, Germany, 1997, pp. 811-814.
30. R. Kompe, A. Kieling, H. Niemann, E. N̈th, E. G. Schukat-Talamazzini, A. Zottmann, and A. Batliner, "Prosodie scoring of word hypotheses graphs," in Proc. Ear. Conf. Speech Communication Technology, vol. 2, Madrid, Spain, 1995, pp. 1333-1336.
31. T. K̈hn, P. Fetter, A. Kaltenmeier, and P. Regel-Brietzmann, "DP-based wordgraph pruning," in Proc. Int. Conf. Acoustics, Speech, Signal Processing, vol. 2, Atlanta, GA, 1996, pp. 861-864.
32. W. Lea, "Prosodie aids to speech recognition," in Trends in Speech Recognition, W. Lea, Ed. Englewood Cliffs, NJ: Prentice-Hall, 1980, pp. 166-205.
33. I. Lehiste, Suprasegmentah. Cambridge, MA: MIT Press, 1970.
34. M. Mast, R. Kompe, S. Harbeck, A. Kieling, H. Niemann, E. N̈th, and V. Wamke, "Dialog act classification with the help of prosody," in Int. Conf. Spoken Language Processing, vol. 3, Philadelphia, PA, 1996, pp. 1728-1731.
35. H. Ney, U. Essen, and R. Kneser, "On structuring probabilistic dependencies on stochastic language modeling," Comput. Speech Lang., vol. 8, no. l,pp. 1-38, 1994.
36. E. N̈th, Prosodische Information in der automatischen Spracherkennung-Berechnung und Anwendung. Tubingen, Germany: Niemeyer, 1991.
37. E. N̈th, A. Batliner, T. K̈hn, and G. Stallwitz, "Intensity as a predictor of focal accent," in Proc. 12th Int. Congr. Phonetic Sciences, vol. 3, Aix-en-Provence, France, 1991, pp. 230-233. .
38. M. Oerder and H. Ney, "Word graphs: An efficient interface between continuous speech recognition and language understanding," in Proc. Int. Conf. Acoustics, Speech, Signal Processing, vol. 2, Minneapolis, MN, 1993, pp. 119-122.
39. M. Ostendorf, P. J. Price, J. Bear, and C. W. Wightman, "The use of relative duration in syntactic disambiguation," in Speech Natural Language Workshop, Hidden Valley, PA, 1990, pp. 26-31.
40. M. Ostendorf, C. W. Wightman, and N. M. Veilleux, "Parse scoring with prosodie information: An analysis/synthesis approach," Comput. Speech Lang., vol. 7, no. 3, pp. 193-210, 1993.
41. P. J. Price, C. W. Wightman, M. Ostendorf, and J. Bear, "The use of relative duration in syntactic disambiguation," in Int. Conf. Spoken Language Processing, vol. 1, Kobe, Japan, 1990, pp. 13-18.
42. N. Reithinger, E. Maier, and J. Alexandersson, "Treatment of incomplete dialogues in a speech-to-speech translation system," in Proc. ESCA Tutorial Research Workshop Spoken Dialogue Systems, P. Dalsgaard, L. B. Larsen, L. Boves, and I. Thomsen, Eds., Vigs0, Denmark, 1995, pp. 33-36.
43. M. Reyelt and A. Batliner, "Ein Inventar prosodischer Etiketten f̈r Verbmobil," Verbmobil Memo 33, 1994.
44. B. Ripplinger and J. Alexandersson, "Disambiguation and translation of German particles in Verbmobil,", Verbmobil Memo 70, 1996.
45. L. A. Schmid, "Parsing word graphs using a linguistic grammar and a statistical language model," in Proc. Int. Conf. Acoustics, Speech, Signal Processing, vol. 2, Adelaide, Australia, 1994, pp. 41-44.
46. E. G. Schukat-Talamazzini, T. K̈hn, and H. Niemann, "Speech recognition for spoken dialogue systems," in Progress Prospects Speech Research Technology: Proc. CRIM/FORWISS Workshop, H. Niemann, R. De Mori, and G. Hanrieder, Eds., 1994, pp. 110-120.
47. N. Sikkel, Parsing Schemata, CIP-Gegevens Koninklijke Bibliotheek, 1993.
48. D. Sleator and D. Temperley, "Parsing English with a link grammar," School of Computer Science, Carnegie Mellon Univ., Tech. Rep. CMU-CS-91-196, 1991.
49. B. Suhm, P. Geutner, T. Kemp, A. Lavie, L. Mayfield, A. E. McNair, I. Rogina, T. Sloboda, W. Ward, M. Woszczyna, and A. Waibel, "Janus: Toward multilingual spoken language translation," in P roc. ARPA.Spoken Language Systems Technology Workshop. San Mateo, CA: Morgan Kaufman, 1995, pp. 221-226.
50. M. Tomita, Efficient Parsing for Natural Language: A Fast Algorithm for Practical Systems. Dordrecht, The Netherlands: Kluwer, 1986.
51. H. Tropf, Spontansprachliche syntaktische Phänomene: Analyse eines Korpus aus der Domäne Terminabsprache, München, Germany, Tech. Rep., Siemens AG, ZFE ST SN 54, 1994.
52. J. Vaissière, "The use of prosodie parameters in automatic speech recognition," in Recent Advances in Speech Understanding and Dialog Systems, Volume 46 of NATO ASI Series F, H. Niemann, M. Lang, and G. Sagerer, Eds. Berlin, Germany: Springer, 1988, pp. 71-99.
53. N. M. Veilleux and M. Ostendorf, "Probabilistic parse scoring with prosodie information," in Proc. Int. Conf. Acoustics, Speech, Signal Processing, vol. 2, Minneapolis, MN, 1993, pp. 51-54.
54. W. Wahlster.. presented at Presseerklärung zum VerbmobilForschungsprototypen am 25.10.1996. [Online]. Available: http://www.dfki.uni-sb.de/verbmobil
55. W. Wahlster, T. Bub, and A. Waibel, "Verbmobil: The combination of deep and shallow processing for spontaneous speech translation," in Proc. Int. Conf. Acoustics, Speech, Signal Processing, vol, l, München, Germany, 1997, pp. 71-74.
56. C. W. Wightman, "Automatic detection of prosodie constituents," Ph.D. dissertation, Boston Univ., Boston, MA, 1992.
57. C. W. Wightman and M. Ostendorf, "Automatic labeling of prosodie patterns," IEEE Trans. Speech Audio Processing, vol. 2, no. 3, pp. 469-481, 1994.