Speaker adaptation of language and prosodic models for automatic dialog act segmentation of speech

Speech Communication

Volumn 52, Issue 3, 2010, Pages 236-245

  Kolář, Jáchym ^a   Liu, Yang ^b   Shriberg, Elizabeth ^c,d  

^a UNIVERSITY OF WEST BOHEMIA   (Czech Republic)

^b The University of Texas at Dallas   (United States)

^c SRI INTERNATIONAL   (United States)

^d INTERNATIONAL COMPUTER SCIENCE INSTITUTE   (United States)

Author keywords

Dialog act segmentation; Language modeling; Prosody modeling; Speaker adaptation; Spoken language understanding

Indexed keywords

AUTOMATIC SEGMENTATIONS; AUTOMATIC SPEECH RECOGNITION; DIALOG ACTS; FUTURE DIRECTIONS; IN-DEGREE; LANGUAGE MODELING; LINEAR COMBINATIONS; PROSODY MODELING; SPEAKER ADAPTATION; SPEECH UNDERSTANDING; SPOKEN LANGUAGE UNDERSTANDING;

COMPUTATIONAL LINGUISTICS; SPEECH ANALYSIS;

SPEECH RECOGNITION;

EID: 73649084746     PISSN: 01676393     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.specom.2009.10.005     Document Type: Article

References (37)

1. Akita, Y., Kawahara, T., 2004. Language model adaptation based on PLSA of topics and speakers. In: Proc. INTERSPEECH 2004-ICSLP, Jeju, Korea.
2. Akita, Y., Saikou, M., Nanjo, H., Kawahara, T., 2006. Sentence boundary detection of spontaneous Japanese using statistical language model and support vector machines. In: Proc. INTERSPEECH 2006 - ICSLP, Pittsburgh, PA, USA.
3. Besling, S., Meier, H.-G., 1995. Language model speaker adaptation. In: Proc. EUROSPEECH, Madrid, Spain.
4. Breiman L., Friedman J., Ohlsen R., and Stone C. Classification and Regression Trees (1984), Wadsworth and Brooks Inc., Pacific Grove, CA, USA
5. Cuendet, S., Hakkani-Tur, D., Tur, G., 2006. Model adaptation for sentence segmentation from speech. In: Proc. IEEE Workshop on Spoken Language Technology, Aruba.
6. Dhillon, R., Bhagat, S., Carvey, H., Shriberg, E., 2004. Meeting recorder project: dialog act labeling guide. Tech. Rep. TR-04-002, ICSI, Berkeley, CA, USA.
7. Favre, B., Hakkani-Tur, D., Petrov, S., Klein, D., 2008. Efficient sentence segmentation using syntactic features. In: Proc. IEEE Workshop on Spoken Language Technology, Goa, India.
8. Furui S., Kikuchi T., Shinnaka Y., and Hori C. Speech-to-text and speech-to-speech summarization of spontaneous speech. IEEE Trans. Speech Audio Process. 12 4 (2004) 401-408
9. Gales M. Maximum likelihood linear transformations for HMM-based speech recognition. Comput. Speech Language 12 (1998) 75-98
10. Gauvain J.-L., and Lee C.-H. Maximum a posteriori estimation for multivariate Gaussian mixture observation of Markov chains. IEEE Trans. Speech Audio Process. 2 2 (1994) 291-298
11. In: Hirst A., and Cristo A.D. (Eds). Intonation Syst. (1998), Cambridge University Press
12. Huang, J., Zweig, G., 2002. Maximum entropy model for punctuation annotation from speech. In: Proc. of ICSLP 2002, Denver, CO, USA.
13. Janin, A., Baron, D., Edwards, J., Ellis, D., Gelbart, D., Morgan, N., Peskin, B., Pfau, T., Shriberg, E., Stolcke, A., Wooters, C., 2003. The ICSI meeting corpus. In: Proc. ICASSP, Hong Kong.
14. Jones, D., Wolf, F., Gibson, E., Williams, E., Fedorenko, E., Reynolds, D., Zissman, M., 2003. Measuring the readability of automatic speech-to-text transcripts. In: Proc. EUROSPEECH, Geneva, Switzerland.
15. Kahn, J.G., Ostendorf, M., Chelba, C., 2004. Parsing conversational speech using enhanced segmentation. In: Proc. HLT-NAACL, Boston, MA, USA.
16. Kim J.H., and Woodland P. A combined punctuation generation and speech recognition system and its performance enhancement using prosody. Speech Communication 41 4 (2003) 563-577
17. Kneser, R., Ney, H., 1995. Improved backing-off for M-gram language modeling. In: Proc. ICASSP, Detroit, MI, USA.
18. Kolář, J., Liu, Y., Shriberg, E., 2007. Speaker adaptation of language models for automatic dialog act segmentation of meetings. In: Proc. INTERSPEECH 2007, Antwerp, Belgium.
19. Kolář, J., Shriberg, E., Liu, Y., 2006a. On speaker-specific prosodic models for automatic dialog act segmentation of multi-party meetings. In: Proc. INTERSPEECH 2006 - ICSLP, Pittsburgh, PA, USA.
20. Kolář, J., Shriberg, E., Liu, Y., 2006b. Using prosody for automatic sentence segmentation of multi-party meetings. In: Text, Speech and Dialogue. Lecture Notes in Artificial Intelligence, Vol. 4188, pp. 629-636.
21. Liu Y., Chawla N., Harper M., Shriberg E., and Stolcke A. A study in machine learning from imbalanced data for sentence boundary detection in speech. Comput. Speech Language 20 (2006) 468-494
22. Liu, Y., Stolcke, A., Shriberg, E., Harper, M., 2004. Comparing and combining generative and posterior probability models: Some advances in sentence boundary detection in speech. In: Proc. EMNLP. Barcelona, Spain.
23. Liu, Y., Stolcke, A., Shriberg, E., Harper, M., 2005. Using conditional random fields for sentence boundary detection in speech. In: Proc. ACL, Ann Arbor, MI, USA.
24. Magimai-Doss, M., Hakkani-Tur, D., Cetin, O., Shriberg, E., Fung, J., Mirghafori, N., 2007. Entropy based classifier combination for sentence segmentation. In: Proc. ICASSP, Honolulu, HI.
25. Matusov, E., Hillard, D., Magimai-Doss, M., Hakkani-Tür, D., Ostendorf, M., Ney, H., 2007. Improving speech translation with automatic boundary prediction. In: Proc. INTERSPEECH 2007, Antwerp, Belgium.
26. Ostendorf M., and Veilleux N. A hierarchical stochastic model for automatic prediction of prosodic boundary locations. Comput. Linguistics 20 1 (1994) 27-54
27. Roark, B., Liu, Y., Harper, M., Stewart, R., Lease, M., Snover, M., Shafran, I., Dorr, B., Hale, J., Krasnyanskaya, A., Yung, L., 2006. Reranking for sentence boundary detection in conversational speech. In: Proc. ICASSP, Toulouse, France.
28. Shriberg E., Stolcke A., Hakkani-Tür D., and Tür G. Prosody-based automatic segmentation of speech into sentences and topics. Speech Communication 32 1-2 (2000) 127-154
29. Sönmez, K., Shriberg, E., Heck, L., Weintraub, M., 1998. Modeling dynamic prosodic variation for speaker verification. In: Proc. ICSLP, Sydney, Australia.
30. Srivastava, A., Kubala, F., 2003. Sentence boundary detection in Arabic speech. In: Proc. EUROSPEECH, Geneva, Switzerland.
31. Stolcke, A., 2002. SRILM - An extensible language modeling toolkit. In: Proc. ICSLP, Denver, CO, USA.
32. Stolcke A., Chen B., Franco H., Gadde V.R.R., Graciearena M., Hwang M.-Y., Kirchhoff K., Mandal A., Morgan N., Lei X., Ng T., Ostendorf M., Sönmez K., Venkataraman A., Vergyri D., Wang W., Zheng J., and Zhu Q. Recent innovations in speech-to-text transcription at SRI-ICSI-UW. IEEE Trans. Audio, Speech, Language Process. 14 5 (2006) 1729-1744
33. Stolcke, A., Shriberg, E., Bates, R., Ostendorf, M., Hakkani, D., Plauche, M., Tür, G., Lu, Y., 1998. Automatic detection of sentence boundaries and disfluencies based on recognized words. In: Proc. ICSLP, Sydney, Australia.
34. Tur, G., Stolcke, A., 2007. Unsupervised language model adaptation for meeting recognition. In: Proc. ICASSP, Honolulu, HI, USA.
35. Warnke, V., Kompe, R., Niemann, H., Nöth, E., 1997. Integrated dialog act segmentation and classification using prosodic features and language models. In: Proc. EUROSPEECH, Rhodes, Greece.
36. Zimmermann, M., 2009. Joint segmentation and classification of dialog acts using conditional random fields. In: Proc. INTERSPEECH 2009, Brighton, UK.
37. Zimmermann, M., Hakkani-Tur, D., Fung, J., Mirghafori, N., Gottlieb, L., Shriberg, E., Liu, Y., 2006. The ICSI+ multilingual sentence segmentation system. In: Proc. INTERSPEECH 2006 - ICSLP, Pittsburgh, PA, USA.