Combining lexical, syntactic and prosodic cues for improved online dialog act tagging

Computer Speech and Language

Volumn 23, Issue 4, 2009, Pages 407-422

  Rangarajan Sridhar, Vivek Kumar ^a   Bangalore, Srinivas ^b   Narayanan, Shrikanth ^a  

^a University of Southern California   (United States)

^b AT AND T LABS RESEARCH   (United States)

Author keywords

Acoustic correlates of prosody; Dialog act tagging; Discourse context; Maximum entropy modeling; Prosodic cues

Indexed keywords

ACOUSTIC CORRELATES OF PROSODY; DIALOG ACT TAGGING; DISCOURSE CONTEXT; MAXIMUM ENTROPY MODELING; PROSODIC CUES;

ACOUSTICS; DECODING; ENTROPY; SYNTACTICS;

SPEECH RECOGNITION;

EID: 67349141395     PISSN: 08852308     EISSN: 10958363     Source Type: Journal    
DOI: 10.1016/j.csl.2008.12.001     Document Type: Article

References (47)

1. Ang, J., Liu, Y., Shriberg, E., 2005. Automatic dialog act segmentation and classification in multiparty meetings. In: Proceedings of ICASSP.
2. Austin J.L. How to do Things with Words (1962), Clarendon Press, Oxford
3. Bangalore S., and Joshi A.K. Supertagging: an approach to almost parsing. Computational Linguistics 25 2 (1999)
4. Bangalore, S., Di Fabbrizio, G., Stent, A., 2006. Learning the structure of task-driven human-human dialogs. In: Proceedings of ACL, Sydney, Australia, pp. 201-208.
5. Berger A., Pietra S.D., and Pietra V.D. A maximum entropy approach to natural language processing. Computational Linguistics 22 1 (1996) 39-71
6. Black, A.W., Campbell, N., 1995. Predicting the intonation of discourse segments from examples in dialogue speech. In: Proceedings of the ESCA Workshop on Spoken Dialogue Systems.
7. Bolinger D.L. Intonation across languages. In: Greenberg J.P., Ferguson C.A., and Moravcsik E.A. (Eds). Universals of Human Language. Phonology vol. 2 (1978), Stanford University Press, Stanford
8. Carletta J., Isard A., Isard S., Kowtko J., Doherty-Sneddon G., and Anderson A. The reliability of a dialogue structure coding scheme. Computational Linguistics 23 (1997) 13-31
9. Chen, J., Vijay-Shanker, K., 2000. Automated extraction of tags from the penn treebank. In: Proceedings of the 6th International Workshop on Parsing Technologies, Trento, Italy.
10. Cruttenden A. Intonation (1989), Cambridge University Press
11. Dudik M., Phillips S., and Schapire R.E. Performance guarantees for regularized maximum entropy density estimation. Proceedings of COLT (2004), Springer Verlag, Banff, Canada
12. Fernandez, R., Picard, R.W., 2002. Dialog act classification from prosodic features using support vector machines. In: Proceedings of Speech Prosody, pp. 291-294.
13. Gravano, A., Benus, B., Chávez, J., Hirschberg, Wilcox, L., 2007. On the role of context and prosody in the interpretation of okay. In: Proceedings of ACL, Prague, Czech Republic.
14. Haffner P. Scaling large margin classifiers for spoken language understanding. Speech Communication 48 iv (2006) 239-261
15. Hamaker, J., Deshmukh, N., Ganapathiraju, A., Picone, J., 1998. Resegmentation and transcription of the SWITCHBOARD corpus. In: Proceedings of Speech Transcription Workshop.
16. Hirschberg J., and Litman D. Empirical studies on the disambiguation of cue phrases. Computational Linguistics 19 3 (1993) 501-530
17. Hirschberg, J., Nakatani, C., 1998. Acoustic indicators of topic segmentation. In: Proceedings of the International Conference on Spoken Language Proc., pp. 976-979.
18. Ji, G., Bilmes, J., 2005. Dialog act tagging using graphical models. In: Proceedings of ICASSP.
19. Joshi A., and Schabes Y. Tree-adjoining grammars. In: Salomaa A., and Rozenberg G. (Eds). Handbook of Formal Lanaguages and Automata (1996), Springer-Verlag, Berlin
20. Jurafsky, D., Bates, R., Coccaro, N., Martin, R., Meteer, M., Ries, K., Shriberg, E., Stolcke, A., Taylor, P., Van Ess-Dykema, C., 1997. Automatic detection of discourse structure for speech recognition and understanding. In: Proceedings of ASRU, Santa Barbara, CA, pp. 88-95.
21. Jurafsky, D., Bates, R., Coccaro, N., Martin, R., Meteer, M., Ries, K., Shriberg, E., Stolcke, S., Taylor, P., Van Ess-Dykema, C., 1998. Switchboard discourse language modeling project report, Center for Speech and Language Processing, Johns Hopkins University, Baltimore, MD, Technical Report Research Note 30.
22. Jurafsky, D., Shriberg, E., Fox, B., Curl, T., 1998. Lexical, prosodic, and syntactic cues for dialog acts. In: Proceedings of the ACL/COLING Workshop on Discourse Relations and Discourse Markers, Montreal, Canada, pp. 114-120.
23. Kuncheva L.I., and Whitaker C.J. Measures of diversity in classifier ensembles. Machine Learning 51 (2003) 181-207
24. Lavie, A., Levin, L., Qu, Y., Waibel, A., Gates, D., Gavalada, M., Mayfield, L., Taboada, M., 1996. Dialogue processing in a conversational speech translation system. In: Proceedings of ICSLP, pp. 554-557.
25. Liu, Y., Shriberg, E., Stolcke, A., 2003. Automatic disfluency identification in conversational speech using multiple knowledge sources. In: Proceedings of the Eurospeech, Geneva, pp. 957-960.
26. Liu Y., Shriberg E., Stolcke A., Hillard H., Ostendorf M., and Harper M. Enriching speech recognition with automatic detection of sentence boundaries and disfluencies. IEEE Transactions on Audio, Speech and Language Processing 14 5 (2006) 1526-1540
27. Mrozinski, J., Whittaker, E.W.D., Chatain, P., Furui, S., 2006. Automatic sentence segmentation of speech for automatic summarization. In: Proceedings of ICASSP, vol. 1, pp. 14-19.
28. Murray, G., Renals, S., Moore, J., Carletta, J., 2006. Incorporating speaker and discourse features into speech summarization. In: Proceedings of HLT-NAACL, New York City, USA.
29. O'Connor J.D., and Arnold G.F. Intonation of Colloquial English. second ed. (1973), Longman
30. Pierrehumbert, J., 1980. The Phonology and Phonetics of English Intonation. Ph.D. Thesis, MIT.
31. Rangarajan Sridhar, V.K., Bangalore, S., Narayanan, S. Dec. 2006. Acoustic-syntactic maximum entropy model for automatic prosody labeling. In: Proceedings of IEEE/ACL Spoken Language Technology, Aruba.
32. Rangarajan Sridhar, V.K., Bangalore, S., Narayanan, S., 2007. Exploiting prosodic features for dialog act tagging in a discriminative modeling framework. In: Proceedings of InterSpeech, Antwerp.
33. Rangarajan Sridhar, V.K., Bangalore, S., Narayanan, S., 2007. Exploiting acoustic and syntactic features for prosody labeling in a maximum entropy framework. In: Proceedings of NAACL-HLT.
34. Rangarajan Sridhar, V.K., Bangalore, S., Narayanan, S., 2008. Enriching spoken language translation with dialog acts. In: Proceedings of ACL.
35. Rangarajan Sridhar, V.K., Bangalore, S., Narayanan, S., 2008. Factored translation models for enriching spoken language translation with prosody. In: Proceedings of Interspeech, Brisbane, Australia.
36. Reithinger, N., Engel, R., Kipp, M., Klesen, M., 1996. Predicting dialogue acts for a speech-to-speech translation system. In: Proceedings of ICSLP, vol. 2, pp. 654-657.
37. Ries, K., 1999. HMM and neural network based speech act detection. In: Proceedings of ICASSP, vol. 1, pp. 497-500.
38. Shriberg E., Bates R., Stolcke A., Taylor P., Jurafsky D., Ries K., Coccaro N., Martin R., Meteer M., and Van Ess-Dykema C. Can prosody aid the automatic classification of dialog acts in conversational speech?. Language and Speech 41 3-4 (1998) 439-487
39. Shriberg, E., Stolcke, A., Hakkani-Tur, D., Tur, G., 2000. Prosody-based automatic segmentation of speech into sentences and topics. In: Speech Communication, No. 32 in Special Issue on Accessing Information in Spoken Audio, pp. 127-154.
40. Stolcke A., Ries K., Coccaro N., Shriberg E., Bates R., Jurafsky D., Taylor P., Martin R., Van Ess-Dykema C., and Meteer M. Dialogue act modeling for automatic tagging and recognition of conversational speech. Computational Linguistics 26 3 (2000) 339-373
41. Taylor P., King S., Isard S., and Wright H. Intonation and dialogue context as constraints for speech recognition. Language and Speech 41 34 (2000) 493-512
42. Witten I.H., and Frank E. Data Mining: Practical Machine Learning Tools and Techniques (2005), Morgan Kaufmann, San Francisco
43. Wu C.H., Yan G.L., and Lin C.L. Speech act modeling in a spoken dialog system using a fuzzy fragment-class Markov model. Speech Communication 38 1-2 (2002) 183-199
44. Xia, F., Palmer, M., Joshi, A., 2000. A uniform method of grammar extraction and its applications. In: Proceedings of Empirical Methods in Natural Language Processing.
45. XTAG, 2001. A lexicalized tree-adjoining grammar for English, Tech. Rep., University of Pennsylvania. .
46. Yoshimura, T., Hayamizu, S., Ohmura, H., Tanaka, K., 1996. Pitch pattern clustering of user utterances in human-machine dialogue. In: Proceedings of ICSLP, vol. 2, pp. 837-840.
47. * based joint segmentation and classification of dialog acts in multiparty meetings. In: Proceedings of the IEEE Speech Recognition and Understanding Workshop, San Juan, Puerto Rico, pp. 215-219.