Recognition of dialogue acts in multiparty meetings using a switching DBN

IEEE Transactions on Audio, Speech and Language Processing

Volumn 16, Issue 7, 2008, Pages 1303-1314

  Dielmann, Alfred ^a   Renals, Steve ^a  

^a UNIVERSITY OF EDINBURGH   (United Kingdom)

Author keywords

AMI corpus; Conditional random field (CRF); Dialogue act (DA); Dynamic Bayesian network (DBN); Interpolated factored language model (FLM)

Indexed keywords

AMI CORPUS; CONDITIONAL RANDOM FIELD (CRF); DIALOGUE ACT (DA); DYNAMIC BAYESIAN NETWORK (DBN); INTERPOLATED FACTORED LANGUAGE MODEL (FLM);

BAYESIAN NETWORKS; COMPUTATIONAL LINGUISTICS; CONTENT BASED RETRIEVAL; DISTRIBUTED PARAMETER NETWORKS; IMAGE SEGMENTATION; INFERENCE ENGINES; INTELLIGENT NETWORKS; SOFTWARE AGENTS; TRANSCRIPTION; USER INTERFACES;

SPEECH RECOGNITION;

EID: 70350572466     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2008.922463     Document Type: Article

References (40)

1. G. Murray, S. Renals, J. Moore, and J. Carletta, "Incorporating speaker and discourse features into speech summarization, " in Proc. HLT-NAACL, Jun. 2006, pp. 367-374.
2. M. Galley, K. R. McKeown, E. Fosler-Lussier, and H. Jing, "Discourse segmentation of multi-party conversation, " in Proc. 41st Annu. Meeting Assoc. Comput. Linguist. (ACL-03), Jul. 2003, pp. 562-569.
3. P. Hsueh and J. Moore, "Automatic topic segmentation and labelling in multiparty dialogue, " in Proc. IEEE/ACL Workshop Spoken Lang. Technol., Dec. 2006, pp. 98-101.
4. M. Al-Hames, A. Dielmann, D. Gatica-Perez, S. Reiter, S. Renals, G. Rigoll, and D. Zhang, "Multimodal integration for meeting group action segmentation and recognition, " in Proc. Multimodal Interaction and Rel. Mach. Learn. AlgorithmsWorkshop (MLMI-05), 2006, pp. 52-63.
5. I. McCowan, D. Gatica-Perez, S. Bengio, and G. Lathoud, "Automatic analysis of multimodal group actions in meetings, " IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, pp. 305-317, Mar. 2005.
6. A. Dielmann and S. Renals, "Automatic meeting segmentation using dynamic Bayesian networks, " IEEE Trans. Multimedia, vol. 9, no. 1, pp. 25-36, Jan. 2007.
7. R. Rienks, D. Zhang, D. Gatica-Perez, and W. Post, "Detection and application of influence rankings in small group meetings, " in Proc. Int. Conf. Multimodal Interfaces (ICMI-06), Nov. 2006, pp. 257-264.
8. M. Purver, J. Niekrasz, and P. Ehlen, "Automatic annotation of dialogue structure from simple user interaction, " in Proc. Multimodal Interaction and Rel. Mach. Learn. Algorithms Workshop (MLMI-07), 2007, pp. 48-59.
9. J. Carletta, S. Ashby, S. Bourban, M. Flynn, M. Guillemot, T. Hain, J. Kadlec, V. Karaiskos, W. Kraaij, M. Kronenthal, G. Lathoud, M. Lincoln, A. Lisowska, I. McCowan, W. Post, D. Reidsma, and P.Wellner, "The AMI meeting corpus: A pre-announcement, " in Proc. Multimodal Interaction and Rel. Mach. Learn. Algorithms Workshop (MLMI-05), 2006, pp. 28-39.
10. A. Janin, D. Baron, J. Edwards, D. Ellis, D. Gelbart, N. Morgan, B. Peskin, T. Pfau, E. Shriberg, A. Stolcke, and C. Wooters, "The ICSI meeting corpus, " in Proc. IEEE ICASSP, Apr. 2003, vol. 1, pp. 364-367.
11. C. Cieri, D. Miller, and K. Walker, "The Fisher corpus: A resource for the next generations of speech-to-text, " in Proc. LREC, May 2004, pp. 69-71.
12. E. Shriberg, R. Dhillon, S. Bhagat, J. Ang, and H. Carvey, "The in Proc. HLT-NAACL SIGDIAL Workshop, Apr.-May 2004, pp. 97-100.
13. T. Hain, L. Burget, J. Dines, G. Garau, V. Wan, M. Karafiat, J. Vepa, and M. Lincoln, "The AMI system for the transcription of speech in meetings, " in Proc. IEEE ICASSP, Apr. 2007, vol. 4, pp. 357-360.
14. D. Talkin, "A robust algorithm for pitch tracking (RAPT), " in Speech Coding and Synthesis, W. B. Kleijn and K. K. Paliwal, Eds. New York: Elsevier, 1995, pp. 495-518.
15. J. Ang, Y. Liu, and E. Shriberg, "Automatic dialog act segmentation and classification in multiparty meetings, " in Proc. IEEE ICASSP, Mar. 2005, vol. 11, pp. 1061-1064.
16. M. Zimmermann, A. Stolcke, and E. Shriberg, "Joint segmentation and classification of dialog acts in multiparty meetings, " in Proc. IEEE ICASSP, May 2006, vol. 1, pp. I-581-I-584.
17. J. Bilmes and K. Kirchhoff, "Factored language models and generalized parallel backoff, " in Proc. HLT-NAACL, May 2003, vol. 2, pp. 4-6.
18. K. Duh and K. Kirchhoff, "Automatic learning of language model structure, " in Proc. Int. Conf. Comput. Linguist. (COLING), Nov. 2004, article no.148.
19. J. Bilmes, "Dynamic Bayesian multinets, " in Proc. Int. Conf. Uncertainty in Artif. Intell., Jun.-Jul. 2000.
20. J. Bilmes and G. Zweig, "The Graphical model ToolKit: An open source software system for speech and time-series processing, " in Proc. IEEE ICASSP, Jun. 2002, vol. 4, pp. 3916-3919.
21. A. Dielmann and S. Renals, "DBN based joint dialogue act recognition of multiparty meetings, " in Proc. IEEE ICASSP, Apr. 2007, vol. 4, pp. 133-136.
22. S. Lesch, T. Kleinbauer, and J. Alexandersson, "A new metric for the evaluation of dialog act classification, " in Proc. Workshop Semantics and Pragmatics of Dialogue (SEMDIAL), Jun. 2005, pp. 143-146.
23. M. Zimmermann, Y. Liu, E. Shriberg, and A. Stolcke, "Toward joint segmentation and classification of dialog acts in multiparty meetings, " in Proc. Multimodal Interaction and Rel. Mach. Learn. Algorithms Workshop (MLMI-05), 2006, pp. 187-193. (Pubitemid 43979736)
24. A. Dielmann and S. Renals, "Multistream recognition of dialogue acts in meetings, " in Proc. Multimodal Interaction and Rel. Mach. Learn. Algorithms Workshop (MLMI-06), 2007, pp. 178-189.
25. M. Collins and T. Koo, "Discriminative reranking for natural language parsing, " Computat. Linguist., vol. 31, no. 1, pp. 25-70, 2005.
26. L. Shen, A. Sarkar, and F. Och, "Discriminative reranking for machine translation, " in Proc. HLT-NAACL, May 2004, pp. 177-184.
27. V. Venkataramani, S. Chakrabartty, and W. Byrne, "Gini support vector machines for segmental minimum Bayes risk decoding of continuous speech, " Comput. Speech Lang., vol. 21, no. 3, pp. 423-442, Jul. 2007.
28. M. Balakrishna, D. Moldovan, and E. Cave, "N-best list reranking using higher level phonetic, lexical, syntactic and semantic knowledge sources, " in Proc. IEEE ICASSP, May 2006, vol. 1, pp. 413-416.
29. J. Lafferty, A. McCallum, and F. Pereira, "Conditional random fields: Probabilistic models for segmenting and labeling sequence data, " in Proc. Int. Conf. Mach. Learn. (ICML), Jun. 2001, pp. 282-289.
30. A. Stolcke and E. Shriberg, "Automatic linguistic segmentation of conversational speech, " in Proc. ICSLP, Oct. 1996, vol. 2, pp. 1005-1008.
31. E. Shriberg, A. Stolcke, D. Hakkani-Tür, and G. Tür, "Prosody-based automatic segmentation of speech into sentences and topics, " Speech Commun., vol. 32, pp. 127-154, Sep. 2000.
32. A. Stolcke, K. Ries, N. Coccaro, E. Shriberg, D. Jurafsky, P. Taylor, R. Martin, C. V. Ess-Dykema, and M. Meteer, "Dialogue act modeling for automatic tagging and recognition of conversational speech, " Comput. Linguist., vol. 26, no. 3, pp. 339-373, 2000.
33. V. Warnke, R. Kompe, H. Niemann, and E. Nöth, "Integrated dialog act segmentation and classification using prosodic features and language models, " in Proc. Interspeech-Eurospeech, Sep. 1997, vol. 1, pp. 207-210.
34. A. Venkataraman, Y. Liu, and E. Shriberg, "Does active learning help automatic dialog act tagging in meeting data?, " in Proc. Interspeech- Eurospeech, Sep. 2005, pp. 2777-2780.
35. G. Ji and J. Bilmes, "Dialog act tagging using graphical models, " in Proc. IEEE ICASSP, Mar. 2005, vol. 1, pp. 33-36.
36. S. Bhagat, H. Carvey, and E. Shriberg, "Automatically generated prosodic cues to lexically ambiguous dialog acts in multiparty meetings, " in Proc. Int. Congr. Phonetic Sci., Aug. 2003, pp. 2961-2964.
37. E. Shriberg, R. Bates, P. Taylor, A. Stolcke, D. Jurafsky, K. Ries, N. Coccaro, R. Martin, M. Meteer, and C. V. Ess-Dykema, "Can prosody aid the automatic classification of dialog acts in conversational speech?, " Lang. Speech, no. 41, pp. 439-487, 1998.
38. R. Fernandez and R. W. Picard, "Dialog act classification from prosodic features using support vector machines, " in Proc. Speech Prosody 2002, Apr. 2002, pp. 291-294.
39. Y. Liu, "Using SVM and error-correcting codes for multiclass dialog act classification in meeting corpus, " in Proc. Interspeech-ICSLP, Sep. 2006, pp. 1938-1941.
40. D. Surendran and G. A. Levow, "Dialog act tagging with support vector machines and hidden Markov models, " in Proc. Interspeech-ICSLP, Sep. 2006, article no. 1831.