The CALO meeting assistant system

IEEE Transactions on Audio, Speech and Language Processing

Volumn 18, Issue 6, 2010, Pages 1601-1611

  Tur, Gokhan ^a   Stolcke, Andreas ^a   Voss, Lynn ^a   Peters, Stanley ^b   Hakkani Tur, Dilek ^c   Dowding, John ^b   Favre, Benoit ^c   Fernandez, Raquel ^b   Frampton, Matthew ^b   Frandsen, Mike ^a   Frederickson, Clint ^a   Graciarena, Martin ^a   Kintzing, Donald ^a   Leveque, Kyle ^a   Mason, Shane ^a   Niekrasz, John ^b   Purver, Matthew ^b   Riedhammer, Korbinian ^c   Shriberg, Elizabeth ^a   Tien, Jing ^a   Vergyri, Dimitra ^a   Yang, Fan ^a   more..

^a SRI INTERNATIONAL   (United States)

^b STANFORD UNIVERSITY   (United States)

^c INTERNATIONAL COMPUTER SCIENCE INSTITUTE   (United States)

Author keywords

Multiparty meetings processing; speech recognition; spoken language understanding

Indexed keywords

AUTOMATIC TRANSCRIPTION; DISTRIBUTED MEETINGS; MULTIPARTY MEETINGS PROCESSING; OFFLINE; PERSONAL ASSISTANTS; QUESTION-ANSWER PAIRS; SEMANTIC ANALYSIS; SPEECH TRANSCRIPTIONS; SPOKEN LANGUAGE UNDERSTANDING; TOPIC IDENTIFICATION;

LINGUISTICS; SPEECH TRANSMISSION; TRANSCRIPTION;

SPEECH RECOGNITION;

EID: 77955800433     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2009.2038810     Document Type: Article

References (71)

1. "DARPA cognitive agent that learns and organizes (CALO) project." [Online]. Available: http://www.ai.sri.com/project/CALO
2. "DARPA perceptive assistant that learns (PAL) program." [Online]. Available: http://www.darpa.mil/ipto/programs/pal/pal.asp
3. S. Burger, V. MacLaren, and H. Yu, "The ISL meeting corpus: The impact of meeting type on speech style," in Proc. ICSLP, Denver, CO, 2002.
4. A. Janin, J. Ang, S. Bhagat, R. Dhillon, J. Edwards, J. Macias-Guarasa, N. Morgan, B. Peskin, E. Shriberg, A. Stolcke, C. Wooters, and B. Wrede, "The ICSI meeting project: Resources and research," in Proc. ICASSP, Montreal, QC, Canada, 2004.
5. "Augmented multi-party interaction," [Online]. Available: http://www. amiproject.org
6. "Computers in the human interaction loop," [Online]. Available: http://chil.server.de
7. "Rich transcription evaluations," [Online]. Available: http://www.nist. gov/speech/tests/rt/rt2007
8. G. Tur, A. Stolcke, L. Voss, J. Dowding, B. Favre, R. Fernandez, M. Frampton, M. Frandsen, C. Frederickson, M. Graciarena, D. Hakkani-Tür, D. Kintzing, K. Leveque, S. Mason, J. Niekrasz, S. Peters, M. Purver, K. Riedhammer, E. Shriberg, J. Tien, D. Vergyri, and F. Yang, "The CALO meeting speech recognition and understanding system," in Proc. IEEE/ACL SLT Workshop, Goa, India, 2008.
9. A. Stolcke, X. Anguera, K. Boakye, Ö. Çetin, F. Grézl, A. Janin, A. Mandal, B. Peskin, C. Wooters, and J. Zheng, "Further progress in meeting recognition: The ICSI-SRI spring 2005 speech-to-text evaluation system," in Proc. MLMI, 2005.
10. T. Hain, L. Burget, J. Dines, G. Garau, V. Wan, M. Karafiat, J. Vepa, and M. Lincoln, "The AMI system for the transcription of speech in meetings," in Proc. ICASSP, Honolulu, HI, 2007, pp. 357-360.
11. G. Tur and A. Stolcke, "Unsupervised language model adaptation for meeting recognition," in Proc. ICASSP, Honolulu, HI, 2007, pp. 173-176.
12. D. Vergri, A. Stolcke, and G. Tur, "Exploiting user feedback for language model adaptation in meeting recognition," in Proc. ICASSP, Taipei, Taiwan, 2009, pp. 4737-4740.
13. E. Shriberg, A. Stolcke, D. Hakkani-Tür, and G. Tur, "Prosody-based automatic segmentation of speech into sentences and topics," Speech Commun., vol.32, no.1-2, pp. 127-154, 2000.
14. J. Kolar, E. Shriberg, and Y. Liu, "Using prosody for automatic sentence segmentation of multi-party meetings," in Proc. Int. Conf. Text, Speech, Dialogue (TSD), Czech Republic, 2006.
15. J. Ang, Y. Liu, and E. Shriberg, "Automatic dialog act segmentation and classification in multiparty meetings," in Proc. ICASSP, Philadelphia, PA, Mar. 2005, pp. 1061-1064.
16. M. Core and J. Allen, "Coding dialogs with the DAMSL annotation scheme," in Proc. Working Notes AAAI Fall Symp. Commun. Action in Humans Mach., Cambridge, MA, Nov. 1997.
17. E. Shriberg, R. Dhillon, S. Bhagat, J. Ang, and H. Carvey, "The ICSI meeting recorder dialog act (MRDA) corpus," in Proc. SigDial Workshop, Boston, MA, May 2004.
18. J. Kolar, Y. Liu, and E. Shriberg, "Speaker adaptation of language models for automatic dialog act segmentation of meetings," in Proc. Interspeech, Antwerp, Belgium, 2007.
19. A. Stolcke and E. Shriberg, "Statistical language modeling for speech disfluencies," in Proc. ICASSP, Atlanta, GA, May 1996, pp. 405-408.
20. Y. Liu, A. Stolcke, E. Shriberg, and M. Harper, "Using conditional random fields for sentence boundary detection in speech," in Proc. ACL, Ann Arbor, MI, 2005.
21. S. Cuendet, D. Hakkani-Tür, and G. Tur, "Model adaptation for sentence segmentation from speech," in Proc. IEEE/ACL SLT Workshop, Aruba, 2006, pp. 102-105.
22. M. Zimmerman, D. Hakkani-Tür, J. Fung, N. Mirghafori, L. Gottlieb, E. Shriberg, and Y. Liu, "The ICSI+ multilingual sentence segmentation system," in Proc. ICSLP, Pittsburg, PA, 2006.
23. U. Guz, D. Hakkani-Tür, S. Cuendet, and G. Tur, "Co-training using prosodic and lexical information for sentence segmentation," in Proc. Interspeech, Antwerp, Belgium, Aug. 2007.
24. G. Tur, "Co-adaptation: Adaptive co-training for semi-supervised learning," in Proc. ICASSP, Taipei, Taiwan, 2009.
25. A. Stolcke, K. Ries, N. Coccaro, E. Shriberg, R. Bates, D. Jurafsky, P. Taylor, R. Martin, C. van Ess-Dykema, and M. Meteer, "Dialogue act modeling for automatic tagging and recognition of conversational speech," Comput. Linguist., vol.26, no.3, pp. 339-373, 2000.
26. G. Tur, U. Guz, and D. Hakkani-Tür, "Model adaptation for dialog act tagging," in Proc. IEEE/ACL SLT Workshop, 2006, pp. 94-97.
27. M. Mast, R. Kompe, S. Harbeck, A. Kiessling, H. Niemann, E. Nöth, E. G. Schukat-Talamazzini, and V. Warnke, "Dialog act classification with the help of prosody," in Proc. ICSLP, Philadelphia, PA, Oct. 1996, pp. 1732-1735.
28. M. Zimmermann, Y. Liu, E. Shriberg, and A. Stolcke, "Toward joint segmentation and classification of dialog acts in multiparty meetings," in Proc. MLMI, Edinburgh, U.K., July 2005.
29. V. Warnke, R. Kompe, H. Niemann, and E. Nöth, "Integrated dialog act segmentation and classification using prosodic features and language models," in Proc. Eurospeech, Rhodes, Greece, Sep. 1997.
30. F. Yang, G. Tur, and E. Shriberg, "Exploiting dialog act tagging and prosodic information for action item identification," in Proc. ICASSP, Las Vegas, NV, 2008, pp. 4941-4944.
31. A. Lisowska, "Multimodal interface design for the multimodal meeting domain: preliminary indications from a query analysis study," ISSCO, Univ. of Geneva, Tech. Rep. IM2.MDM-11, Nov. 2003.
32. D. Beeferman, A. Berger, and J. D. Lafferty, "Statistical models for text segmentation," Mach. Learn., vol.34, no.1-3, pp. 177-210, 1999.
33. J. Reynar, "Statistical models for topic segmentation," in Proc. ACL, 1999, pp. 357-364.
34. G. Tur, D. Hakkani-Tür, A. Stolcke, and E. Shriberg, "Integrating prosodic and lexical cues for automatic topic segmentation," Comput. Linguist., vol.27, no.1, pp. 31-57, 2001.
35. A. Gruenstein, J. Niekrasz, and M. Purver, L. Dybkjaer and W. Minker, Eds., "Meeting structure annotation: Annotations collected with a general purpose toolkit," in Recent Trends in Discourse and Dialogue. Berlin/Heidelberg: Springer-Verlag, 2007, Text, Speech and Language Technology.
36. M. Galley, K. McKeown, E. Fosler-Lussier, and H. Jing, "Discourse segmentation of multi-party conversation," in Proc. ACL, 2003.
37. S. Banerjee and A. Rudnicky, "Segmenting meetings into agenda items by extracting implicit supervision from human note-taking," in Proc. IUI, Honolulu, HI, Jan. 2007, ACM.
38. M. Hearst, "TextTiling: Segmenting text into multi-paragraph subtopic passages," Comput. Linguist., vol.23, no.1, pp. 33-64, 1997.
39. P.-Y. Hsueh, J. Moore, and S. Renals, "Automatic segmentation of multiparty dialogue," in Proc. EACL, 2006.
40. P.-Y. Hsueh and J. Moore, "Automatic topic segmentation and labeling in multiparty dialogue," in Proc. 1st IEEE/ACM Workshop Spoken Lang. Technol. (SLT), Palm Beach, Aruba, 2006.
41. S. Banerjee and A. Rudnicky, "A TextTiling based approach to topic boundary detection in meetings," in Proc. ICSLP, Pittsburgh, PA, Sep. 2006.
42. M. Georgescul, A. Clark, and S. Armstrong, "Word distributions for thematic segmentation in a support vector machine approach," in Proc. CoNLL, New York, Jun. 2006, pp. 101-108.
43. M. Georgescul, A. Clark, and S. Armstrong, "Exploiting structural meeting-specific features for topic segmentation," in Actes de la 14 ème Conf. sur le Traitement Automatique des Langues Naturelles, Toulouse, France, Jun. 2007, Association pour le Traitement Automa-tique des Langues.
44. A. Popescu-Belis, A. Clark, M. Georgescul, D. Lalanne, and S. Zuf-ferey, S. Bengio and H. Bourlard, Eds., "Shallow dialogue processing using machine learning algorithms (or not)," in MLMI, Revised Selected Papers. New York: Springer, 2005, vol.3361, Lecture Notes in Computer Science, pp. 277-290.
45. D. M. Blei, A. Y. Ng, M. I. Jordan, and J. Lafferty, "Latent dirichlet allocation," J. Mach. Learn. Res., vol.3, pp. 993-1022, 2003.
46. M. Purver, K. Körding, T. Griffiths, and J. Tenenbaum, "Unsupervised topic modelling for multi-party spoken discourse," in Proc. COLING-ACL, Sydney, Australia, Jul. 2006, pp. 17-24.
47. M. Dowman, V. Savova, T. L. Griffiths, K. P. Körding, J. B. Tenen-baum, and M. Purver, "A probabilistic model of meetings that combines words and discourse features," IEEE Trans. Audio, Speech, Lang. Process., vol.16, no.7, pp. 1238-1248, Sep. 2008.
48. S. Banerjee, C. Rosé, and A. Rudnicky, "The necessity of a meeting recording and playback system, and the benefit of topic-level annotations to meeting browsing," in Proc. CHI, 2005.
49. S. Corston-Oliver, E. Ringger, M. Gamon, and R. Campbell, "Task-focused summarization of email," in Proc. ACL Workshop Text Summarization Branches Out, 2004.
50. P. N. Bennett and J. Carbonell, "Detecting action-items in e-mail," in Proc. ACM SIGIR, Salvador, Brazil, Aug. 2005.
51. P. N. Bennett and J. G. Carbonell, "Combining probability-based rankers for action-item detection," in Proc. HLT/NAACL, Rochester, NY, Apr. 2007.
52. A. Verbree, R. Rienks, and D. Heylen, "First steps towards the automatic construction of argument-diagrams from real discussions," in Proc. 1st Int. Conf. Comput. Models of Argument, September 11 2006, Frontiers Artif. Intell. Applicat., 2006, vol.144, pp. 183-194, IOS press.
53. P.-Y. Hsueh and J. Moore, "What decisions have you made?: Automatic decision detection in meeting conversations," in Proc. NAACL/HLT, Rochester, NY, 2007.
54. W. Morgan, P.-C. Chang, S. Gupta, and J. M. Brenier, "Automatically detecting action items in audio meeting recordings," in Proc. SIGdial Workshop Discourse and Dialogue, Sydney, Australia, Jul. 2006.
55. M. Purver, J. Dowding, J. Niekrasz, P. Ehlen, S. Noorbaloochi, and S. Peters, "Detecting and summarizing action items in multi-party dialogue," in Proc. 8th SIGdial Workshop on Discourse and Dialogue, Antwerp, Belgium, Sep. 2007.
56. R. Fernández, M. Frampton, P. Ehlen, M. Purver, and S. Peters, "Modelling and detecting decisions in multi-party dialogue," in Proc. 9th SIGdial Workshop Discourse and Dialogue, Columbus, OH, 2008.
57. M. Frampton, J. Huang, T. H. Bui, and S. Peters, "Real-time decision detection in multi-party dialogue," in Proc. EMNLP, Singapore, Aug. 2009.
58. R. Fernández, M. Frampton, J. Dowding, A. Adukuzhiyil, P. Ehlen, and S. Peters, "Identifying relevant phrases to summarize decisions in spoken meetings," in Proc. Interspeech, Brisbane, Australia, 2008.
59. N. Jovanovic, R. op den Akker, and A. Nijholt, "Addressee identification in face-to-face meetings," in Proc. EACL, Trento, Italy, 2006, pp. 169-176.
60. M. Frampton, R. Fernández, P. Ehlen, M. Christoudias, T. Darrell, and S. Peters, "Who is "you"? Combining linguistic and gaze features to resolve second-person references in dialogue," in Proc. EACL, 2009.
61. M. Purver, R. Fernández, M. Frampton, and S. Peters, "Cascaded lex-icalised classifiers for second-person reference resolution," in Proc. SIGDIAL Meeting Discourse and Dialogue, London, U.K., 2009.
62. A. Waibel, M. Bett, M. Finke, and R. Stiefelhagen, "Meeting browser: Tracking and summarizing meetings," in Proc. DARPA Broadcast News Transcription and Understanding Workshop, Lansdowne, VA, Jun. 1998.
63. S. Maskey and J. Hirschberg, "Comparing lexical, acoustic/prosodic, structural and discourse features for speech summarization," in Proc. Interspeech, Lisbon, Portugal, Sep. 2005.
64. G. Murray, S. Renals, and J. Carletta, "Extractive summarization of meeting recordings," in Proc. Interspeech, Lisbon, Portugal, Sep. 2005.
65. J. Carbonell and J. Goldstein, "The use of MMR, diversity-based reranking for reordering documents and producing summaries," in Proc. ACM SIGIR, Melbourne, Australia, 1998.
66. S. Xie and Y. Liu, "Using corpus and knowledge-based similarity measure in maximum marginal relevance for meeting summarization," in Proc. ICASSP, Las Vegas, NV, 2008, pp. 4985-4988.
67. K. Riedhammer, D. Gillick, B. Favre, and D. Hakkani-Tür, "Packing the meeting summarization knapsack," in Proc. Interspeech, Brisbane, Australia, 2008.
68. C. Lin, "ROUGE: A package for automatic evaluation of summaries," in Proc. ACL Text Summarization Workshop, 2004.
69. K. Riedhammer, B. Favre, and D. Hakkani-Tür, "A keyphrase based approach to interactive meeting summarization," in Proc. IEEE/ACL SLT Workshop, Goa, India, 2008.
70. D. Gillick, K. Riedhammer, B. Favre, and D. Hakkani-Tür, "A global optimization framework for meeting summarization," in Proc. IEEE ICASSP, Taipei, Taiwan, 2009, pp. 4769-4772.
71. G. Murray, T. Kleinbauer, P. Poller, S. Renals, J. Kilgour, and T. Becker, "Extrinsic summarization evaluation: A decision audit task," in Proc. MLMI, Utrecht, The Netherlands, 2008.