Unbiased discourse segmentation evaluation

2010 IEEE Workshop on Spoken Language Technology, SLT 2010 - Proceedings

Volumn , Issue , 2010, Pages 43-48

  Niekrasz, John ^a   Moore, Johanna D ^a  

^a UNIVERSITY OF EDINBURGH   (United Kingdom)

Author keywords

Agreement measures; Discourse analysis; Evaluation; Spoken conversation; Topic segmentation

Indexed keywords

AGREEMENT MEASURES; DISCOURSE ANALYSIS; EVALUATION; SPOKEN CONVERSATION; TOPIC SEGMENTATION;

SEMANTICS;

SPEECH RECOGNITION;

EID: 79951775538     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/SLT.2010.5700820     Document Type: Conference Paper

References (16)

1. Doug Beeferman, Adam Berger, and John D. Lafferty, "Statistical models for text segmentation," Machine Learning, vol. 34, no. 1-3, pp. 177-210, 1999.
2. Lev Pevzner and Marti Hearst, "A critique and improvement of an evaluation metric for text segmentation," Computational Linguistics, vol. 28, 2002.
3. Jacob Eisenstein and Regina Barzilay, "Bayesian unsupervised topic segmentation," in Proc. EMNLP, 2008.
4. Masao Utiyama and Hitoshi Isahara, "A statistical model for domain-independent text segmentation," in Proceedings of ACL, 2001, pp. 499-506.
5. Michel Galley, Kathleen McKeown, Eric Fosler-Lussier, and Hongyan Jing, "Discourse segmentation of multiparty conversation," in Proc. ACL, 2003, pp. 562-569.
6. Igor Malioutov and Regina Barzilay, "Minimum cut model for spoken lecture segmentation," in Proceedings of COLING-ACL, 2006, pp. 25-32.
7. John Niekrasz and Johanna Moore, "Participant subjectivity and involvement as a basis for discourse segmentation," in Proceedings of SIGDIAL, 2009, pp. 54-61.
8. Melissa Sherman and Yang Liu, "Using hidden Markov models for topic segmentation of meeting transcripts," in Proc. IEEE SLT, 2008, pp. 185-188.
9. Maria Georgescul, Alexander Clark, and Susan Armstrong, "An analysis of quantitative aspects in the evaluation of thematic segmentation algorithms," in Proceedings of SIGDIAL, 2006, pp. 144-151.
10. Pei-Yun Hsueh, Meeting Decision Detection, Ph.D. thesis, University of Edinburgh, 2008.
11. Sylvain Lamprier, Tassadit Amghar, Bernard Levrat, and Frederic Saubion, "On evaluation methodologies for text segmentation algorithms," in Proc. IEEE Conf. on Tools with Artificial Intelligence, 2007.
12. Freddy Y. Y. Choi, "Advances in domain independent linear text segmentation," in Proc. NAACL, 2000.
13. A. Janin, D. Baron, J. Edwards, D. Ellis, D. Gelbart, N. Morgan, B. Peskin, T. Pfau, E. Shriberg, A. Stolcke, and C. Wooters, "The ICSI meeting corpus," in Proceedings of ICASSP, 2003, vol. 1, pp. 364-367.
14. James Allan, Jaime Carbonell, George Doddington, Jonathan Yamron, and Yiming Yang, "Topic detection and tracking pilot study: Final report," in Proceedings of the 1998 DARPA Broadcast News Transcription and Understanding Workshop, 1998.
15. NIST, "The Topic Detection and Tracking Phase 2 (TDT2) Evaluation Plan, Version 3.7," 1998.
16. Jacob Cohen, "A coefficient of agreement for nominal scales," Educational and Psychological Measurement, vol. 20, pp. 37-46, 1960.