An analysis of quantitative aspects in the evaluation of thematic segmentation algorithms

COLING/ACL 2006 - SIGdial06: 7th SIGdial Workshop on Discourse and Dialogue, Proceedings of the Workshop

Volumn , Issue , 2006, Pages 144-151

  Georgescul, Maria ^a   Clark, Alexander ^b   Armstrong, Susan ^a  

^a UNIVERSITY OF GENEVA   (Switzerland)

^b UNIVERSITY OF LONDON   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL DATA; CRITICAL REVIEW; EVALUATION METRICS; SYNTHETIC DATA; TEXT DOCUMENT; THEMATIC SEGMENTATION;

EID: 84857713243     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.3115/1654595.1654622     Document Type: Conference Paper

References (24)

1. James Allan, Jaime Carbonell, George Doddington, Jonathan Yamron, and Yiming Yang. 1998. Topic Detection and Tracking Pilot Study: Final Report. In DARPA Broadcast News Transcription and Understanding Workshop, pages 194-218, Landsdowne, VA. Morgan Kaufmann.
2. Doug Beeferman, Adam Berger, and John Lafferty. 1999. Statistical Models for Text Segmentation. Machine Learning, 34(Special Issue on Natural Language Learning):177-210.
3. Gillian Brown and George Yule. 1998. Discourse Analysis. (Cambridge Textbooks in Linguistics), Cambridge.
4. Freddy Choi. 2000. Advances in Domain Independent Linear Text Segmentation. In Proceedings of the 1st Conference of the North American Chapter of the Association for Computational Linguistics, Seattle, USA.
5. Olivier Ferret. 2002. Using Collocations for Topic Segmentation and Link Detection. In The 19th International Conference on Computational Linguistics, Taipei, Taiwan.
6. Michael Galley, Kathleen McKeown, Eric Fosler-Luissier, and Hongyan Jing. 2003. Discourse Segmentation of Multy-Party Conversation. In Annual Meeting of the Association for Computational Linguistics, pages 562-569.
7. Barbara J. Grosz and Candace L. Sidner. 1986. Attention, Intentions and the Structure of Discourse. Computational Linguistics, 12:175-204.
8. Michael A. K. Halliday and Ruqaiya Hasan. 1976. Cohesion in English. Longman, London.
9. Marti Hearst and Christian Plaunt. 1993. Subtopic Structuring for Full-Length Document Access. In Proceedings of the 16th Annual International ACM/SIGIR Conference, pages 59-68, Pittsburgh, Pennsylvania, United States.
10. Marti Hearst. 1997. TextTiling: Segmenting Text into Multi-Paragraph Subtopic Passages. Computational Linguistics, 23(1):33-64. (Pubitemid 127458657)
11. Julia Hirschberg and Christine Nakatani. 1996. A Prosodic Analysis of Discourse Segments in Direction-Giving Monologues. In Proceedings of the 34th Annual Meeting on Association for Computational Linguistics, pages 286-293, Santa Cruz, California.
12. Adam Janin, Jeremy Ang, Sonali Bhagat, Rajdip Dhillon, Jane Edwards, Javier Macias-Guarasa, Nelson Morgan, Barbara Peskin, Elizabeth Shriberg, Andreas Stolcke, Chuck Wooters, and Britta Wrede. 2004. The ICSI Meeting Project: Resources and Research. In ICASSP 2004 Meeting Recognition Workshop (NIST RT-04 Spring Recognition Evaluation), Montreal.
13. David Kauchak and Francine Chen. 2005. Featurebased segmentation of narrative documents. In Proceedings of the ACL Workshop on Feature Engineering for Machine Learning in Natural Language Processing, pages 32-39, Ann Arbor; MI; USA.
14. Hideki Kozima and Teiji Furugori. 1994. Segmenting Narrative Text into Coherent Scenes. Literary and Linguistic Computing, 9:13-19.
15. Inderjeet Mani. 2001. Automatic Summarization. John Benjamins Pub Co.
16. Chris Manning and Hinrich Schütze. 1999. Foundations of Statistical Natural Language Processing. MIT Press Cambridge, MA, USA.
17. Daniel Marcu. 2000. The Theory and Practice of Discourse Parsing and Summarization. MIT Press Cambridge, MA, USA.
18. Rebecca J. Passonneau and Diane J. Litman. 1996. Empirical Analysis of Three Dimensions of Spoken Discourse: Segmentation, Coherence and Linguistic Devices.
19. Rebecca J. Passonneau and Diane J. Litman. 1997. Discourse Segmentation by Human and Automated Means. Computational Linguistics, 23(1).
20. Lev Pevzner and Marti Hearst. 2002. A Critique and Improvement of an Evaluation Metric for Text Segmentation. Computational Linguistics, 16(1):19-36.
21. Martin Porter. 1980. An Algorithm for Suffix Stripping. Program, 14:130-137.
22. Jeffrey Reynar. 1998. Topic Segmentation: Algorithms and Applications. Ph.D. thesis, University of Pennsylvania.
23. TDT. 1998. The Topic Detection and Tracking - Phase 2 Evaluation Plan. Available from World Wide Web: http://www.nist.gov/speech/tests/tdt/tdt98/index. htm.
24. Masao Utiyama and Hitoshi Isahara. 2001. A Statistical Model for Domain-Independent Text Segmentation. In ACL/EACL, pages 491-498.