A critique and improvement of an evaluation metric for text segmentation

Computational Linguistics

Volumn 28, Issue 1, 2002, Pages 19-36

  Pevzner, Lev ^a   Hearst, Marti A ^b  

^a HARVARD UNIVERSITY   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EVALUATION METRICS; FALSE NEGATIVES; FALSE POSITIVE; NEAR-MISSES; SIMPLE MODIFICATIONS; TEXT SEGMENTATION; TEXT SEGMENTATION ALGORITHM;

IMAGE SEGMENTATION;

EID: 0037870455     PISSN: 08912017     EISSN: None     Source Type: Journal    
DOI: 10.1162/089120102317341756     Document Type: Article

References (38)

1. Allan, James, Jaime Carbonell, George Doddington, Jonathan Yamron, and Yiming Yang. 1998. Topic detection and tracking pilot study: Final report. In Proceedings of the DARPA Broadcast News Transcription and Understanding Workshop, pages 194-218, Lansdowne, VA.
2. Baeza-Yates, Ricardo and Berthier Ribeiro-Neto. 1999. Modern Information Retrieval. Addison-Wesley Longman.
3. Barzilay, Regina and Michael Elhadad. 1997. Using lexical chains for text summarization. In Proceedings of the ACL Intelligent Scalable Text Summarization Workshop (ISTS'97), Madrid, Spain.
4. Beeferman, Douglas, Adam Berger, and John Lafferty. 1997. Text segmentation using exponential models. In Proceedings of the 2nd Conference on Empirical Methods in Natural Language Processing, pages 35-46, Providence, RI.
5. Beeferman, Douglas, Adam Berger, and John Lafferty. 1999. Statistical models of text segmentation. Machine Learning 34(1-3):177-210.
6. Boguraev, Branimir and Mary Neff. 2000. Discourse segmentation in aid of document summarization. In Proceedings of the 33rd Hawaii International Conference on System Sciences, Maui, HI.
7. Box, G. E. P. and M. E. Muller. 1958. A note on the generation of random normal deviates. Annals of Mathematical Statistics, 29:610-611.
8. Callan, James P. 1994. Passage-level evidence in document retrieval. In Proceedings of the 17th Annual International ACM/SIGIR Conference, pages 302-310, Dublin, Ireland.
9. Choi, Freddy. 2000. Advances in domain independent linear text segmentation. In Proceedings of the 1st Meeting of the North American Chapter of the Association for Computational Linguistics, pages 26-33, Seattle, WA.
10. Dharanipragada, S., M. Franz, Jeffrey S. McCarley, S. Roukos, and Todd Ward. 1999. Story segmentation and topic detection in the broadcast news domain. In Proceedings of the DARPA Broadcast News Workshop, Herndon, VA.
11. Eichmann, David, Miguel Ruiz, Padmini Srinivasan, Nick Street, Chris Culy, and Filippo Menczer. 1999. A cluster-based approach to tracking, detection and segmentation of broadcast news. In Proceedings of the DARPA Broadcast News Workshop, Herndon, VA.
12. Hasnah, Ahmad. 1996. Full Text Processing and Retrieval: Weight Ranking, Text Structuring, and Passage Retrieval for Arabic Documents. Ph.D. thesis, Illinois Institute of Technology.
13. Hauptmann, Alexander G. and Michael J. Witbrock. 1998. Story segmentation and detection of commercials in broadcast news video. In Proceedings of the Advances in Digital Libraries Conference, pages 168-179, Santa Barbara, CA.
14. Hearst, Marti A. 1993. TextTiling: A quantitative approach to discourse segmentation. Technical Report Sequoia 93/24, Computer Science Division, University of California, Berkeley.
15. Hearst, Marti A. 1994. Multi-paragraph segmentation of expository text. In Proceedings of the 32nd Annual Meeting of the Association for Computational Linguistics, pages 9-16, Las Cruces, NM.
16. Hearst, Marti A. 1997. TextTiling: Segmenting text into multi-paragraph subtopic passages. Computational Linguistics, 23(1):33-64.
17. Hearst, Marti A. and Christian Plaunt. 1993. Subtopic structuring for full-length document access. In Proceedings of the 16th Annual International ACM/SIGIR Conference, pages 59-68, Pittsburgh, PA.
18. Heinonen, Oskari. 1998. Optimal multi-paragraph text segmentation by dynamic programming. In Proceedings of the 17th International Conference on Computational Linguistics and the 36th Annual Meeting of the Association for Computational Linguistics (ACL-COLING '98), pages 1484-1486, Montreal.
19. Hirschberg, Julia and Christine H. Nakatani. 1996. A prosodic analysis of discourse segments in direction-giving monologues. In Proceedings of the 34th Annual Meeting of the Association for Computational Linguistics, pages 286-293, Santa Cruz, CA.
20. Kan, Min-Yen, Judith L. Klavans, and Kathleen R. McKeown. 1998. Linear segmentation and segment relevance. In Proceedings of the Sixth Workshop on Very Large Corpora (WVLC 6), pages 197-205, Montreal.
21. Karlgren, Jussi. 1996. Stylistic variation in an information retrieval experiment. In Proceedings of the 2nd International Conference on New Methods in Language Processing (NeMLaP 2), Ankara, Turkey.
22. Kaszkiel, Marcin and Justin Zobel. 1997. Passage retrieval revisited. In Proceedings of the 20th International Conference on Research and Development in Information Access (ACM SIGIR), pages 178-185, Philadelphia, PA.
23. Litman, Diane J. and Rebecca J. Passonneau. 1995. Combining multiple knowledge sources for discourse segmentation. In Proceedings of the 33rd Annual Meeting of the Association for Computational Linguistics, pages 108-115, Cambridge, MA.
24. Mani, Inderjeet, David House, Mark Maybury, and Morgan Green. 1997. Towards content-based browsing of broadcast news video. In Mark Maybury, editor, Intelligent Multimedia Information Retrieval. AAAI/MIT Press, pages 241-258.
25. Manning, Christopher D. 1998. Rethinking text segmentation models: An information extraction case study. Technical Report SULTRY-98-07-01, University of Sydney.
26. Marcu, Daniel. 2000. The Theory and Practice of Discourse Parsing and Summarization. MIT Press.
27. Merlino, Andy, Daryl Morey, and Mark Maybury. 1997. Broadcast news navigation using story segmentation. In Proceedings of the ACM International Multimedia Conference, pages 157-164, Seattle, WA.
28. Mittal, Vibhu, Mark Kantrowitz, Jade Goldstein, and Jaime Carbonell. 1999. Selecting text spans for document summaries: Heuristics and metrics. In Proceedings of the 16th Annual Conference on Artificial Intelligence (AAAI '99), pages 467-473, Orlando, FL.
29. Morris, Jane and Graeme Hirst. 1991. Lexical cohesion computed by thesaural relations as an indicator of the structure of text. Computational Linguistics, 17(1):21-48.
30. Nomoto, Tadashi and Yoshihiko Nitta. 1994. A grammatico-statistical approach to discourse partitioning. In Proceedings of the 15th International Conference on Computational Linguistics (COLING'94), pages 1145-1150, Kyoto, Japan.
31. Passonneau, Rebecca J. and Diane J. Litman. 1993. Intention-based segmentation: Human reliability and correlation with linguistic cues. In Proceedings of the 31st Annual Meeting of the Association for Computational Linguistics, pages 148-155, Columbus, OH.
32. Ponte, Jay and Bruce Croft. 1997. Text segmentation by topic. In Proceedings of the 1st European Conference on Research and Advanced Technology for Digital Libraries, pages 113-125.
33. Reynar, Jeffrey C. 1994. An automatic method of finding topic boundaries. In Proceedings of the Student Session of the 32nd Annual Meeting of the Association for Computational Linguistics, pages 331-333, Las Cruces, NM.
34. Richmond, Korin, Andrew Smith, and Einat Amitay. 1997. Detecting subject boundaries within text: A language independent statistical approach. In Proceedings of the Second Conference on Empirical Methods in Natural Language Processing, pages 47-54. Association for Computational Linguistics.
35. Salton, Gerard, James Allan, and Chris Buckley. 1993. Approaches to passage retrieval in full text information systems. In Proceedings of the 16th Annual International ACM/SIGIR Conference, pages 49-58, Pittsburgh, PA.
36. Salton, Gerard, James Allan, Chris Buckley, and Amit Singhal. 1994. Automatic analysis, theme generation, and summarization of machine-readable texts. Science, 264(5164):1421-1426.
37. van Mulbregt, P., Ira Carp, Larry Gillick, Stephen Lowe, and Jonathan Yamron. 1999. Segmentation of automatically transcribed broadcast news text. In Proceedings of the DARPA Broadcast News Workshop, Herndon, VA.
38. Yaari, Yaakov. 1997. Segmentation of expository text by hierarchical agglomerative clustering. In Recent Advances in NLP (RANLP'97), Bulgaria.