Topical segmentation: A study of human performance and a new measure of quality

NAACL HLT 2012 - 2012 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Proceedings of the Conference

Volumn , Issue , 2012, Pages 211-220

  Kazantseva, Anna ^a   Szpakowicz, Stan ^a  

^a UNIVERSITY OF OTTAWA   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

HUMAN PERFORMANCE; LARGE-SCALE STUDIES; SEGMENTER; SIMPLE MODIFICATIONS; WRITTEN TEXTS;

EID: 84926181286     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (20)

1. Artstein, Ron and Massimo Poesio. 2008. Inter-Coder Agreement for Computational Linguistics. Computational Linguistics, 34(4):555-596.
2. Beeferman, Doug, Adam Berger, and John Lafferty. 1999. Statistical Models for Text Segmentation. Machine Learning, 34:177-210, February.
3. Burger, Susanne, Victoria MacLaren, and Hua Yu. 2002. The ISL meeting corpus: the impact of meeting type on speech style. In INTERSPEECH'02.
4. Cohen, Jacob. 1960. A coefficient of agreement for nominal scales . Educational and Psychological Measurement, 20:37-46.
5. Eisenstein, Jacob and Regina Barzilay. 2008. Bayesian unsupervised topic segmentation. In Proceedings of the 2008 Conference on Empirical Methods in Natural Language Processing, pages 334-343, Honolulu, Hawaii, October.
6. Fournier, Chris and Diana Inkpen. 2012. Segmentation similarity and agreement. In Proceedings of NAACLHLT 2012 (this volume), Montréal, Canada, June.
7. Galley, Michel, Kathleen McKeown, Eric Fosler-Lussier, and Hongyan Jing. 2003. Discourse segmentation of multi-party conversation. In Proceedings of the 41st Annual Meeting on Association for Computational Linguistics - Volume 1, ACL '03, pages 562-569, Stroudsburg, PA, USA. Association for Computational Linguistics.
8. Gruenstein, Alexander, John Niekrasz, and Matthew Purver. 2005. Meeting Structure Annotation: Data and Tools. In In Proceedings of the SIGdial Workshop on Discourse and Dialogue, pages 117-127.
9. Janin, Adam, Don Baron, Jane Edwards, D. Ellis, David Gelbart, Nelson Morgan, Barbara Peskin, Thilo Pfau, Elizabeth Shriberg, A.ndreas Stolcke, and Chuck Wooters. 2003. The ICSI Meeting Corpus. In Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP- 03), volume 1, pages 364-367, April.
10. Kazantseva, Anna and Stan Szpakowicz. 2011. Linear Text Segmentation Using Affinity Propagation. In Proceedings of the 2011 Conference on Empirical Methods in Natural Language Processing, pages 284-293, Edinburgh, Scotland, UK., July. Association for Computational Linguistics.
11. Krippendorff, Klaus. 2004. Content Analysis. An Introduction to Its Methodology. Sage Publications.
12. Landis, J. Richards and Garry G. Koch. 1977. The Measurement of Observer Agreement for Categorical Data. Biometrics, 33(1):159-174.
13. Malioutov, Igor and Regina Barzilay. 2006. Minimum Cut Model for Spoken Lecture Segmentation. In Proceedings of the 21st International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics, pages 25-32, Sydney, Australia, July.
14. Misra, Hemant, François Yvon, Olivier Cappé, and Joemon M. Jose. 2011. Text segmentation: A topic modeling perspective. Information Processing and Management, 47(4):528-544.
15. Passonneau, Rebecca J. and Diane J. Litman. 1997. Discourse segmentation by human and automated means. Computational Linguistics, 23(1):103-139, March.
16. Pevzner, Lev and Marti A. Hearst. 2002. A Critique and Improvement of an Evaluation Metric for Text Segmentation. Computational Linguistics, 28(1):19-36.
17. Scaiano, Martin and Diana Inkpen. 2012. Getting more from segmentation evaluation. In Proceedings of NAACL-HLT 2012 (this volume), Montréal, Canada, June.
18. Scott, William. 1955. Reliability of content analysis: The case of nominal scale coding. Public Opinion Quaterly, 19(3):321-325.
19. Shrout, Patrick E. and Joseph L. Fleiss. 1979. Intraclass correlations: uses in assessing rater reliability. Psychological Bulletin, 86(2):420-428.
20. Siegel, Sidney and John. N. Jr. Castellan. 1988. Nonparametric statistics for the behavioral sciences. Mc- Graw Hill, Boston, MA.