Segmentation similarity and agreement

NAACL HLT 2012 - 2012 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Proceedings of the Conference

Volumn , Issue , 2012, Pages 152-161

  Fournier, Chris ^a   Inkpen, Diana ^a  

^a UNIVERSITY OF OTTAWA   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

AGREEMENT COEFFICIENT; EDIT DISTANCE; HUMAN PERFORMANCE; PENALTY FUNCTION; SCALINGS; SEGMENTATION EVALUATION; SEGMENTATION EVALUATION METRICS; SEGMENTER; STATE OF THE ART;

EID: 84907308404     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (23)

1. Ron Artstein and Massimo Poesio. 2008. Inter-coder agreement for computational linguistics. Computational Linguistics, 34(4):555-596. MIT Press, Cambridge, MA, USA.
2. Doug Beeferman, Adam Berger, and John Lafferty. 1997. Text Segmentation Using Exponential Models. Proceedings of the Second Conference on Empirical Methods in Natural Language Processing, 2:35-46. Association for Computational Linguistics, Stroudsburg, PA, USA.
3. Doug Beeferman and Adam Berger. 1999. Statistical models for text segmentation. Machine learning, 34(1-3):177-210. Springer Netherlands, NL.
4. Jacob Cohen. 1960. A Coefficient of Agreement for Nominal Scales. Educational and Psychological Measurement, 20(1):37-46. Sage, Beverly Hills, CA, USA.
5. Frederick J. Damerau. 1964. A technique for computer detection and correction of spelling errors. Communications of the ACM, 7(3):171-176. Association for Computing Machinery, Stroudsburg, PA, USA.
6. Mark Davies and Joseph L. Fleiss. 1982. Measuring agreement for multinomial data. Biometrics, 38(4):1047-1051. Blackwell Publishing Inc, Oxford, UK.
7. George R. Doddington. 1998. The topic detection and tracking phase 2 (TDT2) evaluation plan. DARPA Broadcast News Transcription and Understanding Workshop, pp. 223-229. Morgan Kaufmann,Waltham, MA, USA.
8. Joseph L. Fleiss. 1971. Measuring nominal scale agreement among many raters. Psychological Bulletin, 76(5):378-382. American Psychological Association, Washington, DC, USA.
9. Martin, Franz, J. Scott McCarley, and Jian-Ming Xu. 2007. User-oriented text segmentation evaluation measure. Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval, pp. 701-702. Association for Computing Machinery, Stroudsburg, PA, USA.
10. William Gale, Kenneth Ward Church, and David Yarowsky. 1992. Estimating upper and lower bounds on the performance of word-sense disambiguation programs. Proceedings of the 30th annual meeting of the Association for Computational Linguistics, pp. 249-256. Association for Computational Linguistics, Stroudsburg, PA, USA.
11. Maria Georgescul, Alexander Clark, and Susan Armstrong. 2006. An analysis of quantitative aspects in the evaluation of thematic segmentation algorithms. Proceedings of the 7th SIGdial Workshop on Discourse and Dialogue, pp. 144-151. Association for Computational Linguistics, Stroudsburg, PA, USA.
12. Marti A. Hearst. 1997. TextTiling: Segmenting Text into Multi-paragraph Subtopic Passages. Computational Linguistics, 23(1):33-64. MIT Press, Cambridge, MA, USA.
13. Anna Kazantseva and Stan Szpakowicz. 2012. Topical Segmentation: a Study of Human Performance. Proceedings of Human Language Technologies: The 2012 Annual Conference of the North American Chapter of the Association for Computational Linguistics. Association for Computational Linguistics, Stroudsburg, PA, USA.
14. Klaus Krippendorff. 1980. Content Analysis: An Introduction to Its Methodology, Chapter 12. Sage, Beverly Hills, CA, USA.
15. Klaus Krippendorff. 2004. Content Analysis: An Introduction to Its Methodology, Chapter 11. Sage, Beverly Hills, CA, USA.
16. Sylvain Lamprier, Tassadit Amghar, Bernard Levrat, and Frederic Saubion 2007. On evaluation methodologies for text segmentation algorithms. Proceedings of the 19th IEEE International Conference on Tools with Artificial Intelligence, 2:19-26. IEEE Computer Society, Washington, DC, USA.
17. Vladimir I. Levenshtein. 1966. Binary codes capable of correcting deletions, insertions, and reversals. Soviet Physics Doklady, 10(8):707-710. American Institute of Physics, College Park, MD, USA.
18. Olena Medelyan. 2009. Human-competitive automatic topic indexing. PhD Thesis. University of Waikato, Waikato, NZ.
19. Olena Medelyan, Eibe Frank, and Ian H. Witten. 2009. Human-competitive tagging using automatic keyphrase extraction. Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing, pp. 1318-1327. Association for Computational Linguistics, Stroudsburg, PA, USA.
20. Rebecca J. Passonneau and Diane J. Litman. 1993. Intention-based segmentation: human reliability and correlation with linguistic cues. Proceedings of the 31st annual meeting of the Association for Computational Linguistics, pp. 148-155). Association for Computational Linguistics, Stroudsburg, PA, USA.
21. Lev Pevzner and Marti A. Hearst. 2002. A critique and improvement of an evaluation metric for text segmentation. Computational Linguistics, 28(1):19-36. MIT Press, Cambridge, MA, USA.
22. William A. Scott. 1955. Reliability of content analysis: The case of nominal scale coding. Public Opinion Quarterly, 19(3):321-325. American Association for Public Opinion Research, Deerfield, IL, USA.
23. Sidney Siegel and N. John Castellan, Jr. 1988. Nonparametric Statistics for the Behavioral Sciences. 2nd Edition, Chapter 9.8. McGraw-Hill, New York, USA.