Significance tests for the evaluation of ranking methods

COLING 2004 - Proceedings of the 20th International Conference on Computational Linguistics

Volumn , Issue , 2004, Pages

  Evert, Stefan ^a  

^a UNIVERSITY OF STUTTGART   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

COLLOCATION EXTRACTION; EMPIRICAL VALIDATION; EVALUATION RESULTS; RANDOM EXPERIMENTS; RANKING METHODS; SIGNIFICANCE TEST; STATISTIC MODELING;

EID: 84860532505     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (12)

1. Alan Agresti. 1990. Categorical Data Analysis. John Wiley & Sons, New York.
2. Kenneth Church, William Gale, Patrick Hanks, and Donald Hindle. 1991. Using statistics in lexical analysis. In Lexical Acquisition: Using On-line Resources to Build a Lexicon, pages 115-164. Lawrence Erlbaum.
3. Ted Dunning. 1993. Accurate methods for the statistics of surprise and coincidence. Computational Linguistics, 19(1):61-74.
4. Stefan Evert and Brigitte Krenn. 2001. Methods for the qualitative evaluation of lexical association measures. In Proceedings of the 39th Annual Meeting of the Association for Computational Linguistics, pages 188-195, Toulouse, France.
5. Stefan Evert. 2004. An on-line repository of association measures. http://www.collocations.de/AM/.
6. Hannah Kermes. 2003. Off-line (and On-line) Text Analysis for Computational Lexicography. Ph.D. thesis, IMS, University of Stuttgart. Arbeitspapiere des Instituts für Maschinelle Sprachverarbeitung (AIMS), volume 9, number 3.
7. Brigitte Krenn and Stefan Evert. 2001. Can we do better than frequency? a case study on extracting pp-verb collocations. In Proceedings of the ACL Workshop on Collocations, pages 39-46, Toulouse, France, July.
8. Brigitte Krenn. 2000. The Usual Suspects: Data-Oriented Models for the Identification and Representation of Lexical Collocations., volume 7 of Saarbrücken Dissertations in Computational Linguistics and Language Technology. DFKI & Universität des Saarlandes, Saarbrücken, Germany.
9. E. L. Lehmann. 1991. Testing Statistical Hypotheses. Wadsworth, 2nd edition.
10. Christopher D. Manning and Hinrich Schütze. 1999. Foundations of Statistical Natural Language Processing. MIT Press, Cambridge, MA.
11. R Development Core Team, 2003. R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. ISBN 3-900051-00-3. See also http://www.r-project.org/.
12. Alexander Yeh. 2000. More accurate tests for the statistical significance of result differences. In Proceedings of the 18th International Conference on Computational Linguistics (COLING 2000), Saarbrücken, Germany.