Do we still need gold standards for evaluation?

Proceedings of the 6th International Conference on Language Resources and Evaluation, LREC 2008

Volumn , Issue , 2008, Pages 547-552

  Poibeau, Thierry ^a   Messiant, Cédric ^a  

^a CNRS   (France)

Author keywords

[No Author keywords available]

Indexed keywords

BINARY TREES; DATA HANDLING; FORESTRY; LEARNING SYSTEMS; NATURAL LANGUAGE PROCESSING SYSTEMS; STATISTICS; SYNTACTICS;

ACQUISITION SYSTEMS; ELECTRONIC FORMATS; EVALUATION FRAMEWORK; STATISTICAL APPROACH; STATISTICAL DATAS; STATISTICAL PARSER; STATISTICAL SYSTEMS; SUBCATEGORIZATION;

GOLD;

EID: 84886611150     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (23)

1. Douglas Biber. 1988. Dimensions of Register Variation: A Cross-linguistic Comparison. Cambridge University Press, Cambridge.
2. Rens Bod. 2007. Is the End of Supervised Parsing in Sight? In Association for Computational Linguistics, pages 400-408, Prague.
3. Ted Briscoe and John Carroll. 1997. Automatic Extraction of Subcategorization from Corpora. In 5th ACL Conference on Applied Natural Language Processing, pages 356-363, Washington, DC.
4. Ted Briscoe. 2001. From Dictionary to Corpus to Self-Organizing Dictionary: Learning Valency Associations in the Face of Variation and Change. In Corpus Linguistics Conference, Lancaster University.
5. Paula Chesley and Susanne Salmon-Alt. 2006. Automatic Extraction of Subcategorization Frames for French. In Language Resources and Evaluation Conference (LREC), Genoa (Italy).
6. William Croft and Alan Cruse. 2004. Cognitive Linguistics. Cambridge University Press, Cambridge.
7. Bonnie Dorr, Christof Monz, Stacy President, Richard Schwartz, and David Zajic. 2005. A Methodology for Extrinsic Evaluation of Text Summarization: Does ROUGE Correlate? In ACL Workshop on Intrinsic and Extrinsic Evaluation Measures for Machine Translation and/or Summarization, pages 1-8, Ann Arbor, Michigan. Association for Computational Linguistics.
8. Claire Gardent, Bruno Guillaume, Guy Perrier, and Ingrid Falk. 2005. Maurice Gross' Grammar Lexicon and Natural Language Processing. In 2nd Language and Technology Conference, Poznan.
9. Maurice Gross. 1994. Constructing Lexicon-Grammars. In Computational Approaches to the Lexicon, pages 213-263, Oxford. Oxford University Press.
10. Anna Korhonen, G. Gorrell, and D. McCarthy. 2000. Statistical filtering and subcategorization frame acquisition. In Proceedings of the Joint SIGDAT Conference on Empirical Methods in Natural Language Processing and Very Large Corpora, Hong Kong.
11. Anna Korhonen. 2002. Subcategorization Acquisition. Ph. D. thesis, University of Cambridge.
12. Anna Kupść. 2007. Extraction automatique de cadres de sous-catégorisation verbale pour le franais à partir d'un corpus arboré. In Conférence Traitement Automatique du Langage Naturel, Toulouse.
13. Christopher D. Manning. 2003. Probabilistic syntax. In R. Bod, J. Hay, and S. Jannedy, editors, Probabilistic Linguistics, pages 289-341. MIT Press.
14. Cédric Messiant, Anna Korhonen, and Thierry Poibeau. 2008. LexSchem: A Large Subcategorization Lexicon for French Verbs. In Language Resource and Evaluation Conference (LREC), Marrakech.
15. Cédric Messiant. 2008. A Subcategorization Frames Acquisition System for French Verbs. In Association for Computational Linguistics (ACL, Student Research Workshop), Columbus, Ohio.
16. Thierry Poibeau, Dominique Dutoit, and Sophie Bizouard. 2002. Evaluating Resource Acquisition Tools for Information Extraction. In Language Resources and Evaluation Conference (LREC), Las Palmas.
17. Thierry Poibeau. 2007. Semantic annotation: Mapping Text to Ontologies. International Journal of Metadata, Semantics and Ontologies, 2 (2).
18. Benot Sagot, Lionel Clment, Eric de La Clergerie, and Pierre Boullier. 2006. The Lefff 2 Syntactic Lexicon for French: Architecture, Acquisition, Use. In Language Resource and Evaluation Conference (LREC), Genoa.
19. Sabine Schulte im Walde. 2006. Experiments on the Automatic Induction of German Semantic Verb Classes. Computational Linguistics, 32(2):159-194.
20. Karen Sparck Jones and Jean Gallier. 1996. Evaluating Natural Language Processing Systems: An Analysis and Review. Oxford University Press, Oxford.
21. Karel Van Den Eynde and Claire Blanche-Benveniste. 1978. Syntaxe et Mécanismes Descriptifs: Présentation de l'approche pronominale. Cahiers de Lexicologie, 32:3-27.
22. Karel Van Den Eynde and Piet Mertens. 2006. Le dictionnaire de valence Dicovalence: manuel d'utilisation. Manuscript, Leuven.
23. Yorick Wilks, Brian Slator, and Louise Guthrie. 1996. Electric Words: Dictionaries, Computers, and Meanings. The MIT Press, Cambridge, MA.