Limits to annotation precision

LINC@EACL 2003 - Proceedings of 4th International Workshop on Linguistically Interpreted Corpora at the 10th Conference of the European Chapter

Volumn , Issue , 2003, Pages 61-68

  Sampson, Geoffrey ^a   Babarczy, Anna ^a  

^a UNIVERSITY OF SUSSEX   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

CURRENT SPECTRA; IT IDENTIFY; PERFORMANCE; PILOT PROGRAMS; TREEBANKS;

COMPUTATIONAL LINGUISTICS;

EID: 61949098480     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (18)

1. Babarczy, A., et al. 2001. Annotator error rates for part-of-speech tagging. LINC 2001, at 34th SLE, Leuven, Belgium, 28 Aug-1 Sep 2001.
2. Bangalore, S., et al. 1998. Grammar and parser evaluation in the XTAG project. In Carroll (1998).
3. Bies, A., et al. 1995. Bracketing guidelines for Treebank II Style, Penn Treebank Project, www.eis.upenn.edu/-treebank/home.html
4. Black, E., et al. 1991. A procedure for quantitatively comparing the syntactic coverage of Enghsh grammars. In Proceedings of the Speech and Natural Language Workshop, DARPA, Feb. 1991, Pacific Grove, Calif., pp. 306-11. Morgan Kaufmann.
5. Carroll, J.A., ed. 1998. Proceedings of Workshop on the Evaluation of Parsing Systems, at 1st LREC, Granada, Spain, 26 May 1998 (Cognitive Science Research Papers 489, University of Sussex).
6. Carroll, J.A., ed. 2002. Proceedings of Workshop "Beyond Parseval - towards improved evaluation measures for parsing systems", at 3rd LREC, Las Palmas, Canary Islands, 2 June 2002.
7. Charniak, E. 1996. Tree-bank grammars. In Proceedings of the 13th AAAI, Portland, Oregon, vol. 2, pp. 1031-6.
8. Colhns, M. 1997. Three generative, lexicalised models for statistical parsing. In Proceedings of the 35th ACL and 8th EACL, 7-12 July 1997, Madrid. Morgan Kaufmann.
9. Hindle, D., and M. Rooth. 1993. Structural ambiguity and lexical relations. Computational Linguistics 19.103-20.
10. Langendoen, D.T. 1997. Review of Sampson 1995. Language 73.600-3.
11. Magerman, D.M. 1995. Statistical decision tree models for parsing. In Proceedings of the 33rd ACL, 28-30 June 1995, Cambridge, Mass., pp. 276-83. Morgan Kaufmann.
12. Martin, W., et al. 1987. Preliminary analysis of a breadth-first parsing algorithm: theoretical and experimental results. In L. Bole (ed.), Natural Language Parsing Systems, Springer (Berlin).
13. Meteer, M., et al. 1995. Dysfluency annotation stylebook for the Switchboard Corpus. www.Idc.upenn.edu/Catalog/CatalogList/LDC9 9T42/DFLGUIDE. PS
14. Obermeier, K.K. 1989. Natural Language Processing Technologies in Artificial Intelligence: the Science and Industry Perspective. EUis Horwood (Chichester, Sussex).
15. Sampson, G.R. 1995. English for the Computer: the SUSANNE Corpus and Analytic Scheme. Clarendon (Oxford University Press).
16. Sampson, G.R. 2000. A proposal for improving the measurement of parse accuracy. International Journal of Corpus Linguistics 5.53-68. Online at www.grsampson.net/Apfi.html
17. Sampson, G.R. and A. Babarczy. 2002. A test of the leaf-ancestor metric for parse accuracy. In Carroll (2002); to appear in Natural Language Engineering. Online at www. grsampson.net/Atot.html
18. Spärck Jones, K., and Y.A. Wilks. 1983. Automatic Natural Language Parsing. EUis Horwood (Chichester, Sussex).