Towards systematic grammar profiling. Test suite technology 10 years after

Computer Speech and Language

Volumn 12, Issue 4, 1998, Pages 411-435

  Oepen, S ^a   Flickinger, D P ^b  

^a SAARLAND UNIVERSITY   (Germany)

^b STANFORD UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL GRAMMARS;

GRAMMAR PROFILING;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 0032181197     PISSN: 08852308     EISSN: None     Source Type: Journal    
DOI: 10.1006/csla.1998.0105     Document Type: Article

References (13)

1. Black, E., Abney, S., Flickinger, D. P., Gdaniec, C., Grishman, R., Harrison, P., Hindle, D., Ingria, R., Jelinek, F., Klavans, J., Liberman, M., Marcus, M., Roukos, S., Santorini, B. & Strzalkowski, T. (1991). A procedure for quantitatively comparing the syntactic coverage of English grammars. Proceedings of the 4th DARPA Speech and Natural Language Workshop. Pacific Grove, CA. Morgan Kaufmann.
2. Carroll, J. (1994). Relating complexity to practical performance in parsing with wide-coverage unification grammars. Proceedings of the 31st Meeting of the Association for Computational Linguistics (ACL), pp. 287-294. Las Cruces, New Mexico.
3. Erbach, G. & Uszkoreit, H. (1990). Grammar engineering: problems and prospects. Technical Report 1. Saarbrücken: Computerlinguistik an der Universität des Saarlandes.
4. Flickinger, D., Nerbonne, J., Sag, I. A. & Wassow, T. (1987). Toward evaluation of NLP systems. Technical Report. Hewlett-Packard Laboratories. Distributed at the 24th Annual Meeting of the Association for Computational Linguistics (ACL).
5. Gambäck, B. (1997). Processing Swedish sentences. A unification-based grammar and some applications. Technical Report (SICS Dissertation Series # 21). Swedish Institute of Computer Science.
6. Lehmann, S., Estival, D., Falkedal, K., Compagnion, H., Balkan, L., Fouvry, F., Baur, J. & Klein, J. (1996a). TSNLP user manual. Volume 3: Test Data Documentation. Technical Report. Istituto Dalle Molle per gli Studii Semantici e Cognitivi (ISSCO) Geneva, Switzerland.
7. Lehmann, S., Oepen, S., Regnier-Prost, S., Netter, K., Lux, V., Klein, J., Falkedal, K., Fouvry, F., Estival, D., Daphin, E., Compagnion, H., Baur, J., Balkan, L. & Arnold, D. (1996b) TSNLP - Test suites for natural language processing. Proceedings of COLING 1996. Kopenhagen, pp. 711-716.
8. Nerbonne, J., Netter, K., Diagne, K., Dickmann, L. & Klein, J. (1993). A diagnostic tool for German syntax. Machine Translation 8, 85-107.
9. Oepen, S. & Groenendijk, M. (1997). Towards systemic testing and diagnosis. Integrating TSNLP and ALEP. Proceedings of 3rd Alep User Group Workshop. Saarbrücken, pp. 62-65.
10. Oepen, S., Netter, K. & Klein, J. (1997). TSNLP - Test suites for natural language processing. In Linguistic Databases (J. Nerbonne, ed.), CSLI Lecture Notes. Center for the Study of Language and Information.
11. Pollard, C. & Sag, I. A. (1994). Head-driven, Phrase Structure Grammar. The University of Chicago Press: Stanford, California.
12. Sparck Jones, K. & Galliers, J. R. (1995). Evaluating Natural Language Processing Systems. An Analysis and Review. Lecture Notes in Artificial Intelligence, Vol. 1083. Berlin-Heidelberg-New York: Springer.
13. Uszkoreit, H., Backofen, R., Busemann, S., Kader Diagne, A., Hinkleman, E. A., Kasper, W., Kiefer, B., Krieger, H.-U., Netter, K., Neumann, G., Oepen, S. & Spackman, S. P. (1994). DISCO - An HPSG-based NLP System and its Application for Appointment Scheduling. Proceedings of the 15th Conference on Computational Linguistics (COLING). Kyoto.