Automatic ranking of MT systems

Proceedings of the 3rd International Conference on Language Resources and Evaluation, LREC 2002

Volumn , Issue , 2002, Pages 1247-1253

  Rajman, Martin ^a   Hartley, Anthony ^b  

^a EPFL   (Switzerland)

^b Centre for Translation Studies   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ADDITIONAL DATUM; AUTOMATIC RANKING; HUMAN JUDGMENTS; INFORMATIVE NESS; RELATIVE RANKINGS; SEMANTIC FEATURES; SYNTACTIC FEATURES;

SEMANTICS;

EID: 35048859807     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (12)

1. Arrow, K.J., 1963. Social Choice and Individual Values. Wiley: New York.
2. Brew, C. and H. Thompson, 1994. Automatic Evaluation of Computer Generated Text. Procs. ARPA/ISTO Workshop on Human Language Technology, 104-109.
3. Besançon, R. and Rajman, M., 2002. Evaluation of a Vector Space similarity measure in a multilingual framework. Procs. 3rd International Conference on Language Resources and Evaluation, Las Palmas, Spain.
4. Carroll, J.B., 1966. An experiment in evaluating the quality of translations. In J. Pierce (ed.) Language and machines. Report by ALPAC. NASNRC, 67-75.
5. Papineni, K., S. Roukos, T. Ward and Z. Wei-Jing, 2001. Bleu: A method for automatic evaluation of machine translation. IBM Research Report RC22176. Yorktown Heights, NY: IBM.
6. Rajman, M. and T. Hartley, 2001. Automatically predicting MT systems rankings compatible with Fluency, Adequacy or Informativeness scores. Procs. 4th ISLE Workshop on MT Evaluation, MT Summit VIII, 29-34.
7. Reeder, F., K. Miller, J. Doyon, and J. White, J. 2001. The naming of things and the confusion of tongues: an MT metric. Procs. 4th ISLE Workshop on MT Evaluation, MT Summit VIII, 55-59.
8. Saari, D., 1999. Explaining all three-alternative voting outcomes. Journal of Economic Theory. 87, 313-355.
9. Salton, G. and Buckley, Cm 1988. Term Weighting Approaches in Automatic Text Retrieval. Information Processing and Management, 24, 513-523.
10. Vanni, M. and K. Miller 2001. Scaling the ISLE framework: validating tests of machine translation quality for multi-dimensional measurement. Procs. 4th ISLE Workshop on MT Evaluation, MT Summit VIII, 21-27.
11. White, J., T. O'Connell and F. O'Mara, 1994. The ARPA MT evaluation methodologies: evolution, lessons and future approaches. Procs. 1st Conference of the Association for Machine Translation in the Americas, 193-205.
12. White, J. and M. Forner, 2001. Predicting MT fidelity from noun-compound handling. Procs. 4th ISLE Workshop on MT Evaluation, MT Summit VIII, 45-48.