Guidelines for word alignment evaluation and manual alignment

Language Resources and Evaluation

Volumn 39, Issue 4, 2005, Pages 267-285

  Lambert, Patrik ^a   De Gispert, Adrià ^a   Banchs, Rafael ^a   Mariño, José B ^a  

^a UNIVERSITAT POLITÈCNICA DE CATALUNYA   (Spain)

Author keywords

Alignment error rate; Bilingual; Evaluation; Gold standard; Manual alignment; Parallel corpus; Precision; Recall; Word alignment

Indexed keywords

EID: 33746098556     PISSN: 1574020X     EISSN: 15728412     Source Type: Journal    
DOI: 10.1007/s10579-005-4822-5     Document Type: Article

References (22)

1. Ahrenberg L., Merkel M., Hein A.S., Tiedemann J. (2000) In: Proc. of the 2nd International Conference on Linguistic. Resources and Evaluation (LREC). Athens, Greece, Vol. III: pp. 1255-1261.
2. Brown P., Della Pietra S., Della Pietra V., Mercer R. (1993) The Mathematics of Statistical Machine Translation: Parameter Estimation. Computational Linguistics, 19(2), pp. 263-311.
3. Crego J.M., Mariño J., de Gispert A. (2004) Finite-state-based and Phrase-based Statistical Machine Translation. Proc. of the 8th Int. Conf. on Spoken Language Processing, ICSLP'04 pp. 37-40.
4. David Yarowsky G.N., Wicentowski, R. (2001) Inducing Multilingual Text Analysis Tools via Robust Projection Across Aligned Corpora. In: Proc. of the 1st International Conference on Human Language Technology Research (HLT), pp. 161-168.
5. de Gispert A., Mariño J., Crego J.M. (2004) Phrase-based Alignment Combining Corpus Cooccurrences and Linguistic Knowledge. Proc. of the Int. Workshop on Spoken Language Translation, IWSLT'04, pp. 107-114.
6. Diab M., Resnik P. (2002) An Unsupervised Method for Word Sense Tagging Using Parallel Corpora. In: Proc. of the Annual Meeting of the Association for Computational Linguistics. Philadelphia, PA, pp. 255-262.
7. Kuhn J. (2004) Experiments in Parallel-Text Based Grammar Induction. In: Proc. of the 42th Annual Meeting of the Association for Computational Linguistics. Barcelona, Spain, pp. 470-477.
8. Lambert P. (2004) The Alignment Set Toolkit, http://gps-tsc.upc.es/veu/ personal/lambert/software/AlignmentSet.html.
9. Martin J., Mihalcea R., Pedersen T. (2005) Word Alignment for Languages with Scarce Resources. In: Proceedings of the ACL Workshop on Building and Using Parallel Texts. Ann Arbor, Michigan.
10. Melamed I.D. (1998a) Annotation Style Guide for the Blinker Project. Technical Report 98-06, IRCS.
11. Melamed I.D. (1998b) Manual Annotation of Translational Equivalence. Technical Report 98-07, IRCS.
12. Mihalcea R., Pedersen T. (2003) An Evaluation Exercise for Word Alignment. In Mihalcea. R., Pedersen. T. (eds.), HLT-NAACL 2003 Workshop: Building and Using Parallel Texts: Data Driven Machine Translation and Beyond Edmonton, Alberta, CanadaAssociation for Computational Linguistics, pp. 1-10.
13. Och F., Ney H. (2003) A Systematic Comparison of Various Statistical Alignment Models. Computational Linguistics, 29(1), pp. 19-51.
14. Och F., Ney H. (2004) The Alignment Template Approach to Statistical Machine Translation. Computational Linguistics, 30(4), pp. 417-449.
15. Och F.J., Ney H. (2000a) A Comparison of Alignment Models for Statistical Machine Translation. In: Proc. of the 18th Int. Conf. on Computational Linguistics. Saarbrucken,Germany, pp. 1086-1090.
16. Och F.J., Ney H. (2000b) Improved Statistical Alignment Models. In: Proc. of the 38th Annual Meeting of the Association for Computational Linguistics. Hongkong, China, pp. 440-447.
17. Pedersen T., Rassier B. (2003) Aligner for Parallel Corpora. http://www.d.umn.edu/~tpederse/parallel.html.
18. Ribeiro A., Lopes G., Mexia J. (2001) Extracting Translation Equivalents from Portuguese-Chinese Parallel Texts. Journal of Studies in Lexicography, 11(1), pp. 118-194.
19. Smadja F.A., McKeown K.R., Hatzivassiloglou V. (1996) Translating Collocations for Bilingual Lexicons: A Statistical Approach. Computational Linguistics, 22(1), pp. 1-38.
20. Van Rijsbergen C.J. (1979) Information Retrieval, 2nd edition. Butterworths, London.
21. Véronis J. (2000) Evaluation of Parallel Text Alignment Systems: The ARCADE Project. In: Parallel Text Processing: Alignment and Use of Translation Corpora. Kluwer Academic Publishers, pp. 369-388.
22. Wang Y.-Y., Waibel A. (1998) Modeling with Structures in Statistical Machine Translation. In: Proc. of the 36th Annual Meeting of the Association for Computational Linguistics and 17th International Conference on Computational Linguistics. Montreal, Canada, pp. 1357-1363.