A systematic comparison of various statistical alignment models

Computational Linguistics

Volumn 29, Issue 1, 2003, Pages 19-51

  Och, Franz Josef ^a   Ney, Hermann ^b  

^a UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

^b RWTH AACHEN UNIVERSITY   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

ALIGNMENT; HEURISTIC METHODS; QUALITY CONTROL; STATISTICS;

ANALYSIS OF VARIOUS; DESIGN DECISIONS; EVALUATION CRITERIA; FIRST-ORDER DEPENDENCE; SMOOTHING TECHNIQUES; STATISTICAL ALIGNMENT MODELS; STATISTICAL ALIGNMENTS; TRAINING ALGORITHMS;

HIDDEN MARKOV MODELS;

EID: 0042879653     PISSN: 08912017     EISSN: None     Source Type: Journal    
DOI: 10.1162/089120103321337421     Document Type: Article

References (36)

1. Al-Onaizan, Yaser, Jan Curin, Michael Jahr, Kevin Knight, John D. Lafferty, I. Dan Melamed, David Purdy, Franz J. Och, Noah A. Smith, and David Yarowsky. 1999. Statistical machine translation. Final Report, JHU Workshop. Available at http://www.clsp.jhu.edu/ws99/projects /mt/final_report/mt-final-report.ps.
2. Alshawi, Hiyan, Srinivas Bangalore, and Shona Douglas. 1998. Automatic acquisition of hierarchical transduction models for machine translation. In COLING-ACL '98:36th Annual Meeting of the Association for Computational Linguistics and 17th International Conference on Computational Linguistics, volume 1, pages 41-47, Montreal, Canada, August.
3. Baum, L. E. 1972. An inequality and associated maximization technique in statistical estimation for probabilistic functions of Markov processes. Inequalities, 3:1-8.
4. Berger, Adam L., Peter R Brown, Stephen A. Della Pietra, Vincent J. Della Pietra, John R. Gillett, John D. Lafferty, Harry Printz, and Lubos Ures. 1994. The Candide system for machine translation. In Proceedings of the ARPA Workshop on Human Language Technology, pages 157-162, Plainsboro, New Jersey, March.
5. Brown, Peter F., Stephen A. Della Pietra, Vincent J. Della Pietra, M. J. Goldsmith, J. Hajic, R. L. Mercer, and S. Mohanty. 1993. But dictionaries are data too. In Proceedings of the ARPA Workshop on Human Language Technology, pages 202-205, Plainsboro, New Jersey, March.
6. Brown, Peter F., Stephen A. Della Pietra, Vincent J. Della Pietra, and R. L. Mercer. 1993. The mathematics of statistical machine translation: Parameter estimation. Computational Linguistics, 19(2):263-311.
7. Brown, Ralf D. 1997. Automated dictionary extraction for "knowledge-free" example-based translation. In Seventh International Conference on Theoretical and Methodological Issues in Machine Translation (TMI-97), pages 111-118, Santa Fe, New Mexico, July.
8. Dagan, Ido, Kenneth W. Church, and William A. Gale. 1993. Robust bilingual word alignment for machine aided translation. In Proceedings of the Workshop on Very Large Corpora, pages 1-8, Columbus, Ohio, June.
9. Dempster, A. P., N. M. Laird, and D. B. Rubin. 1977. Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society, Series B, 39(1):1-22.
10. Diab, Mona. 2000. An unsupervised method for multilingual word sense tagging using parallel corpora: A preliminary investigation. In ACL-2000 Workshop on Word Senses and Multilinguality, pages 1-9, Hong Kong, October.
11. Dice, Lee R. 1945. Measures of the amount of ecologic association between species. Journal of Ecology, 26:297-302.
12. García-Varea, Ismael, Francisco Casacuberta, and Hermann Ney. 1998. An iterative, DP-based search algorithm for statistical machine translation. In Proceedings of the International Conference on Spoken Language Processing (ICSLP'98), pages 1235-1238, Sydney, Australia, November.
13. Germann, Ulrich, Michael Jahr, Kevin Knight, Daniel Marcu, and Kenji Yamada. 2001. Fast decoding and optimal decoding for machine translation. In Proceedings of the 39th Annual Meeting of the Association for Computational Linguistics (ACL), pages 228-235, Toulouse, France, July.
14. Huang, Jin-Xia and Key-Sun Choi. 2000. Chinese-Korean word alignment based on linguistic comparison. In Proceedings of the 38th Annual Meeting of the Association for Computational Linguistics (ACL), pages 392-399, Hong Kong, October.
15. Ker, Sue J. and Jason S. Chang. 1997. A class-based approach to word alignment. Computational Linguistics, 23(2):313-343.
16. Kneser, Reinhard and Hermann Ney. 1993. Improved clustering techniques for class-based statistical language modelling. In European Conference on Speech Communication and Technology, pages 973-976, Berlin, Germany, September.
17. Knight, Kevin. 1999a. Decoding complexity in word-replacement translation models. Computational Linguistics, 25(4):607-615.
18. Knight, Kevin. 1999b. A Statistical MT Tutorial Workbook. Available at http://www.isi.edu/natural-language/mt/wkbk.rtf.
19. Melamed, I. Dan. 1998. Manual annotation of translational equivalence: The blinker project. Technical Report 98-07, Institute for Research in Cognitive Science, Philadelphia.
20. Melamed, I. Dan. 2000. Models of translational equivalence among words. Computational Linguistics, 26(2):221-249.
21. Ney, Hermann, Sonja Nießen, Franz J. Och, Hassan Sawaf, Christoph Tillmann, and Stephan Vogel. 2000. Algorithms for statistical translation of spoken language. IEEE Transactions on Speech and Audio Processing, 8(1):24-36.
22. Nießen, Sonja, Stephan Vogel, Hermann Ney, and Christoph Tillmann. 1998. A DP-based search algorithm for statistical machine translation. In COLING-ACL '98: 36th Annual Meeting of the Association for Computational Linguistics and 17th International Conference on Computational Linguistics, pages 960-967, Montreal, Canada, August.
23. Och, Franz J. 2000. Giza++: Training of statistical translation models. Available at http://www-i6.informatik.rwth-aachen.de/̃och/software/GIZA++.html.
24. Och, Franz J. and Hermann Ney. 2000. A comparison of alignment models for statistical machine translation. In COLING'00: The 18th International Conference on Computational Linguistics, pages 1086-1090, Saarbrücken, Germany, August.
25. Och, Franz J., Christoph Tillmann, and Hermann Ney. 1999. Improved alignment models for statistical machine translation. In Proceedings of the Joint SIGDAT Conference on Empirical Methods in Natural Language Processing and Very Large Corpora, pages 20-28, University of Maryland, College Park, June.
26. Och, Franz J., Nicola Ueffing, and Hermann Ney. 2001. An efficient A* search algorithm for statistical machine translation. In Data-Driven Machine Translation Workshop, pages 55-62, Toulouse, France, July.
27. Och, Franz J. and Hans Weber. 1998. Improving statistical natural language translation with categories and rules. In COLING-ACL '98:36th Annual Meeting of the Association for Computational Linguistics and 17th International Conference on Computational Linguistics, pages 985-989, Montreal, Canada, August.
28. Simard, M., G. Foster, and P. Isabelle. 1992. Using cognates to align sentences in bilingual corpora. In Fourth International Conference on Theoretical and Methodological Issues in Machine Translation (TMI-92), pages 67-81, Montreal, Canada.
29. Smadja, Frank, Kathleen R. McKeown, and Vasileios Hatzivassiloglou. 1996. Translating collocations for bilingual lexicons: A statistical approach. Computational Linguistics, 22(1):1-38.
30. Vogel, Stephan, Hermann Ney, and Christoph Tillmann. 1996. HMM-based word alignment in statistical translation. In COLING '96: The 16th International Conference on Computational Linguistics, pages 836-841, Copenhagen, Denmark, August.
31. Wahlster, Wolfgang, editor. 2000. Verbmobil: Foundations of speech-to-speech translations. Springer Verlag, Berlin.
32. Wang, Ye-Yi and Alex Waibel. 1998. Fast decoding for statistical machine translation. In Proceedings of the International Conference on Speech and Language Processing, pages 1357-1363, Sydney, Australia, November.
33. Wu, Dekai. 1996. A polynomial-time algorithm for statistical machine translation. In Proceedings of the 34th Annual Conference of the Association for Computational Linguistics (ACL '96), pages 152-158, Santa Cruz, California, June.
34. Yamada, Kenji and Kevin Knight. 2001. A syntax-based statistical translation model. In Proceedings of the 39th Annual Meeting of the Association for Computational Linguistics (ACL), pages 523-530, Toulouse, France, July.
35. Yarowsky, David, Grace Ngai, and Richard Wicentowski. 2001. Inducing multilingual text analysis tools via robust projection across aligned corpora. In Human Language Technology Conference, pages 109-116, San Diego, California, March.
36. Yarowsky, David and Richard Wicentowski. 2000. Minimally supervised morphological analysis by multimodal alignment. In Proceedings of the 38th Annual Meeting of the Association for Computational Linguistics (ACL), pages 207-216, Hong Kong, October.