The scaling problem in the pattern recognition approach to machine translation

Pattern Recognition Letters

Volumn 29, Issue 8, 2008, Pages 1145-1153

  Ortiz Martinez D ^b   Garcia Varea I ^a   Casacuberta, F ^b  

^a UNIVERSITY OF CASTILLA LA MANCHA   (Spain)

^b UNIVERSITAT POLITÈCNICA DE VALÈNCIA   (Spain)

Author keywords

Large scale pattern recognition; Machine translation; Phrase based translation; Search decoding algorithms; Statistical machine translation; Statistical pattern recognition

Indexed keywords

ALGORITHMS; DATA HANDLING; LEARNING SYSTEMS; MATHEMATICAL MODELS; SCALING LAWS; STATISTICAL MECHANICS;

LARGE-SCALE PATTERN RECOGNITION; MACHINE TRANSLATION; PHRASE-BASED TRANSLATION; SEARCH/DECODING ALGORITHMS; STATISTICAL MACHINE TRANSLATION; STATISTICAL PATTERN RECOGNITION;

PATTERN RECOGNITION;

EID: 42049088024     PISSN: 01678655     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patrec.2007.10.001     Document Type: Article

References (23)

1. Al-Onaizan, Y., Curin, J., Jahr, M., Knight, K., Lafferty, J.D., Melamed, I.D., Purdy, D., Och, F.J., Smith, N.A., Yarowsky, D., 1999. Statistical machine translation. Final Report, JHU Workshop. http://www.clsp.jhu.edu/ws99/projects/mt/final_report/mt-final{minus 45 degree rule}-report.ps.
2. Brown P.F., Cocke J., Della Pietra S.A., Della Pietra V.J., Jelinek F., Lafferty J.D., Mercer R.L., and Roossin P.S. A statistical approach to machine translation. Comput. Ling. 16 2 (1990) 79-85
3. Brown P.F., Della Pietra S.A., Della Pietra V.J., and Mercer R.L. The mathematics of statistical machine translation: Parameter estimation. Comput. Ling. 19 2 (1993) 263-311
4. Callison-Burch, C., Koehn, P., 2005. Introduction to statistical machine translation. In: Course given at the 17th European Summer School in Logic, Language and Information.
5. Callison-Burch, C., Bannard, C., Schroeder, J., 2005. Scaling phrase-based statistical machine translation to larger corpora and longer sentences. In: Proceedings of the 43rd Annual Meeting of the Association for Computational Linguistics (ACL), Ann Arbor. pp. 255-262.
6. Knuth D.E. Sorting and Searching. second ed. The Art of Computer Programming vol. 3 (1973), Addison-Wesley, Reading, MA pp. 551-575 (Chapter 6)
7. Koehn P. Pharaoh: A beam search decoder for phrase-based statistical machine translation models. User Manual and Description. Technical Report (2003), USC Information Science Institute
8. Koehn, P., Och, F.J., Marcu, D., 2003. Statistical phrase-based translation. In: Proceedings of the Human Language Technology and North American Association for Computational Linguistics Conference (HLT/NAACL), Edmonton, Canada. pp. 48-54.
9. Marcu, D., Wong, W., 2002. A phrase-based, joint probability model for statistical machine translation. In: EMNLP, Philadelphia, USA. pp. 1408-1414.
10. Ney H., Martin S., and Wessel F. Statistical language models using leaving-one-out. In: Young S., and Bloothooft G. (Eds). Corpus Based Methods in Language and Speech Processing (1997), Kluwer 174-207
11. Och, F.J., 2000. GIZA++: Training of statistical translation models. http://www-i6.informatik.rwth-aachen.de/{minus 45 degree rule}~och/software/GIZA++.html.
12. Och, F.J., 2002. Statistical machine translation: From single-word models to alignment templates. Ph.D. Thesis, Computer Science Department, RWTH Aachen, Germany.
13. Ortiz, D., Garca-Varea, I., Casacuberta, F., 2005. Thot: A toolkit to train phrase-based statistical translation models. In: MTSUMMIT05, Phuket, Thailand. pp. 141-148.
14. Papineni K.A., Roukos S., Ward T., and Zhu W.-J. BLEU: A method for automatic evaluation of machine translation. Technical Report RC22176 (W0109-022) (2001), IBM Research Division, Thomas J. Watson Research Center, Yorktown Heights, NY
15. Patterson D.A., and Hennessy J.L. Computer Architecture: A Quantitative Approach (2003), Morgan Kaufmann
16. Rosenfeld R., and Clarkson P. Statistical language modelling using the CMU-Cambridge Toolkit. Tech. Rep. CMU (1997)
17. Stolcke A. SRILM - An extensible language modelling toolkit. Techical Report (1997), Speech Technology and Research Laboratory, SRI International, Menlo Park, CA, USA
18. Tillmann, C., 2003. A projection extension algorithm for statistical machine translation. In: EMNLP. pp. 1-8.
19. Tomás, J., Casacuberta, F., 2001. Monotone statistical translation using word groups. In: MTSUMMIT01, Santiago de Compostela, Spain. pp. 357-361.
20. Venugopal, A., Vogel, S., Waibel, A., 2003. Effective phrase translation extraction from alignment models. In: Proceedings of the 41th Annual Meeting of the Association for Computational Linguistics (ACL), Sapporo, Japan. pp. 319-326.
21. Vogel, S., Zhang, Y., Huang, F., Tribble, A., Venugopal, A., Zhao, B., Waibel, A., 2003. The CMU statistical machine translation system. In: MTSUMMIT03, New Orleans, USA. pp. 115-120.
22. Zens, R., Och, F., Ney, H., 2002. Phrase-based statistical machine translation. In: Advances in Artificial Intelligence, vol. 25. Annual German Conference on AI. vol. 2479 of LNCS. Springer-Verlag, pp. 18-32.
23. Zhang, Y., Vogel, S., 2005. An efficient phrase-to-phrase alignment model for arbitrarily long phrase and large corpora. In: Proceedings of the 10th Annual Conference of the European Association for Machine Translation. The European Association for Machine Translation, Budapest, Hungary, pp. 294-301.