A block bigram prediction model for statistical machine translation

ACM Transactions on Speech and Language Processing

Volumn 4, Issue 3, 2007, Pages

  Tillmann, Christoph ^a   Zhang, Tong ^b  

^a IBM T J WATSON RESEARCH CENTER   (United States)

^b YAHOO RESEARCH   (United States)

Author keywords

Machine learning; Maximum entropy; Statistical machine translation; Stochastic gradient descent

Indexed keywords

BLOCK GENERATION; MAXIMUM ENTROPY; STATISTICAL MACHINE TRANSLATION; STOCHASTIC GRADIENT DESCENT (SGD);

FORMAL LANGUAGES; GRADIENT METHODS; LEARNING SYSTEMS; MATHEMATICAL MODELS; NATURAL LANGUAGE PROCESSING SYSTEMS; PROBLEM SOLVING; STATISTICAL METHODS;

AUTOMATIC PROGRAMMING;

EID: 34547369506     PISSN: 15504875     EISSN: 15504883     Source Type: Journal    
DOI: 10.1145/1255171.1255172     Document Type: Article

References (41)

1. AL-ONAIZAN, Y., GE, N., LEE, Y.-S., PAPMENI, K., XIA, F., AND TILLMANN, C. 2004. IBM site report. In Proceedings of the NIST 2004 MT Workshop. IBM, Alexandria, VA.
2. AL-ONAIZAN, Y. AND PAPINENI, K. 2006. Distortion models for statistical machine translation. In Proceedings of the 21st International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics. Sydney, Australia, Association for Computational Linguistics, 529-536.
3. BROWN, P. F., DELLA PIETRA, V. J., DELLA PIETRA, S. A., AND MERCER, R. L. 1993. The mathematics of statistical machine translation: Parameter estimation. Computat. Linguis. 19, 2, 263-311.
4. CALLISON-BURCH, C., BANNARD, C., AND SCHROEDER, J. 2005. Scaling phrase-based statistical machine translation to larger corpora and longer phrases. In Proceedings of the 43rd Annual Meeting of the Association for Computational Linguistics (ACL'05). Ann Arbor, MI. Association for Computational Linguistics, 255-262.
5. CHIANG, D. 2005. A hierarchical phrase-based model for statistical machine translation. In Proceedings of the 43rd Annual Meeting of the Association for Computational Linguistics (ACL'05). Ann Arbor, MI. Association for Computational Linguistics, 263-270.
6. CHIANG, D., LOPEZ, A., MADNANI, N., MONZ, C., RESNIK, P., AND SUBOTIN, M. 2005. The Hiero machine translation system: Extensions, evaluation, and analysis. In Proceedings of Human Language Technology Conference and Conference on Empirical Methods in Natural Language Processing (HLT/EMNLP'05). Vancouver, British Columbia, Canada, 779-786.
7. COLLINS, M. 2002. Discriminative training methods for hidden Markov models: Theory and experiments with perceptron algorithms. In Proceedings of the Conference on Emperical Methods in Natural Language Modeling (EMNLP'02). Philadelphia, PA. 1-8.
8. DARROCH, J. AND RATCLIFF, D. 1972. Generalized iterative scaling for log-linear models. Ann. Mathemat. Statis. 43, 1470-1480.
9. DELLA PIETRA, S., DELLA PIETRA, V., AND LAFFERTY, J. 1997. Inducing features of random fields. IEEE Trans. Patt. Analy. Mach. Intell. 19, 4, 380-393.
10. DENG, Y. AND BYRNE, W. 2005. HMM word and phrase alignment for statistical machine translation. In Proceedings of Human Language Technology Conference and Conference on Empirical Methods in Natural Language Processing (HLT/EMNLP'05). Vancouver, British Columbia, Canada. 169-176.
11. KOEHN, P., OCH, F. J., AND MARCU, D. 2003. Statistical phrase-based translation. In Proceedings of HLT-NAACL.. Edmonton, Alberta, Canada. 127-133.
12. KUMAR, S. AND BYRNE, W. 2003. A weighted finite state transducer implementation of the alignment template model for statistical machine translation. In Proceedings of HLT-NAACL., M. Hearst and M. Ostendorf, Eds. Edmonton, Alberta, Canada. 142-149.
13. KUMAR, S. AND BYRNE, W. 2005. Local phrase reordering models for statistical machine translation. In Proceedings of Human Language Technology Conference and Conference on Empirical Methods in Natural Language Processing (HLT/EMNLP'05). Vancouver, British Columbia, Canada. 161-168.
14. KUSHNER, H. J. AND YIN, G. G. 1997. Stochastic Approximation Algorithms and Applications. Springer-Verlag, Berlin, Germany.
15. LAFFERTY, J., MCCALLUM, A., AND PEREIRA, F. 2001. Conditional random fields: Probabilistic models for segmenting and labeling sequence data. In Proceedings of the International Conference on Machine Learning (ICML-01). 282-289.
16. MARCU, D. 2001. Towards a unified approach to memory- and statistical-based machine translation. In Proceedings of the 39th Annual Conference of the Association for Computational Linguistics (ACL'01). Toulouse, France.
17. MARCU, D. AND WONG, D. 2002. A phrase-based, joint probability model for statistical machine translation. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP'02). Philadelphia, PA. 133-189.
18. MCDONALD, R., CRAMMER, K., AND PEREIRA, F. 2005. Online large-margin training of dependency parsers. In Proceedings of the 43rd Annual Meeting of the Association for Computational Linguistics (ACL'05). Ann Arbor, MI. Association for Computational Linguistics, 91-98.
19. MOORE, R. C. 2005. A discriminative framework for bilingual word alignment. In Proceedings of Human Language Technology Conference and Conference on Empirical Methods in Natural Language Processing (HLT/EMNLP'05). Vancouver, British Columbia, Canada. 81-88.
20. NAGATA, M., SAITO, K., YAMAMOTO, K., AND OHASHI, K. 2006. A clustered global phrase reordering model for statistical machine translation. In Proceedings of the 21st International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics (ACL'06). Sydney, Australia. 713-720.
21. OCH, F. J. 2003. Minimum error rate training in statistical machine translation. In Proceedings of the 41st Annual Meeting of the Association for Computational Linguistics (ACL'03). Sapporo, Japan. 160-167.
22. OCH, F.-J. AND NEY, H. 2004. The alignment template approach to statistical machine translation. Computat. Linguis. 30, 4, 417-450.
23. OCH, F.-J., TILLMANN, C., AND NEY, H. 1999. Improved alignment models for statistical machine translation. In Proceedings of the Joint Conference on Empirical Methods in Natural Language Processing and Very Large Corpora (EMNLP/VLC'99). College Park, MD. 20-28.
24. OCH ET AL. 2004. A smorgasbord of features for statistical machine translation. In Proceedings of the Joint HLT and NAACL Conference (HLT04). Boston, MA. 161-168.
25. PAPINENI, K., ROUKOS, S., WARD, T., AND ZHU, W.-J. 2002. BLEU: A method for automatic evaluation of machine translation. In Proceedings of the 40th Annual Conf. of the Association for Computational Linguistics (ACL'02). Philadelphia, PA. 311-318.
26. SCHAFER, C. AND YAROWSKY, D. 2003. Statistical machine translation using coercive two-level syntactic transduction. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP'03). Sapporo, Japan. 9-16.
27. SHEN, L., SARKAR, A., AND OCH, F.-J. 2004. Discriminative reranking of machine translation. In Proceedings of the Joint HLT and NAACL Conference (HLT'04). Boston, MA. 177-184.
28. TASKAR, B., SIMON, L.-J., AND DAN, K. 2005. A discriminative matching approach to word alignment. In Proceedings of Human Language Technology Conference and Conference on Empirical Methods in Natural Language Processing (HLT/EMNLP'05). Vancouver, British Columbia, Canada. 73-80.
29. TILLMANN, C. 2003. A projection extension algorithm for statistical machine translation. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP'03), Sapporo, Japan. 1-8.
30. TILLMANN, C. 2004. A unigram orientation model for statistical machine translation. HLT-NAACL2004: Short Papers. Boston, MA. 101-104.
31. TILLMANN, C. 2006. Efficient dynamic programming search algorithms for phrase-based SMT. In Proceedings of the Workshop on Computationally Hard Problems and Joint Inference in Speech and Language Processing (HLT06). New York, NY. 9-16.
32. TILLMANN, C. AND NEY, H. 2003. Word reordering and a DP beam search algorithm for statistical machine translation. Computat. Linguis. 29, 1, 97-133.
33. TILLMANN, C. AND XIA, F. 2003. A phrase-based unigram model for statistical machine translation. In HLT/NAACL'03. Companion Vol. (1), Edmonton, Canada. 106-108.
34. TILLMANN, C. AND ZHANG, T. 2005. A localized prediction model for statistical machine translation. In Proceedings of the 43rd Annual Meeting of the Association for Computational Linguistics (ACL'05). Ann Arbor, MI. Association for Computational Linguistics. 557-564.
35. TILLMANN, C. AND ZHANG, T. 2006. A discriminative global training algorithm for statistical MT. In Proceedings of the 21st International Conference on Computational Linguistics and the 44th Annual Meeting of the Association for Computational Linguistics (ACL/COLING'05). Sydney, Australia. 721-728.
36. UEFFING, N., OCH, F.-J., AND NEY, H. 2002. Generation of word graphs in statistical machine translation. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP'02). Philadelphia, PA. 156-163.
37. VENUGOPAL, A., VOGEL, S., AND WAIBEL, A. 2003. Effective phrase translation extraction from alignment models. In Proceedings of the 41st Annual Meeting of the Association for Computational Linguistics (ACL'03). Sapporo, Japan. 319-326.
38. WATANABE, T., SUMITA, E., AND OKUNO, H. G. 2003. Chunk-based statistical translation. In Proceedings of the 41st Annual Meeting of the Association for Computational Linguistics (ACL'03). Sapporo, Japan. 303-310.
39. ZENS, R. AND NEY, H. 2004. Improvements in phrase-based statistical machine translation. In Proceedings of HLT-NAACL. Boston, MA. 257-264.
40. ZHANG, T. 2004. Solving large scale linear prediction problems using stochastic gradient descent algorithms. In International Conference on Machine Learning (ICML'04). 919-926.
41. ZHAO, B., GE, N., AND PAPINENI, K. 2005. Inner-outer bracket models for word alignment using hidden blocks. In Proceedings of Human Language Technology Conference and Conference on Empirical Methods in Natural Language Processing (HLT/EMNLP'05). Vancouver, British Columbia, Canada. 177-184.