Fast and adaptive online training of feature-rich translation models

ACL 2013 - 51st Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference

Volumn 1, Issue , 2013, Pages 311-321

  Green, Spence ^a   Wang, Sida ^a   Cer, Daniel ^a   Manning, Christopher D ^a  

^a Stanford University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; AUTOMATIC PROGRAMMING;

ADAPTIVE LEARNING RATES; DISCRIMINATIVE METHODS; LARGE SCALE EXPERIMENTS; MACHINE TRANSLATIONS; STATISTICAL MACHINE TRANSLATION; STOCHASTIC GRADIENT DESCENT; TRANSLATION MODELS; TRANSLATION QUALITY;

COMPUTATIONAL LINGUISTICS;

EID: 84907368273     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (49)

1. A. Arun and P. Koehn. 2007. Online learning methods for discriminative training of phrase based statistical machine translation. In MT Summit XI.
2. L. Bottou and O. Bousquet. 2011. The tradeoffs of large scale learning. In Optimization for Machine Learning, pages 351-368. MIT Press.
3. D. Cer, D. Jurafsky, and C. D. Manning. 2008. Regularization and search for minimum error rate training. In WMT.
4. D. Cer, M. Galley, D. Jurafsky, and C. D. Manning. 2010. Phrasal: A statistical machine translation toolkit for exploring new model features. In HLT-NAACL, Demonstration Session.
5. P-C. Chang, M. Galley, and C. D. Manning. 2008. Optimizing Chinese word segmentation for machine translation performance. In WMT.
6. C. Cherry and G. Foster. 2012. Batch tuning strategies for statistical machine translation. In HLT-NAACL.
7. D. Chiang, Y. Marton, and P. Resnik. 2008. Online large-margin training of syntactic and structural translation features. In EMNLP.
8. D. Chiang, K. Knight, and W. Wang. 2009. 11, 001 new features for statistical machine translation. In HLT-NAAC L.
9. D. Chiang. 2012. Hope and fear for discriminative training of statistical translation models. JMLR, 13:1159-1187.
10. K. Crammer, O. Dekel, J. Keshet, S. Shalev-Shwartz, and Y. Singer. 2006. Online passive-aggressive algorithms. JMLR, 7:551-585.
11. K. Crammer, A. Kulesza, and M. Dredze. 2009. Adaptive regularization of weight vectors. In NIPS.
12. J. Duchi and Y. Singer. 2009. Efficient online and batch learning using forward backward splitting. JMLR, 10:2899-2934.
13. J. Duchi, E. Hazan, and Y. Singer. 2011. Adaptive subgradient methods for online learning and stochastic optimization. JMLR, 12:2121-2159.
14. M. Galley and C. D. Manning. 2008. A simple and effective hierarchical phrase reordering model. In EMNLP.
15. K. Gimpel and N. A. Smith. 2012. Structured ramp loss minimization for machine translation. In HLT-NAAC L.
16. K. Gimpel, D. Das, and N. A. Smith. 2010. Distributed asynchronous online learning for natural language processing. In CoNLL.
17. K. Gimpel. 2012. Discriminative Feature-Rich Modeling for Syntax-Based Machine Translation. Ph. D. thesis, Language Technologies Institute, Carnegie Mellon University.
18. S. Green and J. DeNero. 2012. A class-based agreement model for generating accurately inflected translations. In ACL.
19. B. Haddow and P. Koehn. 2012. Analysing the effect of out-of-domain data on SMT systems. In WMT.
20. B. Haddow, A. Arun, and P. Koehn. 2011. SampleR-ank training for phrase-based machine translation. In WMT.
21. E. Hasler, P. Bell, A. Ghoshal, B. Haddow, P. Koehn, F. McInnes, et al. 2012a. The UEDIN systems for the IWSLT 2012 evaluation. In IWSLT.
22. E. Hasler, B. Haddow, and P. Koehn. 2012b. Sparse lexicalised features and topic adaptation for SMT. In IWSLT.
23. X. He and L. Deng. 2012. Maximum expected BLEU training of phrase and lexicon translation models. In AC L.
24. R. Herbrich, T. Graepel, and K. Obermayer. 1999. Support vector learning for ordinal regression. In ICANN.
25. M. Hopkins and J. May. 2011. Tuning as ranking. In EMNLP.
26. A. Ittycheriah and S. Roukos. 2007. Direct translation model 2. In HLT-NAACL.
27. D. Klein and C. D. Manning. 2003. Accurate unlexicalized parsing. In ACL.
28. P. Koehn, H. Hoang, A. Birch, C. Callison-Burch, M. Federico, N. Bertoldi, et al. 2007. Moses: Open source toolkit for statistical machine translation. In ACL, Demonstration Session.
29. J. Langford, A. J. Smola, and M. Zinkevich. 2009. Slow learners are fast. In NIPS.
30. P. Liang and D. Klein. 2009. Online EM for unsupervised models. In HLT-NAACL.
31. P. Liang, A. Bouchard-Côté, D. Klein, and B. Taskar. 2006a. An end-to-end discriminative approach to machine translation. In ACL.
32. P. Liang, B. Taskar, and D. Klein. 2006b. Alignment by agreement. In NAACL.
33. C.-Y. Lin and F. J. Och. 2004. ORANGE: a method for evaluating automatic evaluation metrics for machine translation. In COLING.
34. M. Maamouri, A. Bies, and S. Kulick. 2008. Enhancing the Arabic Treebank: A collaborative effort toward new annotation guidelines. In LREC.
35. M. Marcus, M. A. Marcinkiewicz, and B. Santorini. 1993. Building a large annotated corpus of English: The Penn Treebank. Computational Linguistics, 19:313-330.
36. R. McDonald, K. Hall, and G. Mann. 2010. Distributed training strategies for the structured perceptron. In NAACL-HLT.
37. 2 regularization, and rotational invariance. In ICML.
38. F. J. Och and H. Ney. 2002. Discriminative training and maximum entropy models for statistical machine translation. In ACL.
39. F. J. Och and H. Ney. 2004. The alignment template approach to statistical machine translation. Computational Linguistics, 30(4):417-449.
40. F. J. Och. 2003. Minimum error rate training for statistical machine translation. In ACL.
41. K. Papineni, S. Roukos, T. Ward, and W. Zhu. 2002. BLEU: a method for automatic evaluation of machine translation. In ACL.
42. S. Riezler and J. T. Maxwell. 2005. On some pitfalls in automatic evaluation and significance testing in MT. In ACL Workshop on Intrinsic and Extrinsic Evaluation Measures for Machine Translation and/or Summarization (MTSE).
43. P. Simianer, S. Riezler, and C. Dyer. 2012. Joint feature selection in distributed stochastic learning for largescale discriminative training in SMT. In ACL.
44. A Stolcke. 2002. SRILM-an extensible language modeling toolkit. In ICSLP.
45. C. Tillmann and T. Zhang. 2006. A discriminative global training algorithm for statistical MT. In ACL-COLING.
46. T. Watanabe, J. Suzuki, H. Tsukada, and H. Isozaki. 2007. Online large-margin training for statistical machine translation. In EMNLP-CoNLL.
47. T. Watanabe. 2012. Optimized online rank learning for machine translation. In HLT-NAACL. Association for Computational Linguistics.
48. B. Xiang and A. Ittycheriah. 2011. Discriminative feature-tied mixture modeling for statistical machine translation. In ACL-HLT.
49. N. Xue, F. Xia, F. Chiou, and M. Palmer. 2005. The Penn Chinese Treebank: Phrase structure annotation of a large corpus. Natural Language Engineering, 11(2):207-238.