Large-scale discriminative training for statistical machine translation using held-out line search

NAACL HLT 2013 - 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Proceedings of the Main Conference

Volumn , Issue , 2013, Pages 248-258

  Flanigan, Jeffrey ^a   Dyer, Chris ^a   Carbonell, Jaime ^a  

^a Carnegie Mellon University ^*  (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS; COMPUTER AIDED LANGUAGE TRANSLATION; MACHINE TRANSLATION; NATURAL LANGUAGE PROCESSING SYSTEMS;

DISCRIMINATIVE LEARNING; DISCRIMINATIVE TRAINING; LARGE-SCALES; LEARNING PARAMETERS; LINE SEARCHES; MACHINE TRANSLATIONS; OVERFITTING; SPARSE FEATURES; STATISTICAL MACHINE TRANSLATION; TWO PHASE;

LEARNING ALGORITHMS;

EID: 84961320916     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (31)

1. Phil Blunsom, Trevor Cohn, and Miles Osborne. 2008. A discriminative latent variable model for statistical machine translation. In Proc. ACL-HLT.
2. Léon Bottou. 1998. Online algorithms and stochastic approximations. In David Saad, editor, Online Learning and Neural Networks. Cambridge University Press, Cambridge, UK. revised, oct 2012.
3. Léon Bottou. 2010. Large-scale machine learning with stochastic gradient descent. In Yves Lechevallier and Gilbert Saporta, editors, Proceedings of the 19th International Conference on Computational Statistics (COMPSTAT'2010), pages 177-187, Paris, France, August. Springer.
4. V. Chahuneau, N. A. Smith, and C. Dyer. 2012. pycdec: A python interface to cdec. The Prague Bulletin of Mathematical Linguistics, 98:51-61.
5. Colin Cherry and George Foster. 2012. Batch tuning strategies for statistical machine translation. In Proc. of NAACL.
6. David Chiang, Yuval Marton, and Philip Resnik. 2008. Online large-margin training of syntactic and structural translation features. In Proceedings of the Conference on Empirical Methods in Natural Language Processing, EMNLP '08, pages 224-233, Stroudsburg, PA, USA. Association for Computational Linguistics.
7. David Chiang. 2005. A hierarchical phrase-based model for statistical machine translation. In In ACL, pages 263-270.
8. David Chiang. 2012. Hope and fear for discriminative training of statistical translation models. Journal of Machine Learning Research, pages 1159-1187.
9. Jonathan H. Clark, Chris Dyer, Alon Lavie, and Noah A. Smith. 2011. Better hypothesis testing for statistical machine translation: Controlling for optimizer instability. In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies: short papers-Volume 2, HLT '11, pages 176-181, Stroudsburg, PA, USA.Association for Computational Linguistics.
10. Michael Denkowski and Alon Lavie. 2011. Meteor 1. 3: Automatic Metric for Reliable Optimization and Evaluation of Machine Translation Systems. In Proceedings of the EMNLP 2011 Workshop on Statistical Machine Translation.
11. Chris Dyer, Adam Lopez, Juri Ganitkevitch, Johnathan Weese, Ferhan Ture, Phil Blunsom, Hendra Setiawan, Vladimir Eidelman, and Philip Resnik. 2010. cdec: A decoder, alignment, and learning framework for finitestate and context-free translation models. In Proceedings of ACL.
12. Kevin Gimpel and Noah A. Smith. 2012. Structured ramp loss minimization for machine translation. In Proc. of NAACL.
13. K. Gimpel. 2012. Discriminative Feature-Rich Modeling for Syntax-Based Machine Translation. Ph. D. Thesis, Carnegie Mellon University.
14. Kenneth Heafield. 2011. KenLM: Faster and smaller language model queries. In Proceedings of the Sixth Workshop on Statistical Machine Translation, Edinburgh, UK, July. Association for Computational Linguistics.
15. Mark Hopkins and Jonathan May. 2011. Tuning as ranking. In Proc. of EMNLP.
16. Percy Liang, Alexandre Bouchard-coté, Dan Klein, and Ben Taskar. 2006. An end-to-end discriminative approach to machine translation. In In Proceedings of the Joint International Conference on Computational Linguistics and Association of Computational Linguistics (COLING/ACL, pages 761-768.
17. Preslav Nakov, Francisco Guzmán, and Stephan Vogel. 2012. Optimizing for sentence-level bleu+1 yields short translations. In Martin Kay and Christian Boitet, editors, COLING, pages 1979-1994. Indian Institute of Technology Bombay.
18. Jorge Nocedal and Stephen J. Wright. 2000. Numerical Optimization. Springer.
19. Franz Josef Och and Hermann Ney. 2002. Discriminative training and maximum entropy models for statistical machine translation. In Proc. of ACL.
20. Franz Josef Och and Hermann Ney. 2003. A systematic comparison of various statistical alignment models. Comput. Linguist., 29(1):19-51, March.
21. Franz Josef Och. 2003. Minimum error rate training in statistical machine translation. In Proc. of ACL.
22. Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002. Bleu: A method for automatic evaluation of machine translation. In Proceedings of the 40th Annual Meeting on Association for Computational Linguistics, ACL '02, pages 311-318, Stroudsburg, PA, USA. Association for Computational Linguistics.
23. Antti-Veiko Rosti, Bing Zhang, Spyros Matsoukas, and Richard Schwartz. 2010. BBN system description for WMT10 system combination task. In Proc. WMT.
24. Avneesh Saluja, Ian Lane, and Joy Zhang. 2012. Machine Translation with Binary Feedback: A largemargin approach. In Proceedings of The Tenth Biennial Conference of the Association for Machine Translation in the Americas, San Diego, CA, July.
25. Patrick Simianer, Chris Dyer, and Stefan Riezler. 2012. Joint feature selection in distributed stochastic learning for large-scale discriminative training in SMT. In Proc. ACL.
26. David A. Smith and Jason Eisner. 2006. Minimum risk annealing for training log-linear models. In Proc. of ACL.
27. Andreas Stolcke. 2002. Srilm-An extensible language modeling toolkit. pages 901-904.
28. Christoph Tillmann and Tong Zhang. 2006. A discriminative global training algorithm for statistical mt. In Proceedings of the 21st International Conference on Computational Linguistics and the 44th annual meeting of the Association for Computational Linguistics, ACL-44, pages 721-728, Stroudsburg, PA, USA. Association for Computational Linguistics.
29. Ioannis Tsochantaridis, Thomas Hofmann, Thorsten Joachims, and Yasemin Altun. 2004. Support vector machine learning for interdependent and structured output spaces. In Proceedings of the twenty-first international conference on Machine learning, ICML '04, pages 104-, New York, NY, USA. ACM.
30. TaroWatanabe, Jun Suzuki, Hajime Tsukada, and Hideki Isozaki. 2007. Online large-margin training for statistical machine translation. In Proc. EMNLP-CoNLL.
31. Jonathan Weese, Juri Ganitkevitch, Chris Callison-Burch, Matt Post, and Adam Lopez. 2011. Joshua 3. 0: syntax-based machine translation with the thrax grammar extractor. In Proceedings of the Sixth Workshop on Statistical Machine Translation, WMT '11, pages 478-484, Stroudsburg, PA, USA. Association for Computational Linguistics.