An autoencoder approach to learning bilingual word representations

Advances in Neural Information Processing Systems

Volumn 3, Issue January, 2014, Pages 1853-1861

  Sarath, Chandar A P ^a   Lauly, Stanislas ^b   Larochelle, Hugo ^b   Khapra, Mitesh M ^c   Ravindran, Balaraman ^a   Raykar, Vikas ^c   Saha, Amrita ^c  

^a INDIAN INSTITUTE OF TECHNOLOGY MADRAS   (India)

^b UNIVERSITÉ DE SHERBROOKE   (Canada)

^c IBM RESEARCH   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALIGNMENT; CLASSIFICATION (OF INFORMATION); INFORMATION SCIENCE; LEARNING SYSTEMS; LINGUISTICS; TEXT PROCESSING;

ALIGNED SENTENCES; CROSS LANGUAGES; MACHINE TRANSLATIONS; PARALLEL CORPORA; STATE-OF-THE-ART PERFORMANCE; TEXT CLASSIFICATION; WORD ALIGNMENT; WORD REPRESENTATIONS;

COMPUTATIONAL LINGUISTICS;

EID: 84929385996     PISSN: 10495258     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (26)

1. Kristina Toutanova, Dan Klein, Christopher D. Manning, and Yoram Singer. Feature-rich part-of-speech tagging with a cyclic dependency network. In Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics, NAACL '03, pages 173-180, 2003.
2. Richard Socher, John Bauer, Christopher D. Manning, and Ng Andrew Y. Parsing with compositional vector grammars. In Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 455-465, Sofia, Bulgaria, August 2013.
3. Bing Liu. Sentiment Analysis and Opinion Mining. Synthesis Lectures on Human Language Technologies. Morgan & Claypool Publishers, 2012.
4. Joseph Turian, Lev Ratinov, and Yoshua Bengio. Word representations: A simple and general method for semi-supervised learning. In Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics (ACL2010), pages 384-394, 2010.
5. Ronan Collobert, Jason Weston, Léon Bottou, Michael Karlen, Koray Kavukcuoglu, and Pavel Kuksa. Natural Language Processing (Almost) from Scratch. Journal of Machine Learning Research, 12, 2011.
6. Susan T Dumais, Todd A Letsche, Michael L Littman, and Thomas K Landauer. Automatic cross-language retrieval using latent semantic indexing. AAAI spring symposium on cross-language text and speech retrieval, 15:21 1997.
7. John C. Platt, Kristina Toutanova, and Wen-tau Yih. Translingual document representations from discriminative projections. In Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing, EMNLP '10, pages 251-261, Stroudsburg, PA, USA, 2010.
8. Wen-tau Yih, Kristina Toutanova, John C. Platt, and Christopher Meek. Learning discriminative projections for text similarity measures. In Proceedings of the Fifteenth Conference on Computational Natural Language Learning, CoNLL '11, pages 247-256, Stroudsburg, PA, USA, 2011.
9. Alexandre Klementiev, Ivan Titov, and Binod Bhattarai. Inducing Crosslingual Distributed Representations of Words. In Proceedings of the International Conference on Computational Linguistics, 2012.
10. Will Y. Zou, Richard Socher, Daniel Cer, and Christopher D. Manning. Bilingual Word Embeddings for Phrase-Based Machine Translation. In Empirical Methods in Natural Language Processing, 2013.
11. Tomas Mikolov, Quoc Le, and Ilya Sutskever. Exploiting Similarities among Languages for Machine Translation. Technical report, arXiv, 2013.
12. Manaal Faruqui and Chris Dyer. Improving vector space word representations using multilingual correlation. In Proceedings of the 14th Conference of the European Chapter of the Association for Computational Linguistics, pages 462-471, Gothenburg, Sweden, April 2014.
13. David Yarowsky and Grace Ngai. Inducing multilingual pos taggers and np bracketers via robust projection across aligned corpora. In Proceedings of the second meeting of the North American Chapter of the Association for Computational Linguistics on Language technologies, pages 1-8, Pennsylvania, 2001.
14. Dipanjan Das and Slav Petrov. Unsupervised part-of-speech tagging with bilingual graph-based projections. In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, pages 600-609, Portland, Oregon, USA, June 2011.
15. Rada Mihalcea, Carmen Banea, and Janyce Wiebe. Learning multilingual subjective language via cross-lingual projections. In Proceedings of the 45th Annual Meeting of the Association of Computational Linguistics, pages 976-983, Prague, Czech Republic, June 2007.
16. Xiaojun Wan. Co-training for cross-lingual sentiment classification. In Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP, pages 235-243, Suntec, Singapore, August 2009.
17. Sebastian Padó and Mirella Lapata. Cross-lingual annotation projection for semantic roles. Journal of Artificial Intelligence Research (JAIR), 36:307-340, 2009.
18. Yann Dauphin, Xavier Glorot, and Yoshua Bengio. Large-Scale Learning of Embeddings with Reconstruction Sampling. In Proceedings of the 28th International Conference on Machine Learning (ICML 2011), pages 945-952. Omnipress, 2011.
19. Frederic Morin and Yoshua Bengio. Hierarchical Probabilistic Neural Network Language Model. In Proceedings of the 10th International Workshop on Artificial Intelligence and Statistics (AISTATS 2005), pages 246-252. Society for Artificial Intelligence and Statistics, 2005.
20. Andriy Mnih and Geoffrey E Hinton. A Scalable Hierarchical Distributed Language Model. In Advances in Neural Information Processing Systems 21 (NIPS 2008), pages 1081-1088, 2009.
21. Hugo Larochelle and Stanislas Lauly. A Neural Autoregressive Topic Model. In Advances in Neural Information Processing Systems 25 (NIPS 25), 2012.
22. Jianfeng Gao, Xiaodong He, Wen-tau Yih, and Li Deng. Learning continuous phrase representations for translation modeling. In Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 699-709, Baltimore, Maryland, June 2014.
23. Karl Moritz Hermann and Phil Blunsom. Multilingual models for compositional distributed semantics. In Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics, ACL 2014, June 22-27, 2014, Baltimore, MD, USA, Volume 1: Long Papers, pages 58-68, 2014.
24. Karl Moritz Hermann and Phil Blunsom. Multilingual Distributed Representations without Word Alignment. In Proceedings of International Conference on Learning Representations (ICLR), 2014.
25. Philipp Koehn. Europarl: A parallel corpus for statistical machine translation. In MT Summit, 2005.
26. Edward Loper Bird Steven and Ewan Klein. Natural Language Processing with Python. OReilly Media Inc., 2009.