Adversarial training for unsupervised bilingual lexicon induction

ACL 2017 - 55th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference (Long Papers)

Volumn 1, Issue , 2017, Pages 1959-1970

  Zhang, Meng ^a,b   Liu, Yang ^a,b   Luan, Huanbo ^a   Sun, Maosong ^b  

^a TSINGHUA UNIVERSITY   (China)

^b Jiangsu Collaborative Innovation Center for Language Competence   (China)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS;

BILINGUAL LEXICONS; CROSS-LINGUAL; EMBEDDINGS; PARALLEL CORPORA;

LINGUISTICS;

EID: 85040922305     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.18653/v1/P17-1179     Document Type: Conference Paper

References (38)

1. Waleed Ammar, George Mulcaire, Yulia Tsvetkov, Guillaume Lample, Chris Dyer, and Noah A. Smith. 2016. Massively Multilingual Word Embeddings. arXiv:1602.01925 [cs] http://arxiv.org/abs/1602.01925.
2. Martin Arjovsky and Léon Bottou. 2017. Towards Principled Methods For Training Generative Adversarial Networks. In ICLR. http://arxiv.org/abs/1701.04862.
3. Mikel Artetxe, Gorka Labaka, and Eneko Agirre. 2016. Learning principled bilingual mappings of word embeddings while preserving monolingual invariance. In EMNLP. http://aclanthology.info/papers/learning-principled-bilingual-mappings-of-word-embeddings-while-preserving-monolingual-invariance.
4. Antonio Valerio Miceli Barone. 2016. Towards cross-lingual distributed representations without parallel text trained with adversarial autoencoders. In Proceedings of the 1st Workshop on Representation Learning for NLP. https://doi.org/10.18653/v1/W16-1614.
5. Chris M. Bishop. 1995. Training with Noise is Equivalent to Tikhonov Regularization. Neural Comput. https://doi.org/10.1162/neco.1995.7.1.108.
6. Hailong Cao, Tiejun Zhao, Shu Zhang, and Yao Meng. 2016. A Distribution-based Model to Learn Bilingual Word Embeddings. In COLING. http://aclanthology.info/papers/a-distributionbased-model-to-learn-bilingual-word-embeddings.
7. Sarath Chandar A P, Stanislas Lauly, Hugo Larochelle, Mitesh Khapra, Balaraman Ravindran, Vikas C Raykar, and Amrita Saha. 2014. An Autoencoder Approach to Learning Bilingual Word Representations. In NIPS. http://papers.nips.cc/paper/5270-an-autoencoder-approach-to-learning-bilingual-word-representations.pdf.
8. Xilun Chen, Yu Sun, Ben Athiwaratkun, Claire Cardie, and Kilian Weinberger. 2016. Adversarial Deep Averaging Networks for Cross-Lingual Sentiment Classification. arXiv:1606.01614 [cs] http://arxiv.org/abs/1606.01614.
9. Jocelyn Coulmance, Jean-Marc Marty, Guillaume Wenzek, and Amine Benhalloum. 2015. Trans-gram, Fast Cross-lingual Word-embeddings. In EMNLP. http://aclanthology.info/papers/transgram-fast-cross-lingual-word-embeddings.
10. Hal Daumé III and Jagadeesh Jagarlamudi. 2011. Domain adaptation for machine translation by mining unseen words. In ACL-HLT. http://aclweb.org/anthology/P11-2071.
11. Georgiana Dinu, Angeliki Lazaridou, and Marco Ba-roni. 2015. Improving Zero-Shot Learning by Mitigating the Hubness Problem. In ICLR Workshop. http://arxiv.org/abs/1412.6568.
12. Qing Dou and Kevin Knight. 2012. Large scale decipherment for out-of-domain machine translation. In EMNLP-CoNLL. http://aclweb.org/anthology/D121025.
13. Qing Dou and Kevin Knight. 2013. Dependency-Based Decipherment for Resource-Limited Machine Translation. In EMNLP. http://aclanthology.info/papers/dependency-based-decipherment-for-resource-limited-machine-translation.
14. Qing Dou, Ashish Vaswani, Kevin Knight, and Chris Dyer. 2015. Unifying Bayesian Inference and Vector Space Models for Improved Decipherment. In ACL-IJCNLP. http://www.aclweb.org/anthology/P15-1081.
15. Long Duong, Hiroshi Kanayama, Tengfei Ma, Steven Bird, and Trevor Cohn. 2016. Learning Crosslingual Word Embeddings without Bilingual Corpora. In EMNLP. http://aclanthology.info/papers/learning-crosslingual-word-embeddings-without-bilingual-corpora.
16. Manaal Faruqui and Chris Dyer. 2014. Improving Vector Space Word Representations Using Multilingual Correlation. In EACL. http://aclanthology.info/papers/improving-vector-space-word-representations-using-multilingual-correlation.
17. Pascale Fung and Percy Cheung. 2004. Mining Very-Non-Parallel Corpora: Parallel Sentence and Lexicon Extraction via Bootstrapping and EM. In EMNLP. http://aclweb.org/anthology/W04-3208.
18. Yaroslav Ganin, Evgeniya Ustinova, Hana Ajakan, Pascal Germain, Hugo Larochelle, François Lavi-olette, Mario Marchand, and Victor Lempitsky. 2016. Domain-Adversarial Training of Neural Networks. Journal of Machine Learning Research http://jmlr.org/papers/v17/15-239.html.
19. Eric Gaussier, J.M. Renders, I. Matveeva, C. Goutte, and H. Dejean. 2004. A Geometric View on Bilingual Lexicon Extraction from Comparable Corpora. In ACL. https://doi.org/10.3115/1218955.1219022.
20. Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. 2014. Generative Adversarial Nets. In NIPS. http://papers.nips.cc/paper/5423-generative-adversarial-nets.pdf.
21. Stephan Gouws, Yoshua Bengio, and Greg Corrado. 2015. BilBOWA: Fast Bilingual Distributed Representations without Word Alignments. In ICML. http://jmlr.org/proceedings/papers/v37/gouws15.html.
22. Stephan Gouws and Anders Søgaard. 2015. Simple task-specific bilingual word embeddings. In NAACL-HLT. http://www.aclweb.org/anthology/N15-1157.
23. Nitish Srivastava, Geoffrey Hinton, Alex Krizhevsky, Ilya Sutskever, and Ruslan Salakhutdinov. 2014. Dropout: A Simple Way to Prevent Neural Networks from Overfitting. Journal of Machine Learning Research http://www.jmlr.org/papers/v15/srivastava14a.html.
24. Stephanie Strassel and Jennifer Tracey. 2016. LORELEI Language Packs: Data, Tools, and Resources for Technology Development in Low Resource Languages. In LREC. http://www.lrecconf.org/proceedings/lrec2016/pdf/1138 Paper.pdf.
25. Shyam Upadhyay, Manaal Faruqui, Chris Dyer, and Dan Roth. 2016. Cross-lingual Models of Word Embeddings: An Empirical Comparison. In ACL. http://aclanthology.info/papers/cross-lingual-models-of-word-embeddings-an-empirical-comparison.
26. Laurens Van der Maaten, Minmin Chen, Stephen Tyree, and Kilian Weinberger. 2013. Learning with Marginalized Corrupted Features. In ICML. http://www.jmlr.org/proceedings/papers/v28/vandermaaten13.html.
27. Ivan Vulic and Anna Korhonen. 2016. On the Role of Seed Lexicons in Learning Bilingual Word Embeddings. In ACL. http://aclanthology.info/papers/on-the-role-of-seed-lexicons-in-learning-bilingual-word-embeddings.
28. Ivan Vulic and Marie-Francine Moens. 2013. Cross-Lingual Semantic Similarity of Words as the Similarity of Their Semantic Word Responses. In NAACL-HLT. http://aclanthology.info/papers/ cross-lingual-semantic-similarity-of-words-as-the-similarity-of-their-semantic-word-responses.
29. Ivan Vulic and Marie-Francine Moens. 2015. Bilingual Word Embeddings from Non-Parallel Document-Aligned Data Applied to Bilingual Lexicon Induction. In ACL-IJCNLP. http://aclanthology.info/papers/bilingual-word-embeddings-from-non-parallel-document-aligned-data-applied-to-bilingual-lexicon-induction.
30. Ivan Vulic, Wim De Smet, and Marie-Francine Moens. 2011. Identifying Word Translations from Comparable Corpora Using Latent Topic Models. In ACL-HLT. http://aclanthology.info/papers/ identifying-word-translations-from-comparable-corpora-using-latent-topic-models.
31. Stefan Wager, Sida Wang, and Percy S Liang. 2013. Dropout Training as Adaptive Regularization. In NIPS. http://papers.nips.cc/paper/4882-dropouttraining-as-adaptive-regularization.pdf.
32. Michael Wick, Pallika Kanani, and Adam Pocock. 2016. Minimally-Constrained Multilingual Embeddings via Artificial Code-Switching. In AAAI. http://www.aaai.org/Conferences/AAAI/2016/Papers/15Wick12464.pdf.
33. Chao Xing, Dong Wang, Chao Liu, and Yiye Lin. 2015. Normalized Word Embedding and Orthogonal Transform for Bilingual Word Translation. In NAACL-HLT. http://aclanthology.info/papers/ normalized-word-embedding-and-orthogonal-transform-for-bilingual-word-translation.
34. Hyejin Youn, Logan Sutton, Eric Smith, Cristopher Moore, Jon F. Wilkins, Ian Maddieson, William Croft, and Tanmoy Bhattacharya. 2016. On the universal structure of human lexical semantics. Proceedings of the National Academy of Sciences https://doi.org/10.1073/pnas.1520752113.
35. Meng Zhang, Yang Liu, Huanbo Luan, Yiqun Liu, and Maosong Sun. 2016a. Inducing Bilingual Lexica From Non-Parallel Data With Earth Mover's Distance Regularization. In COLING. http://aclanthology.info/papers/inducing-bilingual-lexica-from-non-parallel-data-with-earth-mover-s-distance-regularization.
36. Meng Zhang, Haoruo Peng, Yang Liu, Huanbo Luan, and Maosong Sun. 2017. Bilingual Lexicon Induction From Non-Parallel Data With Minimal Supervision. In AAAI. http://thunlp.org/zm/publications/aaai2017.pdf.
37. Yuan Zhang, David Gaddy, Regina Barzilay, and Tommi Jaakkola. 2016b. Ten Pairs to Tag - Multilingual POS Tagging via Coarse Mapping between Embeddings. In NAACL-HLT. http://aclanthology.info/papers/ten-pairs-to-tag-multilingual-pos-tagging-via-coarse-mapping-between-embeddings.
38. Will Y. Zou, Richard Socher, Daniel Cer, and Christopher D. Manning. 2013. Bilingual Word Embeddings for Phrase-Based Machine Translation. In EMNLP. http://aclanthology.info/papers/ bilingual-word-embeddings-for-phrase-based-machine-translation.