Multiview LSA: Representation learning via generalized CCA

NAACL HLT 2015 - 2015 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Proceedings of the Conference

Volumn , Issue , 2015, Pages 556-566

  Rastogi, Pushpendre ^a   Van Durme, Benjamin ^a   Arora, Raman ^a  

^a Johns Hopkins University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

SEMANTICS;

APPROXIMATE COMPUTATION; GENERALIZED CANONICAL CORRELATION ANALYSIS; HANDLING MISSING VALUES; LATENT SEMANTIC ANALYSIS; MULTI-VIEWS; STATE OF THE ART; TEST SETS; VECTOR REPRESENTATIONS;

COMPUTATIONAL LINGUISTICS;

EID: 84960153345     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.3115/v1/n15-1058     Document Type: Conference Paper

References (59)

1. Eneko Agirre, Enrique Alfonseca, Keith Hall, Jana Kravalova, Marius Pasça, and Aitor Soroa. 2009. A study on similarity and relatedness using distributional and wordnet-based approaches. In Proceedings of NAACL-HLT. ACL.
2. Rami Al-Rfou, Bryan Perozzi, and Steven Skiena. 2013. Polyglot: Distributed word representations for multilingual nlp. In Proceedings of CoNLL. ACL.
3. Animashree Anandkumar, Rong Ge, Daniel Hsu, Sham M. Kakade, and Matus Telgarsky. 2014. Tensor decompositions for learning latent variable models. JMLR, 15.
4. Raman Arora and Karen Livescu. 2012. Kernel CCA for multi-view learning of acoustic features using articulatory measurements. MLSLP.
5. Francis R Bach and Michael I Jordan. 2005. A probabilistic interpretation of canonical correlation analysis. Technical Report 688, Department of Statistics, University of California, Berkeley.
6. Colin Bannard and Chris Callison-Burch. 2005. Paraphrasing with bilingual parallel corpora. In Proceedings of ACL. ACL.
7. Mohit Bansal, Kevin Gimpel, and Karen Livescu. 2014. Tailoring continuous word representations for dependency parsing. In Proceedings of ACL. ACL.
8. Rahul Bhagat and Deepak Ravichandran. 2008. Large scale acquisition of paraphrases for learning surface patterns. In Proceedings of ACL-HLT.
9. Avrim Blum and Tom Mitchell. 1998. Combining labeled and unlabeled data with co-training. In Proceedings of COLT. ACM.
10. Matthew Brand. 2002. Incremental singular value decomposition of uncertain data with missing values. In Computer Vision-ECCV 2002, pages 707-720. Springer.
11. Matthew Brand. 2006. Fast low-rank modifications of the thin singular value decomposition. Linear algebra and its applications, 415(1).
12. Ulf Brefeld, Thomas Gärtner, Tobias Scheffer, and Stefan Wrobel. 2006. Efficient co-regularised least squares regression. In Proceedings of ICML. ACM.
13. Elia Bruni, Gemma Boleda, Marco Baroni, and Nam-Khanh Tran. 2012. Distributional semantics in technicolor. In Proceedings of ACL. ACL.
14. J Douglas Carroll. 1968. Generalization of canonical correlation analysis to three or more sets of variables. In Proceedings of APA, volume 3.
15. Tsz Ping Chan, Chris Callison-Burch, and Benjamin Van Durme. 2011. Reranking bilingually extracted paraphrases using monolingual distributional similarity. In Proceedings of EMNLP Workshop: GEMS.
16. Michael Collins and Yoram Singer. 1999. Unsupervised models for named entity classification. In Proceedings of EMNLP. ACL.
17. Ronan Collobert and Rémi Lebret. 2013. Word embeddings through hellinger pca. Technical report, Idiap.
18. Paramveer Dhillon, Dean Foster, and Lyle Ungar. 2011. Multi-view learning of word embeddings via CCA. In Procesdings of NIPS.
19. Paramveer Dhillon, Jordan Rodu, Dean P Foster, and Lyle H Ungar. 2012. Two step CCA: A new spectral method for estimating vector models of words. In Proceedings of ICML. ACM.
20. Manaal Faruqui and Chris Dyer. 2014. Improving vector space word representations using multilingual correlation. In Proceedings of EACL.
21. Manaal Faruqui, Jesse Dodge, Sujay Jauhar, Chris Dyer, Eduard Hovy, and Noah Smith. 2014. Retrofitting word vectors to semantic lexicons. In Proceedings of the deep learning and representation learning workshop, NIPS.
22. Lev Finkelstein, Evgeniy Gabrilovich, Yossi Matias, Ehud Rivlin, Zach Solan, Gadi Wolfman, and Eytan Ruppin. 2001. Placing search in context: The concept revisited. In Proceedings of WWW. ACM.
23. Kuzman Ganchev, Joao Graca, John Blitzer, and Ben Taskar. 2008. Multi-view learning over structured and non-identical outputs. In Proceedings of UAI.
24. Juri Ganitkevitch, Benjamin Van Durme, and Chris Callison-Burch. 2013. Ppdb: The paraphrase database. In Proceedings of NAACL-HLT.
25. Nizar Habash and Bonnie Dorr. 2003. Catvar: A database of categorial variations for english. In Proceedings of MT Summit.
26. Trevor Hastie, Robert Tibshirani, and Jerome Friedman. 2009. The Elements Of Statistical Learning, volume 2. Springer.
27. Felix Hill and Anna Korhonen. 2014. Learning abstract concept embeddings from multi-modal data: Since you probably can't see what i mean. In Proceedings of EMNLP. ACL.
28. Felix Hill, KyungHyun Cho, Sebastien Jean, Coline Devin, and Yoshua Bengio. 2014a. Not all neural embeddings are born equal. arXiv preprint arXiv:1410.0718.
29. Felix Hill, Roi Reichart, and Anna Korhonen. 2014b. Simlex-999: Evaluating semantic models with (genuine) similarity estimation. arXiv preprint arXiv:1408.3456.
30. Paul Horst. 1961. Generalized canonical correlations and their applications to experimental data. Journal of Clinical Psychology, 17(4).
31. Eric H. Huang, Richard Socher, Christopher D. Manning, and Andrew Y. Ng. 2012. Improving word representations via global context and multiple word prototypes. In Proceedings of ACL. ACL.
32. Sham M Kakade and Dean P Foster. 2007. Multiview regression via canonical correlation analysis. In Learning Theory. Springer.
33. Jon R Kettenring. 1971. Canonical analysis of several sets of variables. Biometrika, 58(3):433-451.
34. Thomas K Landauer and Susan T Dumais. 1997. A solution to plato's problem: The latent semantic analysis theory of acquisition, induction, and representation of knowledge. Psychological review, 104(2):211.
35. Omer Levy and Yoav Goldberg. 2014. Dependencybased word embeddings. In Proceedings of ACL. ACL.
36. Minh-Thang Luong, Richard Socher, and Christopher D. Manning. 2013. Better word representations with recursive neural networks for morphology. In Proceedings of CoNLL. ACL.
37. Quinn McNemar. 1947. Note on the sampling error of the difference between correlated proportions or percentages. Psychometrika, 12(2).
38. Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg Corrado, and Jeff Dean. 2013a. Distributed representations of words and phrases and their compositionality. In Proceedings of NIPS.
39. Tomas Mikolov, Wen-tau Yih, and Geoffrey Zweig. 2013b. Linguistic regularities in continuous space word representations. In Proceedings of NAACL-HLT, pages 746-751.
40. George A. Miller and Walter G. Charles. 1991. Contextual correlates of semantic similarity. Language and Cognitive Processes, 6(1).
41. Guido Minnen, John Carroll, and Darren Pearce. 2001. Applied morphological processing of english. Natural Language Engineering, 7(03).
42. Courtney Napoles, Matthew Gormley, and Benjamin Van Durme. 2012. Annotated gigaword. In Proceedings of NAACL Workshop: AKBC-WEKEX.
43. Jeffrey Pennington, Richard Socher, and Christopher D. Manning. 2014. Glove: global vectors for word representation. In Proceedings of EMNLP. ACL.
44. Kira Radinsky, Eugene Agichtein, Evgeniy Gabrilovich, and Shaul Markovitch. 2011. A word at a time: Computing word relatedness using temporal semantic analysis. In Proceedings of WWW. ACM.
45. Pushpendre Rastogi and Benjamin Van Durme. 2014. Augmenting framenet via PPDB. In Proceedings of the Second Workshop on EVENTS: Definition, Detection, Coreference, and Representation. ACL.
46. Deepak Ravichandran, Patrick Pantel, and Eduard Hovy. 2005. Randomized algorithms and nlp: Using locality sensitive hash functions for high speed noun clustering. In Proceedings of ACL.
47. Herbert Rubenstein and John B. Goodenough. 1965. Contextual correlates of synonymy. Communications of the ACM, 8(10).
48. Dmitry Savostyanov. 2014. Efficient way to find svd of sum of projection matrices? MathOverflow. URL:http://mathoverflow.net/q/178573 (version: 2014-08-14).
49. Karthik Sridharan and Sham M Kakade. 2008. An information theoretic framework for multi-view learning. In Proceedings of COLT.
50. James H Steiger. 1980. Tests for comparing elements of a correlation matrix. Psychological Bulletin, 87(2).
51. Peter D Turney and Patrick Pantel. 2010. From frequency to meaning: Vector space models of semantics. Journal of AI Research, 37(1).
52. Michel Van De Velden and Tammo HA Bijmolt. 2006. Generalized canonical correlation analysis of matrices with missing rows: a simulation study. Psychometrika, 71(2).
53. Michel van de Velden and Yoshio Takane. 2012. Generalized canonical correlation analysis with missing values. Computational Statistics, 27(3).
54. Javier Vía, Ignacio Santamaría, and Jesús Pérez. 2007. A learning algorithm for adaptive canonical correlation analysis of several data sets. Neural Networks, 20(1).
55. Jason Weston, Sumit Chopra, and Keith Adams. 2014. #tagspace: Semantic embeddings from hashtags. In Proceedings of EMNLP, Doha, Qatar. ACL.
56. Terry Winograd. 1972. Understanding natural language. Cognitive psychology, 3(1):1-191.
57. David Yarowsky. 1995. Unsupervised WSD rivaling supervised methods. In Proceedings of ACL. ACL.
58. Mo Yu and Mark Dredze. 2014. Improving lexical embeddings with semantic knowledge. In Proceedings of ACL. ACL.
59. Will Zou, Richard Socher, Daniel Cer, and Christopher Manning. 2013. Bilingual word embeddings for phrase-based machine translation. In Proceedings of EMNLP. ACL.