Scaling to Large3 data: An efficient and effective method to compute Distributional Thesauri

EMNLP 2013 - 2013 Conference on Empirical Methods in Natural Language Processing, Proceedings of the Conference

Volumn , Issue , 2013, Pages 884-890

  Riedl, Martin ^a   Biemann, Chris ^a  

^a DARMSTADT UNIVERSITY OF TECHNOLOGY   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

LINGUISTICS; THESAURI;

COMPUTATIONAL RESOURCES; DISTRIBUTED FRAMEWORK; LARGE CORPORA; LEXICAL RESOURCES; N-GRAMS; PRUNING TECHNIQUES; SCALABLE APPROACH;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 84906925892     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (30)

1. Eneko Agirre, Enrique Alfonseca, Keith Hall, Jana Kravalova, Marius Paşca, and Aitor Soroa. 2009. A study on similarity and relatedness using distributional and wordnet-based approaches. In Proceedings of Human Language Technologies: The 2009 Annual Conference of the North American Chapter of the Association for Computational Linguistics, NAACL'09, pages 19-27, Boulder, Colorado, USA.
2. Michele Banko and Eric Brill. 2001. Scaling to very very large corpora for natural language disambiguation. In Proceedings of the 39th Annual Meeting on Association for Computational Linguistics, ACL'01, pages 26-33, Toulouse, France.
3. Chris Biemann and Martin Riedl. 2013. Text: Now in 2D! a framework for lexical expansion with contextual similarity. Journal of Language Modelling, 1(1): 55-95.
4. David M. Blei, Andrew Y. Ng, and Michael I. Jordan. 2003. Latent dirichlet allocation. Journal of Machine Learning Research, 3: 993-1022.
5. Stefan Bordag. 2008. A comparison of co-occurrence and similarity measures as simulations of context. In CICLing'08 Proceedings of the 9th international conference on Computational linguistics and intelligent text processing, pages 52-63, Haifa, Israel.
6. Thorsten Brants, Ashok C. Popat, Peng Xu, Franz J. Och, and Jeffrey Dean. 2007. Large language models in machine translation. In Proceedings of the 2007 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (EMNLP-CoNLL), pages 858-867, Prague, Czech Republic.
7. Kenneth Ward Church and Patrick Hanks. 1990. Word association norms, mutual information, and lexicography. Computational Linguistics, 16(1): 22-29.
8. James R. Curran. 2002. Ensemble methods for automatic thesaurus extraction. In Proceedings of the ACL-02 conference on Empirical methods in natural language processing - Volume 10, EMNLP'02, pages 222-229, Philadelphia, PA, USA.
9. James R. Curran. 2004. From Distributional to Semantic Similarity. Ph.D. thesis, University of Edinburgh.
10. Jeffrey Dean and Sanjay Ghemawat. 2004. MapReduce: Simplified Data Processing on Large Clusters. In Proceedings of Operating Systems, Desing & Implementation (OSDI)'04, pages 137-150, San Francisco, CA, USA.
11. Stefan Evert. 2005. The Statistics of Word Cooccurrences: Word Pairs and Collocations. Ph.D. thesis, Institut für maschinelle Sprachverarbeitung, University of Stuttgart.
12. ∗SEM), Volume 1: Proceedings of the Main Conference and the Shared Task: Semantic Textual Similarity, pages 241-247, Atlanta, Georgia, USA.
13. Gene H. Golub and William M. Kahan. 1965. Calculating the singular values and pseudo-inverse of a matrix. J. Soc. Indust. Appl. Math.: Ser. B, Numer. Anal., 2: 205-224.
14. James Gorman and James R. Curran. 2006. Scaling distributional similarity to large corpora. In Proceedings of the 21st International Conference on Computational Linguistics and the 44th annual meeting of the Association for Computational Linguistics, ACL-44, pages 361-368, Sydney, Australia.
15. Amit Goyal and Hal Daumé, III. 2011. Generating semantic orientation lexicon using large data and thesaurus. In Proceedings of the 2nd Workshop on Computational Approaches to Subjectivity and Sentiment Analysis, WASSA'11, pages 37-43, Portland, Oregon, USA.
16. Amit Goyal, Jagadeesh Jagarlamudi, Hal Daumé, III, and Suresh Venkatasubramanian. 2010. Sketch techniques for scaling distributional similarity to the web. In Proceedings of the 2010 Workshop on GEometrical Models of Natural Language Semantics, GEMS'10, pages 51-56, Uppsala, Sweden.
17. Dekang Lin. 1997. Using syntactic dependency as local context to resolve word sense ambiguity. In Proceedings of the 35th Annual Meeting of the Association for Computational Linguistics and Eighth Conference of the European Chapter of the Association for Computational Linguistics, ACL'98, pages 64-71, Madrid, Spain.
18. Dekang Lin. 1998. Automatic retrieval and clustering of similar words. In Proceedings of the 17th international conference on Computational linguistics - Volume 2, COLING'98, pages 768-774, Montreal, Quebec, Canada.
19. Kevin Lund and Curt Burgess. 1996. Producing high-dimensional semantic spaces from lexical cooccurrence. Behavior Research Methods, 28(2): 203-208.
20. Marie-Catherine De Marneffe, Bill Maccartney, and Christopher D. Manning. 2006. Generating typed dependency parses from phrase structure parses. In Proceedings of the International Conference on Language Resources and Evaluation, LREC 2006, Genova, Italy.
21. George A. Miller. 1995. Wordnet: A lexical database for english. Communications of the ACM, 38: 39-41.
22. Patrick Pantel and Dekang Lin. 2002. Discovering word senses from text. In Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining, KDD'02, pages 613-619, Edmonton, Alberta, Canada.
23. Patrick Pantel, Eric Crestan, Arkady Borkovsky, AnaMaria Popescu, and Vishnu Vyas. 2009. Web-scale distributional similarity and entity set expansion. In Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing: Volume 2 - Volume 2, EMNLP'09, pages 938-947, Singapore.
24. Robert Parker, David Graff, Junbo Kong, Ke Chen, and Kazuaki Maeda. 2011. English Gigaword Fifth Edition. Linguistic Data Consortium, Philadelphia, PA, USA.
25. Ted Pedersen, Siddharth Patwardhan, and Jason Michelizzi. 2004. Wordnet: similarity: measuring the relatedness of concepts. In Demonstration Papers at HLT-NAACL 2004, HLT-NAACL-Demonstrations '04, pages 38-41, Boston, Massachusetts, USA.
26. Matthias Richter, Uwe Quasthoff, Erla Hallsteinsdóttir, and Chris Biemann. 2006. Exploiting the leipzig corpora collection. In Proceedings of the IS-LTC 2006, Ljubljana, Slovenia.
27. Pavel Rychlý and Adam Kilgarriff. 2007. An efficient algorithm for building a distributional thesaurus (and other sketch engine developments). In Proceedings of the 45th Annual Meeting of the ACL on Interactive Poster and Demonstration Sessions, ACL'07, pages 41-44, Prague, Czech Republic.
28. Magnus Sahlgren. 2006. The Word-Space Model: using distributional analysis to represent syntagmatic and paradigmatic relations between words in high-dimensional vector spaces. Ph.D. thesis, Stockholm University.
29. Peter D. Turney and Michael L. Littman. 2005. Corpus-based learning of analogies and semantic relations. Machine Learning, 60(1-3): 251-278.
30. Julie Weeds, David Weir, and Diana McCarthy. 2004. Characterising measures of lexical distributional similarity. In Proceedings of the 20th international conference on Computational Linguistics, COLING'04, pages 1015-1021, Geneva, Switzerland.