A Bayesian method for robust estimation of distributional similarities

Proceedings of the Annual Meeting of the Association for Computational Linguistics

Volumn 2010-July, Issue , 2010, Pages 247-256

  Kazama, Jun'ichi ^a   de Saeger, Stijn ^a   Kuroda, Kow ^a   Murata, Masaki ^a,b   Torisawa, Kentaro ^a  

^a NATIONAL INSTITUTE OF INFORMATION AND COMMUNICATIONS TECHNOLOGY   (Japan)

^b TOTTORI UNIVERSITY   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS; NATURAL LANGUAGE PROCESSING SYSTEMS;

BAYESIAN ESTIMATIONS; BAYESIAN METHODS; CONTEXT PROFILES; DATA SPARSENESS; DISTRIBUTIONAL SIMILARITIES; POINT ESTIMATION; ROBUST ESTIMATION; SIMILARITY MEASURE; WORD CONTEXTS; WORD SIMILARITY;

BAYESIAN NETWORKS;

EID: 85118467698     PISSN: 0736587X     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (23)

1. A. Bhattacharyya. 1943. On a measure of divergence between two statistical populations defined by their probability distributions. Bull. Calcutta Math. Soc., 49:214-224.
2. Stanley F. Chen and Joshua Goodman. 1998. An empirical study of smoothing techniques for language modeling. TR-10-98, Computer Science Group, Harvard University.
3. Stanley F. Chen and Ronald Rosenfeld. 2000. A survey of smoothing techniques for ME models. IEEE Transactions on Speech and Audio Processing, 8(1):37-50.
4. Corinna Cortes and Vladimir Vapnik. 1995. Support vector networks. Machine Learning, 20:273-297.
5. CRL. 2002. EDR electronic dictionary version 2.0 technical guide. Communications Research Laboratory (CRL).
6. Ido Dagan, Fernando Pereira, and Lillian Lee. 1994. Similarity-based estimation of word cooccurrence probabilities. In Proceedings of ACL 94.
7. Ido Dagan, Shaul Marcus, and Shaul Markovitch. 1995. Contextual word similarity and estimation from sparse data. Computer, Speech and Language, 9:123-152.
8. Ido Dagan, Lillian Lee, and Fernando Pereira. 1997. Similarity-based methods for word sense disambiguation. In Proceedings of ACL 97.
9. Ido Dagan, Lillian Lee, and Fernando Pereira. 1999. Similarity-based models of word cooccurrence probabilities. Machine Learning, 34(1-3):43-69.
10. Gregory Grefenstette. 1994. Explorations In Automatic Thesaurus Discovery. Kluwer Academic Publishers.
11. Zellig Harris. 1954. Distributional structure. Word, pages 146-142.
12. Donald Hindle. 1990. Noun classification from predicate-argument structures. In Proceedings of ACL-90, pages 268-275.
13. Jun'ichi Kazama and Kentaro Torisawa. 2008. Inducing gazetteers for named entity recognition by large-scale clustering of dependency relations. In Proceedings of ACL-08: HLT.
14. Jun'ichi Kazama, Stijn De Saeger, Kentaro Torisawa, and Masaki Murata. 2009. Generating a large-scale analogy list using a probabilistic clustering based on noun-verb dependency profiles. In Proceedings of 15th Annual Meeting of The Association for Natural Language Processing (in Japanese).
15. Dekang Lin. 1998. Automatic retrieval and clustering of similar words. In Proceedings of COLING/ACL-98, pages 768-774.
16. Daichi Mochihashi, Takeshi Yamada, and Naonori Ueda. 2009. Bayesian unsupervised word segmentation with nested Pitman-Yor language modeling. In Proceedings of ACL-IJCNLP 2009, pages 100-108.
17. Masaki Murata, Qing Ma, Tamotsu Shirado, and Hitoshi Isahara. 2004. Database for evaluating extracted terms and tool for visualizing the terms. In Proceedings of LREC 2004 Workshop: Computational and Computer-Assisted Terminology, pages 6-9.
18. Patrick Pantel and Dekang Lin. 2002. Discovering word senses from text. In Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining, pages 613-619.
19. Patrick Pantel, Eric Crestan, Arkady Borkovsky, Ana-Maria Popescu, and Vishnu Vyas. 2009. Web-scale distributional similarity and entity set expansion. In Proceedings of EMNLP 2009, pages 938-947.
20. T. W. Rauber, T. Braun, and K. Berns. 2008. Probabilistic distance measures of the Dirichlet and Beta distributions. Pattern Recognition, 41:637-645.
21. Keiji Shinzato, Tomohide Shibata, Daisuke Kawahara, Chikara Hashimoto, and Sadao Kurohashi. 2008. Tsubaki: An open search engine infrastructure for developing new information access. In Proceedings of IJCNLP 2008.
22. Yee Whye Teh. 2006. A hierarchical Bayesian language model based on Pitman-Yor processes. In Proceedings of COLING-ACL 2006, pages 985-992.
23. Akira Terada, Minoru Yoshida, and Hiroshi Nakagawa. 2004. A tool for constructing a synonym dictionary using context information. In IPSJ SIG Technical Report (in Japanese), pages 87-94.