Measuring semantic similarity between words by removing noise and redundancy in web snippets

Concurrency and Computation: Practice and Experience

Volumn 23, Issue 18, 2011, Pages 2496-2510

  Xu, Zheng ^a   Luo, Xiangfeng ^a   Yu, Jie ^a   Xu, Weimin ^a  

^a SHANGHAI UNIVERSITY   (China)

Author keywords

information retrieval; query suggestion; semantic similarity; Web search

Indexed keywords

INFORMATION RETRIEVAL; REDUNDANCY; SEARCH ENGINES; SEMANTICS; WEBSITES;

BENCHMARK DATASETS; CORRELATION COEFFICIENT; QUERY SUGGESTION; REMOVE NOISE; REMOVING NOISE; SEMANTIC SIMILARITY; SEMANTIC SIMILARITY MEASURES; WEB SEARCHES;

SEMANTIC WEB;

EID: 81155155538     PISSN: 15320626     EISSN: 15320634     Source Type: Journal    
DOI: 10.1002/cpe.1816     Document Type: Article

References (31)

1. Resnik P,. Semantic similarity in a taxonomy: an information based measure and its application to problems of ambiguity in natural language. Journal of Artificial Intelligence Research 1999; 11: 95-130. (Pubitemid 129628761)
2. Luo X, Hu Q, Xu W, Yu Z,. Discovery of textual knowledge flow based on the management of knowledge maps. Concurrency and Computation: Practice and Experience 2008; 20: 1791-1806.
3. Luo X, Xu Z, Li Q, Hu Q, Yu J, Tang X,. Generation of similarity knowledge flow for intelligent browsing based on semantic link networks. Concurrency and Computation: Practice and Experience 2009; 21: 2018-2032.
4. Luo X, Yu J, Li Q, Liu F, Xu Z,. Building web knowledge flows based on interactive computing with semantics. New Generation Computing 2010; 28: 113-120.
5. Zhang S, Luo X, Chen J, Xu Z, Yu J, Xu W,. Measuring knowledge delivery quantity of associated knowledge flow. In Proceedings of the Fourth International Conference on Semantics, Knowledge and Grid. IEEE Computer Society: Washington, DC, 2008; 117-124.
6. Smeulders A, Worring M, Santini S, Gupta A, Jain R,. Content-based image retrieval at the end of the early years. IEEE Transactions on Pattern Analysis and Machine Intelligence 2000; 22 (12): 1349-1380. (Pubitemid 32088465)
7. Srihari R, Zhang Z, Rao A,. Intelligent indexing and semantic retrieval of multimodal documents. Information Retrieval 2000; 2: 245-275.
8. Makkonen J, Ahonen-Myka H, Salmenkivi M,. Simple semantics in topic detection and tracking. Information Retrieval 2004; 7: 347-368. (Pubitemid 39046502)
9. Green SJ,. Building hypertext links by computing semantic similarity. IEEE Transactions on Knowledge and Data Engineering 1999; 11 (5): 713-730. (Pubitemid 30518729)
10. Vojnovic M, Cruise J, Gunawardena D, Marbach P,. Ranking and suggesting popular items. IEEE Transactions on Knowledge and Data Engineering 2009; 21 (8): 1133-1146.
11. Cimano P, Handschuh S,. Towards the self-annotating web. In Proceedings of the 13th International World Wide Web Conference. ACM Press: New York, 2004; 462-471. (Pubitemid 40752780)
12. Schenkel R, Theobald A, Weikum G,. Semantic similarity search on semistructured data with the XXL search engine. Information Retrieval 2005; 8: 521-545. (Pubitemid 40550473)
13. Resnik P, Smithm A,. The Web as a parallel corpus. Computational Linguistics 2003; 29 (3): 349-380. (Pubitemid 37449712)
14. Xiao C, Wang W, Lin X, Xu Yu J,. Efficient similarity joins for near duplicate detection. In Proceedings of 17th International World Wide Web Conference. ACM Press: New York, NY, 2008; 131-140.
15. Pederson T, Patwardhan S, Michelizzi J,. WordNet::similarity-measuring the relatedness of concepts. Human Language Technology Conference, 2004; 38-41.
16. Rada R, Mili H, Bicknell E, Blettner M,. Development and application of a metric on semantic nets. IEEE Transaction on System, Man, and Cybernetics 1989; 19 (1): 17-30.
17. Richardson R, Smeaton F,. Using WordNet in a knowledge-based approach to information retrieval, Working Paper, CA-0395, School of Computer Applications, Dublin City University, Ireland, 1999.
18. Sussna M,. Word sense disambiguation for free-text indexing using a massive semantic network. In Proceedings of the Second International Conference on Information and Knowledge Management. ACM Press: New York, NY, 1993; 67-74.
19. Jiang JJ, Conrath DW,. Semantic similarity based on corpus statistics and lexical taxonomy, Proceedings of International Conference Research on Computational Linguistics, 1997.
20. Herdagdelen A, Erk K,. Measuring semantic relatedness with vector space models and random walks, Proceedings of the 2009 Workshop on Graph-based Methods for Natural Language Processing, 2009; 50-53.
21. Li Y, Bandar A, McLean D,. An approach for measuring semantic similarity between words using multiple information sources. IEEE Transaction on Knowledge and Data Engineering 2003; 15 (4): 871-882.
22. Turney PD,. Features of similarity. Psychological Review 1997; 84 (4): 327-352.
23. Chen H, Lin M, Wei Y,. Novel association measures using web search with double checking. In Proceedings of the 21st International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics, 2006; 1009-1016.
24. Sahami M, Heilman D,. A web-based kernel function for measuring the similarity of short text snippets. In Proceedings of the 15th International World Wide Web Conference. ACM Press: New York, NY, 2006; 377-386. (Pubitemid 46946630)
25. Islam A, Inkpen D,. Second order co-occurrence PMI for determining the semantic similarity of words. Proceedings of the International Conference on Language Resources and Evaluation, 2006; 1033-1038.
26. Bollegala D, Matsuo Y, Ishizuka M,. Measuring semantic similarity between words using web search engines. In Proceedings of 16th International World Wide Web Conference. ACM Press: New York, NY, 2007; 757-766. (Pubitemid 47582305)
27. Firth R,. A synopsis of linguistic theory 1930-1955. In Studies in Linguistic Analysis. Philological Society: Oxford, 1957.
28. Bayardo RJ, Ma Y, Srikant R,. Scaling up all pairs similarity search. In Proceedings of 16th International World Wide Web Conference. ACM Press: New York, NY, 2007; 131-140. (Pubitemid 47582245)
29. Rubenstein H, Goodenough B,. Contextual correlates of synonymy. Communications of the ACM 1965; 8 (10): 627-633.
30. Agrawal R, Imielinski T, Swami A,. Mining association rules between sets of items in large databases. In Proceedings of the 1993 ACM SIGMOD International Conference on Management of Data, Vol. 22. ACM Press: New York, NY, 1993; 207-216.
31. Church W, Hanks P,. Word association norms, mutual information and lexicography. Proceedings of the 27th Annual Conference of the Association of Computational Linguistics, 1989; 76-83.