Concept-based information retrieval using explicit semantic analysis

ACM Transactions on Information Systems

Volumn 29, Issue 2, 2011, Pages

  Egozi, Ofer ^a   Markovitch, Shaul ^a   Gabrilovich, Evgeniy ^a  

^a TECHNION ISRAEL INSTITUTE OF TECHNOLOGY   (Israel)

Author keywords

Concept based retrieval; Explicit semantic analysis; Feature selection; Semantic search

Indexed keywords

CONCEPT-BASED; CONCEPT-BASED RETRIEVAL; DATA SETS; EXPLICIT SEMANTICS; FEATURE SELECTION METHODS; HIGH QUALITY; HUMAN KNOWLEDGE; KEYWORD-BASED RETRIEVAL; LABELED DATA; LABELED TRAINING DATA; SEMANTIC SEARCH; TERM CO-OCCURRENCE; TEXT FEATURE; TEXT REPRESENTATION; WIKIPEDIA; WORLD KNOWLEDGE;

FEATURE EXTRACTION; INFORMATION RETRIEVAL SYSTEMS; KNOWLEDGE REPRESENTATION; SEARCH ENGINES; SEMANTICS;

INFORMATION RETRIEVAL;

EID: 80051504927     PISSN: 10468188     EISSN: 15582868     Source Type: Journal    
DOI: 10.1145/1961209.1961211     Document Type: Article

References (71)

1. ALLAN, J., CALLAN, J., FENG, F.-F., AND MALIN, D. 1999. Inquery and trec-8. In Proceedings of the 8th Text Retrieval Conference (TREC-8). 637-644.
2. ANDERKA, M. AND STEIN, B. 2009. The esa retrieval model revisited. In Proceedings of the 32nd International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, 670-671.
3. ARAMPATZIS, A. AND KAMPS, J. 2008. A study of query length. In Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, 811-812.
4. ARMSTRONG, T. G., MOFFAT, A., WEBBER, W., AND ZOBEL, J. 2009. Improvements that don't add up: Ad-Hoc retrieval results since 1998. In Proceeding of the 18th ACM Conference on Information and Knowledge Management (CIKM'09). ACM, 601-610.
5. BILLERBECK, B. AND ZOBEL, J. 2004. Questioning query expansion: An examination of behaviour and parameters. In Proceedings of the 15th Australasian Database Conference. Australian Computer Society, 69-76.
6. BUCKLEY, C. AND ROBERTSON, S. 2008. Relevance feedback track overview: Trec 2008. In Proceedings of the 17th Text REtrieval Conference (TREC-17).
7. CALLAN, J. P. 1994. Passage-Level evidence in document retrieval. In Proceedings of the 17th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM/Springer, 302-310.
8. CASTELLS, P., FERNANDEZ, M., AND VALLET, D. 2007. An adaptation of the vector-space model for ontologybased information retrieval. IEEE Trans. Knowl. Data Engin. 19, 2, 261-272. (Pubitemid 46104028)
9. CHANG, M.-W., RATINOV, L., ROTH, D., AND SRIKUMAR, V. 2008. Importance of semantic representation: Dataless classification. In Proceedings of the 23rd AAAI Conference on Artificial Intelligence. AAAI Press, 830-835.
10. CROFT, B. W. 2000. Combining Approaches to Information Retrieval. Kluwer Academic Publishers, Chapter 1, 1-36.
11. CRONEN-TOWNSEND, S., ZHOU, Y., AND CROFT, W. B. 2002. Predicting query performance. In Proceedings of the 25th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, 299-306.
12. DEERWESTER, S. C., DUMAIS, S. T., LANDAUER, T. K., FURNAS, G. W., AND HARSHMAN, R. A. 1990. Indexing by latent semantic analysis. J. Amer. Soc. Inf. Sci. 41, 6, 391-407.
13. DUMAIS, S. T. 1994. Latent semantic indexing (lsi) and trec-2. In Proceedings of the 2nd Text Retrieval Conference (TREC-2). 105-116.
14. EGOZI, O., GABRILOVICH, E., AND MARKOVITCH, S. 2008. Concept-Based feature generation and selection for information retrieval. In Proceedings of the 23rd AAAI Conference on Artificial Intelligence. AAAI Press, 1132-1137.
15. FOX, E. A. AND SHAW, J. A. 1994. Combination of multiple searches. In Proceedings of the 2nd Text RE-trieval Conference (TREC-2). 243-252.
16. FULLER, M., KASZKIEL, M., KIMBERLEY, S., NG, C., WILKINSON, R., WU, M., AND ZOBEL, J. 1999. The rmit/csiro ad hoc, q&a, web, interactive, and speech experiments at trec 8. In Proceedings of the 8th Text REtrieval Conference (TREC-8). 549-564.
17. FURNAS, G. W., LANDAUER, T. K., GOMEZ, L. M., AND DUMAIS, S. 1987. The vocabulary problem in human-system communication. Comm. ACM 30, 11, 964-971.
18. GABRILOVICH, E. AND MARKOVITCH, S. 2005. Feature generation for text categorization using world knowledge. In Proceedings of the 19th International Joint Conference on Artificial Intelligence (IJ-CAI'05). Morgan Kaufmann Publishers, 1048-1053.
19. GABRILOVICH, E. AND MARKOVITCH, S. 2006. Overcoming the brittleness bottleneck using wikipedia: Enhancing text categorization with encyclopedic knowledge. In Proceedings of the 21st National Conference on Artificial Intelligence (AAAI'06). AAAI Press, 1301-1306. (Pubitemid 44705454)
20. GABRILOVICH, E. AND MARKOVITCH, S. 2007. Computing semantic relatedness using wikipedia-based explicit semantic analysis. In Proceedings of the 20th International Joint Conference on Artificial Intelligence (IJCAI'07). Morgan Kaufmann Publishers, 1606-1611.
21. GAUCH, S., MADRID, J. M., INDURI, S., RAVINDRAN, D., AND CHADLAVADA, S. 2003. Keyconcept: A conceptual search engine. Tech. rep. TR-8646-37, University of Kansas.
22. GONZALO, J., VERDEJO, F., CHUGUR, I., AND CIGARRIN, J. 1998. Indexing with wordnet synsets can improve text retrieval. In Proceedings of the COLING/ACL Workshop on Usage of WordNet for NLP.
23. GROOTJEN, F. AND VAN DER WEIDE, T. P. 2006. Conceptual query expansion. Data Knowl. Engin. 56, 174-193. (Pubitemid 41660384)
24. GUPTA, R. AND RATINOV, L.-A. 2008. Text categorization with knowledge transfer from heterogeneous data sources. In Proceedings of the 23rd AAAI Conference on Artificial Intelligence. AAAI Press, 842-847.
25. GUREVYCH, I., MULLER, C., AND ZESCH, T. 2007. What to be? - Electronic career guidance based on semantic relatedness. In Proceedings of the Association for Computational Linguistics (ACL). The Association for Computer Linguistics, 1032-1039.
26. GUYON, I. AND ELISSEEFF, A. 2003. An introduction to variable and feature selection. J. Mach. Learn. Res. 3, 1157-1182.
27. HAWKING, D. 1999. Acsys trec-8 experiments. In Proceedings of the 8th Text REtrieval Conference (TREC-8). 307-316.
28. HOFMANN, T. 1999. Probabilistic latent semantic indexing. In Proceedings of the 22nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR'99). ACM, 50-57.
29. HUANG, X., HUANG, Y. R., WEN, M., AN, A., LIU, Y., AND POON, J. 2006. Applying data mining to pseudorelevance feedback for high performance text retrieval. In Proceedings of the 6th IEEE International Conference on Data Mining (ICDM'06). IEEE Computer Society, 295-306. (Pubitemid 47485810)
30. JOHN, G. H., KOHAVI, R., AND PFLEGER, K. 1994. Irrelevant features and the subset selection problem. In Proceedings of the 11th International Conference on Machine Learning. 121-129.
31. KAPTEIN, R., KAMPS, J., AND HIEMSTRA, D. 2008. The impact of positive, negative and topical relevance feedback. In Proceedings of the 17th Text REtrieval Conference (TREC-17).
32. KASZKIEL, M. AND ZOBEL, J. 2001. Effective ranking with arbitrary passages. J. Amer. Soc. Inf. Sci. Technol. 52, 4, 344-364. (Pubitemid 32248265)
33. KWOK, K. L., GRUNFELD, L., AND CHAN, M. 1999. Trec-8 ad-hoc, query and filtering track experiments using pircs. In Proceedings of the 8th Text Retrieval Conference (TREC-8). 217-228.
34. LEE, J. H. 1995. Combining multiple evidence from different properties of weighting schemes. In Proceedings of the 18th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, 180-188.
35. LI, W. AND MCCALLUM, A. 2006. Pachinko allocation: Dag-Structured mixture models of topic correlations. In Proceedings of the 23rd International Conference on Machine Learning (ICML'06). ACM, 577-584. (Pubitemid 44482980)
36. LIBERMAN, S. AND MARKOVITCH, S. 2009. Compact hierarchical explicit semantic representation. In Proceedings of the IJCAI Workshop on User-Contributed Knowledge and Artificial Intelligence: An Evolving Synergy (WikiAI'09). Morgan Kaufmann Publishers.
37. LIU, X. AND CROFT, W. B. 2002. Passage retrieval based on language models. In Proceedings of the 11th International Conference on Information and Knowledge Management. ACM, 375-382.
38. LIU, Z. AND CHU, W. W. 2005. Knowledge-Based query expansion to support scenario-specific retrieval of medical free text. In Proceedings of the ACM Symposium on Applied Computing. ACM, 1076-1083.
39. MANDALA, R., TAKENOBU, T., AND HOZUMI, T. 1998. The use of wordnet in information retrieval. In Proceedings of the COLING/ACL Workshop on Usage of WordNet in Natural Language Processing Systems. 31-37.
40. MILLER, G. A., BECKWITH, R., FELLBAUM, C., GROSS, D., AND MILLER, K. J. 1990. Introduction to wordnet: An on-line lexical database. Int. J. Lexicograph. 3, 235-244.
41. MILNE, D. N., WITTEN, I. H., AND NICHOLS, D. M. 2007. A knowledge-based search engine powered by wikipedia. In Proceedings of the 16th ACM Conference on Information and Knowledge Management. ACM, 445-454.
42. MITRA, M., SINGHAL, A., AND BUCKLEY, C. 1998. Improving automatic query expansion. In Proceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, 206-214.
43. OZCAN, R. AND ASLANDOGAN, Y. A. 2005. Concept-based information access. In Proceedings of the International Conference on Information Technology: Coding and Computing (ITCC'05). IEEE Computer Society, 794-799. (Pubitemid 41290192)
44. POTTHAST, M., STEIN, B., AND ANDERKA, M. 2008. A wikipedia-based multilingual retrieval model. In Proceedings of the 30th European Conference on IR Research (ECIR). Springer, 522-530. (Pubitemid 351499100)
45. QIU, Y. AND FREI, H. P. 1993. Concept based query expansion. In Proceedings of the 16th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM Press, 160-169.
46. QUINLAN, J. R. 1986. Induction of decision trees. Mach. Learn. 1, 1, 81-106.
47. ROBERTSON, S. E. AND WALKER, S. 1999. Okapi/keenbow at trec-8. In Proceedings of the 8th Text REtrieval Conference (TREC-8). 151-162.
48. ROCCHIO, J. J. 1971. Relevance feedback in information retrieval. In The SMART Retrieval System: Experiments in Automatic Document Processing, G. Salton Ed., Prentice Hall, Englewood Cliffs, NJ, 313-323.
49. RUTHVEN, I. AND LALMAS, M. 2003. A survey on the use of relevance feedback for information access systems. Knowl. Engin. Rev. 18, 2, 95-145.
50. SALTON, G. AND BUCKLEY, C. 1990. Improving retrieval performance by relevance feedback. J. Amer. Soc. Inf. Sci. 41, 4, 288-297.
51. SANDERSON, M. 2000. Retrieving with good sense. Inf. Retriev. 2, 1, 49-69.
52. SCHUETZE, H. AND PEDERSEN, J. O. 1995. Information retrieval based on word senses. In Proceedings of the 4th Annual Symposium on Document Analysis and Information Retrieval. 161-175.
53. SINGHAL, A., ABNEY, S., BACCHIANI, M., COLLINS, M., HINDLE, D., AND PEREIRA, F. 1999. At&t at trec-8. In Proceedings of the 8th Text REtrieval Conference (TREC-8). 317-330.
54. SINGHAL, A., MITRA, M., AND BUCKLEY, C. 1997. Learning routing queries in a query zone. In Proceedings of the 20th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, 25-32. (Pubitemid 127720301)
55. SINGHAL, A., SALTON, G., MITRA, M., AND BUCKLEY, C. 1995. Document length normalization. Tech. rep. TR95-1529, Cornell University, Ithaca, NY.
56. SORG, P. AND CIMIANO, P. 2008. Cross-lingual information retrieval with explicit semantic analysis. In Working Notes for the CLEF 2008 Workshop.
57. STOKOE, C. P., OAKES, M., AND TAIT, J. 2003. Word sense disambiguation in information retrieval revisited. In Proceedings of the 26th Annual International ACM SIGIR Conference on Research and Development in Informaion Retrieval. ACM, 159-166.
58. STYLTSVIG, H. B. 2006. Ontology-based information retrieval. Ph. D. thesis, Department of Computer Science, Roskilde University, Denmark.
59. VOGT, C. C. AND COTTRELL, G. W. 1999. Fusion via a linear combination of scores. Inf. Retriev. 1, 3, 151-173.
60. VOORHEES, E. M. 1993. Using wordnet to disambiguate word senses for text retrieval. In Proceedings of the 16th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, 171-180.
61. VOORHEES, E. M. 1994. Query expansion using lexical-semantic relations. In Proceedings of the 17th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. Springer, 61-69.
62. VOORHEES, E. M. 2005. Overview of the TREC 2004 robust retrieval track. In Proceedings of the 13th Text REtrieval Conference (TREC-13). 70-79.
63. VOORHEES, E. M. AND HARMAN, D. 1998. Overview of the seventh text retrieval conference (trec-7). In Proceedings of the 7th Text REtrieval Conference (TREC-7). 1-24.
64. VOORHEES, E. M. AND HARMAN, D. 1999. Overview of the eighth text retrieval conference (trec-8). In Proceedings of the 8th Text REtrieval Conference (TREC-8). 1-24.
65. WEI, X. AND CROFT, W. B. 2006. Lda-Based document models for ad-hoc retrieval. In Proceedings of the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR'06). ACM, 178-185.
66. XU, J. AND CROFT, W. B. 2000. Improving the effectiveness of information retrieval with local context analysis. ACM Trans. Inf. Syst. 18, 1, 79-112.
67. YAN, R., HAUPTMANN, A. G., AND JIN, R. 2003. Negative pseudo-relevance feedback in content-based video retrieval. In Proceedings of the 11th ACM International Conference on Multimedia. ACM, 343-346.
68. YANG, Y. AND PEDERSEN, J. O. 1997. A comparative study on feature selection in text categorization. In Proceedings of the 14th International Conference on Machine Learning. Morgan Kaufmann, 412-420.
69. YI, X. AND ALLAN, J. 2009. A comparative study of utilizing topic models for information retrieval. In Proceedings of the 31st European Conference on IR Research (ECIR). Springer, 29-41.
70. ZHOU, X., ZHANG, X., AND HU, X. 2006. Using concept-based indexing to improve language modeling approach to genomic ir. In Lecture Notes in Computer Science. Springer, 444-455. (Pubitemid 44029485)
71. ZOBEL, J. 1998. How reliable are the results of large-scale information retrieval experiments? In Proceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM Press, 307-314.