Employing web mining and data fusion to improve weak ad hoc retrieval

Information Processing and Management

Volumn 43, Issue 2, 2007, Pages 406-419

  Kwok, Kui Lam ^a   Grunfeld, Laszlo ^a   Deng, Peter ^a  

^a CITY UNIVERSITY OF NEW YORK   (United States)

Author keywords

Alternate queries; Data fusion; Robust retrieval; Salient term selection; Weak query; Web mining

Indexed keywords

INFORMATION RETRIEVAL; QUERY LANGUAGES; SEARCH ENGINES; WORLD WIDE WEB;

ALTERNATE QUERIES; DATA FUSION; SALIENT TERM SELECTION; WEAK QUERY; WEB MINING;

DATA MINING;

EID: 33750443208     PISSN: 03064573     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ipm.2006.07.008     Document Type: Article

References (27)

1. Amati G., Carpineto C., and Romano G. Query difficulty, robustness and selective application of query expansion. Advances in Information Retrieval. Proceedings of the 26th European conference on IR research. Lecture notes in computer science Vol. 2997 (2004), Springer, Heidelberg 127-137
2. Arampatzis A.T., van der Weide T.P., van Bommel P., and Koster C.H.A. Linguistically-motivated information retrieval. Information Processing & Management 34 (1998) 693-707
3. Buckley, C. (2004). Why current IR engines fail. In Proceedings of the 27th annual international ACM-SIGIR conference on Research & Development in IR (pp. 584-585). New York: ACM.
4. Chang, C.-C., & Lin, C.-J. (2004). LIBSVM: a library for support vector machines. National Taiwan University. Available from: .
5. Cronen-Townsend, S., Zhou, Y., & Croft, W.B. (2002). Predicting query performance. In Proceedings of the 25th annual international ACM-SIGIR conference on Research & Development in IR (pp. 299-306). New York: ACM.
6. Dorr, B., Zajic, D., & Schwartz, R. (2003). Hedge Trimmer: A Parse-and-Trim Approach to Headline Generation. In Proceedings of HLT-NAACL 2003 text summarization workshop, paper W03-0501.
7. Fox, E. A., & Shaw, J. (1994). Combination of multiple searches. In NIST Special Publication 500-215: the second text retrieval conference (TREC-2) (pp. 243-252). Gaithersberg, MD: NIST.
8. Grunfeld, L, Kwok, K.L., Dinstl, N. & Deng, P. (2004). TREC 2003 Robust, HARD and QA track experiments using PIRCS. In NIST special publication 500-255: the 12th text retrieval conference (TREC 2003) (pp. 510-521). Gaithersburg, MD: NIST.
9. Harman, D., & Buckley, C. (2004). The NRRC reliable information access (RIA) workshop. In Proceedings of the 27th annual international ACM-SIGIR conference on Research & Development in IR (pp. 528-529). New York: ACM.
10. Ingwersen, P. (1994). Polyrepresentation of information needs and semantic entities: elements of a cognitive theory for information retrieval interaction. In Proceedings of the 17th annual international ACM-SIGIR conference on Research & Development in IR (pp. 101-110). New York: ACM.
11. Katz S. Distribution of content words and phrases in text and language modeling. Natural Language Engineering 2 1 (1996) 15-59
12. Kwok K.L. A network approach to probabilistic information retrieval. ACM Transactions on Office Information System 13 (1995) 324-353
13. Kwok, K. L. (1996). A new method of weighting query terms for ad-hoc retrieval. In Proceedings of the 19th annual international ACM-SIGIR conference on Research & Development in IR (pp. 187-195). New York: ACM.
14. Kwok, K. L & Chan, M. (1998). Improving two-stage ad-hoc retrieval for short queries. In Proceedings of the 21st annual international ACM-SIGIR conference on Research & Development in IR (pp. 250-256), New York: ACM.
15. Kwok, K.L., Grunfeld, L., Deng, P., & Dinstl, N. (2005). TREC 2004 Robust track experiments using PIRCS. In NIST Special Publication 500-261: the 13th text retrieval conference (TREC 2004) (paper 54). Available form: .
16. Lee, J.H. (1997). Analysis of multiple evidence combination. In Proceedings of the 20th annual international ACM-SIGIR conference on Research & Development in IR (pp. 267-276). New York: ACM.
17. Lin, D. (1994). PRINCIPAR - an efficient, broad-coverage, principle-based parser. In Proceedings of COLING 1994, 15th international conference on Computational Linguistics (pp. 482-488). Available from: .
18. Lin, J., Fernandes, A., Katz, B., Marton, G., & Tellex, S. (2003). Extracting answers from the Web using knowledge annotation and knowledge mining techniques. In Proceedings of the 11th text retrieval conference (TREC 2002) (pp. 447-456). NIST Special Publication 500-251. Gaithersburg, MD: NIST.
19. Liu, S., Sun, C., & Yu, C. (2005). UIC at TREC 2004: Robust Track. In NIST Special Publication 500-261: the 13th text retrieval conference (TREC 2004) (paper 79). Available from: .
20. Nie, J. -Y., Simard, M., Isabelle, P., & Durand, R. (1999). Cross-language information retrieval based on parallel texts and automatic mining of parallel texts from the web. In Proceedings of the 22nd annual international ACM-SIGIR conference on Research & Development in IR (pp.74-81). New York: ACM.
21. Rada R., and Bicknell E. Ranking documents with a thesaurus. Journal of American Society for Information Science 40 (1989) 304-310
22. Robertson S.E., and Sparck Jones K. Relevance weighting of search terms. Journal of American Society for Information Science 27 (1976) 129-146
23. Vogt C.C., and Cottrell G.W. Fusion via a linear combination of scores. Information Retrieval 1 (1999) 151-173
24. Voorhees, E. M. (1994). Query expansion using lexical-semantic relations. In Proceedings of the 17th annual international ACM-SIGIR conference on Research & Development in IR (pp. 61-69). New York: ACM.
25. Voorhees, E. M. (2004). Overview of the TREC 2003 Robust retrieval track. in NIST Special Publication 500-255: the 12th text retrieval conference (TREC 2003) (pp. 69-77). Gaithersburg, MD: NIST.
26. Voorhees, E. M. (2005). Overview of the TREC 2004 Robust track. In NIST Special Publication 500-261: the 13th text retrieval conference (TREC 2004) (paper 6). Available from: .
27. Yom-Tov, E., Fine, S., Carmel, D., Darlow, A., & Amitay, E. (2005). Juru at TREC 2004: Experiments with prediction of query difficulty. In NIST Special Publication 500-261: The 13th Text Retrieval Conference (TREC 2004) (paper 29). Available from: .