Evolving general term-weighting schemes for Information Retrieval: Tests on larger collections

Artificial Intelligence Review

Volumn 24, Issue 3-4, 2005, Pages 277-299

  Cummins, Ronan ^a   O'Riordan, Colm ^a  

^a NATIONAL UNIVERSITY OF IRELAND   (Ireland)

Author keywords

Genetic programming; Information retrieval; Term weighting schemes

Indexed keywords

COMPUTER PROGRAMMING; FREQUENCIES; GENETIC ALGORITHMS; MATHEMATICAL MODELS; STANDARDS; VECTORS;

FREQUENCY CHARACTERIZATION; GENETIC PROGRAMMING; INFORMATION RETRIEVAL MODELS; TERM-WEIGHT SCHEMES;

INFORMATION RETRIEVAL;

EID: 29144457410     PISSN: 02692821     EISSN: None     Source Type: Journal    
DOI: 10.1007/s10462-005-9001-y     Document Type: Conference Paper

References (28)

1. Cummins, R. & O'Riordan, C. (2004a). Determining General Term Weighting Schemes for the Vector Space Model of Information Retrieval Using Genetic Programming. In 15th Artificial Intelligence and Cognitive Science Conference (AICS 2004). Galway-Mayo Institute of Technology, Castlebar Campus, Ireland.
2. Cummins, R. & O'Riordan, C. (2004b). Using Genetic Programming to Evolve Weighting Schemes for the Vector Space Model of Information Retrieval. In Keijzer, M. (ed.) Late Breaking Papers at the 2004 Genetic and Evolutionary Computation Conference. Seattle: Washington, USA.
3. Darwin, C. (1859). The Origin of the Species by means of Natural Selection, or The Preservation of Favoured Races in the Struggle for Life. First edition.
4. Fan, W, Gordon, M. D. & Pathak, P. (2004). A Generic Ranking Function Discovery Framework by Genetic Programming For Information Retrieval. Information Processing & Management.
5. Goldberg, D. E. (1989). Genetic Algorithms in Search, Optimisation and Machine learning. Addison-Wesley.
6. Gordon, M. (1988). Probabilistic and Genetic Algorithms in Document Retrieval. Communication of the ACM 31(10), 1208-1218.
7. Greiff, W (1998). A Theory of Term Weighting Based on Exploratory Data Analysis. In Proceedings of the 21st International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR '98). Melbourne, Australia.
8. Hersh, W., Buckley, C. Leone, T. J. & Hickam, D. (1994). OHSUMED: An Interactive Retrieval Evaluation and New Large Test Collection for Research. In Proceedings of the 17th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 192-201, Springer-Verlag: New York, Inc.
9. Horng, J. & Yen, C. (2000). Applying Genetic Algorithms to Query Optimization in Document Retrieval. Information Processing & Management 36(5): 737-759.
10. Kim, S. & Zhang, B. T. (2001). Evolutionary Learning of Web-Document Structure for Information Retrieval. In Proceedings of the 2001 Congress on Evolutionary Computation (CEC2001).
11. Koza, J. R. (1992). Genetic Programming: On the Programming of Computers by Means of Natural Selection. MIT Press, Cambridge, MA, USA.
12. Kuscu, I. (2000). Generalisation and Domain Specific Functions in Genetic Programming. In Proceedings of the 2000 Congress on Evolutionary Computation CEC00. 1393-1400, IEEE Press.
13. Luhn, H. (1958). The Automatic Creation of Literature Abstracts. IBM Journal of Research and Development 159-165.
14. Oren, N. (2002). Re-examining tf.idf Based Information Retrieval with Genetic Programming. Proceedings of SAICSIT.
15. Porter, M. (1980). An algorithm for Suffix Stripping. Program 14(3): 130-137.
16. Robertson, S. E. & Sparck Jones, K. (1976). Relevance Weighting of Search Terms. Journal of American Society for Information Sciences 27(3): 129-146.
17. Robertson, S. E. & Walker, S. (1997). On Relevance Weights with Little Relevance Information. In Proceedings of the 20th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 16-24, ACM Press.
18. Robertson, S. E., Walker, S., Hancock-Beaulieu, M., Gull, A. & Lau, M. (1995). Okapi at TREC-3. In Harman, D. K. (ed.) The Third Text REtrieval Conference (TREC-3) NIST.
19. Salton, G & Buckley, C. (1988). Term-Weighting Approaches in Automatic Text Retrieval. Information Processing & Management 24(5): 513-523.
20. Salton, G., Wong, A. & Yang, C. S. (1975). A Vector Space Model for Automatic Indexing. Communications of the ACM 18(11), 613-620.
21. Salton, G. & Yang, C. S. (1973). On the Specification of Term Values in Automatic indexing. Journal of Documentation 29: 351-372.
22. Trotman, A. (2004). An Artificial Intelligence Approach to Information Retrieval (Abstract Only). In SIGIR. p. 603.
23. Van Rijsbergen, C. J. (1979). Information Retrieval, 2nd ed. Department of Computer Science, University of Glasgow.
24. Vrajitoru, D. (1998). Crossover Improvement for the Genetic Algorithm in Information Retrieval. Information Processing and Management 34(4): 405-415.
25. Vrajitoru, D. (2000). In Crestani, F. & Pasi, G (eds.) Soft Computing in Information Retrieval. Techniques and Applications, 199-222. Physica-Verlag.
26. Yang, J. & Korfhage, R. (1993). Query Optimization in Information Retrieval Using Genetic Algorithms. In: Proceedings of the Fifth International Conference on Genetic Algorithms. 603-611.
27. Yang, Y. & Pedersen, J. O. (1997). A Comparative Study on Feature Selection in text Categorization. In Fisher, D. H. (ed.) Proceedings of ICML-97, 14th Inter- national Conference on Machine Learning. Nashville, US, 412-420, Morgan Kaufmann Publishers: San Francisco, US.
28. Zipf, G (1949). Human Behaviour and the Principle of Least Effort. Addison-Wesley: Cambridge, MA.