Evaluating Different Methods of Estimating Retrieval Quality for Resource Selection

SIGIR Forum (ACM Special Interest Group on Information Retrieval)

Volumn , Issue SPEC. ISS., 2003, Pages 290-297

  Nottelmann, Henrik ^a   Fuhr, Norbert ^a  

^a UNIVERSITY OF DUISBURG ESSEN   (Germany)

Author keywords

Decision theoretic framework; Evaluation; Formal models; Normal distribution; Resource selection

Indexed keywords

ALGORITHMS; APPROXIMATION THEORY; DIGITAL LIBRARIES; ESTIMATION; INDEXING (OF INFORMATION); NORMAL DISTRIBUTION; PROBABILITY;

DECISION-THEORETIC FRAMEWORK; FORMAL MODELS; RESOURCE SELECTION;

INFORMATION RETRIEVAL SYSTEMS;

EID: 1542317683     PISSN: 01635840     EISSN: None     Source Type: Journal    
DOI: 10.1145/860435.860489     Document Type: Conference Paper

References (17)

1. J. Callan and M. Connell. Query-based sampling of text databases. ACM Transactions on Information Systems, 19(2):97-130, 2001.
2. J. Callan, W. Croft, and S. Harding. The INQUERY retrieval system. In Proceedings of DEXA-92, 3rd International Conference on Database and Expert Systems Applications, pages 78-83, Berlin et al., 1992. Springer.
3. J. Callan, Z. Lu, and W. Croft. Searching distributed collections with inference networks. In E. Fox, P. Ingwersen, and R. Fidel, editors, Proceedings of the 18th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 21-29, New York, 1995. ACM. ISBN 0-89791-714-6.
4. J. Callan, A. L. Powell, J. C. French, and M. Connell. The effects of query-based sampling on automatic database selection algorithms. ACM Transactions on Information Systems (submitted for publication).
5. J. French, A. Powell, J. Callan, C. Viles, T. Emmitt, K. Prey, and Y. Mou. Comparing the performance of database selection algorithms. In Proceedings of the 22nd International Conference on Research and Development in Information Retrieval, pages 238-245, New York, 1999. ACM.
6. N. Fuhr. A decision-theoretic approach to database selection in networked IR. ACM Transactions on Information Systems, 17(3):229-249, 1999.
7. L. Gravano and H. Garcia-Molina. Generalizing GIOSS to vector-space databases and broker hierarchies. In U. Dayal, P. Gray, and S. Nishio, editors, Proceedings of the International Conference on Very Large Databases, pages 78-89, Los Altos, California, 1995. Morgan Kaufman.
8. D. Harman, editor. The Second Text REtrieval Conference (TREC-2), Gaithersburg, Md. 20899, 1994. National Institute of Standards and Technology.
9. R. Manmatha, T. Rath, and F. Feng. Modeling score distributions for combining the outputs of search engines. In W. Croft, D. Harper, D. Kraft, and J. Zobel, editors, Proceedings of the 24th Annual International Conference on Research and development in Information Retrieval, New York, 2001. ACM.
10. H. Nottelmann and N. Fuhr. From uncertain inference to probability of relevance for advanced IR applications. In F. Sebastiani, editor, 25th European Conference on Information Retrieval Research (ECIR 2003), pages 235-250. Springer, 2003.
11. W. H. Press, S. A. Teukolsky, W. T. Vetterling, and B. P. Flannery, editors. Nested Relations and Complex Objects in Databases, Cambridge University Press, 1992.
12. S. E. Robertson, S. Walker, M. Hancock-Beaulieu, A. Gull, and M. Lau. Okapi at TREC. In Text REtrieval Conference, pages 21-30, 1992.
13. L. Si and J. Callan. Relevant document distribution estimation method for resource selection. In Proceedings of the 26st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, New York, 2003. ACM.
14. L. Si, R. Jin, J. Callan, and P. Ogilvie. Proceedings of the 11th international conference on information and knowledge management. In D. Grossman, editor, Proceedings of the 11th International Conference on Information and Knowledge Management, New York, 2002. ACM.
15. C. J. van Rijsbergen. A non-classical logic for information retrieval. The Computer Journal, 29(6):481-485, 1986.
16. S. Wong and Y. Yao. On modeling information retrieval with probabilistic inference. ACM Transactions on Information Systems, 13(1):38-68, 1995.
17. S. Wu and F. Crestani. Multi-objective resource selection in distributed information retrieval. In Proceedings of The 9th International Conference on Information Processing and Management of Uncertainty in Knowledge-Based Systems (IPMU), 2002.