Extreme value theory applied to document retrieval from large collections

Information Retrieval

Volumn 9, Issue 3, 2006, Pages 273-294

  Madigan, David ^a   Vardi, Yehuda ^b   Weissman, Ishay ^c  

^a AVAYA LABS RESEARCH   (United States)

^b RUTGERS UNIVERSITY   (United States)

^c TECHNION ISRAEL INSTITUTE OF TECHNOLOGY   (Israel)

Author keywords

Extreme value theory; Precision at K; Very large corpus IR

Indexed keywords

EID: 33744829492     PISSN: 13864564     EISSN: 15737659     Source Type: Journal    
DOI: 10.1007/s10791-006-0882-4     Document Type: Article

References (15)

1. Arampatzis A and van Hameren A (2001) The score-distributional threshold optimization for adaptive binary classification tasks. In: Proceedings of the 24th ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 285-203
2. Bennett PN (2003) Using asymmetric distributions to improve text classifier probability estimates In: Proceedings of SIGIR-03, 26th ACM International Conference on Research and Development in Information Retrieval, pp. 111-118
3. Cooper WS (1968) Expected search length: A single measure of retrieval effectiveness based on weak ordering action of retrieval systems Journal of the American Society for Information Science, 19:30-41
4. Cox DR and Hinkley DV (1974) Theoretical Statistics. CRC Press, London
5. David HA and Nagaraja HN (2003) Order Statistics (Third Edition), Wiley-Interscience, New York
6. DeGroot MH and Schervish MJ (2002) Probability and Statistics (Third Edition). Addison-Wesley, New York
7. Hawking D, Thistlewaite P and Harman D (1909) Scaling up the TREC Collection. Information Retrieval 1:115-137
8. Hawking D and Robertson S (2003) On Collection Size and Retrieval Effectiveness. Information Retrieval 6:99-105
9. Manmatha R, Feng F and Rath T (2001) Using models of score distributions in information retrieval. In: Proceedings of the 24th ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 267-275
10. Mann NR, Schafer RE and Singpurwalla NP (1974) Methods for Statistical Analysis of Reliability and Life Data. Wiley
11. Piessens R, deDoncker-Kapenga E, Uberhuber C and Kahaner D (1983) Quadpack: a Subroutine Package for Automatic Integration, Springer Verlag
12. Resnick SI (1987) Extreme Values, Regular Variation and Point Processes. Springer-Verlag, New York
13. Sable C, McKeown K and Hatzivassiloglou V (2002) Using Density Estimation to Improve Text Categorization. Technical Report CUCS-012-02, Columbia University, 2002.
14. Si L and Callan J (2003) Relevant document distribution estimation method for resource selection. In Proceedings of the Twenty Sixth Annual International ACM SIGIR Conference on Research and Development in Information Retrieval
15. Swets JA (1963) Information retrieval systems. Science 141:245-250