Statistical inference in retrieval effectiveness evaluation

Information Processing and Management

Volumn 33, Issue 4, 1997, Pages 495-512

  Savoy, Jacques ^a  

^a UNIVERSITY OF NEUCHÂTEL   (Switzerland)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; STATISTICAL TESTS;

STATISTICAL INFERENCE METHODOLOGY;

INFORMATION RETRIEVAL;

EID: 0031193029     PISSN: 03064573     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0306-4573(97)00027-7     Document Type: Article

References (41)

1. Antille, A., Kersting, G., & Zucchini, W. (1982). Testing symmetry. Journal of the American Statistical Association, 77(379), 639-646.
2. Bickel, P. J., & Freedman, D. A. (1981). Some asymptotic theory for the bootstrap. The Annals of Statistics, 9(6), 1196-1217.
3. Cleverdon, C. W. (1984). Optimizing convenient on-line access to bibliographic databases. Information Service and Use, 4, 37-47.
4. Conover, W. J. (1980). Practical nonparametric statistics (2nd ed.). New York, NY: John Wiley and Sons.
5. Cooper, W. S. (1968). A single measure of retrieval effectiveness based on the weak ordering action of retrieval systems. American Documentation, 19(1), 30-41.
6. Efron, B., & Tibshirani, R. J. (1986). Bootstrap measures for standard errors, confidence intervals, and other measures of statistical accuracy. Statistical Science, 1, 54-77.
7. Efron, B., & Tibshirani, R. J. (1993). An introduction to the bootstrap. New York, NY: Chapman and Hall.
8. Fienberg, S. E. (1989). The analysis of cross-classified categorical data. Cambridge, MA: The MIT Press.
9. Fox, E. A. (1983). Characterization of two experimental collections in computer and information science containing textual and bibliographic concepts. Technical Report TR 83-561, Department of Computer Science, Cornell University.
10. Frakes, W. B. (1992). Stemming algorithms. In W. B. Frakes & R. Baeza-Yates (Ed.), Information retrieval data structures and algorithms (pp. 131-160). Englewood Cliffs, NJ: Prentice-Hall.
11. Freeman, D. E. (1987). Applied categorical data analysis. New York, NY: Marcel Dekker.
12. Gluck, M. (1996). Exploring the relationship between user satisfaction and relevance in information systems. Information Processing and Management., 32(1), 89-104.
13. Gosset, W. S. (1908). The probable error of a mean. Biometrika, 6, 1-25.
14. Grimm, L. G. (1993). Statistical applications for the behavioral sciences. New York, NY: John Wiley and Sons.
15. Harman, D. (1991). How effective is suffixing?. Journal of the American Society of Information Science, 42, 7-15.
16. Harter, S.P. (1996). Variations in relevance assessments and the measurement of retrieval effectiveness. Journal of the American Society for Information Science, 47, 37-49.
17. Herring, C., & Palmore, J. I. (1995). Random number generators are chaotic. Communications of the ACM, Technical Correspondence, 38(1), 121-122.
18. Hull, D. (1993). Using statistical testing in the evaluation of retrieval experiments. Proceedings of the 16th International Conference of the ACM-SIGIR'93, Pittsburgh, PA, pp. 329-338.
19. Hull, D. (1996). Stemming algorithms: a case study for detailed evaluation. Journal of the American Society for Information Science, 47, 70-84.
20. Keen, M. E. (1992). Presenting results of experimental retrieval comparisons. Information Processing and Management, 28(4), 491-502.
21. Krovetz, R. (1993). Viewing morphology as an inference process. Proceedings of the 16th International Conference of the ACM-SIGIR'93, Pittsburgh, PA, pp. 191-202.
22. L'Écuyer, P., & Côté, S. (1991). Implementing a random number package with splitting facilities. ACM Transactions on Mathematical Software, 17(1), 98-111.
23. Ledwith, R. (1992). On the difficulties of applying the results of information retrieval research to aid in the searching of large scientific databases. Information Processing and Management, 28(4), 451-455.
24. Léger, C., Politis, D. N., & Romano, J. P. (1992). Bootstrap technology and applications. Technometrics, 34(4), 378-398.
25. Lovins, J. B. (1968). Development of a stemming algorithm. Mechanical Translation and Computational Linguistics, 11(1), 22-31.
26. Paice, C. D. (1994, July). An evaluation method for stemming procedure. Proceedings of the 17th International Conference of the ACM-SIGIR'94, Dublin, Ireland, pp. 42-50.
27. Porter, M. F. (1980). An algorithm for suffix stripping. Program, 14(3), 130-137.
28. van Rijsbergen, C. J. (1979). Information retrieval (2nd Ed.). London, UK: Butterworths.
29. Saracevic, T. (1975). Relevance: a review of and a framework for thinking on the notion in information science. Journal of the American Society for Information Science, 26, 321-343.
30. Saracevic, T. (1995). Evaluation of evaluation in information retrieval. Proceedings of the 18th International Conference of the ACM-SIGIR'95, Seattle, WA, pp. 137-146.
31. Salton, G. (1989). Automatic text processing, the transformation, analysis, and retrieval of information by computer. Reading, MA: Addison-Wesley.
32. Salton, G. (1992). The state of retrieval system evaluation. Information Processing and Management, 28(4), 441-449.
33. Salton, G., & McGill, M. J. (1983). Introduction to modern information retrieval. New York, NY: McGraw-Hill.
34. Savoy, J. (1993). Stemming of french words based on grammatical category. Journal of the American Society for Information Science, 44, 1-9.
35. Savoy, J. (1994). A learning scheme for information retrieval in hypertext. Information Processing and Management, 30(4), 515-533.
36. Schamber, L. (1994). Relevance and information behavior. Annual Review of Information Science and Technology, 29, 3-48.
37. Siegel, S. (1956). Nonparametric statistics for the behavioral sciences. New York, NY: McGraw-Hill.
38. Sparck Jones, K., & Bates, R. G. (1977). Research on automatic indexing 1974-1976. Technical Report, Computer Laboratory, University of Cambridge, U.K.
39. Tague-Sutcliffe, J. (1992). The pragmatics of information retrieval experimentation, revised. Information Processing and Management, 28(4), 467-490.
40. Tague-Sutcliffe, J., & Blustein, J. (1994). A statistical analysis of the TREC-3 data. Proceedings of the 3rd Text REtrieval Conference TREC'3, Gaithersburg, MD, pp. 385-398.
41. Tezuka, S., & L'Écuyer, P. (1991). Efficient and portable combined Tausworthe random number generators. ACM Transactions on Modeling and Computer Simulation, 1(2), 99-112.