The maximum entropy method for analyzing retrieval measures

SIGIR 2005 - Proceedings of the 28th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval

Volumn , Issue , 2005, Pages 27-34

  Aslam, Javed A ^a   Yilmaz, Emine ^a   Pavlu, Virgiliu ^a  

^a Northeastern University   (United States)

Author keywords

average precision; evaluation; maximum entropy; modeling; precision recall curve

Indexed keywords

AVERAGE PRECISION; DISTRIBUTION OF RELEVANT DOCUMENTS; EVALUATION; MAXIMUM ENTROPY DISTRIBUTION; MEASURES OF PERFORMANCE; PRECISION-RECALL CURVE; RELEVANT DOCUMENTS; RETRIEVAL PERFORMANCE;

INFORMATION RETRIEVAL; MODELS;

MAXIMUM ENTROPY METHODS;

EID: 33746264710     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1076034.1076042     Document Type: Conference Paper

References (21)

1. A. L. Berger, V. D. Pietra, and S. D. Pietra. A maximum entropy approach to natural language processing. Comput. Linguist., 22:39-71, 1996.
2. C. Buckley and E. Voorhees. Evaluating evaluation measure stability. In SIGIR '00: Proceedings of the 23rd annual international ACM SIGIR conference on Research and development in information retrieval, pages 33-40. ACM Press, 2000.
3. W. S. Cooper. On selecting a measure of retrieval effectiveness. part i. In Readings in information retrieval, pages 191-204. Morgan Kaufmann Publishers Inc., 1997.
4. T. M. Cover and J. Thomas. Elements of Information Theory. John Wiley & sons, 1991.
5. B. Dervin and M. S. Nilan. Information needs and use. In Annual Review of Information Science and Technology, volume 21, pages 3-33, 1986.
6. W. R. Greiff and J. Ponte. The maximum entropy approach and probabilistic ir models. ACM Trans. Inf. Syst., 18(3):246-287, 2000.
7. E. Jaynes. On the rationale of maximum entropy methods. In Proc.IEEE, volume 70, pages 939-952, 1982.
8. E. T. Jaynes. Information theory and statistical mechanics: Part i. Physical Review 106, pages 620-630, 1957a.
9. E. T. Jaynes. Information theory and statistical mechanics: Part ii. Physical Review 108, page 171, 1957b.
10. Y. Kagolovsky and J. R. Moehr. Current status of the evaluation of information retrieval. J. Med. Syst., 27(5):409-424, 2003. (Pubitemid 38115300)
11. P. B. Kantor and J. Lee. The maximum entropy principle in information retrieval. In SIGIR '86: Proceedings of the 9th annual international ACM SIGIR conference on Research and development in information retrieval, pages 269-274. ACM Press, 1986.
12. D. D. Lewis. Evaluating and optimizing autonomous text classification systems. In SIGIR '95: Proceedings of the 18th annual international ACM SIGIR conference on Research and development in information retrieval, pages 246-254. ACM Press, 1995.
13. R. M. Losee. When information retrieval measures agree about the relative quality of document rankings. J. Am. Soc. Inf. Sci., 51(9):834-840, 2000.
14. K. Nigam, J. Lafferty, and A. McCallum. Using maximum entropy for text classification. In IJCAI-99 Workshop on Machine Learning for Information Filtering, pages 61-67, 1999.
15. D. Pavlov, A. Popescul, D. M. Pennock, and L. H. Ungar. Mixtures of conditional maximum entropy models. In T. Fawcett and N. Mishra, editors, ICML, pages 584-591. AAAI Press, 2003.
16. S. J. Phillips, M. Dudik, and R. E. Schapire. A maximum entropy approach to species distribution modeling. In ICML '04: Twenty-first international conference on Machine learning, New York, NY, USA, 2004. ACM Press.
17. V. Raghavan, P. Bollmann, and G. S. Jung. A critical investigation of recall and precision as measures of retrieval system performance. ACM Trans. Inf. Syst., 7(3):205-229, 1989. (Pubitemid 21659999)
18. A. Ratnaparkhi and M. P. Marcus. Maximum entropy models for natural language ambiguity resolution, 1998.
19. T. Saracevic. Evaluation of evaluation in information retrieval. In SIGIR '95: Proceedings of the 18th annual international ACM SIGIR conference on Research and development in information retrieval, pages 138-146. ACM Press, 1995.
20. C. E. Shannon. A mathematical theory of communication. The Bell System Technical Journal 27, pages 379-423 & 623-656, 1948.
21. N. Wu. The Maximum Entropy Method. Springer, New York, 1997.