Constructing informative prior distributions from domain knowledge in text classification

Proceedings of the Twenty-Ninth Annual International ACM SIGIR Conference on Research and Development in Information Retrieval

Volumn 2006, Issue , 2006, Pages 493-500

  Dayanik, Aynur ^a   Lewis, David D ^b   Madigan, David ^a   Menkov, Vladimir ^c   Genkjn, Alexander ^a  

^a RUTGERS UNIVERSITY   (United States)

^b David D Lewis Consulting   (United States)

^c Aqsaqal Enterprises   (Canada)

Author keywords

Knowledge based; MAP estimation; Maximum entropy

Indexed keywords

ENTROPY; INFORMATION RETRIEVAL; KNOWLEDGE BASED SYSTEMS; LINGUISTICS; REGRESSION ANALYSIS; TEXT PROCESSING; KNOWLEDGE ACQUISITION; MATHEMATICAL MODELS; PARAMETER ESTIMATION;

LOGISTIC REGRESSION; MAP ESTIMATION; MAXIMUM ENTROPY; TEXT CATEGORIZATION;

CLASSIFICATION (OF INFORMATION); SUPERVISED LEARNING;

EID: 33750288406     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1148170.1148255     Document Type: Conference Paper

References (34)

1. Medical Subject Headings - Home Page, 2005. http://www.nlm.nih.gov/mesh.
2. C. Buckley, G. Salton, and J. Allan. The effect of adding relevance information in a relevance feedback environment. In SIGIR '94.
3. B. Carlin and T. Louis. Bayes and Empirical Bayes Methods for Data Analysis. Chapman & Hall, London, 1996.
4. K. Chai, H. Chieu, and H. Ng. Bayesian online classifiers for text classification and filtering. In SIGIR '02, pages 97-104, 2002.
5. C. Chelba and A. Acero. Adaptation of maximum entropy capitalizer: Little data can help a lot. In EMNLP '04, 2004.
6. W. Cohen and D. Kudenko. Transferring and retraining learned information filters. In AAAI/IAAI '97, pages 583-590, 1997.
7. A. Dayanik, D. Fradkin, A. Genkin, P. Kantor, D. Lewis, D. Madigan, and V. Menkov. DIMACS at the TREC 2004 genomics track. In TREC '04, 2005.
8. N. Fuhr and U. Pfeifer. Combining model-oriented and description-oriented approaches for probabilistic indexing. In SIGIR '91. pages 45-56, 1991.
9. E. Gabrilovich and S. Markovitch. Feature generation for text categorization using world knowledge. In IJCAI '05, pages 1048-1053, 2005.
10. A. Genkin, D. Lewis, and D. Madigan. Large-scale Bayesian logistic regression for text categorization. Technometrics, 2006. To appear.
11. W. Hersh, R. Bhuptiraju, L. Ross, A. Cohen, D. Kraemer, and P. Johnson. TREC 2004 genomics track overview. In TREC '04, 2004.
12. T. Joachims. Text categorization with support vector machines: Learning with many relevant features. In ECML '98, pages 137-142, 1998.
13. T. Joachims. Learning to Classify Text Using Support Vector Machines. Kluwer, 2002.
14. R. Jones, A. McCallum, K. Nigam, and E. Riloff. Bootstrapping for text learning tasks. In IJCAI '99 Workshop on Text Mining, 1999.
15. D. Lewis, Y. Yang, T. Rose, and F. Li. RCV1: A new benchmark collection for text categorization research. JMLR, 5:361-397, April 2004.
16. F. Li and Y. Yang. A loss function analysis for classification methods in text categorization. In ICML '03, pages 472-479, 2003.
17. B. Liu, X. Li, W. Lee, and P. Yu. Text classification by labeling words. In AAAI '04, 2004.
18. D. Madigan, J. Gavrin, and A. Raftery. Eliciting prior information to enhance the predictive performance of bayesian graphical models. Communications in Statistics - Theory and Methods, pages 2271-2292, 1995.
19. T. Meyer and B. Whateley. SpamBayes: Effective open-source, Bayesian based, email classification system. In CEAS '04, 2004.
20. K. Nigam, J. Lafferty, and A. McCallum. Using maximum entropy for text classification. In IJCAI'99 Workshop on Information Filtering, 1999.
21. M. Porter. An algorithm for suffix stripping. Program, 14(3):130-137, July 1980.
22. H. Raghavan, O. Madani, and R. Jones. Interactive feature selection. In IJCAI '05, pages 841-846, 2005.
23. G. Salton, editor. The SMART Retrieval System: Experiments in Automatic Document Processing. Prentice-Hall, 1971.
24. G. Salton and C. Buckley. Term-weighting approaches in automatic text retrieval. IPM, 24(5):513-523, 1988.
25. G. Salton and M. McGill. Introduction to modern information retrieval. McGraw-Hill. 1983.
26. R. Schapire, M. Rochery, M. Rahim, and N. Gupta. Incorporating prior knowledge into boosting. In ICML '02, 2002.
27. H. Schutze, D. Hull, and J. Pedersen. A comparison of classifiers and document representations for the routing problem. In SIGIR '95, pages 229-237, 1995.
28. F. Sebastiani. Machine learning in automated text categorization. ACM Computing Surveys, 34(1):1-47, 2002.
29. R. Smith. Bayesian and frequentist approaches to parametric predictive inference (with discussion). In Bayesian Statistics 6. Oxford Univ. Press, 1999.
30. R. Tibshirani. Regression shrinkage and selection via the lasso. J. Royal Statistical Soc. B., 58:267-288, 1996.
31. C. Van Rijsbergen. Information Retrieval. Butterworth-Heinemann, London, 2nd edition, 1979.
32. X. Wu and R. Srihari. Incorporating prior knowledge with weighted margin support vector machines. In KDD '04, pages 326-333, 2004.
33. J. Zhang and Y. Yang. Robustness of regularized linear classification methods in text categorization. In SIGIR'03, pages 190-197, 2003.
34. T. Zhang and F. Oles. Text categorization based on regularized linear classification methods. Information Retrieval, 4:5-31, 2001.