Study on mutual information-based feature selection for text categorization

Journal of Computational Information Systems

Volumn 3, Issue 3, 2007, Pages 1007-1012

  Xu, Yan ^a,b   Jones, Gareth ^c   Li, Jintao ^a   Wang, Bin ^a   Sun, Chunming ^a,b  

^a INSTITUTE OF COMPUTING TECHNOLOGY   (China)

^b NORTH CHINA ELECTRIC POWER UNIVERSITY   (China)

^c DUBLIN CITY UNIVERSITY   (Ireland)

Author keywords

Feature selection; Information theory; Mutual information; Text categorization

Indexed keywords

ELECTRONIC DOCUMENT IDENTIFICATION SYSTEMS; FEATURE EXTRACTION; INFORMATION THEORY;

FEATURE SELECTION; MUTUAL INFORMATION; TEXT CATEGORIZATION;

TEXT PROCESSING;

EID: 34250708626     PISSN: 15539105     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (16)

1. S. Doan and S. Horiguchi, 'An Efficient Feature Selection using Multi-Criteria in Text Categorization for Naive Bayes Classifier', WSEAS Transactions on Information Science and Applications, Vol.2, Issue 2, pp. 98-103, 2005.
2. Y. Liu, A Comparative Study on Feature Selection Methods for Drug Discovery, J. Chem. Inf. Comput. Sci. 2004, 44, 1823-1828.
3. St. M. Yang, X.-B. Wu, Z.-H. Deng, M. Zhang and D.-Q. Yang. 2002 Modification of Feature Selection Methods Using Relative Term Frequency. Proceedings of ICMLC-2002, pp. 1432-1436.
4. Y. Yang, J. and O. Pedersen. 1997. A Comparative Study on Feature Selection in Text Categorization. Proceedings of ICML-97, pp. 412-420.
5. F. Sebastiani, Machine Learning in Automated Text Categorization. ACM Computing Surveys, 34(1): 1-47. 2002.
6. K. W. Church and P. Hanks. Word Association Norms, Mutual Information and Lexicography. In Proceedings of ACL 27, pp. 76-83, Vancouver, Canada, 1989.
7. J. R. Quinlan. Induction of Decision Trees. Machine Learning, 1(1): pp. 81-106, 1986.
8. T. Mitchell. Machine Learning. McCraw Hill, 1996.
9. E. Wiener, J. O. Pedersen, and A. S. Weigend. A Neural Network Approach to Topic Spotting. In Proceedings of the Fourth Annual Symposium on Document Analysis and Information Retrieval (SDAIR'95), 1995.
10. T. M. Cover and J. A. Thomas, Elements of Information Theory, 1991 John Wiley and Sons, Inc. Print ISBN 0-471-06259-6 Online ISBN 0-471-20061-1.
11. C. E. Shannon, A mathematical theory of communication, Bell System Technical Journal, Vol.27, pp. 379-423 and 623-656, July and October, 1948.
12. Y. Yang and X. Liu. A re-examination of text categorization methods. (SIGIR'99), pp. 42-49, 1999.
13. H. Zhang. The Optimality of Naive Bayes. The 17th International FLAIRS conference, Miami Beach, May 17-19, 2004.
14. Y. Yang. An Evaluation of Statistical Approaches to Text Categorization. Journal of Information Retrieval, Vol 1, No.1/2, pp 67-88, 1999.
15. Reuters21578. http://www.daviddlewis.com/resources/testcollections/reuters21578/
16. OHSUMED. http://www.cs.umn.edu/%CB%9Chan/data/tmdata.tar.gz.