Relative term-frequency based feature selection for text categorization

Proceedings of 2002 International Conference on Machine Learning and Cybernetics

Volumn 3, Issue , 2002, Pages 1432-1436

  Yang, Stewart M ^a   Wu, Xiao Bin ^a   Deng, Zhi Hong ^a   Zhang, Ming ^a   Yang, Dong Qing ^a  

^a PEKING UNIVERSITY   (China)

Author keywords

Feature selection; Relative term frequency; Text categorization

Indexed keywords

CLASSIFICATION (OF INFORMATION); FEATURE EXTRACTION; STATISTICAL METHODS; TEXT PROCESSING;

AUTOMATIC FEATURE SELECTION METHODS; DOCUMENT FREQUENCY; RELATIVE TERM FREQUENCY; TEXT CATEGORIZATION;

LEARNING SYSTEMS;

EID: 0036930581     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (16)

1. Yiming Yang, Jan O. Pedersen, A Comparative Study on Feature Selection in Text Categorization. Proceedings of ICML-97, 14th International Conference on Machine Learning, pp. 412-420, 1997
2. Y. Yang and W.J. Wilbur. Using corpus statistics to remove redundant words in text categorization. In J Amer Soc Inf, 1996
3. Yiming Yang, Xin Liu. A re-examination of text categorization methods. In 22nd Ann Int ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR'99), pp. 42-49, 1999
4. Y. Yang, Expert Network: Effective and efficient learning from human decisions in text categorization and retrieval. In 17th Ann Int ACM SIGIR Conference on Research and Development in information retrieval (SIGIR'94), pp. 13-22, 1994
5. C. Apte, F. Damerau, and S. Weiss. Automated learning of decision rules for text categorization. ACM Transactions on Information Systems, 12(3): pp.233-251, 1994
6. Lewis D.D. and M. Ringuette. Comparison of two learning algorithms for text categorization. In Proceedings of the Third Annual Symposium on Document Analysis and Information Retrieval (SDAIR'94), 1994
7. Kenneth Ward Church and Patrick Hanks. Word association norms, mutual information and lexicography. In proceedings of ACL 27, pp.76-83, Vancouver, Canada, 1989
8. H. Schutze, D.A. Hull, and J.O. Pedersen. A comparison of classifiers and document representations for the routing problem. In 18th Ann Int ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR'95), pp.229-237, 1995
9. R. Fano. Transmission of Information. MIT Press, Cambridge, MA, 1961
10. M.F. Porter. An algorithm for suffix stripping. Program, 14(3), pp. 130-137, 1980
11. Lewis D.D. Reuters-21578 test collection. http://www.research.att.com/~lewis/reuters21578.html
12. News Group test collection. http://www-2.cs.cmu.edu/~mccallum/bow/rainbow/
13. Lewis D.D. Representation and Learning in Information Retrieval. Ph.D. dissertation, University of Massachusetts, USA, 1992
14. Tom Mitchell. Machine Learning. McCraw Hill, 1996
15. E. Wiener, J.O. Pedersen, and A.S. Weigend. A neural network approach to topic spotting. In Proceedings of the Fourth Annual Symposium on Document Analysis and Information Retrieval (SDAIR'95), 1995
16. J.R. Quinlan. Induction of decision trees. Machine Learning, 1(1): pp.81-106, 1986