BNS feature scaling: An improved representation over TF-IDF for SVM text classification

International Conference on Information and Knowledge Management, Proceedings

Volumn , Issue , 2008, Pages 263-270

  Forman, George ^a  

^a HEWLETT PACKARD LABORATORIES   (United States)

Author keywords

Feature selection; Feature weighting; IDF text representation; Machine learning; Support vector machine; Text classification; TF

Indexed keywords

FEATURE SELECTION; FEATURE WEIGHTING; IDF TEXT REPRESENTATION; MACHINE LEARNING; TEXT CLASSIFICATION; TF;

IMAGE RETRIEVAL; KNOWLEDGE MANAGEMENT; ROBOT LEARNING; SUPPORT VECTOR MACHINES; VECTORS;

TEXT PROCESSING;

EID: 65749103423     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1458082.1458119     Document Type: Conference Paper

References (17)

1. Dumais, S., Platt, J., Heckerman, D. and Sahami, M. Inductive Learning Algorithms and Representations for Text Categorization. In Proc. of the 17th Intl. Conf. on Information and Knowledge Management(CIKM, Maryland):148-155, 1998.
2. Forman, G. BNS Scaling: A Complement to Feature Selection for SVM Text Classification. Hewlett-Packard Labs Tech Report HPL-2006-19, 2006.
3. Forman, G. Tackling concept drift by temporal inductive transfer. In Proc. of the 29th Int'l ACM Conf. on Research and Development in Information Retrieval(SIGIR, Seattle):252-259, 2006.
4. Forman, G. An Extensive Empirical Study of Feature Selection Metrics for Text Classification. Special Issue on Variable and Feature Selection, Journal of Machine Learning Research, 3(Mar):1289-1305, 2003.
5. Gabrilovich, E., and Markovitch, S. Feature Generation for Text Categorization Using World Knowledge. In Proc. of the 19th Intl. Joint Conference for Artificial Intelligence(IJCAI, Edinburgh), 2005.
6. Gabilovich, E. and Markovitch, S. Text Categorization with Many Redundant Features: Using Aggressive Feature Selection to Make SVMs Competitive with C4.5. In Proc. of the 21st Intl. Conf. on Machine Learning(ICML), 2004.
7. th European Conf. on the Principles of Data Mining and Knowledge Discovery(PKDD): 424-431, 2000.
8. th ACM SIGKDD Int'l Conf. on Knowledge Discovery and Data Mining(KDD, Philly):217-226, 2006.
9. th European Conf. on Machine Learning(ECML, Berlin):137-142, 1998.
10. Manning, C. and Schütze, H. Foundations of Statistical Natural Language Processing.MIT Press, 1999.
11. th National Conf. on Artificial Intelligence(AAAI), 1998.
12. th ACM SIGIR Conf. on Research and Development in Information Retrieval(SIGIR,Sheffield):234-241, 2004.
13. th Intl. Conf. on Machine Learning(ICML):258-267, 1999.
14. th Intl. Conf. on Information and Knowledge Management(CIKM, Virginia):659-661, 2002.
15. Wettschereck, D., Aha, D. W., and Mohri, T. A Review and Empirical Evaluation of Feature Weighting Methods for a Class of Lazy Learning Algorithms. Artificial Intelligence Review 11, 1-5, 273-314, 1997.
16. nd edition),Morgan Kaufmann, 2005. http://www.cs.waikato.ac.nz/̃ml/weka
17. Yang, Y. and Pedersen, J. A Comparative Study on Feature Selection in Text Categorization. In Proc. of the Intl. Conf. on Machine Learning(ICML):412-420, 1997.