Analytical evaluation of term weighting schemes for text categorization

Pattern Recognition Letters

Volumn 31, Issue 11, 2010, Pages 1310-1323

  Altinçay, Hakan ^a   Erenel, Zafer ^a  

^a EASTERN MEDITERRANEAN UNIVERSITY   (Turkey)

Author keywords

Contour lines; Relative weights; Term occurrence probability; Term weighting; Text categorization

Indexed keywords

CONTOUR LINE; RELATIVE WEIGHTS; TERM OCCURRENCES; TERM WEIGHTING; TEXT CATEGORIZATION;

CONTOUR MEASUREMENT; TEXT PROCESSING;

PROBABILITY;

EID: 77953131475     PISSN: 01678655     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patrec.2010.03.012     Document Type: Article

References (28)

1. Buckley, C., 1985. Implementation of the smart information retrieval system. Technical Report, Cornell University, Ithaca, USA.
2. Chen J., Huang H., Tian S., and Qu Y. Feature selection for text classification with naive Bayes. Expert Syst. Appl. 36 (2009) 5432-5435
3. Craven, M., DiPasquo, D., Freitag, D., McCallum, A., Mitchell, T., Nigam, K., Slattery, S., 1998. Learning to extract symbolic knowledge from the world wide web. In: Proc. 1998 National Conf. on Artificial Intelligence.
4. Debole, F., Sebastiani, F., 2003. Supervised term weighting for automated text categorization. In: SAC '03: Proc. 2003 ACM Symp. on Applied Computing, New York, NY, USA. ACM, pp. 784-788.
5. Debole F., and Sebastiani F. An analysis of the relative hardness of Reuters-21578 subsets. J. Amer. Soc. Inform. Sci. Technol. 56 6 (2004) 584-596
6. Duda R.O., Hart P.E., and Stork D.G. Pattern Classification (2001), John Wiley and Sons
7. Erenel, Z., Alti{dotless}nçay, H., Varoǧlu, E., 2009. A symmetric term weighting scheme for text categorization based on term occurrence probabilities. In: Proc. Fifth Internat. Conf. on Soft Computing, Computing with Words and Perceptions in System Analysis, Decision and Control (ICSCCW), Famagusta. Northern Cyprus.
8. Forman G. An extensive empirical study of feature selection metrics for text classification. J. Mach. Learn. Res. 3 (2003) 1289-1305
9. Forman G. Feature selection for text classification. Computational Methods of Feature Selection (2007), Chapman and Hall/CRC Press
10. Guo, G., Wang, H., Greer, K., 2004. An knn model-based approach and its application in text categorization. In: Proc. 5th Internat. Conf. on Computational Linguistics and Intelligence Text Processing, pp. 559-570.
11. Joachims, T., 1997. A probabilistic analysis of the Rocchio algorithm with tfidf for text categorization. In: Proc. 14th Internat. Conf. on Machine Learning, pp. 143-151.
12. Joachims, T., 1998. Text categorization with support vector machines: learning with many relevant features. In: Proc. 10th European Conf. Machine Learning, pp. 137-142.
13. Joachims T. Making large-scale SVM learning practical. In: Schölkoph B., Burges C.J.C., and Smola A.J. (Eds). Advances in Kernel Methods-Support Vector Learning (1999), MIT Press, Cambridge, MA 169-184
14. Lan M., Tan C.L., Su J., and Lu Y. Supervised and traditional term weighting methods for automatic text categorization. IEEE Trans. Pattern Anal. Machine Intell. 31 4 (2009) 721-735
15. Leopold E., and Kindermann J. Text categorization with support vector machines.how to represent texts in input space?. Machine Learning 46 1-3 (2002) 423-444
16. Liu H., and Yu L. Toward integrating feature selection algorithms for classification and clustering. IEEE Trans. Knowledge Data Eng. 17 4 (2005) 491-502
17. Liu Y., Loh H.T., and Sun A. Imbalanced text classification: A term weighting approach. Expert Systems with Applications 36 (2009) 690-701
18. Mladenic D., and Grobelnik M. Feature selection on hierarchy of web documents. Decision Support Syst. 35 1 (2003) 45-87
19. Özgür, A., Özgür, L., Güngör, T., 2005. Text categorization with class-based and corpus-based keyword selection. In: Proc. 20th Internat. Symp. on Computer and Information Sciences. Lecture Notes in Computer Science, vol. 3733, Springer-Verlag, pp. 606-615.
20. Porter M.F. An algorithm for suffix stripping. Program 14 3 (1980) 130-137
21. Rogati, M., Yang, Y., 2002. High-performing feature selection for text classification. In: Proc. Eleventh Internat. Conf. Information and Knowledge Management, pp. 659-661.
22. Sebastiani F. Machine learning in automated text categorization. ACM Comput. Surveys 34 1 (2002) 1-47
23. Selamat A., and Omatu S. Web page feature selection and classification using neural networks. Inform. Sci. 158 (2004) 69-88
24. Tan S. Neighbor-weighted k-nearest neighbor for unbalanced text corpus. Expert Syst. Appl. 28 (2005) 667-671
25. Tsai R.T., Hung H., Dai H., Lin Y., and Hsu W. Exploiting likely-positive and unlabeled data to improve the identification of protein-protein interaction articles. BMC Bioinform. 9 (2008)
26. Yang, Y., Pedersen, J.O., 1997. A comparative study on feature selection in text categorization. In: Proc. ICML'97, 14th Internat. Conf. on Machine Learning. Morgan Kaufmann Publishers, San Francisco, US, pp. 412-420.
27. Zheng, Z., Srihari, R., 2003. Optimally combining positive and negative features for text categorization. In: Workshop for Learning from Imbalanced Datasets II, Proc. ICML, Washington, DC.
28. Zheng Z., Wu X., and Srihari R. Feature selection for text categorization on imbalanced data. SIGKDD Explor. Newsl. 6 1 (2004) 80-89