The impact of preprocessing on text classification

Information Processing and Management

Volumn 50, Issue 1, 2014, Pages 104-112

  Uysal, Alper Kursat ^a   Gunal, Serkan ^a  

^a ANADOLU UNIVERSITY   (Turkey)

Author keywords

Pattern recognition; Text categorization; Text classification; Text preprocessing

Indexed keywords

BENCHMARK DATASETS; CLASSIFICATION ACCURACY; DIMENSION REDUCTION; EXPERIMENTAL ANALYSIS; FEATURE DIMENSIONS; TEXT CATEGORIZATION; TEXT CLASSIFICATION; TEXT PREPROCESSING;

CLASSIFICATION (OF INFORMATION); PATTERN RECOGNITION;

TEXT PROCESSING;

EID: 84884546254     PISSN: 03064573     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ipm.2013.08.006     Document Type: Article

References (34)

1. Asuncion, A.; Newman, D. J. (2007). UCI machine learning repository. In C. A. Irvine (Ed.), University of California, Department of Information and Computer Science.
2. F. Can, S. Kocberber, E. Balcik, C. Kaynak, H.C. Ocalan, and O.M. Vursavas Information retrieval on Turkish texts Journal of the American Society for Information Science and Technology 59 2008 407 421 (Pubitemid 351291633)
3. Y.-T. Chen, and M.C. Chen Using chi-square statistics to measure similarities for text categorization Expert Systems with Applications 38 2011 3085 3090
4. N. Cheng, R. Chandramouli, and K.P. Subbalakshmi Author gender identification from text Digital Investigation 8 2011 78 88
5. R. Duwairi, M.N. Al-Refai, and N. Khasawneh Feature reduction techniques for Arabic text categorization Journal of the American Society for Information Science and Technology 60 2009 2347 2352
6. S. Ergin, E.S. Gunal, H. Yigit, and R. Aydin Turkish anti-spam filtering using binary and probabilistic models AWERProcedia Information Technology and Computer Science 1 2012 1007 1012
7. G. Feng, J. Guo, B.Y. Jing, and L. Hao A Bayesian feature selection paradigm for text classification Information Processing & Management 48 2012 283 302
8. G. Forman An extensive empirical study of feature selection metrics for text classification Journal of Machine Learning Research 3 2003 1289 1305
9. M. Ghiassi, M. Olschimke, B. Moon, and P. Arnaudo Automated text classification using a dynamic artificial neural network model Expert Systems with Applications 39 2012 10967 10976
10. Gonçalves, C. A.; Gonçalves, C. T.; Camacho, R.; Oliveira, E. C. (2010). The impact of pre-processing on the classification of MEDLINE documents. In Proceedings of the 10th international workshop on pattern recognition in information systems (pp. 53-61).
11. S. Gunal, and R. Edizkan Subspace based feature selection for pattern recognition Information Sciences 178 2008 3716 3726
12. S. Gunal, S. Ergin, M.B. Gulmezoglu, and O.N. Gerek On feature extraction for spam e-mail detection Lecture Notes in Computer Science 4105 2006 635 642 (Pubitemid 44743899)
13. T. Joachims A probabilistic analysis of the Rocchio algorithm with tfidf for text categorization 14th international conference on machine learning 1997 Morgan Kaufmann Publishers Inc 143 151
14. M.A. Kumar, and M. Gopal A comparison study on multiple binary-class SVM methods for unilabel text categorization Pattern Recognition Letters 31 2010 1437 1444
15. C. Lee, and G.G. Lee Information gain and divergence-based feature selection for machine learning-based text categorization Information Processing & Management 42 2006 155 165 (Pubitemid 41119082)
16. H. Liu, J. Sun, L. Liu, and H. Zhang Feature selection with dynamic mutual information Pattern Recognition 42 2009 1330 1339
17. I. Maks, and P. Vossen A lexicon model for deep sentiment analysis and opinion mining applications Decision Support Systems 53 2012 680 688
18. J.R. Méndez, E.L. Iglesias, F. Fdez-Riverola, F. Díaz, and J.M. Corchado Tokenising, stemming and stopword removal on anti-spam filtering domain Proceedings of the 11th spanish association conference on current topics in artificial intelligence 2006 Santiago de Compostela, Spain Springer-Verlag
19. Metsis, V.; Androutsopoulos, I.; Paliouras, G. (2006). Spam filtering with naive Bayes - Which naive Bayes? In 3rd conference on email and anti-spam (Vol. 17, pp. 28-69).
20. S.A. Ozel A web page classification system based on a genetic algorithm using tagged-terms as features Expert Systems with Applications 38 2011 3407 3415
21. J. Pomikálek, and R. Rehurek The Influence of preprocessing parameters on text categorization International Journal of Applied Science, Engineering and Technology 4 2007 430 434
22. M.F. Porter An algorithm for suffix stripping Program 14 1980 130 137
23. G. Salton, A. Wong, and C.S. Yang A vector space model for automatic indexing Communications of the ACM 18 1975 613 620
24. W. Shang, H. Huang, H. Zhu, Y. Lin, Y. Qu, and Z. Wang A novel feature selection algorithm for text categorization Expert Systems with Applications 33 2007 1 5 (Pubitemid 44959912)
25. F.X. Song, S.H. Liu, and J.Y. Yang A comparative study on text representation schemes in text categorization Pattern Analysis and Applications 8 2005 199 209
26. S. Tan, Y. Wang, and G. Wu Adapting centroid classifier for document categorization Expert Systems with Applications 38 2011 10264 10273
27. S. Theodoridis, and K. Koutroumbas Pattern recognition 4th ed. 2008 Academic Press
28. Toman, M.; Tesar, R.; Jezek, K. (2006). Influence of word normalization on text classification. In Proceedings of the 1st international conference on multidisciplinary information sciences & technologies (Vol. 2, pp. 354-358). Merida, Spain.
29. Toraman, C.; Can, F.; Kocberber, S. (2011). Developing a text categorization template for Turkish news portals. In International symposium on innovations in intelligent systems and applications (INISTA) (pp. 379-383).
30. Torunoglu, D.; Cakirman, E.; Ganiz, M. C.; Akyokus, S.; Gurbuz, M. Z. (2011). Analysis of preprocessing methods on classification of Turkish texts. In International Symposium on Innovations in Intelligent Systems and Applications (INISTA) (pp. 112-117).
31. Uysal, A. K.; Gunal, S.; Ergin, S.; Gunal, E. S. (2012). A novel framework for sms spam filtering. In Proceedings of the IEEE international symposium on innovations in intelligent systems and applications. Trabzon, Turkiye.
32. A.K. Uysal, and S. Gunal A novel probabilistic feature selection method for text classification Knowledge-Based Systems 36 2012 226 235
33. Y. Yang, and J.O. Pedersen A comparative study on feature selection in text categorization 14th international conference on machine learning 1997 Morgan Kaufmann Publishers Inc 412 420
34. Zemberek. < http://code.google.com/p/zemberek/ > (Accessed January 2013).