Support vector machines based Arabic language text classification system: Feature selection comparative study

Advances in Computer and Information Sciences and Engineering

Volumn , Issue , 2008, Pages 11-16

  Mesleh, Abdelwadood Moh'd ^a  

^a AL BALQA APPLIED UNIVERSITY   (Jordan)

Author keywords

[No Author keywords available]

Indexed keywords

ARABIC LANGUAGES; COMPARATIVE STUDIES; MACROAVERAGING; TEXT CLASSIFICATION; TEXT CLASSIFICATION SYSTEMS;

CLASSIFICATION (OF INFORMATION); MACROS;

SOFTWARE ENGINEERING;

EID: 79251509497     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1007/978-1-4020-8741-7_3     Document Type: Conference Paper

References (51)

1. C. Manning, and H. Schütze, "Foundations of Statistical Natural Language Processing", MIT Press (1999).
2. F. Sebastiani, "Machine Learning in Automated Text Categorization", ACM Computing Surveys, Vol. 34, No. 1, 2002, pp.1-47.
3. A. McCallum, and K. Nigam, "A comparison of event models for naïve Bayes text classification", AAAI-98 Workshop on Learning for Text Categorization, 1998, pp.41-48.
4. nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR'99), 1999, pp. 42-49.
5. th International Conference on Intelligent Text Processing and Computational Linguistic, CICLing-2004, LNCS 2945, Springer-Verlag, pages, 2004, pp. 559-570.
6. th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR'94), 1994, pp. 13-22.
7. T. Joachims, "Text categorization with Support Vector Machines: learning with many relevant features", Proceedings of the European Conference on Machine Learning (ECML'98), Berlin, 1998, pp.137-142, Springer.
8. D. Lewis, and M. Ringuette, "A comparison of two learning algorithms for text categorization", The Third Annual Symposium on Document Analysis and Information Retrieval, 1994, pp.81-93.
9. R. Schapire, and Y. Singer, "BoosTexter: A boosting-based system for text categorization", Machine Learning, Vol. 39, No.2-3, 2000, pp.135- 168.
10. S. Gao, W. Wu, C-H. Lee, and T-S. Chua, "A maximal figure-of-merit (MFoM)-learning approach to robust classifier design for text categorization", ACM Transactions on Information Systems, Vol. 24, No. 2, 2006, pp. 190-218.
11. J. Zhang, R. Jin, Y.M. Yang, and A. Hauptmann, "A modified logistic regression: an approximation to SVM and its applications in large-scale Text Categorization", Proceedings of the Twentieth International Conference (ICML 2003), August 21-24, 2003, Washington, DC, USA, pp. 888-895.
12. F. Ciravegna, et.al., "Flexible Text Classification for Financial Applications: the FACILE System", Proceedings of PAIS-2000, Prestigious Applications of Intelligent Systems sub-conference of ECAI2000, 2000, pp.696-700.
13. F. Peng, X. Huang, D. Schuurmans, and S. Wang, "Text Classification in Asian Languages without Word Segmentation", Proceedings of the Sixth International Workshop on Information Retrieval with Asian Languages (IRAL 2003), Association for Computational Linguistics, July 7, Sapporo, Japan, 2003, pp. 41-48.
14. J. He, A-H. TAN, and C-L. TAN, "On Machine Learning Methods for Chinese document Categorization", Applied Intelligence, 2003, pp. 311- 322.
15. th Conference of the Internet and Information Technology in Modern Organizations, December, Cairo, Egypt, 2005, pp. 13-15.
16. Sakhr company website: http://www.sakhr.com.
17. A.M. El-Halees, "Arabic Text Classification Using Maximum Entropy", The Islamic University Journal, Vol. 15, No. 1, 2007, pp 157-167.
18. nd international Conference on Software and Data Technologies, (Knowledge Engineering), Volume 1, Barcelona, Spain, July, 22-25, 2007, pp. 235-240.
19. A.M. Mesleh, "CHI Square Feature Extraction Based SVMs Arabic Language Text Categorization System", Journal of Computer Science, Vol. 3, No. 6, 2007, pp. 430-435.
20. th, 2004, pp. 51-58.
21. th International Multiconference on Computer Science and Information Technology (CSIT 2006), Vol. 4, Amman, Jordan, April 5-7, 2006, Retrieved March 20, 2007, from http://csit2006.asu.edu.jo/proceedings.
22. th International Multiconference on Computer Science and Information Technology (CSIT 2006), Vol. 4, Amman, Jordan, April 5-7, 2006, Retrieved March 20, 2007, from http://csit2006.asu.edu.jo/proceedings.
23. M. Syiam, Z. Fayed, and M. Habib, "An Intelligent System for Arabic Text Categorization", International Journal of Intelligent Computing and Information Ssciences, Vol.6, No.1, 2006, pp. 1-19.
24. H. Sawaf, J. Zaplo, and H. Ney, "Statistical Classification Methods for Arabic News Articles", Paper presented at the Arabic Natural Language Processing Workshop (ACL2001), Toulouse, France. ( Retrieved from Arabic NLP Workshop at ACL/EACL 2001 website: http://www.elsnet.org/acl2001-arabic.html).
25. R.M. Duwairi, "A Distance-based Classifier for Arabic Text Categorization", Proceedings of the 2005 International Conference on Data Mining (DMIN2005), Las Vegas, USA, 2005, pp.187-192.
26. L. Khreisat, "Arabic Text Classification Using N-Gram Frequency Statistics A Comparative Study", Proceedings of the 2006 International Conference on Data Mining (DMIN2006). Las Vegas, USA, 2006, pp.78-82.
27. R.M. Duwairi, "Machine Learning for Arabic Text Categorization" , Journal of American society for Information Science and Technology, Vol. 57, No. 8, 2006, pp.1005-1010.
28. M. Benkhalifa, A. Mouradi, and H. Bouyakhf, "Integrating WordNet knowledge to supplement training data in semi-supervised agglomerative hierarchical clustering for text categorization", International Journal of Intelligent Systems, Vol. 16, No. 8, 2001, pp. 929-947..
29. th International Conference on Machine Learning (ICML'97), Morgan Kaufmann, 1997, pp.412-420.
30. G. Forman, "An Extensive Empirical Study of Feature Selection Metrics for Text Classification", Journal of Machine Learning Research, Vol. 3, 2003, pp. 1289-1305.
31. G. Salton, A. Wong, and C.S. Yang, "A Vector Space Model for Automatic Indexing", Communications of the ACM, Vol. 18, No. 11, 1975, pp. 613-620.
32. G. Salton, and C. Buckley, "Term weighting approaches in automatic text retrieval", Information Processing and Management, Vol. 24, No. 5, 1988, pp. 513-523.
33. T. Hofmann, "Introduction to Machine Learning", Draft Version 1.1.5, November 10, 2003.
34. M. Dash, M., K. Choi, P. Scheuermann, and H. Liu, "Feature Selection for Clustering-a Filter Solution", Proceedings of the second International Conference of Data Mining, 2002, pp. 115-122.
35. P. Mitra, C.-A. Murthy, and S.-K. Pal, "Unsupervised Feature Selection Using Feature Similarity". IEEE Transaction of Pattern Analysis and Machine Intelligence, Vol. 24, No. 3, 2002, pp. 301-312.
36. R. Kohavi, G.H. John, "Wrappers for feature subset selection", Artificial Intelligence, Vol. 97, No. 1-2, 1997, pp.273-324.
37. E. Leopold, and J. Kindermann, "Text Categorization with Support Vector Machines. How to Represent Texts in Input Space?", Machine Learning, Vol. 46, 2002, pp. 423-444.
38. K. Nigam, A.K. Mccallum, S. Thrun, and T. Mitchell, "Text Classification from Labeled and Unlabeled Documents Using EM", Machine Learning, Vol. 39, 2000, pp. 103-134.
39. D. Mladenic, "Feature subset selection in text learning", Proceedings of European Conference on Machine Learning (ECML), 1998, pp. 95-100.
40. th Conference of the American Association for Artificial Intelligence (Orlando, US, 1999), 1999, pp. 480-486.
41. D. Lewis, "Feature Selection and Feature Extraction for Text Categorization", Proceedings of a workshop on speech and natural language, San Mateo, CA: Morgan Kaufmann, 1992, pp. 212-217.
42. M. Dash, and H. Liu, "Feature selection for classification", Intelligent Data Analysis, Vol. 1, No. 3, 1997, pp.131-156.
43. H. Liu, and L. Yu, "Toward integrating feature selection algorithms for classification and clustering", IEEE Transaction on Knowledge and Data Engineering, Vol. 17, No. 4, 2005, pp. 491-502.
44. H. Liu, "Evolving feature selection", IEEE Intelligent Systems, 2005, pp.64-76.
45. S. Das, "Filters, wrappers and a boosting-based hybrid for feature selection", Proceedings of the Eighteenth International Conference on Machine Learning, 2001, pp. 74-81.
46. A.L Blum, and P. Langley, "Selection of Relevant Features and Examples in machine Learning", Artificial Intelligence, Vol. 97, No. 1-2, 1997, pp. 245-271.
47. D. Mladenic, and M. Grobelnik, "Feature Selection for Unbalanced Class Distribution and Naïve Bayes", Proceedings of the Sixteenth International Conference on Machine Learning (ICML), 1999, pp. 258- 267.
48. th ACM International Conference on Research and Development in Information Retrieval, Philadelphia, PA, 1997, pp. 67-73.
49. th European Conference on Research and Advanced Technology for Digital Libraries, Lisbon, Portugal, 2000, pp. 59-68.
50. V. Vapnik, "The Nature of Statistical Learning Theory", Springer- Verlag, New York, 1995.
51. R. Baeza-Yates, and B. Rieiro-Neto, "Modern Information Retrieval", Addison-Wesley & ACM Press, 1999.