A local-concentration-based feature extraction approach for spam filtering

IEEE Transactions on Information Forensics and Security

Volumn 6, Issue 2, 2011, Pages 486-497

  Zhu, Yuanchun ^a   Tan, Ying ^a  

^a PEKING UNIVERSITY   (China)

Author keywords

Artificial immune system (AIS); bag of words (BoW); feature extraction; global concentration (GC); local concentration (LC); spam filtering

Indexed keywords

ARTIFICIAL IMMUNE SYSTEM; BAG-OF-WORDS (BOW); GLOBAL CONCENTRATION (GC); LOCAL CONCENTRATION (LC); SPAM FILTERING;

FEATURE EXTRACTION; IMMUNOLOGY; INTERNET;

CONCENTRATION (PROCESS);

EID: 79957511078     PISSN: 15566013     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIFS.2010.2103060     Document Type: Article

References (33)

1. Commtouch, Q4 2008 Internet Threats Trend Report Jan. 2009 [Online]. Available: http://www.pallas.com/fileadmin/img/content/ publikationen/Commtouch- Pallas-2008-Q4-Internet- Threats-Trend-Report.pdf
2. R. Jennings, Cost of Spam is Flattening-Our 2009 Predictions Ferris Research, Jan. 2009 [Online]. Available: http://www.ferris.com/ 2009/01/28/cost-of-spam-is-flattening-our-2009-predictions/
3. M. Sahami, S. Dumais, D. Heckerman, and E. Horvitz, A Baysian Approach to Filtering Junk e-mail AAAI Tech. Rep.WS-98-05, 1998, pp. 55-62.
4. R. Segal, "Combining global and personal anti-spam filtering," in Proc. 4th Conf. Email and Anti-spam (CEAS' 07), California, 2007.
5. A. Ciltik and T. Gungor, "Time-efficient spam e-mail filtering using n-gram models," Pattern Recognit. Lett., vol. 29, no. 1, pp. 19-33, 2008. (Pubitemid 350026659)
6. H. Drucker, D. Wu, and V. Vapnik, "Support vector machines for spam categorization," IEEE Trans. Neural Netw., vol. 10, no. 5, pp. 1048-1054, Sep. 1999.
7. G. Ruan and Y. Tan, "Intelligent detection approaches for spam," in Proc. Third Int. Conf. Natural Computation (ICNC07), Haikou, China, 2007, pp. 1-7.
8. S. Bickel and T. Scheffer, "Dirichlet-enhanced spam filtering based on biased samples," Adv. Neural Inf. Process. Syst., vol. 19, pp. 161-168, 2007.
9. I. Kanaris, K. Kanaris, I. Houvardas, and E. Stamatatos, "Words versus character N-grams for anti-spam filtering," Int. J. Artif. Intell. T., vol. 16, no. 6, pp. 1047-1067, 2007. (Pubitemid 350281097)
10. I. Androutsopoulos, G. Paliouras, V. Karkaletsis, G. Sakkis, C. D. Spyropoulos, and P. Stamatopoulos, "Learning to filter spam e-mail: A comparison of a naive bayesian and a memory-based approach," in Proc. Workshop "Machine Learning and Textual Information Access," 4th Eur. Conf. Principles and Practice of Knowledge Discovery in Databases (PKDD' 00), 2000, pp. 1-13.
11. G. Sakkis, I. Androutsopoulos, G. Paliouras, V. Karkaletsis, C. D. Spyropoulos, and P. Stamatopoulos, "A memory-based approach to antispam filtering for mailing lists," Inform. Retrieval, vol. 6, no. 1, pp. 49-73, 2003. (Pubitemid 39046524)
12. J. Clark, I. Koprinska, and J. Poon, "A neural network based approach to automated e-mail classification," in Proc. IEEE Int. Conf. Web Intelligence (WI' 03), Halifax, Canada, 2003, pp. 702-705.
13. C.-H. Wu, "Behavior-based spam detection using a hybrid method of rule-based techniques and neural networks," Expert Syst. Appl., vol. 36, no. 3, pp. 4321-4330, Apr. 2009.
14. X. Carreras and L. Márquez, "Boosting trees for anti-spam email filtering," in Proc. 4th Int. Conf. Recent Advances in Natural Language Processing (RANLP' 01), 2001, pp. 58-64.
15. J. R. He and B. Thiesson, "Asymmetric gradient boosting with application to spam filtering," in Proc. 4th Conf. Email and Anti-spam (CEAS'07), California, 2007.
16. T. Oda and T. White, "Developing an immunity to spam," Lecture Notes Comput. Sci. (LNCS), pp. 231-242, 2003.
17. T. S. Guzella, T. A. Mota-Santos, J. Q. Uchôa, and W. M. Caminhas, "Identification of spam messages using an approach inspired on the immune system," Biosystems, vol. 92, no. 3, pp. 215-225, Jun. 2008.
18. Y. Tan, C. Deng, and G. Ruan, "Concentration based feature construction approach for spam detection," in Proc. IEEE Int. Joint Conf. Neural Networks (IJCNN2009), Atlanta, GA, Jun. 14-19, 2009, pp. 3088-3093.
19. G. Ruan and Y. Tan, "A three-layer back-propagation neural network for spam detection using artificial immune concentration," Soft Comput., vol. 14, pp. 139-150, 2010.
20. D. Dasgupta, "Advances in artificial immune systems," IEEE Comput. Intell. Mag., vol. 1, no. 4, pp. 40-49, Nov. 2006.
21. Wikipedia [Online]. Available: http://en.wikipedia.org/wiki/Information- gain
22. I. Koprinska, J. Poon, J. Clark, and J. Chan, "Learning to classify e-mail," Inform. Sci., vol. 177, pp. 2167-2187, 2007. (Pubitemid 46356315)
23. Y. Yang and J. O. Pedersen, "A comparative study on feature selection in text categorization," in Proc. Int. Conf. Machine Learning (ICML'97), 1997, pp. 412-420.
24. T. S. Guzella and M. Caminhas, "A review of machine learning approaches to spam filtering," Expert Syst. Appl., vol. 36, pp. 10206-10222, 2009.
25. E. Blanzieri and A. Bryl, A Survey of Learning-Based Techniques of e-mail Spam Filtering University of Trento, Information Engineering and Computer Science Department, Trento, Italy, Tech. Rep. DIT-06-065, Jan. 2008.
26. I. Androutsopoulos, G. Paliouras, and E. Michelakis, Learning to Filter Unsolicited Commercial E-mail NCSR "Demokritos" Tech. Rep. 2004/2, Oct. 2006, minor corrections.
27. K.-M. Schneider, "A comparison of event models for naive bayes antispam e-mail filtering," in Proc. 10th Conf. Eur. Chapter of the Association for Computational Linguistics, 2003, pp. 307-314.
28. W. S. Yerazunis, "Sparse binary polynomial hashing and the CRM114 discriminator," in Proc. 2003 Spam Conf., Cambrige, MA, 2003.
29. C. Siefkes, F. Assis, S. Chhabra, and W. S. Yerazunis, "Combining winnow and orthogonal sparse bigrams for incremental spam filtering," Lecture Notes Comput. Sci., vol. 3202/2004, pp. 410-421, 2004. (Pubitemid 39740421)
30. G. V. Cormack, "Content-based web spam detection," in Proc. 3rd Int. Workshop Adversarial Information Retrieval on the Web (AIRWeb'07), Banff, Canada, 2007.
31. D. Sculley, "Advances in Online Learning-Based Spam Filtering," Ph.D. dissertation, Tufts Univ., Somerville, MA, 2008.
32. V. Metsis, I. Androutsopoulos, and G. Paliouras, "Spam filtering with naive bayes-Which naive bayes?," in Proc. 3rd Conf. Email and Anti- Spam (CEAS'06), Mountain View, CA, 2006, pp. 125-134.
33. C.-C. Chang and C.-J. Lin, LIBSVM: a Library for Support Vector Machines [Online]. Available: http://www.csie.ntu.edu.tw/~cjlin/libsvm