An overview of content-based spam filtering techniques

Informatica (Ljubljana)

Volumn 31, Issue 3, 2007, Pages 269-277

  Khorsi, Ahmed ^a  

^a UNIVERSITY OF SIDI BEL ABBES   (Algeria)

Author keywords

Antispam filters; Email classification; Text categorization

Indexed keywords

COMPUTER VIRUSES; CONTENT BASED RETRIEVAL; INTERNET; TELECOMMUNICATION SERVICES; USER INTERFACES;

ANTISPAM FILTERS; CONTENT-BASED SPAMS; EMAIL CLASSIFICATION; TEXT CATEGORIZATION;

SPAMMING;

EID: 36749057350     PISSN: 03505596     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Review

References (61)

1. M. Ahluwalia and L. Bull. A genetic programmingbased classifier system. In Wolfgang Banzhaf, Jason Daida, Agoston E. Eiben, Max H. Garzon, Vasant Honavar, Mark Jakiela, and Robert E. Smith, editors, Proceedings of the Genetic and Evolutionary Computation Conference, volume 1, pages 11-18, Orlando, Florida, USA, 13-17 July 1999. Morgan Kaufmann.
2. I. Androutsopoulos, G. Paliouras, V. Karkaletsis, G. Sakkis, C.D. Spyropoulos, and P. Stamatopoulos. Learning to filter spam e-mail: A comparison of a naive bayesian and a memorybased approach. In H. Zaragoza, P. Gallinari, , and M. Rajman, editors, Proceedings of the Workshop on Machine Learning and Textual Information Access, 4th European Conference on Principles and Practice of Knowledge Discovery in Databases (PKDD 2000), pages 1-13, 2000.
3. S. Atskins. Size and cost of the problem. In Priceedings of the Fifty-sixth Internet Engineering Task Force(IETF) Meeting, (San Francisco, CA), March 16-21 2003. SpamCon Foundation.
4. L. Becchetti, C. Castillo, D. Donato, S. Leonardi, and R. Baeza-Yates. Using rank propagation and probabilistic counting for link-based spam detection. Technical report, DELIS - Dynamically Evolving, Large-Scale Information Systems, 2006.
5. L. Becchetti, C. Castillo, D. Donato, S. Leonardi, and R. Baeza-Yates. Using rank propagation and probabilistic counting for link-based spam detection. In Workshop: The Future of Web Search, Barcelona, May 2006.Universitat Pompeu Fabra.
6. J. S. De Bonet. Novel statistical multiresolution techniques for image synthesis, discrimination, and recognition. Master's thesis, Massachusetts Institute of Technology, Cambridge, MA, May 1997.
7. C. J. C. Burges. A tutorial on support vector machines for pattern recognition. Data Mining and Knowledge Discovery, 2(2): 121-167, 1998.
8. W. W. Cohen. Learning to classify English text with ILP methods. In Luc De Raedt, editor, Advances in inductive logic programming, pages 124-143. IOS Press, Amsterdam, NL, 1995.
9. C. Cortes and V. Vapnik. Support-vector networks. Machine Learning, 20(3):273-297, 1995.
10. N. Cristiatnini and J. Shawe-Taylor. An introduction to Support Vector Machines and Other Kernel-Based Learning Methods. Cambridge University Press, 2003. http://www.support-vector.net.
11. W. Daelemans, J. Zavrel, K. van der Sloot, and A. van den Bosch. Timbl: Tilburg memory based learner, version 1.0, reference guide. ILK Technical Report 98-03, Tilburg, 1998.
12. H. Drucker, V. Vapnik, and D. Wu. Support vector machines for spam categorization. IEEE Transactions on Neural Networks, 10(5): 1048-1054, 1999. Available: http://www.monmouth.edu/druker/SVM_spam_article_compete.PDF.
13. P. Ferragina and R. Grossi. Improved dynamic text indexing. /. Algorithms, 31(2):291-319, 1999.
14. M. Click and D. Rumelhart. Neuroscience and Connectionist Theory. The Developpement in Connictionist Theory. Erlbaum Assiciates, Hilldsdale,
15. NJ, 1989.J. Goodman. Sequential conditional generalized iterative scaling. In ACL '02: Proceedings of the40th Annual Meeting on Association for Computational Linguistics, pages 9-16, Morristown, NJ, USA, 2001. Association for Computational Linguistics.
16. S. Haykin. Neural Networks: A Fomprehensive Foundation. Printice Hall, 1998.
17. J. Holland. Adaptation in Natural and Artificial Systems. Ann Arbor: The University of Michigan Press, 1975.
18. G. Hulten, J. Goodman, and R. Rounthwaite. Filtering spam e-mail on a global scale. Technical report, Microsoft Corp, 2004.
19. J. Kärkkäinen and E. Ukkonen. Lempel-ziv parsing and sublinear-size index structures for string matching. In Proc WSP'96, pages 141- 155. Carleton University Press, 1996.
20. H. Katirai. Filtering junk e-mail: A performance comparison between genetic programming and naive bayes.
21. V. Kecman. Learning and Soft Computing. The MIT Press, 2001.
22. O. Kolesnikov, W. Lee, and R. Lipton. Filtering spam using search engines. Technical Report GIT-CC-04-15, Georgia Tech, College of Computing, Georgia Institute of Technology, Atlanta, GA 30332, 2004-2005.
23. A. Konar. Artificial Intelligence and Soft Computing : Behavioral and Congnitive Modeling of the Human Brain, chapter 8. CRC Press, Washington, 2000.
24. J. Koza. Genetic Programming: On the Programming of Computers by Means of Natural Selection. MIT Press, MA, 1992.
25. J. R. Koza. Hierarchical genetic algorithms operating on populations of computer programs. In N. S. Sridharan, editor, Proceedings of the Eleventh International Joint Conference on Artificial Intelligence IJCAI-89, volume 1, pages 768-774. Morgan Kaufmann, 20-25 aug 1989.
26. J. R. Koza. Genetic programming: A paradigm for genetically breeding populations of computer programs to solve problems. Technical Report STAN-CS-90-1314, Dept. of Computer Science, Stanford University, June 1990.
27. J. R. Koza. Genetic Programming II: Automatic Discovery of Reusable Programs. MIT Press, Cambridge, MA, 1994.
28. D. Lewis, (spam vs.) forty years of machine learning for text classification. In Proceedings of the Spam Conference, 2003.
29. L. Lu, H. Jiang, and H. Zhang. A robust audio classification and segmentation method. In MULTIMEDIA '01: Proceedings of the ninth ACM international conference on Multimedia, pages 203-211, New York, NY, USA, 2001. ACM Press.
30. D. Platt Majoras, O. Swindle, Commissioner, T. B. Leary, P. O. Harbour, Commissioner, and J. Leibowitz. A can-spam informant reward system : A report to congress. Technical report, Federal Trade Commission, US, 2004.
31. W. S. McCulloch and W. H. Pitts. A logical calculus of the ideas immanent in nervous activity. Bulletin of Mathematical Biophysics, 5:115- 133, 1943.
32. T. A. Meyer and B. Whateley. Spambayes: Effective open-source, bayesian based, email classification system. In Proceedings of the First Conference on Email and Anti-Spam (CEAS), 2004. Available: http://www.ceas.cc/papers- 2004/136.pdf.
33. C. Miller. Neural network-based anti-spam heuristics, white paper.
34. K. Mock. An experimental framework for email categorization and management. In 24th Annual ACM International Conference on Research and Development in Information Retrieval, New Orleans, LA, September 2001.
35. G. Navarro and R. Baeza-Yates. A practical q-gram index for text retrieval allowing errors. CLEI Electonic Journal, 1(2), 1998.
36. G. Nicosia, V. Cutello, P. J. Bentley, and J. Timmis, editors. Artificial Immune Systems, Third International Conference, ICARIS 2004, Catania, Sicily, Italy, September 13-16, 2004, volume 3239 of Lecture Notes in Computer Science. Springer, 2004.
37. T. Oda and T. White. Developing an immunity to spam. In GECCO, pages 231-242, 2003.
38. L. Ösgür, T. Güngör, and F. Gürgen. Adaptive anti-spam filtering for agglutinative languages: a special case for turkish. Pattern Recogn. Lett., 25(16):1819-1831, 2004.
39. J. C. Piatt. Fast training of support vector machines using sequential minimal optimization, pages 185-208, 1999.
40. 29th Applied Image Pattern Recognition Workshop (AIPR 2000), 16-18 October 2000, Washington, DC, USA, Proceedings. IEEE Computer Society, 2000.
41. A. Ratnaparkhi. A simple introduction to maximum entropy models for natural language processing. Technical report, University of Pennsylvania, 1997.
42. F. Rosenblatt. Principles of Neurodynamics. Spartan Books, Washington, 1958.
43. F. Rosenblatt. The perceptron: A probabilistic model for information storage and organization in the brain. In J. W. Shavlik and T. G. Dietterich, editors, Readings in Machine Learning, pages 138-149. Kaufmann, SanMateo, CA, 1990.
44. M. Sahami. Learning limited dependence Bayesian classifiers. In Second International Conference on Knowledge Discovery in Databases, 1996.
45. M. Sahami. A bayesian approach to filtering junk e-mail. In Proceedings of AAAI-98 workshop on Learning for Text Categorization, Madison, Wisconsin, USA, 1998.
46. G. Sakkis, I. Androutsopoulos, G. Paliouras, V. Karkaletsis, C. D. Spyropoulos, and P. Stamatopoulos. A memory-based approach to antispam filtering for mailing lists. Information Retrieval, 6:49-73, 2003.
47. C. Sarrocco. Spam in the information society: Building frameworks for international cooperation. Technical report, OECD Task force on spam, 2004.
48. A. Seeker, A Freitas, and J. Timmis. Aisec: An artificial immune system for e-mail classification. In R. Sarker, R. Reynolds, H. Abbass, T. Kay-Chen, R. McKay, D Essam, and T. Gedeon, editors, Proceedings of the Congress on Evolutionary Computation, pages 131-139, Canberra. Australia, December 2003. IEEE.
49. S. Shakeri and P. Rosso. The bsp spam filter. In Proc. Confer. Information Technologies Int. Symposium, Tutan, Morocco, June 2005. IEEE.
50. J. Shavlik, R. Mooney, and G. Towell. Symbolic and neural learning algorithms: An experimental comparison. Machine Learning, 6:111-143, 1991.
51. H. T. Siegelmann and E. D. Sontag. On the computational power of neural nets. Journal of Computer and System Sciences, 50(1):132-150, 1995.
52. A. Somayaji, S. Hofmeyr, and S. Forrest. Principles of a computer immune system. In NSPW '97: Proceedings of the 1997 workshop on New security paradigms, pages 75-82, New York, NY, USA, 1997. ACM Press.
53. Spamassassin. Spamassassin website, http://spamassassin.org.
54. New York Times, March 19, 1998.
55. J.Weaver. Aol escalates spam warfare, March 5, 2003.
56. Internet Week, May 4, 1998.
57. Gregory L. Wittel and S. Felix Wu. On attacking statistical spam filters. In Proceedings of the First Conference on Email and Anti-Spam (CEAS), 2004.
58. H. K. Yoke. Curbing spam via technical measures: an overview. Technical report, ITUWSIS Thematic Meeting on Countering Spam, 2004.
59. th International Conference on Computer Processing of Oriental Languages (ICCPOL03), pages 446453, 2003.
60. L. Zhang, J. Zhu, and T. Yao. An evaluation of statistical spam filtering techniques. ACMTransactions on Asian Language Information Processing (TALIP), 3(4):243-269, 2004.
61. F. Zhou, L. Zhuang, B. Y. Zhao, L. Huang, A. D. Joseph, and J. Kubiatowicz. Approximate object location and spam filtering on peer-to-peer systems. In Proc. of ACM/IFIP/USENIX Intl. Middleware Conf, 2003.