An incremental cluster-based approach to spam filtering

Expert Systems with Applications

Volumn 34, Issue 3, 2008, Pages 1599-1608

  Hsiao, Wen Feng ^a   Chang, Te Min ^b  

^a NATIONAL PINGTUNG UNIVERSITY   (Taiwan)

^b NATIONAL SUN YAT SEN UNIVERSITY   (Taiwan)

Author keywords

Concept drift; Email classification; Incremental learning; Skewed class distribution

Indexed keywords

CLASSIFICATION (OF INFORMATION); DATA COMMUNICATION EQUIPMENT; ELECTRONIC MAIL; LEARNING SYSTEMS; PERSONNEL TRAINING;

CONCEPT DRIFT; EMAIL CLASSIFICATION; INCREMENTAL LEARNING; SKEWED CLASS DISTRIBUTION;

INTERNET;

EID: 37349022259     PISSN: 09574174     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.eswa.2007.01.018     Document Type: Article

References (21)

1. Androutsopoulos, I., Koutsias, J., Chandrinos, K. V., & Spyropoulos, D. (2000). Learning to filter spam e-mail: a comparison of a naive bayesian and a memory-based approach. The 4th PKDD's workshop on machine learning and textual information access.
2. Chan P.K., Fan W., Prodromidis A.L., and Stolfo S.J. Distributed data mining in credit card fraud detection. IEEE Intelligent Systems 14 6 (1999) 67-74
3. Delany, S. J., & Cunningham, P. (2006). ECUE: a spam filter that uses machine learning to track concept drift. Technical Report, Computer Science Department, The University of Dublin. Available from https://www.cs.tcd.ie/publications/tech-reports/reports.06/TCD-CS-2006-05.pdf.
4. Drucker H., Wu D., and Vapnik V.N. Support vector machines for spam categorization. IEEE Transactions on Neural Networks 10 5 (1999) 1048-1054
5. Fawcett T. In vivo spam filtering: a challenge problem for KDD. ACM SIGKDD Explorations Newsletter 5 2 (2003) 140-148
6. Forman, G. (2006). Tackling concept drift by temporal inductive transfer. SIGIR '06 ACM.
7. Hart P.E. The condensed nearest neighbor rule. IEEE Transactions on Information Theory IT-14 (1968) 515-516
8. Honda, T., Motizuki, H., Ho, T. B., & Okumura, M. (1997). Generating decision trees from an unbalanced data set. In Maarten vanSomeren., Gerhard Widmer (Eds.), Poster papers presented at the 9th European conference on machine learning (ECML) (pp. 68-77).
9. Jain A.K., Murty M.N., and Flynn P.J. Data clustering: a review. ACM Computing Surveys 31 3 (1999) 264-323
10. Lee C., and Lee G.G. Information gain and divergence-based feature selection for machine learning-based text categorization. Information Processing and Management 42 1 (2006) 155-165
11. Lian, Y. (2002). E-mail filtering, Master thesis. University of Sheffield, Department of Advanced Software Engineering.
12. Luo, X., & Zincir-Heywood, N. (2005). Comparison of a SOM based sequence analysis system and naive bayesian classifier for spam filtering. In Proceedings of IEEE international joint conference on neural networks - IJCNN '05 (Vol. 4, pp. 2571 - 2576).
13. McCallum, A. (2002). Bow: a toolkit for statistical language modeling, text retrieval, classification and clustering. Available from http://www.cs.cmu.edu/~mccallum/bow/.
14. Monard, M. C., & Batista, G. E. A. P. A. (2002). Learning with skewed class distributions. In Advances in logic, artificial intelligence and robotics (LAPTEC'02).
15. Nigam K., McCallum A.K., Thrun S., and Mitchell T. Text classification from labeled and unlabeled documents using EM. Machine Learning 39 (2000) 103-134
16. Payne T.R., and Edward P. Interface agents that learn: an investigation of learning issues in a mail agent interface. Applied Artificial Intelligence (1997) 1-32
17. Porter M. An algorithm for suffix stripping. Program. Automated Library and Information Systems 4 3 (1980) 130-137
18. Sahami, M., Dumais, S., Heckerman D., & Horvitz, E., (1998). A Bayesian approach to filtering junk e-mail. AAAI-98 workshop on learning for text categorization.
19. Stanley, K. O. (2003). Learning concept drift with a committee of decision trees. Department of Computer Sciences Technical Report AI-03-302.
20. Wu, H., Pang, T. H., Liu, B., & Li., X. (2002). A refinement approach to handling model misfit in text categorization. In Proceedings of the ACM SIGKDD international conference on knowledge discovery and data mining (pp. 23-26).
21. Zhang T., and Oles F.J. Text categorization based on regularized linear classification methods. Information Retrieval 4 1 (2001) 5-31