A case-based technique for tracking concept drift in spam filtering

Knowledge-Based Systems

Volumn 18, Issue 4-5, 2005, Pages 187-195

  Delany, Sarah Jane ^a   Cunningham, Pádraig ^b   Tsymbal, Alexey ^b   Coyle, Lorcan ^b  

^a DUBLIN INSTITUTE OF TECHNOLOGY   (Ireland)

^b TRINITY COLLEGE DUBLIN   (Ireland)

Author keywords

Case based reasoning; Concept drift; Spam filtering

Indexed keywords

CLASSIFICATION (OF INFORMATION); DATA REDUCTION; ELECTRONIC MAIL; HIERARCHICAL SYSTEMS; LEARNING SYSTEMS; SPAMMING;

CASE-BASED REASONING; CONCEPT DRIFT; FEATURE SELECTION; SPAM FILTERING;

SIGNAL FILTERING AND PREDICTION;

EID: 22544443981     PISSN: 09507051     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.knosys.2004.10.002     Document Type: Conference Paper

References (33)

1. D.W. Aha, D. Kibler, and M.K. Albert Instance-based learning algorithms Machine Learning 6 1991 37 66
2. I. Androutsopoulos, J. Koutsias, V. Konstantinos, V. Chandrinos, G. Paliouras, and C. Spyropoulos An evaluation of Naive Bayesian anti-spam filtering G. Potamias V. Moustakis M. van Someren Proceedings of the ECML 2000 Workshop on Machine Learning in the New Information Age 2000 9 17
3. I. Androutsopoulos, J. Koutsias, G. Paliouras, V. Karkaletsis, G. Sakkis, C. Spyropoulos, P. Stamatopoulos, Learning to filter spam e-mail: A comparison of a naive Bayesian and a memory-based approach, in: 4th PKDD Workshop on Machine Learning and Textual Information Access, 2000.
4. I. Androutsopoulos, G. Paliouras, E Michelakis, Learning to Filter Unsolicited Commercial E-Mail. Tech rpt 2004/2, NCSR Demokritos, 2004, http://www.iit.demokritos.gr/skel/i-config/publications/
5. X. Carreras, L. Marquez, Boosting trees for anti-spam email filtering, in: Proceedings of 4th Internatinal Conference on Recent Advances in Natural Language Processing, Tzigov Chark, Bulgaria, (2001).
6. P. Cunningham, N. Nowlan, S.J. Delany, and M. Haahr A Case-Based Approach to Spam Filtering that Can Track Concept Drift The ICCBR'03 Workshop on Long-Lived CBR Systems 2003 Trondheim Norway
7. S.J. Delany, P. Cunningham, and L. Coyle An assessment of case-base reasoning for spam filtering, L. McGinty B. Crean Proceedings of 15th Artificial Intelligence and Cognitive Science Conference 2004
8. S.J. Delany, and P. Cunningham An analysis of case-based editing in a spam filtering system P. Funk ad P.A. Gonzalez-Calero Proceedings of 7th European Conference in Case-Based Reasoning, ECCBR-04 2004 Springer Berlin 128 141
9. H.D. Drucker, D. Wu, and V. Vapnik Support vector machines for spam categorization IEEE Transactions On Neural Networks 10 5 1999 1048 1054
10. K.R. Gee, Using Latent Semantic Indexing to Filter Spam, in: Proceedings of the 2003 ACM Symposium on Applied Computing (SAC), (ACM, 2003), pp. 460-464.
11. M. Harries, C. Sammut, and K. Horn Extracting hidden context Machine Learning 32 2 1998 101 126
12. http://www.brightmail.com/accuracy.html
13. G. Hulten, L. Spencer and P. Domingos, Mining time-changing data streams, in: Proceedings of the 7th International Conference on Knowledge Discovery and Data Mining, 2001, pp. 97-106 (ACM Press).
14. R. Klinkenberg Learning drifting concepts: example selection vs. example weighting Intelligent Data Analysis, Special Issue on Incremental Learning Systems Capable of Dealing with Concept Drift 8 3 2004
15. A. Kolcz, J. Alspector, SVM-based filtering of e-mail spam with content-specific misclassification costs, in: Proceedings of TextDM'2001, IEEE ICDM-2001 Workshop on Text Mining, San Jose CA, 2001.
16. J.Z. Kolter, M.A. Maloof, Dynamic weighted majority: a new ensemble method for tracking concept drift, in: Proceedings of the 3rd IEEE International Conference on Data Mining, IEEE CS Press, 2003, pp. 123-130
17. M. Kubat, G. Widmer, Adapting to drift in continuous domains, Tech. Report ÖFAI-TR-94-27, Austrian Research Institute for Artificial Intelligence, Vienna, 1994
18. C. Lanquillon, and I. Renz Adaptive information filtering: detecting changes in text streams Proceedings of the 8th International Conference on Information and Knowledge Management CIKM-1999 1999 ACM Press pp. 538-544
19. M. Lenz, E. Auriol, and M. Manago Diagnosis and decision support, M. Bartsch-Sporl S. Wess Case-Based Reasoning Technology: From Foundations to Applications, LNCS 104 1998 Springer Berlin
20. P. Pantel, D. Lin, SpamCop: A spam classification and organization program, in: Learning for Text Categorization - Papers from the AAAI Workshop, Madison Wisconsin, 1998 pp. 95-98, (AAAI Technical Report WS-98-05).
21. J. Ross Quinlan C4.5 Programs for Machine Learning 1993 Morgan Kaufmann Publishers San Mateo, CA
22. M. Sahami, S. Dumais, D. Heckerman, E. Horvitz, A Bayesian Approach to Filtering Junk Email, in: AAAI-98 Workshop on Learning for Text Categorization. Madison, Wisconsin, 1998, pp. 55-62, (AAAI Technical Report WS-98-05).
23. G. Sakkis, I. Androutsopoulos, G. Paliouras, V. Karkaletsis, C. Spyropoulos, and P. Stamatopoulos A memory-based approach to anti-spam filtering for mailing lists Information Retrieval 6 1 2004 49 73
24. G. Sakkis, I. Androutsopoulos, G. Paliouras, V. Karkaletsis, and C. Spyropoulos Stacking classifiers for anti-spam filtering of e-mail Lee Harman Proceedings of the 6th Conference on Empirical Methods in Natural Language Processing, 2001 44 50
25. M. Salganicoff Tolerating concept and sampling shift in lazy learning using prediction error context switching AI Review Special Issuse on Lazy Learning 11 1-5 1997 133 155
26. J.C. Schlimmer, and R.H. Granger Incremental learning from noisy data Machine Learning 1 3 1986 317 354
27. J. Spira, Spam E-Mail and its Impact on IT Spending and Productivity, Basex Report 2003, http://www.basex.com/poty2003.nsfl
28. K.O. Stanley, Learning concept drift with a committee of decision trees, Tech. Report UT-AI-TR-03-302, Dept of Computer Sciences, University of Texas at Austin, USA, 2003
29. W. Street, Y. Kim, and A. streaming A streaming ensemble algorithm (SEA) for large-scale classification Proceedings of the 7th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining KDD-2001 2001 ACM Press New York pp. 377-382
30. H. Wang, W. Fan, P.S. Yu, J. Han, Mining concept-drifting data streams using ensemble classifiers, in: Proceedings of the 9th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining KDD-2003, pp. 226-235, (ACM Press).
31. G. Widmer, M. Kubat, Effective learning in dynamic environments by explicit context tracking, in: Proceedings ECML, LNCS 667, 1993, pp. 227-243, (Springer-Verlag).
32. G. Widmer, and M. Kubat Learning in the presence of concept drift and hidden contexts Machine Learning 23 1 1996 69 101
33. Y. Yang Y, J.O. Pedersen, A comparative study on feature selection in text categorization, in: Proceedings of ICML-97, 1997, pp. 412-420.