Enhanced Topic-based Vector Space Model for semantics-aware spam filtering

Expert Systems with Applications

Volumn 39, Issue 1, 2012, Pages 437-444

  Santos, Igor ^a   Laorden, Carlos ^a   Sanz, Borja ^a   Bringas, Pablo G ^a  

^a UNIVERSITY OF DEUSTO   (Spain)

Author keywords

Computer security; Information Retrieval; Machine learning; Semantics; Spam detection

Indexed keywords

INFORMATION RETRIEVAL MODELS; LINGUISTIC PHENOMENA; MACHINE-LEARNING; PHISHING; SEMANTIC ONTOLOGY; SPAM DETECTION; SPAM FILTERING; SPAM MESSAGES; STATISTICAL REPRESENTATIONS; VECTOR SPACE MODELS;

COMPUTER VIRUSES; ELECTRONIC MAIL; INFORMATION RETRIEVAL; INTERNET; LEARNING ALGORITHMS; NETWORK SECURITY; ONTOLOGY; SECURITY OF DATA; SECURITY SYSTEMS; SEMANTICS;

VECTOR SPACES;

EID: 81855221782     PISSN: 09574174     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.eswa.2011.07.034     Document Type: Article

References (76)

1. S. Amari, and S. Wu Improving support vector machine classifiers by modifying kernel functions Neural Networks 12 1999 783 789
2. Androutsopoulos, I.; Koutsias, J.; Chandrinos, K.; & Spyropoulos, C. (2000). An experimental comparison of naive Bayesian and keyword-based anti-spam filtering with personal e-mail messages. In Proceedings of the 23rd annual international ACM SIGIR conference on research and development in information retrieval (pp. 160-167).
3. Androutsopoulos, I.; Koutsias, J.; Chandrinos, K.; Paliouras, G.; & Spyropoulos, C. (2000). An evaluation of Naive Bayesian anti-spam filtering. In Proceedings of the workshop on machine learning in the new information age (pp. 9-17).
4. Androutsopoulos, I.; Paliouras, G.; Karkaletsis, V.; Sakkis, G.; Spyropoulos, C.; & Stamatopoulos, P. (2000). Learning to filter spam e-mail: A comparison of a naive bayesian and a memory-based approach. In Proceedings of the machine learning and textual information access workshop of the 4th european conference on principles and practice of knowledge discovery in databases.
5. Awad, A.; Polyvyanyy, A.; & Weske, M. (2008). Semantic querying of business process models. In IEEE international conference on enterprise distributed object computing conference (EDOC 2008) (pp. 85-94).
6. R.A. Baeza-Yates, and B. Ribeiro-Neto Modern information retrieval 1999 Addison-Wesley Boston, MA, USA
7. M. Bates, and R. Weischedel Challenges in natural language processing 1993 Cambridge Univ. Pr.
8. T. Bayes An essay towards solving a problem in the doctrine of chances Philosophical Transactions of the Royal Society 53 1763 370 418
9. Becker, J.; & Kuropka, D. (2003). Topic-based vector space model. In Proceedings of the 6th international conference on business information systems (pp. 7-12).
10. C. Bishop Pattern recognition and machine learning 2006 Springer New York
11. Blanzieri, E.; & Bryl, A. (2007). Instance-based spam filtering using SVM nearest neighbor classifier. Proceedings of FLAIRS-20 (pp. 441-442).
12. A. Bratko, B. Filipič, G. Cormack, T. Lynam, and B. Zupan Spam filtering using statistical data compression models The Journal of Machine Learning Research 7 2006 2673 2698
13. L. Breiman Random forests Machine Learning 45 2001 5 32
14. R. Carnap Meaning and synonymy in natural languages Philosophical Studies 6 1955 33 47
15. J. Carpinter, and R. Hunt Tightening the net: A review of current and next generation spam filtering tools Computers and Security 25 2006 566 578
16. Carreras, X.; & Márquez, L. (2001). Boosting trees for anti-spam email filtering. In Proceedings of RANLP-01, 4th international conference on recent advances in natural language processing (pp. 58-64).
17. Castillo, E.; Gutiérrez, J. M.; & Hadi, A. S. (1996). Expert systems and probabilistic network models (Erste ed.). New York, NY, USA.
18. O. Chapelle, B. Schölkopf, and A. Zien Semi-supervised learning 2006 MIT Press
19. D. Cohen Explaining linguistic phenomena 1974 Halsted Press
20. Cooper, G. F.; & Herskovits, E. (1991). A bayesian method for constructing bayesian belief networks from databases. In Proceedings of the 7th conference on Uncertainty in artificial intelligence.
21. G. Cormack, and T. Lynam Online supervised spam filter evaluation ACM Transactions on Information Systems (TOIS) 25 2007
22. L. Cranor, and B. LaMacchia Spam! Communications of the ACM 41 1998 74 83
23. D. Cruse Hyponymy and lexical hierarchies Archivum Linguisticum 6 1975 26 31
24. T. Dietterich, R. Lathrop, and T. Lozano-Pérez Solving the multiple instance problem with axis-parallel rectangles Artificial Intelligence 89 1997 31 71
25. H. Drucker, D. Wu, and V. Vapnik Support vector machines for spam categorization IEEE Transactions on Neural Networks 10 1999 1048 1054
26. C. Fellbaum WordNet: An electronic lexical database 1998 MIT Press Cambridge, MA
27. Fix, E.; & Hodges, J. L. (1952). Discriminatory analysis: Nonparametric discrimination: Small sample performance. Technical Report Project 21-49-004, Report Number 11. Technical Report USAF School of Aviation Medicine, Randolf Field, Texas.
28. L. Floridi Blackwell guide to the philosophy of computing and information 2003 Blackwell Publishers, Inc. Cambridge, MA, USA
29. Garner, S. (1995). Weka: The Waikato environment for knowledge analysis. In Proceedings of the New Zealand Computer Science Research Students Conference (pp. 57-64).
30. Geiger, D.; Goldszmidt, M.; Provan, G.; Langley, P.; & Smyth, P. (1997). Bayesian network classifiers. In Machine learning (pp. 131-163).
31. J.L. Gross, and J. Yellen Handbook of graph theory Series discrete mathematics and its applications 2004 CRC Press
32. S. Heron Technologies for spam detection Network Security 2009 2009 11 15
33. Holmes, G.; Donkin, A.; & Witten, I. H. (1994). Weka: A machine learning workbench (pp. 357-361).
34. N. Ide, and J. Véronis Introduction to the special issue on word sense disambiguation: The state of the art Computational Linguistics 24 1998 2 40
35. T. Jagatic, N. Johnson, M. Jakobsson, and F. Menczer Social phishing Communications of the ACM 50 2007 94 100
36. J. Jung, and E. Sit An empirical study of spam traffic and the use of DNS black lists Proceedings of the 4th ACM SIGCOMM conference on Internet measurement 2004 ACM New York, NY, USA 370 375
37. C. Karlberger, G. Bayler, C. Kruegel, and E. Kirda Exploiting redundancy in natural language to penetrate bayesian spam filters Proceedings of the 1st USENIX workshop on offensive technologies (WOOT) 2007 USENIX Association 1 7
38. J. Kent Information gain and a general measure of correlation Biometrika 70 1983 163
39. Kohavi, R. (1995). A study of cross-validation and bootstrap for accuracy estimation and model selection. In International Joint Conference on Artificial Intelligence (Vol. 14, pp. 1137-1145).
40. Kołcz, A.; Chowdhury, A.; & Alspector, J. (2004). The impact of feature selection on signature-driven spam detection. In Proceedings of the 1st conference on email and anti-spam (CEAS-2004).
41. Kotsiantis, S. (2007). Supervised machine learning: A review of classification techniques. In Proceeding of the 2007 conference on Emerging Artificial Intelligence Applications in Computer Engineering: Real Word AI Systems with Applications in eHealth, HCI, Information Retrieval and Pervasive Technologies (pp. 3-24).
42. S. Kotsiantis, and P. Pintelas Recent advances in clustering: A brief survey WSEAS Transactions on Information Science and Applications 1 2004 73 81
43. D. Kuropka Modelle zur Repräsentation natürlichsprachlicher dokumente-information-filtering und-retrieval mit relationalen datenbanken Advances in Information Systems and Management Science 10 2004
44. D. Lewis Naive (Bayes) at forty: The independence assumption in information retrieval Lecture Notes in Computer Science 1398 1998 4 18
45. Lin, H.; & Lin, C. (2003). A study on sigmoid kernels for SVM and the training of non-PSD kernels by SMO-type methods. Technical Report Nat'l Taiwan University.
46. J. Lovins Development of a stemming algorithm Mechanical Translation and Computational Linguistics 11 1968 22 31
47. O. Maron, and T. Lozano-Pérez A framework for multiple-instance learning Advances in Neural Information Processing Systems 1998 570 576
48. McCallum, A.; & Nigam, K. (1998). A comparison of event models for Naive Bayes text classification. AAAI-98 workshop on learning for text categorization (vol. 752).
49. K. Ming-Tzu, and P. Nation Word meaning in academic English: Homography in the academic word list Applied Linguistics 25 2004 291 314
50. Mishne, G.; Carmel, D.; & Lempel, R. (2005). Blocking blog spam with language model disagreement. In Proceedings of the 1st international workshop on adversarial information retrieval on the web (AIRWeb) (pp. 1-6).
51. R. Navigli Word sense disambiguation: A survey ACM Computing Surveys (CSUR) 41 2009 10
52. Pearl, J. (1982). Reverend Bayes on inference engines: A distributed hierarchical approach. In Proceedings of the national conference on artificial intelligence (pp. 133-136).
53. J. Platt Sequential minimal optimization: A fast algorithm for training support vector machines Advances in Kernel Methods-Support Vector Learning 208 1999
54. Polyvyanyy, A. (2007). Evaluation of a novel information retrieval model: eTVSM. MSc Dissertation.
55. J. Quinlan Induction of decision trees Machine Learning 1 1986 81 106
56. J. Quinlan C4. 5 programs for machine learning 1993 Morgan Kaufmann Publishers
57. Radden, G.; & Kövecses, Z. (1999). Towards a theory of metonymy. Metonymy in language and thought (pp. 17-59).
58. Ramachandran, A.; Dagon, D.; & Feamster, N. (2006). Can DNS-based blacklists keep up with bots. In Conference on email and anti-spam.
59. S.J. Russell, and P. Norvig Artificial intelligence: A modern approach 2nd ed. 2003 Prentice Hall
60. Sahami, M.; Dumais, S.; Heckerman, D.; & Horvitz, E. (1998). A Bayesian approach to filtering junk e-mail. In Learning for text categorization: Papers from the 1998 workshop, AAAI technical report WS-98-05 (Vol. 62, pp. 98-05). Madison, Wisconsin.
61. G. Sakkis, I. Androutsopoulos, G. Paliouras, V. Karkaletsis, C. Spyropoulos, and P. Stamatopoulos A memory-based approach to anti-spam filtering for mailing lists Information Retrieval 6 2003 49 73
62. Sakkis, G.; Androutsopoulos, I.; Paliouras, G.; Karkaletsis, V.; Spyropoulos, C. D.; & Stamatopoulos, P. (2001). Stacking classifiers for anti-spam filtering of e-mail. In Proceedings of the 6th conference on empirical methods in natural language processing (EMNLP) (pp. 44-50).
63. G. Salton, and M. McGill Introduction to modern information retrieval 1983 McGraw-Hill New York
64. G. Salton, A. Wong, and C. Yang A vector space model for automatic indexing Communications of the ACM 18 1975 613 620
65. Schneider, K. (2003). A comparison of event models for Naive Bayes anti-spam e-mail filtering. In Proceedings of the 10th Conference of the European Chapter of the Association for Computational Linguistics (pp. 307-314).
66. Sculley, D.; & Wachman, G. (2007). Relaxed online SVMs for spam filtering. In Proceedings of the 30th annual international ACM SIGIR conference on research and development in information retrieval (pp. 415-422).
67. F. Sebastiani Machine learning in automated text categorization ACM Computing Surveys (CSUR) 34 2002 1 47
68. A. Seewald An evaluation of naive Bayes variants in content-based learning for spam filtering Intelligent Data Analysis 11 2007 497 524
69. Y. Singh, A. Kaur, and R. Malhotra Comparative analysis of regression and machine learning methods for predicting fault proneness models International Journal of Computer Applications in Technology 35 2009 183 193
70. B. Üstün, W. Melssen, and L. Buydens Facilitating the application of support vector regression by using a universal Pearson VII function based kernel Chemometrics and Intelligent Laboratory Systems 81 2006 29 40
71. V. Vapnik The nature of statistical learning theory 2000 Springer
72. W. Wilbur, and K. Sirotkin The automatic identification of stop words Journal of Information Science 18 1992 45 55
73. Wittel, G.; & Wu, S. (2004). On attacking statistical spam filters. In Proceedings of the 1st conference on email and anti-spam (CEAS).
74. D. Wolpert Stacked generalization Neural Networks 5 1992 241 259
75. L. Zhang, J. Zhu, and T. Yao An evaluation of statistical spam filtering techniques ACM Transactions on Asian Language Information Processing (TALIP) 3 2004 243 269
76. Y. Zhou, Z. Jorgensen, and M. Inge Combating good word attacks on statistical spam filters with multiple instance learning Proceedings of the 19th IEEE international conference on tools with artificial intelligence Vol. 02 2007 IEEE Computer Society 298 305