SMS spam filtering: Methods and data

Expert Systems with Applications

Volumn 39, Issue 10, 2012, Pages 9899-9908

  Delany, Sarah Jane ^a   Buckley, Mark ^a   Greene, Derek ^b  

^a DUBLIN INSTITUTE OF TECHNOLOGY   (Ireland)

^b UNIVERSITY COLLEGE DUBLIN   (Ireland)

Author keywords

SMS spam dataset; SMS spam filtering; Text classification

Indexed keywords

DATA COLLECTION; DATA SETS; E-MAIL SPAM; PERSONAL SERVICES; RESPONSE RATE; SPAM FILTERING; TEXT CLASSIFICATION;

INFORMATION SYSTEMS; MATHEMATICAL MODELS;

INTERNET;

EID: 84859217714     PISSN: 09574174     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.eswa.2012.02.053     Document Type: Review

References (58)

1. Almeida, T. A.; Gómez Hidalgo, J. M.; Yamakami, A. (2011). In Proceedings of the 11th ACM symposium on document engineering DOCENG'11 (pp. 259-s62). Mountain View, CA, USA: ACM.
2. Beaufort, R.; Roekhaut, S.; Cougnon, L. A.; Fairon, C. (2010). A hybrid rule/model-based finite-state framework for normalizing SMS messages. In Proceedings of the 48th annual meeting of the association for computational linguistics ACL '10 (pp. 770-779). Stroudsburg, PA, USA: Association for Computational Linguistics.
3. Benevenuto, F.; Magno, G.; Rodriques, T.; Almeida, V. (2010). Detecting spammers on twitter. In Procs of the 7th annual collaboration electronic messaging, anti-abuse and spam conference.
4. P.O. Boykin, and V.P. Roychowdhury Leveraging social networks to fight spam IEEE Computer 38 2005 61 68
5. Cai, J.; Tang, Y.; Hu, R. (2008). Spam filter for short messages using winnow. In Proceedings of the international conference on advanced language processing and web information technology (pp. 454-459). IEEE.
6. Castillo, C.; Mendoza, M.; Poblete, B. (2011). Information credibility on twitter. In S. Srinivasan, K. Ramamritham, A. Kumar, M. P. Ravindra, E. Bertino, & R. Kumar (Eds.), WWW (pp. 675-684). ACM.
7. Chang, C. C.; Lin, C. J.; 2011. LIBSVM: A library for support vector machines. ACM Transactions on Intelligent Systems and Technology, 2 (27), 1-27. < http://www.csie.ntu.edu.tw/cjlin/libsvm >.
8. Chu, Z.; Gianvecchio, S.; Wang, H.; Jajodia, S. (2010). Who is tweeting on twitter: human, bot, or cyborg? In Gates, Franz, and McDermott, 2010.
9. Cormack, G. V.; Gómez Hidalgo, J. M.; Sánz, E. P. (2007). Spam filtering for short messages. In Proceedings of the 16th ACM conference on conference on information and knowledge management CIKM '07 (pp. 313-320). New York, NY, USA: ACM.
10. Deng, W.-W.; Peng, H.; (2006). Research on a Naive Bayesian Based Short Message Filtering System. In Proceedings of the international conference on machine learning and cybernetics (pp. 1233-1237). IEEE.
11. I.S. Dhillon, and D.S. Modha Concept decompositions for large sparse text data using clustering Machine Learning 42 2001 143 175
12. Dixit, S.; Gupta, S.; Ravishankar, C. V. (2005). LOHIT: An online detection & control system for cellular SMS spam. In Proceedings of the IASTED international conference on communication, network and information security (pp. 48-54).
13. Fairon, C.; Paumier, S. (2006). A translated corpus of 30,000 French SMS. In Proceedings of language resources and evaluation.
14. Gao, H.; Hu, J.; Wilson, C.; Li, Z.; Chen, Y.; Zhao, B. Y. (2010). Detecting and characterizing social spam campaigns. In E. Al-Shaer, A. D. Keromytis, & V. Shmatikov (Eds.), ACM conference on computer and communications security (pp. 681-683). ACM.
15. Gates, C.; Franz, M.; McDermott, J. P. (Eds.), 2010. Twenty-sixth annual computer security applications conference. ACSAC 2010, Austin, Texas, USA, 6-10 December 2010. ACM.
16. S. Gianvecchio, M. Xie, Z. Wu, and H. Wang Measurement and classification of humans and bots in internet chat P.C. van Oorschot, USENIX security symposium 2008 USENIX Association 155 170
17. Gómez Hidalgo, J. M.; Bringas, G. C.; Sánz, E. P.; García, F. C. (2006). Content based SMS spam filtering. In D. Bulterman, & D. F. Brailsford (Eds.), Proceedings of the 2006 ACM symposium on document engineering DocEng '06 (pp. 107-114). New York, NY, USA: ACM.
18. Graham-Cumming, J. (2005). Why I hate challenge-response systems. In JGC's spam and antispam newsletter. < http://www.jgc.org/antispam/02282005- 60dfea1d4f36a4071c21d1ba86f5e988.pdf > 28.02.05.
19. GSMA (2011a). Operator FAQs. GSMA spam reporting service.
20. GSMA (2011b). SMS spam and mobile messaging attacks - Introduction. Trends and examples. GSMA spam reporting service.
21. T.S. Guzella, and W.M. Caminhas A review of machine learning approaches to spam filtering Expert Systems with Applications 2009 10206 10222
22. He, P.; Wen, X.; Zheng, W. (2008). A novel method for filtering group sending short message spam. In Proceedings of the international conference on convergence and hybrid information technology (pp. 60 -65).
23. Healy, M.; Delany, S.; Zamolotskikh, A. (2005). An assessment of case-based reasoning for short text message classification. In N. Creaney (Ed.), Proceedings of 16th Irish conference on artificial intelligence and cognitive science, (AICS-05) (pp. 257-266).
24. Y. How, and M.-Y. Kan Optimizing predictive text entry for short message service on mobile phones M.J. Smith, G. Salvendy, Proceedings of human computer interfaces international (HCII 05) 2005 Lawrence Erlbaum Associates
25. Hu, X.; Yan, F. (2010). Sampling of mass SMS filtering algorithm based on frequent time-domain area. In Proceedings of the third international conference on knowledge discovery and data mining (pp. 548 -551).
26. Jie, H.; Bei, H.; Wenjing, P. (2010). A Bayesian approach for text filter on 3G network. In Proceedings of the 6th international conference on wireless communications networking and mobile computing (pp. 1-5).
27. Junaid, M. B.; Farooq, M. (2011). Using evolutionary learning classifiers to do mobile spam (SMS) filtering. In Procs. of genetic and evolutionary computation conference (GECCO 2011).
28. B. Klimt, and Y. Yang The enron corpus: A new dataset for email classification research J.-F. Boulicaut, F. Esposito, F. Giannotti, D. Pedreschi, Machine learning: ECML 2004 Lecture notes in computer science Vol. 3201 2004 Springer Berlin/ Heidelberg 217 226
29. Kobus, C.; Yvon, F.; Damnati, G. (2008). Normalizing SMS: Are two metaphors better than one? In Proceedings of the 22nd international conference on computational linguistics (Vol. 1, pp. 441-448). Association for Computational Linguistics.
30. C.-C. Lai An empirical study of three machine learning methods for spam filtering Knowledge-Based Systems 20 2007 249 254
31. yu Lam, H.; yan Yeung, D. (2007). A learning approach to spam detection based on social networks. In Proceedings of fourth conference on email and antispam CEAS 2007.
32. R. Ling The socio-linguistics of SMS: An analysis of SMS use by a random sample of Norwegians R. Ling, P. Pedersen, Mobile communications: Renegotiation of the social sphere 2005 Springer London 335 349
33. N. Littlestone Learning quickly when irrelevant attributes abound: A new linear-threshold algorithm Machine Learning 2 1988 285 318
34. W. Liu, and W. Fang Adaptive spam filtering based on fingerprint vectors ISECS international colloquium on computing, communication, control, and management Vol. 1 2008 IEEE Computer Society Washington, DC, USA 384 388
35. W. Liu, and T. Wang Index-based online text classification for SMS spam filtering Journal of Computers 5 2010 844 851
36. Liu, Z.; Lin, W.; Li, N.; Lee, D. (2005). Detecting and filtering instant messaging spam: A global and personalized approach. In Proceedings of the first international conference on secure network protocols NPSEC'05 (pp. 19-24). Washington, DC, USA: IEEE Computer Society.
37. Longzhen, D.; An, L.; Longjun, H. (2009). A new spam short message classification. In Proceedings of the first international workshop on education technology and computer science (Vol. 2, pp. 168 -171).
38. Maaroof, U. (2010). Analysis and detection of SPIM using message statistics. In 6th International conference on emerging technologies (ICET) (pp. 246-249).
39. Maina, W. (2010). Vodafone unveils low-cost mobile handsets. Business Daily. < http://www.businessdailyafrica.com/Corporate+News/-/539550/863416/-/ xsf06c/-/index.html > 17.02.10.
40. A. Ng, M. Jordan, and Y. Weiss On spectral clustering: Analysis and an algorithm Advances in Neural Information Processing 14 2001 849 856
41. Rafique, M. Z.; Farooq, M. (2010). SMS SPAM detection by operating on byte-level distributions using hidden markov models (HMMs). In Proceedings of the 20th virus bulletin international conference.
42. Rennie, J. (2000). IFILE: An application of machine learning to E-mail filtering. In Proceedings of the KDD-2000 workshop on text mining, sixth ACM SIGKDD international conference on knowledge discovery and data mining.
43. Sandhaus, E. (2008). The New York times annotated corpus. Linguistic data consortium.
44. F. Sebastiani Machine learning in automated text categorization ACM Computing Surveys 34 2002 1 47
45. T. Shortis The language of ICT 2000 Routledge London
46. Sohn, D. N.; Lee, J. T.; Rim, H. C. (2009). The contribution of stylistic information to content-based mobile spam filtering. In Proceedings of the ACL/AFNLP 2009 conference short papers (pp. 321-324).
47. Stringhini, G.; Kruegel, C.; Vigna, G. (2010). Detecting spammers on social networks. In Gates et al.; 2010.
48. Tagg, C. (2009). A corpus linguistics study of SMS text messaging. Ph.D. thesis University of Birmingham.
49. Taufiq, M.; bin Abdullah, M. F. A.; Kang, K.; Choi, D. J. (2010). A survey of preventing, blocking and filtering short message services (SMSs) spam. In Proceedings of international conference on computer and electrical engineering (Vol. 1, pp. 462-466). IEEE.
50. C.-Y. Tseng, and M.-S. Chen Incremental SVM model for spam detection on dynamic email social networks CSE Vol. 4 2009 IEEE Computer Society 128 135
51. Wang, A. H. (2010). Don't follow me - spam detection in twitter. In S.K. Katsikas, & P. Samarati (Eds.), SECRYPT (pp. 142-151). Sciteress.
52. C. Wang, Y. Zhang, X. Chen, Z. Liu, L. Shi, and G. Chen A behavior-based SMS antispam system IBM Journal of Research and Development 54 2010 3:1 3:16
53. Wu, N.; Wu, M.; Chen, S. (2008). Real-time monitoring and filtering system for mobile SMS. In Proceedings of 3rd IEEE conference on industrial electronics and applications (pp. 1319-1324).
54. Xiang, Y.; Chowdhury, M.; Ali, S. (2004). Filtering mobile spam by support vector machine. In N. Debnath (Ed.), Proceedings of the third international conference on computer sciences, software engineering, information technology, E-business and applications (pp. 1-4).
55. Yadav, K.; Kumaraguru, P.; Goyal, A.; Gupta, A.; Naik, V. (2011). SMSAssassin: Crowdsourcing driven mobile-based system for SMS spam filtering. In Proceedings of the 12th workshop on mobile computing systems and applications (HotMobile 2011).
56. Yardi, S.; Romero, D. M.; Schoenebeck, G.; Boyd, D. (2010). Detecting spam in a twitter network. First Monday, 15.
57. J.W. Yoon, H. Kim, and J.H. Huh Hybrid spam filtering for mobile communication Computers & Security 29 2010 446 459
58. L. Zhang, J. Zhu, and T. Yao An evaluation of statistical spam filtering techniques ACM Transactions on Asian Language Information Processing (TALIP) 3 2004 243 269