Robust detection of comment spam using entropy rate

Proceedings of the ACM Conference on Computer and Communications Security

Volumn , Issue , 2012, Pages 59-69

  Kantchelian, Alex ^a   Ma, Justin ^a   Huang, Ling ^b   Afroz, Sadia ^c   Joseph, Anthony D ^a   Tygar, J D ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b INTEL CORPORATION   (United States)

^c DREXEL UNIVERSITY   (United States)

Author keywords

Comment spam; Content complexity; Logistic regression; Noisy label; Spam filtering

Indexed keywords

COMMENT SPAM; CONTENT COMPLEXITY; LOGISTIC REGRESSIONS; NOISY LABELS; SPAM FILTERING;

ARTIFICIAL INTELLIGENCE; LOGISTICS; REGRESSION ANALYSIS;

INTERNET;

EID: 84869838776     PISSN: 15437221     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2381896.2381907     Document Type: Conference Paper

References (24)

1. A. R. Barron, J. Rissanen, and B. Yu. The minimum description length principle in coding and modeling. IEEE Transactions on Information Theory, 44(6):2743-2760, 1998.
2. A. Bratko, G. V. Cormack, B. Filipic, T. R. Lynam, and B. Zupan. Spam filtering using statistical data compression models. Journal of Machine Learning Research, 7:2673-2698, Dec 2006.
3. M. Brennan, S. Wrazien, and R. Greenstadt. Learning to extract quality discourse in online communities. In Workshops at the Twenty-Fourth AAAI Conference on Artificial Intelligence, 2010.
4. B.-C. Chen, J. Guo, B. Tseng, and J. Yang. User reputation in a comment rating environment. In Proceedings of KDD'11, 2011.
5. H. Gao, J. Hu, C. Wilson, Z. Li, Y. Chen, and B. Zhao. Detecting and characterizing social spam campaigns. In Proceedings of IMC, 2010.
6. C.-F. Hsu, E. Khabiri, and J. Caverlee. Ranking Comments on the Social Web. In Proceedings of the IEEE International Conference on Computational Science and Engineering (CSE), pages 90-97, 2009.
7. K. Lee, J. Caverlee, and S. Webb. Uncovering social spammers: social honeypots+ machine learning. In Proceedings of SIGIR, 2010.
8. K. Levenberg. A method for the solution of certain non-linear problems in least squares. In Quarterly of Applied Mathematics, volume 2, pages 164-168, 1944.
9. D. Marquardt. An algorithm for least-squares estimation of nonlinear parameters. In SIAM Journal on Applied Mathematics, volume 11, pages 430-441, 1963.
10. G. Mishne, D. Carmel, and R. Lempel. Blocking Blog Spam with Language Model Disagreement. In Proceedings of the International Workshop on Adversarial Information Retrieval on the Web (AIRWeb), 2005.
11. G. Mishne and N. Glance. Leave a Reply: An Analysis of Weblog Comments. In Proceedings of the International World Wide Web Conference (WWW), 2006.
12. A. Mishra and R. Rastogi. Semi-supervised correction of biased comment ratings. In Proceedings of WWW'12, 2012.
13. I. Pavlov. LZMA SDK (software development kit), 2007.
14. P. L. R. H. Byrd and J. Nocedal. A limited memory algorithm for bound constrained optimization. In SIAM Journal on Scientific and Statistical Computing, volume 16, pages 1190-1208, 1995.
15. A. Ramachandran and N. Feamster. Understanding the network-level behavior of spammers. In Proceedings of Sigcomm, 2006.
16. A. Ramachandran, N. Feamster, and S. Vempala. Filtering spam with behavioral blacklisting. In Proceedings of CCS'07, 2007.
17. V. C. Raykar, S. Yu, L. H. Zhao, G. H. Valadez, C. Florin, L. Bogoni, and L. Moy. Learning from crowds. Journal of Machine Learning Research, 11:1297-1322, April 2010.
18. T. Schurmann and P. Grassberger. Entropy estimation of symbol sequence. Chaos (Woodbury, N.Y.), 6(3):414-427, Sept. 1996.
19. D. Sculley and G. M. Wachman. Relaxed online svms for spam filtering. In Proceedings of SIGIR'07, 2007.
20. C. Shannon. Prediction and Entropy of Printed English. Bell System Technical Journal, 30(1):50-64, 1951.
21. Y. Shin, M. Gupta, and S. Myers. Prevalence and mitigation of forum spamming. In INFOCOM, 2011 Proceedings IEEE, pages 2309-2317. IEEE, 2011.
22. Y. Xie, F. Yu, K. Achan, R. Panigrahy, G. Hulten, and I. Osipkov. Spamming botnets: Signatures and characteristics. In Proceedings of SIGCOMM 08, 2008.
23. J.-M. Xu, G. Fumera, F. Roli, and Z.-H. Zhou. Training spamassassin with active semi-supervised learning. In Proceedings of the 6th Conference on Email and Anti-Spam (CEAS'09), 2009.
24. L. Zhuang, J. Dunagan, D. R. Simon, H. J. Wang, I. Osipkov, G. Hulten, and J. Tygar. Characterizing botnets from email spam records. In Proceedings of LEET, 2008.