Fast statistical spam filter by approximate classifications

Performance Evaluation Review

Volumn 34, Issue 1, 2006, Pages 347-358

  Li, Kang ^a   Zhong, Zhenyu ^a  

^a University of Georgia ^*  (United States)

Author keywords

Approximation; Bayesian filter; Bloom filter; SPAM

Indexed keywords

APPROXIMATION THEORY; CLASSIFICATION (OF INFORMATION); COMPUTER NETWORKS; DATA PROCESSING; DATA STRUCTURES; DIGITAL FILTERS; SERVERS;

BAYESIAN FILTERS; BLOOM FILTERS; LOOKUP APPROXIMATIONS; SPAM;

COMPUTER SYSTEMS;

EID: 33750374263     PISSN: 01635999     EISSN: 01635999     Source Type: Conference Proceeding    
DOI: 10.1145/1140103.1140317     Document Type: Conference Paper

References (30)

1. I. Androutsopoulos, J. Koutsias, K. Chandrinos, G. Paliouras, and C. Spyropoulos. An evaluation of naive bayesian anti-spam filtering. In Proceedings of the workshop on Machine Learning in the New Information Age, 2000., pages 9-17, May 2000.
2. T. Berger and J. D. Gibson. Lossy source coding. IEEE Transactions on Information Theory, vol.44(6):2693-2723, 1998.
3. B. Bloom. Space/time trade-offs in hash coding with allowable errors. Communications of the ACM, vol.13(7), July 1970.
4. A. Broder and M. Mitzenmacher. A survey of network applications of bloom filters. Internet Mathmatics, vol.1(4):485-509, 2004.
5. F. Chang, K. Li, and W. Feng. Approximate packet classification caching. In Proceedings of IEEE Infocom 2004, March 2004.
6. M. Delio. Not all asian email is spam. In Wired News Article, Feb 2002. http://www.wired.com/news/politics/0, 1283, 50455, 00.html Last accessed Feb 26, 2006.
7. S. Dharmapurikar, P. Krishnamurthy, and D. E. Taylor. Longest prefix matching using bloom filters. In in Proceedings of ACM SIGCOMM 2003, pages 201-212, August 2003.
8. End-to-End Interest Research Group. The end2end-interest archives, http://www.postel.org/pipermail/end2end-interest/ Last accessed Feb 27, 2006.
9. O. Erdogan and P. Cao. Hash-av: fast virus signature scanning by cache-resident filters. In in Proceedings of Globecom'05, November 2005.
10. C. Estan and G. Varghese. New directions in traffic measurement and accounting. In Proceedings of Internet Measurement Workshop, pages 75-80, November 2001.
11. L. Fan, P. Cao, J. Almeida, and A.Z.Broder. Summary cache: a scalable wide-area web cache sharing protocol. IEEE and ACM Transaction on Networking, 8(3):281-293, 2000.
12. D. Gall. MPEG: A video compression standard for multimedia applications. In Communication of ACM, pages 46-58, April 1991.
13. P. Graham. A plan for spam, Janurary 2003. In the First SPAM Conference http://spamconference.org.
14. D. Heckerman and M. P. Wellman. Bayesian networks. In Communications of the ACM, number 3, pages 27-30, March 1995.
15. S. Holden. Spam filter evaluations. http://sam.holden.id.au/writings/ spam2/ Last accessed Nov 2, 2005.
16. P. Jacob. The spam problem: moving beyond RBLs, 2003. http://theory.whirlycott.com/~phil/antispam/rbl-bad/rbl-bad.html Last accessed Feb 26, 2006.
17. P. Judge. The SPAM archive. http://www.spamarchive.org Last accessed Feb 26, 2006.
18. K. Li, F. Chang, W. chang Feng, and D. Burger. Architecture for packet classification caching. In Proceedings of IEEE ICON'2003, May 2003.
19. D. Lowd and C. Meek. Good word attacks on statistical spam filters. In Proceedings of the Second Email and SPAM conference, July 2005.
20. J. Max. Quantizing for minimum distortion. IEEE Transactions on Information Theory, vol.28(2):7-12, 1960.
21. T. Meyer and B. Whateley. SpamBayes: Effective open-source, bayesian based, email classifications. In Proceedings of the First Email and SPAM conference, July 2004.
22. Perl Monger Users. Perl monger mailing-list. http://mail.pm.org/ pipermail/classiccity-pm/ Last accessed Feb 27, 2006.
23. E. S. Raymond. Bogofilter: A fast open source bayesian spam filters. http://bogofilter.sourceforge.net/ Last accessed Nov 2, 2005.
24. R. Rivest. The MD5 message-digest algorithm. RFC 1321, April 1992.
25. G. Robinson. A statistical approach to the spam problem. In Linux Journal 107, March 2003, http://www.linuxjournal.com/article.php?sid=6467 Last accessed Nov 2, 2005.
26. V. Schryver. Distributed spam clearinghouse. http://www.rhyolite.com/ anti-spam/dcc/ Last accessed Nov 2, 2005.
27. M. Sergeant. Internet level spam detection and spamassassin. In Proceedings of the 2003 Spam Conference, January 2003.
28. A. Snoeren, C. Partridge, L. Sanchez, C. Jones, F. Tchakountio, S. Kent, and W. Strayer. Hash-based IP Traceback. In Proceedings of ACM SIGCOMM'01, August 2001.
29. G. L. Wittel and S. F. Wu. On attacking statistical spam filters. In Proceedings of the First Email and SPAM conference, July 2004.
30. A. Wood. Quick spam filter. http://freshmeat.net/projects/qsf/ Last accessed Nov 2, 2005.