Detecting splogs via temporal dynamics using self-similarity analysis

ACM Transactions on the Web

Volumn 2, Issue 1, 2008, Pages

  Lin, Yu Ru ^a   Sundaram, Hari ^a   Chi, Yun ^b   Tatemura, Junichi ^b   Tseng, Belle L ^b  

^a ARIZONA STATE UNIVERSITY   (United States)

^b NEC LABORATORIES AMERICA   (United States)

Author keywords

Blogs; Regularity; Self similarity; Spam; Splog detection; Temporal dynamics; Topology

Indexed keywords

DATASETS; FEATURE VECTOR; FISHER LINEAR DISCRIMINANT ANALYSIS; SPLOG DETECTION;

DISCRIMINANT ANALYSIS; ONLINE SYSTEMS; SEARCH ENGINES; SUPPORT VECTOR MACHINES;

INTRUSION DETECTION;

EID: 40949163854     PISSN: 15591131     EISSN: 1559114X     Source Type: Journal    
DOI: 10.1145/1326561.1326565     Document Type: Article

References (36)

1. Benczur, A., Csalogany, K., Sarlos, T., and Uher, M. 2005. Spamrank-fully automatic link spam detection. In Proceedings of the 1st International Workshop on Adversarial Information Retrieval on the Web (AIRWeb).
2. Castillo, C., Donato, D., Becchetti, L., Boldi, P., Santini, M., and Vigna, S. 2006. A reference collection for web spam. SIGIR Forum (Dec.) ACM Press, 11-24.
3. Cavnar, W. B. and Trenkle, J. M. 1994. N-gram-based text categorization. In Proceedings of 3rd Annual Symposium on Document Analysis and Information Retrieval.
4. Chang, C.-C. and Lin, C.-J. 2001. Libsvm: A library for support vector machines. ntv.edu.two- cjlin/papers (libsvm, ps.gz).
5. Duda, R. O., Hart, P. E., and Stork, D. G. 2001. Pattern Classification. John Wiley & Sons, Inc. New York.
6. Eckmann, J., Kamphorst, S. O., and Ruelle, D. 1987. Recurrence plots of dynamical systems. Europhysics Lett. 4, 973-977.
7. Fetterly, D., Manasse, M., and Najork, M. 2004. Spam, damn spam, and statistics: Using statistical analysis to locate spam web pages. In Proceedings of the 7th International Workshop on the Web and Databases. Colocated with ACM SIGMOD/PODS. 1-6.
8. Fetterly, D., Manasse, M., and Najork, M. 2005. Detecting phrase-level duplication on the world wide web. In Proceedings of the 28th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. 170-177.
9. Fogaras, D. and Racz, B. 2005. Scaling link-based similarity search. In Proceedings of the 14th International Conference on World Wide Web. ACM Press. 641-650.
10. Foote, J., Cooper, M., and Nam, U. 2002. Audio retrieval by rhythmic similarity. In Proceedings of the International Conference on Music Information Retrieval. 265-266.
11. Gyngyi, Z., Garcia-Molina, H., and Pedersen, J. 2004. Combating Web spam with trustrank. In Proceedings of the 30th International Conference on Very Large Data Bases (VLDB'04). Toronto, Canada. Morgan Kaufmann. 576-587.
12. Gyngyi, Z. and Garcia-Molina, H. 2005. Web spam taxonomy. In Proceedings of the 1st International Workshop on Adversarial Information Retrieval on the Web (AIRWeb).
13. Gyngyi, Z., Berkhin, P., Garcia-Molina, H., and Pedersen, J. 2006. Link spam detection based on mass estimation. In Proceedings of the 32nd International Conference on Very Large Data Bases (VLDB). Seoul, Korea. 439-450.
14. Han, S., Ahn, Y., Moon, S., and Jeong, H. 2006. Collaborative blog spam filtering using adaptive percolation search. WWW2006 Workshop on the Weblogging Ecosystem: Aggregation, Analysis and Dynamics. Edinburgh.
15. Kolari, P. 2005. Welcome to the splogosphere: 75% of new pings are spings (splogs). http://ebiquity.umbc.edu/blogger/2005/12/15/welcome-to-the- splogosphere-75-of-new-blog-posts- are-spam/.
16. Kolari, P., Finin, T., and Joshi, A. 2006a. Svms for the blogosphere: Blog identification and splog detection. In Proceedings of the AAAI Spring Symposium on Computational Approaches to Analyzing Weblogs.
17. Kolari, P., Java, A., and Finin, T. 2006b. Characterizing the splogosphere. In Proceedings of the 3rd Annual Workshop on Weblogging Ecosystem: Aggregation, Analysis and Dynamics, 15th World Wide Web Conference.
18. Kolari, P., Java, A., Finin, T., Mayfield, J., Joshi, A., and Martineau, J. 2006c. Blog track open task: Spam blog classification. TREC Blog Track Notebook.
19. Kolari, P., Java, A., Finin, T., Oates, T., and Joshi, A. 2006d. Detecting spam blogs: A machine learning approach. In Proceedings of the 21st National Conference on Artificial Intelligence (AAAI'06). Boston, MA.
20. Lin, Y., Sundaram, H., Chi, Y., Tatemura, J., and Tseng, B. 2007. Splog detection using content, time and link structures. IEEE International Conference on Multimedia and Expo 2007: 2030-2033.
21. Lin, Y.-R., Chen, W.-Y., Shi, X., Sia, R., Song, X., Chi, Y., Hino, K., Sundaram, H., Tatemura, J., and Tseng, B. 2006. The splog detection task and a solution based on temporal and link properties. In Poceedings of the 15th Text REtrieval Conference (TREC'06).
22. Macdonald, C. and Ounis, I. 2006. The trec blogs06 collection: Creating and analyzing a blog test collection. TR-2006-224. Department of Computer Science, University of Glasgow.
23. Mishne, G., Carmel, D., and Lempel, R. 2005. Blocking blog spam with language model disagreement. In Proceedings of the 1st International Workshop on Adversarial Information Retrieval on the Web (AIRWeb).
24. Narisawa, K., Yamada, Y., Ikeda, D., and Takeda, M. 2006. Detecting blog spams using the vocabulary size of all substrings in their copies. In Proceedings of the 3rd Annual Workshop on Weblogging Ecosystem.
25. Newman, M. and Girvan, M. 2004. Finding and evaluating community structure in networks. Phys. Rev. E 69, 2, 26113.
26. Ntoulas, A., Najork, M., Manasse, M., and Fetterly, D. 2006. Detecting spam Web pages through content analysis. In Proceedings of the 15th International Conference on World Wide Web. Edinburgh, Scotland. ACM Press, 83-92.
27. Salvetti, F. and Nicolov, N. Weblog classification for fast splog filtering: A url language model segmentation approach. In Proceedings of the Human Language Technology Conference of the NAACL. Companion Volume: Short Papers, 137-140.
28. Shen, G., Gao, B., Liu, T.-Y., Feng, G., Song, S., and Li, H. 2006. Detecting link spam using temporal information. In Proceedings of the 6th International Conference on Data Mining. IEEE Computer Society. 1049-1053.
29. SURBL Surbl-spam uri realtime blocklists. http://www.surbl.org/.
30. Swain, M. and Ballard, D. 1991. Color indexing. Int. J. Comput. Vision 7, 1, 11-32.
31. UMBRIA. 2006. Spam in the blogosphere. http://www.umbrialistens.com/ files/uploads/umbria_ splog.pdf.
32. Urvoy, T., Lavergne, T., and Filoche, P. 2006. Tracking web spam with hidden style similarity. AIRWEB, Seattle, WA.
33. Von Ahn, L., Blum, M., and Langford, J. 2004. Telling humans and computers apart automatically. Comm. ACM 47, 2, 56-60.
34. Wikipedia. http://en.wikipedia.org/wiki/.
35. Wu, B. and Davison, B. 2005. Identifying link farm spam pages. In Proceedings of the International World Wide Web Conference. ACM Press. 820-829.
36. Zawodny, J. 2005 Yahoo¡ Search blog: A defense against comment spam. http://www.ysearchblog.com/archives/000069.html.