Identifying web spam with user behavior analysis

AIRWeb 2008 - Proceedings of the 4th International Workshop on Adversarial Information Retrieval on the Web

Volumn , Issue , 2008, Pages 9-16

  Liu, Yiqun ^a   Cen, Rongwei ^a   Zhang, Min ^a   Shaoping, Ma ^a   Ru, Liyun ^a  

^a TSINGHUA UNIVERSITY   (China)

Author keywords

Spam detection; User behavior analysis; Web search engine

Indexed keywords

BEHAVIORAL RESEARCH; INFORMATION RETRIEVAL; INFORMATION SERVICES; INTERNET; LEARNING ALGORITHMS; SEARCH ENGINES; SPAMMING; TELECOMMUNICATION NETWORKS;

BAYESIAN LEARNING; DETECTION ALGORITHMS; DETECTION FRAMEWORKS; SPAM DETECTION; USER BEHAVIOR ANALYSIS; USER BEHAVIORS; WEB ACCESS; WEB ACCESS LOGS; WEB SEARCH ENGINE;

WORLD WIDE WEB;

EID: 63049102411     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1451983.1451986     Document Type: Conference Paper

References (27)

1. CNNIC (China Internet Network Information Center), the 16th report in development of Internet in China. Online at http://www.cnnic.net.cn/uploadfiles/ pdf/2005/7/20/210342.pdf.
2. Silverstein, C., Marais, H., Henzinger, M., and Moricz, M. 1999. Analysis of a very large web search engine query log. SIGIR Forum 33,1 (Sep. 1999), 6-12.
3. Gyongyi, Z. and Garcia-Molina, H. Web spam taxonomy. In First International Workshop on Adversarial Information Retrieval on the Web, 2005.
4. Henzinger, M.R., Motwani, R., Silverstein, C. 2003. Challenges in Web Search Engines. In Proceedings of the 18th International Joint Conference on Artificial Intelligence (2003) 1573-1579.
5. Brin, S. and Page, L. 1998. The anatomy of a large-scale hypertextual Web search engine. In Proceedings of the Seventh international Conference on World Wide Web 7 (Brisbane, Australia). 107-117.
6. Kleinberg. J.M. 1999. Authoritative sources in a hyperlinked environment. Journal of the ACM, 1999,46(5):604-632.
7. Wu, B. and Davison, B. Cloaking and redirection: a preliminary study. In First International Workshop on Adversarial Information Retrieval on the Web (AIRWeb '05), May 2005.
8. th International Conference World Wide Web (WWW), May 2007.
9. Fetterly, D., Manasse, M. and Najork, M. Spam, damn spam, and statistics: Using statistical analysis to locate spam web pages. In S. Amer-Yahia and L. Gravano, editors, WebDB, pages 1-6, 2004.
10. Ntoulas, A., Najork, M., Manasse, M., and Fetterly, D. 2006. Detecting spam web pages through content analysis. In Proceedings of the 15th International Conference on World Wide Web (Edinburgh, Scotland, May 23 - 26, 2006). WWW '06. ACM Press, New York, NY, 83-92.
11. Davison B. Recognizing nepotistic links on the Web. In Artificial Intelligence for Web Search, pages 23-28. AAAI Press, July 2000. Presented at the AAAI-2000 workshop on Artificial Intelligence for Web Search, Technical Report WS-00-01.
12. Amitay, E., Carmel, D., Darlow, A., Lempel, R., and Soffer, A. 2003. The connectivity sonar: detecting site functionality by structural patterns. In Proceedings of the Fourteenth ACM Conference on Hypertext and Hypermedia (Nottingham, UK, August 26 - 30, 2003). HYPERTEXT '03.
13. Gyöngyi, Z., Garcia-Molina, H., and Pedersen, J. 2004. Combating web spam with trustrank. In Proceedings of the Thirtieth international Conference on Very Large Data Bases - Volume 30. 576-587.
14. Krishnan, V. and Raj, R. Web Spam Detection with Anti-Trust-Rank. In the 2nd International Workshop on Adversarial Information Retrieval on the Web (AIRWeb), August 2006.
15. L. Becchetti, C. Castillol D. Donatol, S. Leonardi, and R. Baeza-Yates. Using Rank Propagation and Probabilistic Counting for Link Based Spam Detection. In Proc. of WebKDD'06, August 2006.
16. Geng, G., Wang, C., Li, Q., Xu, L., and Jin, X. 2007. Boosting the Performance of Web Spam Detection with Ensemble Under-Sampling Classification. In Proceedings of the Fourth international Conference on Fuzzy Systems and Knowledge Discovery (FSKD 2007) Vol.4 - Volume 04 (August 24 - 27, 2007). FSKD. IEEE Computer Society, Washington, DC, 583-587.
17. Svore, K., Wu, Q., Burges, C. and Raman, A. Improving Web Spam Classification using Rank-time Features. In Third International Workshop on Adversarial Information Retrieval on the Web (AIRWeb '07), May 2007.
18. Sullivan D. 2006. Searches Per Day. Retrieved from search engine watch web site http://searchenginewatch.com/reports/article.php/2156461.
19. Silverstein, C., Marais, H., Henzinger, M., and Moricz, M. 1999. Analysis of a very large web search engine query log. SIGIR Forum 33, 1 (Sep. 1999), 6-12.
20. Yu, H., Liu, Y., Zhang, M. and Ma, S. Research in Search Engine User Behavior Based on Log Analysis. Journal of Chinese Information Processing. Vol. 21(1): pp. 109-114, 2007.
21. Yu, H., Han, J., and Chang, K. C. 2004. PEBL: Web Page Classification without Negative Examples. IEEE Transactions on Knowledge and Data Engineering 16, 1 (Jan. 2004), 70-81.
22. Voorhees. E. M. 2001. The philosophy of information retrieval evaluation. In Proceedings of the Second Workshop of the Cross-Language Evaluation Forum, (CLEF 2001), pages 355-370.
23. Nigam, K., McCallum, A. K., Thrun, S., & Mitchell, T. (2000). Text Classification from Labeled and Unlabeled Documents using EM. Machine Learning. 39(2-3): 103-134.
24. Denis, F. PAC Learning from Positive Statistical Queries (pp.112-126). Proceedings of the 9th international Conference on Algorithmic Learning theory. Lecture Notes In Computer Science, vol. 1501. London: Springer-Verlag, 1998.
25. Manevitz, L. M. & Yousef, M. One-class SVMs for document classification. Machine Learning. Res. 2:139-154.
26. Mitchell, T. Chapter 6: Bayesian Learning, in Mitchell, T., Machine Learning, McGraw-Hill Education, 1997.
27. Web Spam Challenge Website: http://webspam.lip6.fr/