Latent dirichlet allocation in web spam filtering

AIRWeb 2008 - Proceedings of the 4th International Workshop on Adversarial Information Retrieval on the Web

Volumn , Issue , 2008, Pages 29-32

  Bíró, István ^a   Szabó, Jácint ^a   Benczúr, András A ^a  

^a INSTITUTE OF EXPERIMENTAL MEDICINE   (Hungary)

Author keywords

Latent dirichlet allocation; Web content spam

Indexed keywords

BAG-OF-WORDS; F MEASURES; LATENT DIRICHLET ALLOCATION; LDA TECHNIQUES; LOGISTIC REGRESSIONS; SPAM CLASSIFICATIONS; SPAM FILTERING; STATISTICAL LANGUAGE MODELS; STRONG LINKS; TRAINING PHASE; WEB CONTENT SPAM; WEB RETRIEVALS; WEB SITES;

COMPUTATIONAL LINGUISTICS; INFORMATION RETRIEVAL; INFORMATION SERVICES; INTERNET; PROBABILITY DENSITY FUNCTION; WORLD WIDE WEB;

SPAMMING;

EID: 63049112029     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1451983.1451991     Document Type: Conference Paper

References (24)

1. J. Abernethy, O. Chapelle, and C. Castillo. WITCH: A New Approach to Web Spam Detection. In Proceedings of the 4th International Workshop on Adversarial Information Retrieval on the Web (AIRWeb), 2008.
2. E. Amitay, D. Carmel, A. Darlow, R. Lempel, and A. Soffer. The Connectivity Sonar: Detecting site functionality by structural patterns. In Proceedings of the 14th ACM Conference on Hypertext and Hypermedia (HT), pages 38-47, Nottingham, United Kingdom, 2003.
3. I. Bhattacharya and L. Getoor. A latent dirichlet model for unsupervised entity resolution. SIAM International Conference on Data Mining, 2006.
4. D. Blei, A. Ng, and M. Jordan. Latent Dirichlet allocation. Journal of Machine Learning Research, 3(5):993-1022, 2003.
5. A. Bratko, B. Filipič, G. Cormack, T. Lynam, and B. Zupan. Spam Filtering Using Statistical Data Compression Models. The Journal of Machine-Learning Research, 7:2673-2698, 2006.
6. C. Castillo, D. Donato, A. Gionis, V. Murdock, and F. Silvestři. Know your neighbors: Web spam detection using the web topology. Technical report, DELIS - Dynamically Evolving, Large-Scale Information Systems, 2006.
7. G. Cormack. Content-based Web Spam Detection. In Proceedings of the 3rd International Workshop on Adversarial Information Retrieval on the Web (AIRWeb), 2007.
8. L. Fei-Fei and P. Perona. A Bayesian hierarchical model for learning natural scene categories. Proc. CVPR, 5, 2005.
9. D. Fetterly, M. Manasse, and M. Najork. Spam, damn spam, and statistics - Using statistical analysis to locate spam web pages. In Proceedings of the 7th International Workshop on the Web and Databases (WebDB), pages 1-6, Paris, France, 2004.
10. D. Fetterly, M. Manasse, and M. Najork. Detecting phrase-level duplication on the world wide web. In Proceedings of the 28th A CM International Conference on Research and Development in Information Retrieval (SIGIR), Salvador, Brazil, 2005.
11. T. Griffiths. Finding scientific topics. Proceedings of the National Academy of Sciences, 101(suppl-1):5228-5235, 2004.
12. Z. Gyongyi and H. Garcia-Molina. Web spam taxonomy. In Proceedings of the 1st International Workshop on Adversarial Information Retrieval on the Web (AIRWeb), Chiba, Japan, 2005.
13. G. Heinrich. Parameter estimation for text analysis. Technical report, Technical Report, 2004.
14. M. R. Henzinger, R. Motwani, and C. Silverstein. Challenges in web search engines. SIGIR Forum, 36(2):11-22, 2002.
15. T. Hofmann. Probabilistic latent semantic indexing. Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval, pages 50-57, 1999.
16. T. Lynam, G. Cormack, and D. Cheriton. On-line spam filter fusion. Proc. of the 29th international ACM SIGIR conference on Research and development in information retrieval, pages 123-130, 2006.
17. T. Minka and J. Lafferty. Expectation-propagation for the generative aspect model. Uncertainty in Artificial Intelligence (UAI), 2002.
18. A. Ntoulas, M. Najork, M. Manasse, and D. Fetterly. Detecting spam web pages through content analysis. In Proceedings of the 15th International World Wide Web Conference (WWW), pages 83-92, Edinburgh, Scotland, 2006.
19. X.-H. Phan. http://gibbslda.sourceforge.net/.
20. A. Singhal. Challenges in running a commercial search engine. In IBM Search and Collaboration Seminar 2004. IBM Haifa Labs, 2004.
21. A. Singhal, G. Salton, M. Mitra, and C. Buckley. Document length normalization. Information Processing and Management, 32(5):619-633, 1996.
22. J. Sivic, B. Russell, A. Efros, A. Zisserman, and W. Freeman. Discovering Objects and their Localization in Images. Computer Vision, ICCV 2005. Tenth IEEE International Conference on, 1, 2005.
23. I. H. Witten and E. Frank. Data Mining: Practical Machine Learning Tools and Techniques. Morgan Kaufmann Series in Data Management Systems. Morgan Kaufmann, second edition, June 2005.
24. D. Xing and M. Girolami. Employing Latent Dirichlet Allocation for fraud detection in telecommunications. Pattern Recognition Letters, 28(13):1727-1734, 2007.