Near-duplicate detection for web-forums

ACM International Conference Proceeding Series

Volumn , Issue , 2009, Pages 142-151

  Muthmann, Klemens ^a   Barczyński, Wojciech M ^b   Löser, Alexander ^c   Brauer, Falk ^b  

^a DRESDEN UNIVERSITY OF TECHNOLOGY   (Germany)

^b SAP RESEARCH   (Germany)

^c TECHNISCHE UNIVERSITÄT BERLIN   (Germany)

Author keywords

Data mining; Knowledge management; Web forum analysis

Indexed keywords

NEAR-DUPLICATE DETECTION; NEAR-DUPLICATES; NEW THREAD; ON-MACHINES; REAL-WORLD; SEARCH RESULTS; SEARCH TECHNOLOGY; WEB PAGE; WEB-FORUM ANALYSIS;

KNOWLEDGE MANAGEMENT;

ALGORITHMS;

EID: 70350675569     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1620432.1620447     Document Type: Conference Paper

References (15)

1. E. Agichtein, C. Castillo, D. Donato, A. Gionis, and G. Mishne. Finding high quality content in social media, with an application to community-based question answering. In Proceedings of ACM WSDM, pages 183-194, Stanford, CA, USA, February 2008. ACM Press.
2. R. Baeza-Yates and B. Ribeiro-Neto. Modern Information Retrieval. Addison Wesley, May 1999.
3. W. M. Barczynski, F. Brauer, A. Loeser, and A. Mocan. Algebraic information extraction of enterprise data: Methodology and operators. In IK-KR Workshop at IJCAI 2009 (to be published), 2009.
4. A. Z. Broder. Identifying and filtering near-duplicate documents. In COM '00: Proceedings of the 11th Annual Symposium on Combinatorial Pattern Matching, pages 1-10, London, UK, 2000. Springer-Verlag.
5. M. S. Charikar. Similarity estimation techniques from rounding algorithms. In STOC 02: Proceedings of the thiry-fourth annual ACM symposium on Theory of computing, pages 380-388, New York, NY, USA, 2002. ACM.
6. A. Chowdhury, O. Frieder, D. Grossman, and M. C. McCabe. Collection statistics for fast duplicate document detection. ACM Trans. Inf. Syst., 20(2):171-191, 2002.
7. X. Z. Fern and W. Lin. Cluster ensemble selection. In SDM, pages 787-797. SIAM, 2008.
8. A. Gionis, P. Indyk, and R. Motwani. Similarity search in high dimensions via hashing. In VLDB '99: Proceedings of the 25th International Conference on Very Large Data Bases, pages 518-529, San Francisco, CA, USA, 1999. Morgan Kaufmann Publishers Inc.
9. M. Henzinger. Finding near-duplicate web pages: a large-scale evaluation of algorithms. In SIGIR '06: Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval, pages 284-291, New York, NY, USA, 2006. ACM.
10. U. Manber. Finding similar files in a large file system. In Proceedings of the USENIX Winter 1994 Technical Conference, pages 1-10, San Fransisco, CA, USA, JanuaryJuly-FebruaryJanuary 1994.
11. R. Ramakrishnan and A. Tomkins. Toward a peopleweb. IEEE Computer, 40(8):63-72, 2007.
12. M. Theobald, J. Siddharth, and A. Paepcke. Spotsigs: robust and efficient near duplicate detection in large web collections. In SIGIR '08: Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval, pages 563-570, New York, NY, USA, 2008. ACM.
13. T.S.Jayram, R. Krishnamurthy, S. Raghavan, S. Vaithyanathan, and H. Zhu. Avatar information extraction system. In IEEE Data Engineering Bulletin, May 2006.
14. W. Xi, E. A. Fox, W. Fan, B. Zhang, Z. Chen, J. Yan, and D. Zhuang. Simfusion: measuring similarity using unified relationship matrix. In SIGIR '05: Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval, pages 130-137, New York, NY, USA, 2005. ACM.
15. S. Ye, R. Song, J.-R. Wen, and W.-Y. Ma. A query-dependent duplicate detection approach for large scale search engines. In APWeb, pages 48-58, 2004.