Efficient overlap and content reuse detection in blogs and online news articles.

WWW'09 - Proceedings of the 18th International World Wide Web Conference

Volumn , Issue , 2009, Pages 81-90

  Kim, Jong Wook ^a   Candan, K Selçuk ^a   Tatemura, Junichi ^b  

^a Arizona State University   (United States)

^b NEC LABORATORIES AMERICA   (United States)

Author keywords

Reuse detection; Weblogs

Indexed keywords

BLOGOSPHERES; CONTENT RE-USE; DETECTION RATES; DYNAMIC NATURE; INCREMENTAL PROCESSING; INFORMATION SOURCES; MEDIA OUTLETS; MULTIPLE ORDERS; ONLINE NEWS; PROCESSING TIME; WEBLOGS;

INFORMATION DISSEMINATION; WORLD WIDE WEB;

BLOGS;

EID: 77955914175     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1526709.1526721     Document Type: Conference Paper

References (40)

1. David Sifry's Blog. http://www.sifry.com/alerts/.
2. Google Blog Search. http://blogsearch.google.com/blogsearch.
3. Google News. http://news.google.com.
4. Google Book Search. http://books.google.com/.
5. Yahoo News. http://news.yahoo.com.
6. The MD5 Message-Digest Algorithm. http://tools.ietf.org/html/rfc1321.
7. WWW'06 Workshop on the Weblogging Ecosystem: Aggregation, Analysis and Dynamics. 2006.
8. E. Adar and L.A. Adamic. Tracking Information Epidemics in Blogspace. In Proceedings of the 2005 IEEE/WIC/ACM International Conference on Web Intelligence, 2005.
9. A. Arasu, V. Ganti, and R. Kaushik. Efficient exact set-similarity joins. In VLDB, 2006.
10. R.J. Bayardo, Y. Ma, and R. Srikant. Scaling Up All Pairs Similarity Search. In WWW, 2007.
11. S. Berchtold, D.A. Keim, and H. Kriegei. The X-tree: An Index Structure for High-Dimensional Data. In VLDB, 1996.
12. Y. Bernstein and J. Zobel. A Scalable System for Identifying Co-derivative Documents. In Proceedings of String Processing and Information Retrieval Symp, 2004.
13. R. Blood. The Weblog Handbook: Practical Advice on Creating and Maintaining Your Blog. Perseus Books Group, 2002.
14. A.Z. Broder. On the resemblance and containment of documents. In Proceedings of Compression and Complexity of Sequences, 1997.
15. S. Brin, J. Davis, and H. Garcia-Molina. Copy detection mechanisms for digital documents. In SIGMOD, 1995.
16. K. Chakrabarti, and S. Mehrotra. The Hybrid Tree: An Index Structure for High Dimensional Feature Spaces. In ICDE, 1999.
17. S. Chaudhuri, V. Ganti, and R. Kaushik. A Primitive Operator for Similarity Joins in Data Cleaning. In ICDE, 2006.
18. X. Chen, B. Francia, M. Li, and B. Mckinnon. Shared Information and Program Plagiarism Detection. IEEE Transactions on Information Theory, 50 (7), 1545-1551, 2004.
19. Y. Chi, S. Zhu, X. Song, J. Tatemura, and B.L. Tseng. Structural and temporal analysis of the blogosphere through community factorization. In SIGKDD, 2007.
20. R. Cilibrasi, and P. Vitanyi. Clustering by compression. IEEE Transactions on Information Theory, 51(4), 1523-1545, 2005.
21. A. Chowdhury, O. Frieder, D. Grossman, M.C. McCabe. Collection statistics for fast duplicate document detection. ACM TOIS, v.20 n.2, p.171-191, 2002.
22. A. Gionis, P. Indyk, and R. Motwani. Similarity Search in High Dimensions via Hashing. In VLDB, 1999.
23. L. Gravano, P.G. Ipeirotis, H.V. Jagadish, N.Koudas, S. Muthukrishnan, and D. Srivastava Approximate String Joins in a Database (Almost) for Free. In VLDB, 2001.
24. N. Heintze. Scalable document fingerprinting. In USENIX Workshop on Electronic Commerce, 1996.
25. T. Hofmann. Probabilistic latent semantic analysis. In Proceedings of Uncertainty in Artificial Intelligence, 1999.
26. P. Indyk, R. Motwani, P. Raghavan and S. Vempala Locality-preserving hashing in multidimensional spaces. In STOC, 1997.
27. N. Katayama and S. Satoh. The SR-tree: an index structure for high-dimensional nearest neighbor queries. In SIGMOD, 1997.
28. J.W. Kim, K.S. Candan, and J.Tatemura. CDIP: Collection-Driven, yet Individuality-Preserving Automated Blog Tagging. In ICSC, 2007.
29. J.W. Kim, K.S. Candan, and J.Tatemura. Organization and Tagging of Blog Entries based on Content Reuse. submitted.
30. O. Kolak, and B.N. Schilit. Generating links by mining quotations. In HT, 2008.
31. U. Manber. Finding Similar Files in a Large File System. In Proceedings of the USENIX Winter 1994 Technical Conference, 1994.
32. G.S. Manku, A. Jain and A.D.Sarma. Detecting Near Duplicates for Web Crawling. In WWW, 2007.
33. D. Metzler, Y. Bernstein, W.B. Croft, A. Moffat, and J. Zobel. Similarity Measures for Tracking Information Flow. In CIKM, 2005.
34. S. Schleimer, D.S. Wilkerson, and A. Aiken. Winnowing: Local Algorithms for Document Fingerprinting. In SIGMOD, 2003.
35. S. Sarawagi, and A. Kirpa. Efficient set joins on similarity predicates. In SIGMOD, 2004.
36. N. Shivakumar and H. Garcia-Molina. SCAM: A Copy Detection Mechanism for Digital Documents. Second Annual Conference on the Theory and Practice of Digital Libraries, 1995.
37. N. Shrivakumar and H. Garcia-Molina Finding near-replicas of documents on the Web. In International Workshop on the World Wide Web and Databases, 1998.
38. H. Yang, and J. Callan Near-duplicate detection by instance-level constrained clustering. In SIGIR, 2006.
39. J. Zobel, A. Moffat, and K. Ramamohanarao. Inverted files versus signature files for text indexing. ACM Transactions on Database Systems(TODS), 23(4), 453-490, Dec. 1998.
40. C. Xiao, W. Wang, X. Lin, and J.X. Yu. Efficient Similarity Joins for Near Duplicate Detection. In WWW, 2008.