Efficient Jaccard-based diversity analysis of large document collections

ACM International Conference Proceeding Series

Volumn , Issue , 2012, Pages 1402-1411

  Deng, Fan ^a   Siersdorfer, Stefan ^a   Zerr, Sergej ^a  

^a L3S RESEARCH CENTER   (Germany)

Author keywords

clustering; diversity; jaccard

Indexed keywords

BIBLIOGRAPHIC DATA; CENSUS DATA; CLUSTERING; CONSTANT TIME; DATA SETS; DIVERSITY; DIVERSITY ANALYSIS; DOCUMENT COLLECTION; JACCARD; KNOWLEDGE EVOLUTION; LARGE DOCUMENT CORPORA; LINEAR-TIME APPROXIMATION; PHOTO-SHARING SITES; PROBABILISTIC GUARANTEES; QUADRATIC COMPLEXITY; SIMILARITY COMPUTATION; TOPIC DIVERSITY; USER-GENERATED CONTENT; WEB REPOSITORIES;

KNOWLEDGE MANAGEMENT; POPULATION STATISTICS;

APPROXIMATION ALGORITHMS;

EID: 84871064447     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2396761.2398445     Document Type: Conference Paper

References (30)

1. Data clustering: 50 years beyond k-means. Pattern Recognition Letters, 31(8):651-666, 2010.
2. B. Babcock, S. Babu, M. Datar, R. Motwani, and J. Widom. Models and issues in data stream systems. PODS '02, Madison, Wisconsin.
3. R. Baeza-Yates and B. Ribeiro-Neto. Modern Information Retrieval. ACM Press, New York, 1999.
4. A. Z. Broder. Min-wise independent permutations: Theory and practice. ICALP '00, London, UK.
5. A. Z. Broder. On the resemblance and containment of documents. SEQUENCES '97, Washington, USA.
6. A. Z. Broder. Identifying and filtering near-duplicate documents. COM '00, London, UK, 2000.
7. A. Z. Broder, M. Charikar, A. Frieze, and M. Mitzenmacher. Min-wise independent permutations. J. Comput. Syst. Sci., 60:630-659, June 2000.
8. M. Charikar. Similarity estimation techniques from rounding algorithms. STOC '02.
9. P. Dagum, R. Karp, M. Luby, and S. Ross. An optimal algorithm for monte carlo estimation. SIAM J. Comput., 29:1484-1496, March 2000.
10. M. Datar, N. Immorlica, P. Indyk, and V. S. Mirrokni. Locality-sensitive hashing scheme based on p-stable distributions. SCG '04, New York, USA.
11. J. D. Fearon. Ethnic and cultural diversity by country*. Journal of Economic Growth, 8:195-222, 2003.
12. S. Gollapudi and A. Sharma. An axiomatic approach for result diversification. WWW'09, Madrid, Spain.
13. P. Indyk and R. Motwani. Approximate nearest neighbors: towards removing the curse of dimensionality. STOC '98, Dallas, Texas, USA.
14. C. C. Krebs. Ecological Methodology. HarperCollins, 1989.
15. C. Lévêque and J.-C. Mounolou. Biodiversity. John Wiley & Sons, 2003.
16. D. D. Lewis, Y. Yang, T. G. Rose, and F. Li. Rcv1: A new benchmark collection for text categorization research. Journal of Machine Learning Research, 5:361-397, 2004.
17. M. Ley. The dblp computer science bibliography. http://www.informatik. uni-trier.de/~ley/db/.
18. S. Lieberson. Measuring population diversity. American Sociological Review, 34(6):850-862, 1969.
19. C. D. Manning, P. Raghavan, and H. Schütze. Introduction to Information Retrieval. Cambridge University Press, 2008.
20. C. Meek, B. Thiesson, and D. Heckerman. The learning-curve sampling method applied to model-based clustering. J. Mach. Learn. Res., 2:397-418, March 2002.
21. E. Minack, W. Siberski, and W. Nejdl. Incremental diversification for very large sets: a streaming-based approach. In SIGIR '11, Beijing, China.
22. Olken. Random sampling from databases. In Ph.D. Diss. (University of California at Berkeley), 1993.
23. O. Papapetrou, W. Siberski, and N. Fuhr. Text clustering for peer-to-peer networks with probabilistic guarantees. LNCS, pages V.5993, 293-305. Springer Berlin / Heidelberg, 2010.
24. D. Rafiei, K. Bharat, and A. Shukla. Diversifying web search results. In WWW '10, Raleigh, USA.
25. I. Rafols and M. Meyer. Diversity and network coherence as indicators of interdisciplinarity: case studies in bionanoscience. Scientometrics, 82(2):263-287, 2010.
26. N. Sahoo, J. Callan, R. Krishnan, G. Duncan, and R. Padman. Incremental hierarchical clustering of text documents. In CIKM '06.
27. E. H. Simpson. Measurement of diversity. Nature, 163, 1949.
28. A. Stirling. A general framework for analysing diversity in science, technology and society. Journal of The Royal Society Interface, 4(15):707-719, 2007.
29. E. Vee, U. Srivastava, J. Shanmugasundaram, P. Bhat, and S. A. Yahia. Efficient computation of diverse query results. In ICDE'08, Washington, DC, USA.
30. C.-N. Ziegler, S. M. McNee, J. A. Konstan, and G. Lausen. Improving recommendation lists through topic diversification. In WWW '05, New York, USA.