Improved consistent sampling, Weighted Minhash and L1 Sketching

Proceedings - IEEE International Conference on Data Mining, ICDM

Volumn , Issue , 2010, Pages 246-255

  Ioffe, Sergey ^a  

^a GOOGLE INC   (United States)

Author keywords

Compression; Hashing; Minhash; Retrieval; Sampling; Sketching

Indexed keywords

COMPRESSION; HASHING; MINHASH; RETRIEVAL; SKETCHING;

DATA MINING;

EID: 79951749405     PISSN: 15504786     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICDM.2010.80     Document Type: Conference Paper

References (13)

1. P. Indyk and R. Motwani, "Approximate nearest neighbors: towards removing the curse of dimensionality," in STOC '98: Proceedings of the thirtieth annual ACM symposium on Theory of computing, New York, NY, USA, 1998, pp. 604-613.
2. M. Datar, N. Immorlica, P. Indyk, and V. S. Mirrokni, "Locality-sensitive hashing scheme based on p-stable distributions," in SCG '04: Proceedings of the twentieth annual symposium on Computational geometry, New York, NY, USA, 2004, pp. 253-262.
3. A. Z. Broder, M. Charikar, A. M. Frieze, and M. Mitzen-macher, "Min-wise independent permutations," J. Comput. Syst. Sci., vol. 60, no. 3, pp. 630-659, 2000.
4. A. Andoni and P. Indyk, "Near-optimal hashing algorithms for approximate nearest neighbor in high dimensions," in FOCS '06: Proceedings of the 47th Annual IEEE Symposium on Foundations of Computer Science, Washington, DC, USA, 2006, pp. 459-468. (Pubitemid 351175534)
5. M. S. Charikar, "Similarity estimation techniques from rounding algorithms," in STOC '02: Proceedings of the thiry-fourth annual ACM symposium on Theory of computing, New York, NY, USA, 2002, pp. 380-388. (Pubitemid 35009398)
6. Y. Weiss, A. Torralba, and R. Fergus, "Spectral hashing," in Proc. Neural Information Processing Systems 2008, 2008.
7. R. Salakhutdinov and G. Hinton, "Semantic hashing," in IRGM 2007 workshop at the SIGIR 2007 conference, 2007.
8. O. Chum, J. Philbin, and A. Zisserman, "Near duplicate image detection: min-hash and tf-idf weighting," in Proceedings of the British Machine Vision Conference, 2008.
9. J. Kleinberg and E. Tardos, "Approximation algorithms for classification problems with pairwise relationships: Metric labeling and markov random fields," in FOCS '99: Proceedings of the 40th Annual Symposium on Foundations of Computer Science, Washington, DC, USA, 1999, p. 14.
10. M. Manasse, F. McSherry, and K. Talwar, "Consistent weighted sampling," MSR, Tech. Rep. MSR-TR-2010-73, 2010.
11. P. Li and C. König, "b-bit minwise hashing," in WWW '10, 2010.
12. G. Marsaglia and W. W. Tsang, "The ziggurat method for generating random variables," Journal of Statistical Software, vol. 5, no. 8, pp. 1-7, 2000. (Pubitemid 39217761)
13. P. Li, T. J. Hastie, and K. W. Church, "Nonlinear estimators and tail bounds for dimension reduction in l1 using cauchy random projections," J. Mach. Learn. Res., vol. 8, 2007.