Principles of hash-based text retrieval

Proceedings of the 30th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR'07

Volumn , Issue , 2007, Pages 527-534

  Stein, Benno ^a  

^a BAUHAUS UNIVERSITY WEIMAR   (Germany)

Author keywords

Dimension reduction; Hash based similarity search; Locality sensitive hashing

Indexed keywords

SEARCH ENGINES; STATISTICAL METHODS; TEXT PROCESSING;

DIMENSION REDUCTION; HASH-BASED SIMILARITY SEARCH; LOCALITY-SENSITIVE HASHING; OPTIMUM HASH FUNCTIONS; PLAGIARISM ANALYSIS;

INFORMATION RETRIEVAL;

EID: 36448954599     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1277741.1277832     Document Type: Conference Paper

References (29)

1. R. Ando and L. Lee. Iterative Residual Rescaling: An Analysis and Generalization of LSI. In Proc. 24th conference on research and development in IR, 2001.
2. G. Aston and L. Burnard. The BNC Handbook. http : //www. natcorp.ox.ac.uk/what/, 1998.
3. M. Bawa, T. Condie, and P. Ganesan. LSH Forest: Self-Tuning Indexes for Similarity Search. In WWW'05: Proc. of the 14th int. conference on World Wide Web, 2005.
4. A. Broder, S. Glassman, M. Manasse, and G. Zweig. Syntactic Clustering of the Web. In Selected papers from the sixth int. conference on World Wide Web, 1997.
5. D. Cai and X. Hee. Orthogonal Locality Preserving Indexing. In Proc. of the 28th conference on Research and development in IR, 2005.
6. M. S. Charikar. Similarity Estimation Techniques from Rounding Algorithms. In STOC'02: Proc. of the thirty-fourth ACM symposium on theory of computing, 2002.
7. T. Cormen, C. Leiserson, and R. Rivest. Introduction to Algorithms. MIT Press, Cambridge. 1990.
8. M. Datar, N. Immorlica, P. Indyk, and V. S. Mirrokni. Locality-Sensitive Hashing Scheme Based on p-Stable Distributions. In SCG'04: Proc. of the twentieth symposium on computational geometry, 2004.
9. S. Deerwester, S. Dumais, T. Landauer, G. Furnas, and R. Harshman. Indexing by Latent Semantic Analysis. Journal of the American Society of Information Science, 41(6):391-407, 1990.
10. C. Eckart and G. Young. The Approximation of one Matrix by Another of Lower Rank. Psychometrika, 1:211-2,18, 1936.
11. A. Gionis, P. Indyk, and R. Motwani. Similarity Search in High Dimensions via Hashing. In The VLDB Journal, 1999.
12. X. He, D. Cai, H. Liu, and W.-Y. Ma. Locality Preserving Indexing for Document Representation. In Proc. of the 27th conference on research and development in IR, 2001.
13. M. Henzinger. Finding Near-Duplicate Web Pages: a Large-Scale Evaluation of Algorithms. In Proc. of the 29th conference on research and development in IR, 2006.
14. N. Higham. Computing a Nearest Symmetric Positive Semidefinite Matrix. Linear Algebra and its App., 1988.
15. G. Hinton and R. Salakhutdinov. Reducing the Dimensionality of Data with Neural Networks. Science, 313:504-507, 2006.
16. T. Hofmann. Unsupervised Learning by Probabilistic Latent Semantic Analysis. Machine Learning, 42:177-196, 2001.
17. P. Indyk. Stable Distributions, Pseudorandom, Generators, Embeddings and Data Stream Computation. In FOCS'OO: Proc. of the 41st symposium on foundations of computer science, 2000. IEEE Computer Society.
18. P. Indyk and R. Motwani. Approximate Nearest Neighbor Towards Removing the Curse of Dimensionality. In Proc. of the 30th symposium on theory of computing, 1998.
19. I. Jolliffe. Principal Component Analysis. Springer, 1996.
20. J. Kleinberg. Two Algorithms for Nearest-Neighbor Search in High Dimensions. In STOC'97: Proc. of the twenty-ninth ACM symposium on theory of computing, 1997.
21. J. Kruskal. Multidimensional Scaling by Optimizing Goodness of Fit to a Nonmetric Hypothesis. Psychometrika, 29(1), 1964.
22. Y. Matsuo and M. Ishizuka. Keyword Extraction from a Single Document using Word Co-ocurrence Statistical Information. Int. Journal on Artificial Intelligence Tools, 13(1): 157-169, 2004.
23. J. Nolan. Stable Distributions-Models for Heavy Tailed, Data, http://academic2.american.edu/~jpnolan/stable/, 2005.
24. T. Rose, M. Stevenson, and M. Whitehead. The Reuters Corpus Volume 1. From Yesterday's News to Tomorrow's Language Resources. In Proc. of the third int. conference on language resources and evaluation, 2002.
25. S. Rump. Verification of Positive Definiteness. BIT Numerical Mathematics, 46:433-452, 2006.
26. B. Stein. Fuzzy-Fingerprints for Text-Based IR. In Proc. of the 5th Int. Conference on Knowledge Management, Graz, Journal of Universal Computer Science, 2005.
27. B. Stein and S. Meyer zu Eißen. Near Similarity Search and Plagiarism Analysis. In From Data and Information Analysis to Knowledge Engineering. Springer, 2006.
28. R. Weber, H. Schek, and S. Blott. A Quantitative Analysis and Performance Study for Similarity-Search Methods in High-dimensional Spaces. In Proc. of the 24th VLDB conference, 1998.
29. H. Yang and J. Callan. Near-Duplicate Detection by Instance-level Constrained Clustering. In Proc. of the 29th conference on research and development in IR, 2006.