Indexing shared content in information retrieval systems

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 3896 LNCS, Issue , 2006, Pages 313-330

  Broder, Andrei Z ^a   Eiron, Nadav ^b   Fontoura, Marcus ^a   Herscovici, Michael ^c   Lempel, Ronny ^c   McPherson, John ^d   Qi, Runping ^a   Shekita, Eugene ^d  

^a YAHOO INC   (United States)

^b GOOGLE INC   (United States)

^c IBM HAIFA RESEARCH LAB   (Israel)

^d IBM ALMADEN RESEARCH CENTER   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DOCUMENT REPRESENTATION MODEL; FREE-TEXT QUERIES; INVERTED INDEX; NEWSGROUP SEARCH;

ALGORITHMS; ELECTRONIC MAIL; MATHEMATICAL MODELS; QUERY LANGUAGES; SEARCH ENGINES; TREES (MATHEMATICS); WORLD WIDE WEB;

INFORMATION RETRIEVAL SYSTEMS;

EID: 33745590124     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/11687238_21     Document Type: Conference Paper

References (23)

1. R. Baeza-Yates and B. Ribeiro-Neto. Modern Information Retrieval. Addison Wesley, 1999.
2. M. Bilenko and R. J. Mooney. Adaptive duplicate detection using learnable string similarity measures. In KDD '03, pages 39-48, 2003.
3. S. Brin and L. Page. The anatomy of a large-scale hypertextual Web search engine. In WWW '98, pages 107-117, 1998.
4. A. Z. Broder. Identifying and filtering near-duplicate documents. In CPM '00, pages 1-10, 2000.
5. A. Z. Broder, D. Carmel, M. Herscovici, A. Soffer, and J. Zien. Efficient query evaluation using a two-level retrieval process. In CIKM '03, pages 426-434, 2003.
6. A. Z. Broder, S. C. Glassman, M. S. Manasse, and G. Zweig. Syntactic clustering of the web. In WWW '97, pages 1157-1166, 1997.
7. D. Carmel, D. Cohen, R. Fagin, E. Farchi, M. Herscovici, Y. S. Maarek, and A. Soffer. Static index pruning for information retrieval systems. In SIGIR '01, pages 43-50, 2001.
8. J. Cho, N. Shivakumar, and H. Garcia-Molina. Finding replicated web collections. In SIGMOD '00, pages 355-366, 2000.
9. E. S. de Moura, C. F. dos Santos, D. R. Fernandes, A. S. Silva, P. Calado, and M. A. Nascimento. Improving web search efficiency via a locality based static pruning method. In WWW '05, pages 235-244, 2005.
10. M. Fontoura, E. J. Shekita, J. Y. Zien, S. Rajagopalan, and A. Neumann. High performance index build algorithms for intranet search engines. In VLDB '04, pages 1158-1169, 2004.
11. H. Garcia-Molina, J. Ullman, and J. Widom. Database System Implementation. Prentice Hall, 2000.
12. Gmail. http://gmail.google.com/gmail/help/about.html.
13. S. Heinz and J. Zobel. Efficient single-pass index construction for text databases. JASIST, 54(8), 2003.
14. B. Klimt and Y. Yang. The Enron corpus: A new dataset for email classification research. In European Conference on Machine Learning, 2004.
15. X. Long and T. Suel. Optimized query execution in large search engines with global page ordering. In VLDB '03, pages 129-140, 2003.
16. S. Melnik, S. Raghavan, B. Yang, and H. Garcia-Molina. Building a distributed full-text index for the web. In WWW '01, pages 396-406, 2001.
17. A. Moffat and J. Zobel. Compression and fast indexing for multi-gigabyte text databases. Australian Computer Journal, 26(1), 1994.
18. F. Scholer, H. E. Williams, J. Yiannis, and J. Zobel. Compression of inverted indexes for fast query evaluation. In SIGIR '02, pages 222-229, 2002.
19. R. Stata, P. Hunt, and M. G. Thiruvalluvan. The Bloomba personal content database. In VLDB '04, pages 1214-1223, 2004.
20. H. Turtle and J. Flood. Query evaluation: strategies and optimizations. Inf. Proc. Management, 31(6):831-850, 1995.
21. I. Witten, A. Moffat, and T. Bell. Managing Gigabytes. Morgan Kaufmann, 1999.
22. Z. Zhang. The behavior of duplicate pages on the world wide web. Submitted to CIKM, 2005.
23. J. Zobel and A. Moffat. Adding compression to a full-text retrieval system. Soft-ware - Practice & Experience, 25(8), 1995.