Caching search engine results over incremental indices

SIGIR 2010 Proceedings - 33rd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval

Volumn , Issue , 2010, Pages 82-89

  Blanco, Roi ^a   Bortnikov, Edward ^b   Junqueira, Flavio P ^a   Lempel, Ronny ^b   Telloli, Luca ^a   Zaragoza, Hugo ^a  

^a YAHOO RESEARCH   (Spain)

^b YAHOO RESEARCH   (United States)

Author keywords

Real time indexing; Search engine caching

Indexed keywords

CACHE INVALIDATION; CRITICAL COMPONENT; INDEX UPDATE; POOR PERFORMANCE; QUERY EVALUATION; QUERY LOGS; REAL-TIME INDEXING; SEARCH ENGINE RESULTS; SEARCH RESULTS; TIME-TO-LIVE; WEB SEARCH ENGINES; WIKIPEDIA;

ENGINES; INDEXING (OF INFORMATION); SEARCH ENGINES; WEBSITES;

INFORMATION RETRIEVAL;

EID: 77956030122     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1835449.1835466     Document Type: Conference Paper

References (21)

1. A. Arasu, J. Cho, H. Garcia-Molina, A. Paepcke, and S. Raghavan. Searching the Web. ACM Transactions on Internet Technology, 1(1):2-43, 2001.
2. Ricardo Baeza-Yates, Aristides Gionis, Flavio P. Junqueira, Vanessa Murdock, Vassilis Plachouras, and Fabrizio Silvestri. Design trade-offs for search engine caching. ACM Transactions on the Web, 2(4):1-28, 2008.
3. Ricardo Baeza-Yates, Flavio Junqueira, Vassilis Plachouras, and Hans F. Witschel. Admission Policies for Caches of Search Engine Results. In SPIRE, 2007.
4. Ricardo A. Baeza-Yates and Berthier A. Ribeiro-Neto. Modern Information Retrieval. ACM Press / Addison Wesley, New York, NY, 1999.
5. Sergey Brin and Lawrence Page. The anatomy of a large-scale hypertextual Web search engine. In WWW'98: Proceedings of the 7th International Conference on the World Wide Web, pages 107-117, 1998.
6. Andrei Z. Broder, Steven C. Glassman, Mark S. Manasse, and Geoffrey Zweig. Syntactic clustering of the Web. Computer Networks and ISDN Systems, 29(8-13):1157-1166, 1997.
7. Soumen Chakrabarti. Mining the Web - Discovering Knowledge from Hypertext Data. Morgan Kaufmann Publishers, San Francisco, CA, 2003.
8. Junghoo Cho and Hector García-Molina. The evolution of the Web and implications for an incremental crawler. In Proc. 26th International Conference on Very Large Data Bases (VLDB2000), pages 200-209, 2000.
9. Anirban Dasgupta, Arpita Ghosh, Ravi Kumar, Christopher Olston, Sandeep Pandey, and Andrew Tomkins. The discoverability of the Web. In WWW '07: Proceedings of the 16th International Conference on the World Wide Web, pages 421-430. ACM, 2007.
10. Tiziano Fagni, Raffaele Perego, Fabrizio Silvestri, and Salvatore Orlando. Boosting the Performance of Web Search Engines: Caching and Prefetching Query Results by Exploiting Historical Usage Data. ACM Transactions on Information Systems, 24(1):51-78, 2006.
11. Marcus Fontoura, Jason Zien, Eugene Shekita, Sridhar Rajagopalan, and Andreas Neumann. High performance index build algorithms for intranet search engines. In Proc. 30th International Conference on Very Large Data Bases (VLDB 2004), pages 1158-1169. Morgan Kaufmann, August 2004.
12. Qingqing Gan and Torsten Suel. Improved techniques for result caching in Web search engines. In WWW'09: Proceedings of the 18th International Conference on the World Wide Web, pages 431-440, April 2009.
13. Paul Jaccard. Étude comparative de la distribution florale dans une portion des alpes et des jura. Bulletin de la Société Vaudoise des Sciences Naturelles, 37:547-579, 1901.
14. Ronny Lempel and Shlomo Moran. Predictive Caching and Prefetching of Query Results in Search Engines. In WWW'03: Proceedings of the 12th International Conference on the World Wide Web, pages 19-28. ACM Press, 2003.
15. Ronny Lempel and Shlomo Moran. Competitive caching of query results in search engines. Theoretical Computer Science, 324(2):253-271, September 2004.
16. Xiaohui Long and Torsten Suel. Three-level caching for efficient query processing in large Web search engines. In WWW'05: Proceedings of the 14th International Conference on the World Wide Web, pages 257-266, May 2005.
17. Evangelos P. Markatos. On Caching Search Engine Query Results. Computer Communications, 24(2):137-143, 2001.
18. Sergey Melnik, Sriram Raghavan, Beverly Yang, and Hector Garcia-Molina. Building a distributed full-text index for the Web. In WWW'01: Proceedings of the 10th International Conference on the World Wide Web, pages 396-406, May 2001.
19. P. Saraiva, E. Moura, N. Ziviani, W. Meira, R. Fonseca, and B. Ribeiro-Neto. Rank-preserving two-level caching for scalable search engines. In Proc. 24th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 51-58, 2001.
20. Gleb Skobeltsyn, Flavio Junqueira, Vassilis Plachouras, and Ricardo Baeza-Yates. ResIn: a combination of results caching and index pruning for high-performance Web search engines. In Proceedings of the 31st ACM SIGIR conference, pages 131-138, 2008.
21. Ian Witten, Alistair Moffat, and Timoty Bell. Managing Gigabytes. Morgan Kaufmann Publishers, Inc., San Francisco, CA, second edition, 1999.