A refreshing perspective of search engine caching

Proceedings of the 19th International Conference on World Wide Web, WWW '10

Volumn , Issue , 2010, Pages 181-190

  Cambazoglu, Berkant Barla ^a   Junqueira, Flavio P ^a   Plachouras, Vassilis ^b   Banachowski, Scott ^c   Cui, Baoqiu ^c   Lim, Swee ^c   Bridge, Bill ^d  

^a YAHOO RESEARCH   (Spain)

^b ATHENS UNIVERSITY OF ECONOMICS AND BUSINESS   (Greece)

^c YAHOO RESEARCH   (United States)

^d ORACLE CORPORATION   (United States)

Author keywords

caching; index updates; refresh; web search engines

Indexed keywords

BACK-END SERVERS; HIT RATE; IDLE CYCLES; INDEX UPDATE; LATENCY CONSTRAINTS; LOW LATENCY; NOVEL ALGORITHM; REAL PROBLEMS; TIME-TO-LIVE; USER QUERY; WEB SEARCH ENGINES;

CLUSTERING ALGORITHMS; ENGINES; INFORMATION RETRIEVAL; SEARCH ENGINES; SERVERS;

WORLD WIDE WEB;

EID: 77954650555     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1772690.1772710     Document Type: Conference Paper

References (31)

1. C. Aggarwal, J. L. Wolf, and P. S. Yu. Caching on the World Wide Web. IEEE Trans. Knowledge and Data Eng., 11:94-107, 1999.
2. A. V. Aho, P. J. Denning, and J. D. Ullman. Principles of optimal page replacement. J. ACM, 18(1):80-93, 1971.
3. R. Alonso, D. Barbara, and H. Garcia-Molina. Data caching issues in an information retrieval system. ACM Trans. Database Syst., 15(3):359-384, 1990.
4. R. Baeza-Yates, A. Gionis, F. Junqueira, V. Murdock, V. Plachouras, and F. Silvestri. The impact of caching on search engines. In 30th SIGIR Conference, pages 183-190, 2007.
5. L. Breslau, P. Cao, L. Fan, G. Phillips, and S. Shenker. Web caching and Zipf-like distributions: evidence and implications. In INFOCOM '99, pages 126-134, 1999.
6. E. A. Brewer. Lessons from giant-scale services. IEEE Internet Computing, 5(4):46-55, 2001.
7. P. Cao and S. Irani. Cost-aware WWW proxy caching algorithms. In 1st USITS, 1997.
8. E. Cohen and H. Kaplan. Refreshment policies for web content caches. In INFOCOM '01, pages 1398-1406, 2001.
9. P. J. Denning. Virtual memory. ACM Computing Surveys, 2(3):153-189, 1970.
10. W. Effelsberg and T. Haerder. Principles of database buffer management. ACM Trans. Database Syst., 9(4):560-595, 1984.
11. T. Fagni, R. Perego, F. Silvestri, and S. Orlando. Boosting the performance of web search engines: Caching and prefetching query results by exploiting historical usage data. ACM Trans. Inf. Syst., 24(1):51-78, 2006.
12. Q. Gan and T. Suel. Improved techniques for result caching in Web search engines. In 18th WWW Conference, pages 431-440, 2009.
13. B. T. Jónsson, M. J. Franklin, and D. Srivastava. Interaction of query evaluation and buffer management for information retrieval. SIGMOD Rec., 27(2):118-129, 1998.
14. R. Karedla, J. S. Love, and B. G. Wherry. Caching strategies to improve disk system performance. Computer, 27(3):38-46, 1994.
15. T. M. Kroeger, D. D. E. Long, and J. C. Mogul. Exploring the Bounds of Web Latency Reduction from Caching and Prefetching. In 1st USITS, 1997.
16. D. Lee, J. Choi, J. Kim, S. Noh, S. Min, Y. Cho, and C. Kim. LRFU: A Spectrum of Policies that Subsumes the Least Recently Used and Least Frequently Used Policies. IEEE Trans. Comp., 50(12):1352-1361, 2001.
17. R. Lempel and S. Moran. Predictive caching and prefetching of query results in search engines. In 12th WWW Conference, pages 19-28, 2003.
18. X. Long and T. Suel. Three-level caching for efficient query processing in large web search engines. In 14th WWW Conference, pages 257-266, 2005.
19. E. P. Markatos. On caching search engine query results. Comp. Commun., 24(2):137-143, 2001.
20. N. Megiddo and D. S. Modha. Outperforming LRU with an Adaptive Replacement Cache Algorithm. Computer, 37(4):58-65, 2004.
21. S. V. Nagaraj. Web Caching And Its Applications (Kluwer International Series in Engineering and Computer Science). Kluwer Academic Publishers, Norwell, MA, USA, 2004.
22. R. Ozcan, I. S. Altingovde, and O. Ulusoy. Static query result caching revisited. In 17th WWW Conference, pages 1169-1170, 2008.
23. S. Podlipnig and L. Böszörmenyi. A survey of web cache replacement strategies. ACM Comput. Surv., 35(4):374-398, 2003.
24. V. V. Raghavan and H. Sever. On the reuse of past optimal queries. In 18th SIGIR Conference, pages 344-350, 1995.
25. J. T. Robinson and M. V. Devarakonda. Data cache management using frequency-based replacement. SIGMETRICS Perform. Eval. Rev., 18(1):134-142, 1990.
26. P. C. Saraiva, E. S. de Moura, N. Ziviani, W. Meira, R. Fonseca, and B. Riberio-Neto. Rank-preserving two-level caching for scalable search engines. In 24th SIGIR Conference, pages 51-58, 2001.
27. G. Skobeltsyn, F. Junqueira, V. Plachouras, and R. Baeza-Yates. ResIn: A combination of results caching and index pruning for high-performance Web search engines. In 31st SIGIR Conference, pages 131-138, 2008.
28. A. J. Smith. Cache memories. ACM Comput. Surv., 14(3):473-530, 1982.
29. I. Tatarinov. An Efficient LFU-Like Policy for Web Caches. Technical Report NDSU-CSORTR-98-01, Computer Science Department, North Dakota State University, Wahpeton, ND, 1998.
30. A. Tomasic and H. Garcia-Molina. Caching and database scaling in distributed shared-nothing information retrieval systems. SIGMOD Rec., 22(2):129-138, 1993.
31. Y. Xie and D. R. O'Hallaron. Locality in search engine queries and its implications for caching. In INFOCOM, pages 1238-1247, 2002.