A five-level static cache architecture for web search engines

Information Processing and Management

Volumn 48, Issue 5, 2012, Pages 828-840

  Ozcan, Rifat ^a   Sengor Altingovde, I ^a   Barla Cambazoglu, B ^b   Junqueira, Flavio P ^b   Ulusoy, Özgür ^a  

^a BILKENT UNIVERSITY   (Turkey)

^b YAHOO RESEARCH   (Spain)

Author keywords

Query processing; Static caching; Web search engines

Indexed keywords

ACCESS FREQUENCY; CACHE ARCHITECTURE; CACHING DECISIONS; COMPUTATIONAL COSTS; GREEDY HEURISTICS; INTER-DEPENDENCIES; QUERY RESPONSE; QUERY RESULTS; STATIC CACHING; STORAGE OVERHEAD;

INFORMATION RETRIEVAL; QUERY PROCESSING; WEBSITES;

SEARCH ENGINES;

EID: 84864289878     PISSN: 03064573     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ipm.2010.12.007     Document Type: Article

References (31)

1. R. Alonso, D. Barbara, and H. Garcia-Molina Data caching issues in an information retrieval system ACM Transactions on Database Systems 15 3 1990 359 384
2. Altingovde, I. S.; Ozcan, R.; & Ulusoy, Ö. (2009). A cost-aware strategy for query result caching in web search engines. In Proceedings of the 31st European conference on information retrieval (pp. 628-636).
3. Baeza-Yates, R.; & Saint-Jean, F. (2003). A three level search engine index based in query log distribution. In Proceedings of the 10th international symposium on string processing and information retrieval (pp. 56-65).
4. Baeza-Yates, R.; Gionis, A.; Junqueira, F.; Murdock, V.; Plachouras, V.; & Silvestri, F. (2007). The impact of caching on search engines. In Proceedings of the 30th annual international ACM SIGIR conference on research and development in information retrieval (pp. 183-190).
5. Cambazoglu, B. B.; Junqueira, F. P.; Plachouras, V.; Banachowski, S.; Cui, B.; Lim, S.; et al. (2010). A refreshing perspective of search engine caching. In Proceedings of the 19th international conference on world wide web (pp. 181-190).
6. Chowdhury, A.; & Pass, G. (2003). Operational requirements for scalable search systems. In Proceedings of the 12th international conference on information and knowledge management (pp. 435-442).
7. Dean, J. (2009). Challenges in building large-scale information retrieval systems (invited talk). In Proceedings of the 2nd ACM international conference on web search and data mining (p. 1).
8. W. Effelsberg, and T. Haerder Principles of database buffer management ACM Transactions on Database Systems 9 4 1984 560 595
9. T. Fagni, R. Perego, F. Silvestri, and S. Orlando Boosting the performance of web search engines: Caching and prefetching query results by exploiting historical usage data ACM Transactions on Information Systems 24 1 2006 51 78
10. Gan, Q.; & Suel, T. (2009). Improved techniques for result caching in web search engines. In Proceedings of the 18th international conference on world wide web (pp. 431-440).
11. Garcia, S. (2007). Search engine optimisation using past queries. PhD Thesis. RMIT University.
12. Jonsson, B. T.; Franklin, M. J.; & Srivastava, D. (1998). Interaction of query evaluation and buffer management for information retrieval. In Proceedings of the 1998 ACM SIGMOD international conference on management of data (pp. 118-129).
13. Lempel, R.; & Moran, S. (2003). Predictive caching and prefetching of query results in search engines. In Proceedings of the 12th international conference on world wide web (pp. 19-28).
14. Long, X.; & Suel, T. (2005). Three-level caching for efficient query processing in large web search engines. In Proceedings of the 14th international conference on world wide web (pp. 257-266).
15. Marin, M.; Gil-Costa, V.; & Gomez-Pantoja, C. (2010). New caching techniques for web search engines. In Proceedings of the 19th ACM international symposium on high performance distributed computing (pp. 215-226).
16. E.P. Markatos On caching search engine query results Computing Communications 24 2 2001 137 143
17. Ounis, I.; Amati, G.; Plachouras, V.; He, B.; Macdonald, C.; & Johnson, D. (2005). Terrier information retrieval platform. In Proceedings of the 27th European conference on information retrieval (pp. 517-519).
18. Ozcan, R.; Altingovde, I. S.; & Ulusoy, Ö. (2008). Static query result caching revisited. In Proceeding of the 17th international conference on world wide web (pp. 1169-1170).
19. Ozcan, R.; Altingovde, I.S.; & Ulusoy, Ö. (in press). Cost-aware strategies for query result caching in web search engines. ACM Transactions on the Web.
20. Pass, G.; Chowdhury, A.; & Torgeson, C. (2006). A picture of search. In Proceedings of the 1st international conference on scalable information systems.
21. S. Podlipnig, and L. Böszörmenyi A survey of web cache replacement strategies ACM Computing Surveys 35 4 2003 374 398
22. D. Puppin, R. Perego, F. Silvestri, and R. Baeza-Yates Tuning the capacity of search engines: Load-driven routing and incremental caching to reduce and balance the load ACM Transactions on Information Systems 28 2 2010 1 36
23. R. Ramakrishnan, and J. Gehrke Database management systems 3rd ed. 2003 McGraw-Hill
24. Saraiva, P. C.; de Moura, E. S.; Ziviani, N.; Meira, W.; Fonseca, R.; & Ribeiro-Neto, B. (2001). Rank-preserving two-level caching for scalable search engines. In Proceedings of the 24th annual international ACM SIGIR conference on research and development in information retrieval (pp. 51-58).
25. Simpson, P.; & Alonso, R. (1987). Data caching in information retrieval systems. In Proceedings of the 10th annual international ACM SIGIR conference on research and development in information retrieval (pp. 296-305).
26. Skobeltsyn, G.; Junqueira, F.; Plachouras, V.; & Baeza-Yates, R. (2008). ResIn: A combination of results caching and index pruning for high-performance web search engines. In Proceedings of the 31st international ACM SIGIR conference on research and development in information retrieval (pp. 131-138).
27. A.J. Smith Cache memories ACM Computing Surveys 14 3 1982 473 530
28. A. Tomasic, and H. Garcia-Molina Caching and database scaling in distributed shared-nothing information retrieval systems ACM SIGMOD Record 22 2 1993 129 138
29. J. Wang A survey of web caching schemes for the Internet ACM SIGCOMM Computer Communication Review 29 5 1999 36 46
30. Xie, Y.; & O'Hallaron, D. (2002). Locality in search engine queries and its implications for caching. In Proceedings of the 6th European conference on research and advanced technology for digital libraries (pp. 1238-1247).
31. Zhang, J.; Long, X.; & Suel, T. (2008). Performance of compressed inverted list caching in search engines. In Proceedings of the 17th international world wide web conference (pp. 387-396).