Load-balancing and caching for collection selection architectures

ACM International Conference Proceeding Series

Volumn 06-08-June-2007, Issue , 2007, Pages

  Puppin, Diego ^a   Silvestri, Fabrizio ^a   Perego, R ^a   Baeza Yates, Ricardo ^b  

^a ISTI CNR   (Italy)

^b YAHOO RESEARCH   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ECONOMIC AND SOCIAL EFFECTS; INFORMATION SYSTEMS; INFORMATION USE; SEARCH ENGINES;

CACHING STRATEGY; COMPUTING LOAD; COMPUTING WORKLOADS; DISTRIBUTED ORGANIZATIONS; DISTRIBUTED TASKS; QUALITY OF RESULTS; QUERY ANSWERING; SELECTION ARCHITECTURE;

BALANCING;

EID: 84940835729     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.4108/infoscale.2007.892     Document Type: Conference Paper

References (30)

1. Claudine Santos Badue, Ramurti Barbosa, Paulo Golgher, Berthier Ribeiro-Neto, and Nivio Ziviani. Distributed processing of conjunctive queries. In HDIR'05: Proceedings of the First International Workshop on Heterogeneous and Distributed Information Retrieval (HDIR'05), sigir 2005, Salvador, Bahia, Brazil, 2005.
2. Ricardo Baeza-Yates, Carlos Castillo, Flavio Junqueira, Vassilis Plachouras, and Fabrizio Silvestri. Challenges in distributed information retrieval (invited paper). In ICDE, 2007.
3. L. A. Barroso, J. Dean, and U. Hölze. Web search for a planet: The google cluster architecture. IEEE Micro, 22(2), Mar/Apr. 2003.
4. Steven M. Beitzel, Eric C. Jensen, Abdur Chowdhury, David Grossman, and Ophir Frieder. Hourly analysis of a very large topically categorized web query log. In SIGIR, 2004.
5. Richard Bellman. Adaptive Control Processes. Princeton University Press, Princeton, nj., 1961.
6. S. Brin and L. Page. The Anatomy of a Large-Scale Hypertextual Web Search Engine. In Proceedings of the WWW7 conference/Computer Networks, volume 1-7, pages 107-117, April 1998.
7. Fidel Cacheda, Vassilis Plachouras, and Iadh Ounis. a case study of distributed information retrieval architectures to index one terabyte of text. Inf. Process. Manage., 41(5):1141-1161, 2005.
8. J. P. Callan, Z. Lu, and W. B. Croft. Searching Distributed Collections with Inference Networks. In e. a. Fox, p. Ingwersen, and r. Fidel, editors, Proceedings of the Eighteenth Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 21-28, Seattle, wa, July 1995. acm Press.
9. N. Craswell, P. Bailey, and D. Hawking. Server Selection on the World Wide Web. In Proceedings of the Fifth ACM Conference on Digital Libraries, pages 37-46, 2000.
10. I. S. Dhillon, S. Mallela, and D. S. Modha. Information-theoretic coclustering. In Proceedings of The Ninth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD-2003), pages 89-98, 2003.
11. Tiziano Fagni, Raffaele Perego, Fabrizio Silvestri, and Salvatore Orlando. Boosting the performance of web search engines: Caching and prefetching query results by exploiting historical usage data. ACM Trans. Inf. Syst., 24(1):51-78, 2006.
12. David Hawking and Paul Thistlewaite. Methods for Information Server Selection. ACM Transactions on Information Systems, 17(1):40-76, 1999.
13. Bernard Jansen and Amanda Spink. How are we searching the World Wide Web? A comparison of nine search engine transaction logs. Inf. Proc. & Management, 42:248-263, 2006.
14. Bernard J. Jansen, Amanda Spink, Judy Bateman, and Tefko Saracevic. Real life information retrieval: a study of user queries on the web. SIGIR Forum, 32(1):5-17, 1998.
15. Ronny Lempel and Shlomo Moran. Predictive caching and prefetching of query results in search engines. In WWW, 2003.
16. A. MacFarlane, J. A. McCann, and S. E. Robertson. Parallel search using partitioned inverted files. In SPIRE'00: Proceedings of the Seventh International Symposium on String Processing Information Retrieval (SPIRE'00), page 209, Washington, DC, USA, 2000. IEEE Computer Society.
17. Evangelos P. Markatos. On Caching Search Engine Query Results. Computer Communications, 24(2):137-143, 2001.
18. Alistair Moffat and Justin Zobel. Information Retrieval Systems for Large Document Collections. In Proceddings of the Text REtrieval Conference, pages 85-94, 1994.
19. J. Nielsen. Information foraging: Why google makes people leave your site faster. Available at: http://www.useit.com/alertbox/20030630.html, 2003.
20. Stefan Podlipnig and Laszlo Boszormenyi. A survey of web cache replacement strategies. ACM Comput. Surv., 35(4):374-398, 2003.
21. D. Puppin, F. Silvestri, and D. Laforenza. Query-driven document partitioning and collection selection. In Infoscale 2006, 2006.
22. Vijay V. Raghavan and Hayri Sever. On the reuse of past optimal queries. In Proceedings of the 18th annual international ACM SIGIR conference on Research and development in information retrieval, pages 344-350, 1995.
23. S. E. Robertson and S. Walker. Some simple effective approximations to the 2-poisson model for probabilistic weighted retrieval. In SIGIR'94: Proceedings of the 17th annual international ACM SIGIR conference on Research and development in information retrieval, pages 232-241, New York, NY, USA, 1994. Springer-Verlag New York, Inc.
24. Patricia Correia Saraiva, Edleno Silva de Moura, Nivio Ziviani, Wagner Meira, Rodrigo Fonseca, and Berthier Ribeiro-Neto. Rank-Preserving Two-Level Caching for Scalable Search Engines. In Proceedings of the SIGIR2001 conference, New Orleans, LA, September 2001. SIGIR, ACM.
25. L. Si and J. Callan. Relevant document distribution estimation method for resource selection, 2003.
26. C. Silverstein, M. Henzinger, H. Marais, and M. Moricz. Analysis of a very large web search engine query log. In ACM SIGIR Forum, pages 6-12, 1999.
27. Yinglian Xie and David R. O'Hallaron. Locality in search engine queries and its implications for caching. In INFOCOM, 2002.
28. Xu, Jinxi, and W. B. Croft. Effective Retrieval with Disributed Collections. In Proceedings of SIGIR98 conference, Melbourne, Australia, August 1998.
29. Jinxi Xu and W. Bruce Croft. Cluster-Based Language Models for Distributed Retrieval. In Research and Development in Information Retrieval, pages 254-261, 1999.
30. G. Zervas and S. M. Rger. The curse of dimensionality and document clustering. In the IEEE Searching for Information: AI and IR Approaches, 1999.