Analyzing imbalance among homogeneous index servers in a web search system

Information Processing and Management

Volumn 43, Issue 3, 2007, Pages 592-608

  Badue, C S ^a   Baeza Yates, R ^b   Ribeiro Neto, B ^a,c   Ziviani, A ^d   Ziviani, N ^a  

^a FEDERAL UNIVERSITY OF MINAS GERAIS   (Brazil)

^b Research   (Spain)

^c Google Inc   (Brazil)

^d LABORATÓRIO NACIONAL DE COMPUTAÇÃO CIENTÍFICA   (Brazil)

Author keywords

Imbalance; Parallel query processing; Performance analysis; Search engines

Indexed keywords

COMPUTER SIMULATION; MATHEMATICAL MODELS; ONLINE SEARCHING; QUERY LANGUAGES; SEARCH ENGINES; SERVERS; WORLD WIDE WEB;

PARALLEL QUERY PROCESSING; PARTIAL RANKED ANSWER; PERFORMANCE ANALYSIS; QUERY EXECUTION;

PARALLEL PROCESSING SYSTEMS;

EID: 33846530701     PISSN: 03064573     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ipm.2006.09.002     Document Type: Article

References (17)

1. Badue C.S., Baeza-Yates R., Ribeiro-Neto B., and Ziviani N. Distributed query processing using partitioned inverted files. Proceedings of the 8th international symposium on string processing and information retrieval (SPIRE'Ol) (2001), IEEE Computer Society, Laguna de San Rafael, Chile 10-20
2. Badue, C. S., Barbosa, R., Golgher, P., Ribeiro-Neto, B., & Ziviani, N. (2005). Basic issues on the processing of web queries. In Proceedings of the 28th annual international ACM SIGIR conference on research and development in information retrieval (SIGIR'05), Salvador, BA, Brazil (pp. 577-578).
3. In: Baeza-Yates R., and Ribeiro-Neto B. (Eds). Modern information retrieval (1999), ACM Press, Addison Wesley, New York
4. Barroso L.A., Dean J., and Holzle U. Web search for a planet: the Google cluster architecture. IEEE Micro 23 2 (2003) 22-28
5. Brin S., and Page L. The anatomy of a large-scale hypertextual web search engine. Computer Networks and ISDN Systems 30 1-7 (1998) 107-117
6. Cacheda F., Plachouras V., and Ounis I. A case study of distributed information retrieval architectures to index one terabyte of text. Information Processing and Management 41 5 (2004) 1141-1161
7. Chowdhury, A., & Pass, G. (2003). Operational requirements for scalable search systems. In Proceedings of the 12th international conference on information and knowledge management (CIKM'03), New Orleans, LA, USA (pp. 435-442).
8. Jupiter Media (2005). Jupiter Research forecasts online advertising market to reach 18.9 billion by 2010; search advertising revenue to surpass display. Available from www.jupitermedia.com/corporate/releases/05.08.15-newjupresearch2.html, Press Release.
9. Kleinberg, J. (1998). Authoritative sources in a hyperlinked environment. In Proceedings of the 9th annual ACM-SIAM symposium on discrete algorithms, San Francisco, CA, USA (pp. 668-677).
10. MacFarlane A., McCann J.A., and Robertson S.E. Parallel search using partitioned inverted files. Proceedings of the 7th international symposium on string processing and information retrieval (SPIRE'00) (2000), IEEE Computer Society, La Coruña, Spain 209-220
11. Orlando S., Perego R., and Silvestri F. Design of a parallel and distributed web search engine. Proceedings of the 2001 parallel computing conference (ParCo'0l) (2001), Imperial College Press, Naples, Italy 197-204
12. Ribeiro-Neto, B. A., & Barbosa, R. A. (1998). Query performance for tightly coupled distributed digital libraries. In Proceedings of the 3rd ACM conference on digital libraries Pittsburgh, PH, USA (pp. 182-190).
13. Risvik, K. M., Aasheim, Y., & Lidal, M. (2003). Multi-tier architecture for web search engines. In Proceedings of the 1st Latin American web congress (LAWEB'03), Santiago, Chile (pp. 132-143).
14. Salton G., and McGill M.J. Introduction to modern information retrieval (1983), McGraw-Hill
15. TodoBR (2003). Available from http://www.todobr.com.br.
16. Tomasic, A., & Garcia-Molina, H. (1993). Performance of inverted indices in shared-nothing distributed text document information retrieval systems. In Proceedings of the 2nd international conference on parallel and distributed information systems (PDIS'93), San Diego, CA, USA (pp. 8-17).
17. Witten I.H., Moffat A., and Bell T.C. Managing gigabytes: compressing and indexing documents and images. 2nd ed. (1999), Morgan Kaufmann Publishers Inc