A study of the impact of index updates on distributed query processing for web search

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 5478 LNCS, Issue , 2009, Pages 595-602

  Sarigiannis, Charalampos ^a   Plachouras, Vassilis ^b   Baeza Yates, Ricardo ^b  

^a UNIVERSITAT POMPEU FABRA   (Spain)

^b YAHOO RESEARCH   (Spain)

Author keywords

[No Author keywords available]

Indexed keywords

DATA CENTERS; DISTRIBUTED QUERY PROCESSING; DOCUMENT COLLECTION; INDEX INFORMATION; INDEX UPDATE; MULTI-SITE; NETWORK FAILURE; REMOTE SITES; SINGLE SITES; WEB SEARCH ENGINES; WEB SEARCHES;

INFORMATION RETRIEVAL; INFORMATION SERVICES; QUERY PROCESSING; SATELLITE COMMUNICATION SYSTEMS; SEARCH ENGINES;

WORLD WIDE WEB;

EID: 67650706396     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-00958-7_55     Document Type: Conference Paper

References (14)

1. AllTheWeb search engine, http://www.alltheweb.com
2. Baeza-Yates, R., Castillo, C., Junqueira, F., Plachouras, V., Silvestri, F.: Challenges in distributed information retrieval. In: 23rd ICDE (2007)
3. Baeza-Yates, R., Gionis, A., Junqueira, F., Plachouras, V., Telloli, L.: On the feasiblity of multi-site Web search engines (2008) (submitted for reviewing)
4. Barroso, L.A., Dean, J., Hölzle, U.: Web search for a planet: The google cluster architecture. IEEE Micro. 23(2), 22-28 (2003)
5. Callan, J.: Distributed Information Retrieval. In: Croft, W.B. (ed.) Advances in Information Retrieval, pp. 127-150. Kluwer Academic Publishers, Dordrecht (2000)
6. Douglis, F., Feldmann, A., Krishnamurthy, B., Mogul, J.C.: Rate of change and other metrics: a live study of the world wide web. In: 1st USITS (1997)
7. D'Souza, D., Thom, J.A., Zobel, J.: Collection selection for managed distributed document databases. Inf. Process. Manage. 40(3), 527-546 (2004)
8. Fetterly, D., Manasse, M., Najork, M., Wiener, J.L.: A large-scale study of the evolution of web pages. Softw. Pract. Exper. 34(2), 213-237 (2004)
9. Ntoulas, A., Cho, J.: Pruning policies for two-tiered inverted index with correctness guarantee. In: 30th SIGIR Conference, pp. 191-198 (2007) (Pubitemid 350164961)
10. Ntoulas, A., Cho, J., Olston, C.: What's new on the web?: the evolution of the web from a search engine perspective. In: 13th WWW, pp. 1-12 (2004) (Pubitemid 40752735)
11. Puppin, D., Silvestri, F., Perego, R., Baeza-Yates, R.: Load-balancing and caching for collection selection architectures. In: 2nd INFOSCALE, pp. 1-10 (2007)
12. Risvik, K.M., Aasheim, Y., Lidal, M.: Multi-tier architecture for web search engines. In: 1st LAWEB, pp. 132-143 (2003)
13. Robertson, S.E.,Walker, S., Jones, S., Hancock-beaulieu, M.M., Gatford, M.: Okapi at trec-3. In: Text REtrieval Conference (TREC-3), pp. 109-126 (1995)
14. Yalag, P., Nath, S., Yu, H., Gibbons, P.B., Seshan, S.: Beyond availability: Towards a deeper understanding of machine failure characteristics in large distributed systems. In: USENIX WORLDS (2004)