Mining query logs to optimize index partitioning in parallel web search engines

ACM International Conference Proceeding Series

Volumn 06-08-June-2007, Issue , 2007, Pages

  Lucchese, Claudio ^a,b   Orlando, Salvatore ^a   Perego, Raffaele ^b   Silvestri, Fabrizio ^b  

^a CA' FOSCARI UNIVERSITY OF VENICE   (Italy)

^b ISTI CNR   (Italy)

Author keywords

[No Author keywords available]

Indexed keywords

INFORMATION SYSTEMS; INFORMATION USE; SEARCH ENGINES; WEBSITES;

DISJOINT SUBSETS; GLOBAL VOCABULARY; INDEX PARTITIONING; INVERTED INDICES; OPTIMIZATION PROBLEMS; PARALLEL SERVERS; PARTITIONING STRATEGIES; SKEWED DISTRIBUTION;

INFORMATION RETRIEVAL;

EID: 63149179704     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.4108/infoscale.2007.227     Document Type: Conference Paper

References (15)

1. L. A. Barroso, J. Dean, and U. Hölze. Web search for a planet: The google cluster architecture. IEEE Micro, 22(2), Mar/Apr. 2003.
2. B. Cahoon, K. S. McKinley, and Zhihong Lu. Evaluating the performance of distributed architectures for information retrieval using a variety of workloads. ACM Trans. on Inf. Syst., 18(1):1-43, 2000.
3. T. Fagni, F. Silvestri, S. Orlando, and R. Perego. Boosting the performance of web search engines: Caching and prefetching query results by exploiting historical usage data. ACM Trans. on Inf. Syst., 18:21-36, 2006.
4. D. Harman, W. McCoy, R. Toense, and G. Candela. Prototyping a distributed information retrieval system that uses statistical ranking. Inf. Process. Manag., 27(5), 1991.
5. B. S. Jeong and E. Omiecinski. Inverted file partitioning schemes in multiple disk systems. IEEE Trans. on Parallel and Distrib. Syst., 6(2):142-153, 1995.
6. O. De Kretser, A. Moffat, T. Shimmin, and J. Zobel. Methodologies for distributed information retrieval. In Proc. Intl. Conf. on Distrib. Comp. Syst., pages 66-73, Washington, DC, USA, 1998.
7. I. A. Macleod, T. P. Martin, B. Nordin, and J. R. Phillips. Strategies for building distributed information retrieval systems. Inf. Process. & Manag., 6(23):511-528, 1987.
8. A. Moffat, W. Webber, and J. Zobel. Load Balancing for Term-Distributed Parallel Retrieval. In Proc. of the ACM SIGIR Intl. Conf., Seattle, USA, 2006. ACM.
9. A. Moffat, W. Webber, J. Zobel, and R. Baeza-Yates. A pipelined architecture for distributed text query evaluation. Information Retrieval, In Press.
10. A. Moffat and J. Zobel. What does it mean to 'measure performance'? In Proc. of the Intl. Conf. on Web Inf. Syst., pages 1-12, Brisbane, Australia, November 2004.
11. B. Ribeiro-Neto, E. S. Moura, M. S. Neubert, and N. Ziviani. Efficient distributed algorithms to build inverted files. In Proc. of ACM SIGIR Intl. Conf., New York, USA, 1999.
12. C. Santos-Badue, R. A. Baeza-Yates, B. A. Ribeiro-Neto, and N. Ziviani. Distributed query processing using partitioned inverted files. In Proc. of Intl. Symp. on String Process. and Inf. Retr., pages 10-20, 2001.
13. A. Tomasic and H. Garcia-Molina. Performance of inverted indices in shared-nothing distributed text document informatioon retrieval systems. In Proc. of the Intl. Conf. on Parallel and Distrib. Inf. Syst., pages 8-17, San Diego, USA, 1993.
14. Y. Xie and D. O'Hallaron. Locality in search engine queries and its implications for caching. In Proc. of IEEE Infocom 2002, New York, USA, June 2002.
15. J. Zhang and T. Suel. Efficient query evaluation on large textual collections in a peer-to-peer environment. In Proc. of IEEE Intl. Conf. on P2P Computing, pages 225-233, 2005.