Pruning policies for two-tiered inverted index with correctness guarantee

Proceedings of the 30th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR'07

Volumn , Issue , 2007, Pages 191-198

  Ntoulas, Alexandros ^a   Cho, Junghoo ^b  

^a MICROSOFT RESEARCH   (United States)

^b Department of Civil and Environmental Engineering   (United States)

Author keywords

Correctness guarantee; Inverted index; Pruning; Web search engines

Indexed keywords

ONLINE SEARCHING; OPTIMIZATION; QUERY PROCESSING; SEARCH ENGINES; USER INTERFACES; WEB SERVICES;

CORRECTNESS GUARANTEE; INVERTED INDEX; PRUNING;

INDEXING (OF INFORMATION);

EID: 36448957933     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1277741.1277776     Document Type: Article

References (33)

1. V. N. Anh, O. de Kretser, and A. Moffat. Vector-space ranking with effective early termination. In SIGIR, 2001.
2. V. N. Anh and A. Moffat. Pruning strategies for mixed-mode querying. In CIKM, 2006.
3. R. A. Baeza-Yates and B. A. Ribeiro-Neto. Modem Information Retrieval. ACM Press / Addison-Wesley, 1999.
4. N. Bruno, L. Gravano, and A. Marian. Evaluating top-k queries over web-accessible databases. In ICDE, 2002.
5. S. Büttcher and C. L. A. Clarke. A document-centric approach to static index pruning in text retrieval systems. In CIKM, 2006.
6. B. Cahoon, K. S. McKinley, and Z. Lu. Evaluating the performance of distributed architectures for information retrieval using a variety of workloads. ACM TOIS, 18(1), 2000.
7. D. Carmel, D. Cohen, R. Fagin, E. Farchi, M. Herscovici, Y. Maarek, and A. Soffer. Static index pruning for information retrieval systems. In SIGIR, 2001.
8. S. Chaudhuri and L. Gravano. Optimizing queries over multimedia repositories. In SIGMOD, 1996.
9. T. H. Cormen, C. E. Leiserson, and R. L. Rivest. Introduction to Algorithms, 2nd Edition. MIT Press/McGraw Hill, 2001.
10. Open directory, http://www.dmoz.org.
11. R. Fagin. Combining fuzzy information: an overview. In SIGMOD Record, 31(2), 2002.
12. R. Fagin, A. Lotem., and M. Naor. Optimal aggregation algorithms for middleware. In PODS, 2001.
13. A. Gulli and A. Signorini. The indexable web is more than 11.5 billion pages. In WWW, 2005.
14. U. Guntzer, G. Balke, and W. Kiessling. Towards efficient multi-feature queries in heterogeneous environments. In ITCC, 2001.
15. Z. Gyöngyi, H. Garcia-Molina, and J. Pedersen. Combating web spam with trustrank. In VLDB, 2004.
16. B. J. Jansen and A. Spink. An analysis of web documents retrieved and viewed. In International Conf. on Internet Computing, 2003.
17. J. Kleinberg. Authoritative sources in a hyperlinked environment. Journal of the ACM, 46(5):604-632, September 1999.
18. R. Lempel and S. Moran. Predictive caching and prefetching of query results in search engines. In WWW, 2003.
19. R. Lempel and S. Moran. Optimizing result prefetching in web search engines with segmented indices. ACM Trans. Inter: Tech., 4(1), 2004.
20. X. Long and T. Suel. Optimized query execution in large search. engines with global page ordering. In VLDB, 2003.
21. X. Long and T. Suel. Three-level caching for efficient query processing in large web search engines. In WWW, 2005.
22. Looksmart inc. http : / /www. looksmart. com.
23. S. Melnik, S. Raghavan, B. Yang, and H. Garcia-Molina. Building a distributed full-text index for the web. ACM WIS, 19(3):217-241, 2001.
24. A. Ntoulas, J. Cho, C. Olston. What's new on the web? The evolution of the web from a search engine perspective. In WWW, 2004.
25. A. Ntoulas, M. Najork, M. Manasse, and D. Fetterly. Detecting spam web pages through content analysis. In WWW, 2006.
26. L. Page, S. Brin, R. Motwani, and T. Winograd. The pagerank citation ranking: Bringing order to the web. Technical report, Stanford University.
27. M. Persin, J. Zobel, and R. Sacks-Davis. Filtered document retrieval with frequency-sorted indexes. Journal of the American Society of Information Science, 47(10), 1996.
28. M. Richardson and P. Domingos. The intelligent surfer: Probabilistic combination of link and content information in pagerank. In Advances in Neural Information Processing Systems, 2002.
29. S. Robertson and K. Spärck-Jones. Relevance weighting of search, terms. Journal of the American Society for Information Science, 27:129-46, 1976.
30. G. Salton and M. J. McGill. Introduction to modern information retrieval. McGraw-Hill, first edition, 1983.
31. P. C. Saraiva, E. S. de Moura, N. Ziviani, W. Meira, R. Fonseca, and B. Riberio-Neto. Rank-preserving two-level caching for scalable search engines. In SIGIR, 2001.
32. M. Theobald, G. Weikum, and R. Schenkel. Top-k query evaluation with probabilistic guarantees. In VLDB, 2004.
33. A. Tbmasic and H. Garcia-Molina. Performance of inverted indices in shared-nothing distributed text document information retrieval systems. In Parallel and Distributed Information Systems, 1993.