Adaptive parallelism for web search

Proceedings of the 8th ACM European Conference on Computer Systems, EuroSys 2013

Volumn , Issue , 2013, Pages 155-168

  Jeon, Myeongjae ^a   He, Yuxiong ^b   Elnikety, Sameh ^b   Cox, Alan L ^a   Rixner, Scott ^a  

^a RICE UNIVERSITY   (United States)

^b MICROSOFT RESEARCH   (United States)

Author keywords

parallelism; response time; web search

Indexed keywords

ADAPTIVE RESOURCE MANAGEMENT; DEGREE OF PARALLELISM; MULTI-CORE SERVERS; PARALLELISM; PARALLELIZATION EFFICIENCY; PRODUCTION WORKLOADS; SEQUENTIAL EXECUTION; WEB SEARCHES;

ALGORITHMS; INFORMATION RETRIEVAL; RESPONSE TIME (COMPUTER SYSTEMS); WEBSITES;

WINDOWS OPERATING SYSTEM;

EID: 84877706836     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2465351.2465367     Document Type: Conference Paper

References (37)

1. V. N. Anh, O. de Kretser, and A. Moffat. Vector-space ranking with effective early termination. In SIGIR, 2001.
2. M. Armbrust, A. Fox, R. Griffith, A. D. Joseph, R. Katz, A. Konwinski, G. Lee, D. Patterson, A. Rabkin, I. Stoica, and M. Zaharia. A view of cloud computing. Commun. ACM, 53 (4):50-58, Apr. 2010.
3. R. Baeza-Yates, A. Gionis, F. Junqueira, V. Murdock, V. Plachouras, and F. Silvestri. The impact of caching on search engines. In SIGIR, 2007.
4. N. Bansal, K. Dhamdhere, and A. Sinha. Non-clairvoyant scheduling for minimizing mean slowdown. Algorithmica, 40 (4):305-318, Sept. 2004. (Pubitemid 40871643)
5. L. A. Barroso and U. Hölzle. The case for energy-proportional computing. Computer, 40(12):33-37, Dec. 2007.
6. F. Blagojevic, D. S. Nikolopoulos, A. Stamatakis, C. D. Antonopoulos, and M. Curtis-Maury. Runtime scheduling of dynamic parallelism on accelerator-based multi-core systems. Parallel Comput., 33(10-11):700-719, Nov. 2007. (Pubitemid 350051063)
7. C. Buckley and A. F. Lewit. Optimization of inverted vector searches. In SIGIR, 1985.
8. B. B. Cambazoglu, F. P. Junqueira, V. Plachouras, S. Banachowski, B. Cui, S. Lim, and B. Bridge. A refreshing perspective of search engine caching. In WWW, 2010.
9. M. Curtis-Maury, J. Dzierwa, C. D. Antonopoulos, and D. S. Nikolopoulos. Online power-performance adaptation of multithreaded programs using hardware event-based prediction. In ICS, 2006.
10. S. Ding, J. He, H. Yan, and T. Suel. Using graphics processors for high performance ir query processing. In WWW, 2009.
11. D. Feitelson. A Survey of Scheduling in Multiprogrammed Parallel Systems. Research report. IBM T.J. Watson Research Center, 1994.
12. E. Frachtenberg. Reducing query latencies in web search using fine-grained parallelism. In WWW, 2009.
13. Q. Gan and T. Suel. Improved techniques for result caching in web search engines. In WWW, 2009.
14. A. Greenberg, J. Hamilton, D. A. Maltz, and P. Patel. The cost of a cloud: research problems in data center networks. SIGCOMM Comput. Commun. Rev., 39(1):68-73, Dec. 2008.
15. Y. He, W.-J. Hsu, and C. E. Leiserson. Provably efficient online nonclairvoyant adaptive scheduling. IEEE Trans. Parallel Distrib. Syst., 19(9):1263-1279, Sept. 2008.
16. T. Hoff. Latency Is Everywhere And It Costs You Sales - How To Crush It, 2009. http://highscalability.com/latency-everywhere- and-it-costs-you-sales-how- crush-it.
17. V. Janapa Reddi, B. C. Lee, T. Chilimbi, and K. Vaid. Web search using mobile cores: quantifying and mitigating the price of efficiency. In ISCA, 2010.
18. S. Jonassen, B. B. Cambazoglu, and F. Silvestri. Prefetching query results and its impact on search engines. In SIGIR, 2012.
19. C. Jung, D. Lim, J. Lee, and S. Han. Adaptive execution techniques for smt multiprocessor architectures. In PPoPP, 2005.
20. W. Ko, M. N. Yankelevsky, D. S. Nikolopoulos, and C. D. Polychronopoulos. Effective cross-platform, multilevel parallelism via dynamic adaptive execution. In IPDPS, 2002.
21. J. Lee, H. Wu, M. Ravichandran, and N. Clark. Thread tailor: dynamically weaving threads together for efficient, adaptive parallel applications. In ISCA, 2010.
22. C. McCann, R. Vaswani, and J. Zahorjan. A dynamic processor allocation policy for multiprogrammed shared-memory multiprocessors. ACM Trans. Comput. Syst., 11(2):146-178, May 1993. (Pubitemid 23668699)
23. D. Meisner, C. M. Sadler, L. A. Barroso, W.-D. Weber, and T. F. Wenisch. Power management of online data-intensive services. In ISCA, 2011.
24. M. Persin, J. Zobel, and R. Sacks-Davis. Filtered document retrieval with frequency-sorted indexes. J. Am. Soc. Inf. Sci., 47(10):749-764, Sept. 1996. (Pubitemid 126607666)
25. K. K. Pusukuri, R. Gupta, and L. N. Bhuyan. Thread reinforcer: Dynamically determining number of threads via os level monitoring. In IISWC, 2011.
26. A. Raman, H. Kim, T. Oh, J. W. Lee, and D. I. August. Parallelism orchestration using dope: the degree of parallelism executive. In PLDI, 2011.
27. B. Schlegel, T. Willhalm, and W. Lehner. Fast sorted-set intersection using simd instructions. In ADMS, 2011.
28. E. Schurman and J. Brutlag. The user and business impact of server delays, additional bytes, and http chunking in web search. 2009.
29. T. Strohman, H. Turtle, and W. B. Croft. Optimization strategies for complex queries. In SIGIR, 2005.
30. M. A. Suleman, M. K. Qureshi, and Y. N. Patt. Feedback-driven threading: power-efficient and high-performance execution of multi-threaded workloads on cmps. In ASPLOS, 2008.
31. S. Tatikonda, B. B. Cambazoglu, and F. P. Junqueira. Posting list intersection on multicore architectures. In SIGIR, 2011.
32. D. Tsirogiannis, S. Guha, and N. Koudas. Improving the performance of list intersection. Proc. VLDB Endow., 2(1):838-849, Aug. 2009.
33. G. Upadhyaya, V. S. Pai, and S. P. Midkiff. Expressing and exploiting concurrency in networked applications with aspen. In PPoPP, 2007.
34. B. Vamanan, J. Hasan, and T. Vijaykumar. Deadline-aware datacenter tcp (d2tcp). In SIGCOMM, 2012.
35. Z. Wang and M. F. O'Boyle. Mapping parallelism to multi-cores: a machine learning based approach. In PPoPP, 2009.
36. M. Welsh, D. Culler, and E. Brewer. Seda: an architecture for well-conditioned, scalable internet services. In SOSP, 2001.
37. C. Wilson, H. Ballani, T. Karagiannis, and A. Rowtron. Better never than late: meeting deadlines in datacenter networks. In SIGCOMM, 2011.