Join-Idle-Queue: A novel load balancing algorithm for dynamically scalable web services

Performance Evaluation

Volumn 68, Issue 11, 2011, Pages 1056-1071

  Lu, Yi ^a   Xie, Qiaomin ^a   Kliot, Gabriel ^b   Geller, Alan ^b   Larus, James R ^b   Greenberg, Albert ^c  

^a University of Illinois at Urbana Champaign   (United States)

^b MICROSOFT RESEARCH   (United States)

^c MICROSOFT   (United States)

Author keywords

Cloud computing; Load balancing; Queueing analysis; Randomized algorithm

Indexed keywords

COMMUNICATION OVERHEADS; DISTRIBUTED DESIGN; DISTRIBUTED LOAD BALANCING; FRONT END; HIGH LOAD; HORIZONTAL SCALING; JOIN-THE-SHORTEST-QUEUE; LARGE SYSTEM; LOAD BALANCER; LOAD BALANCING ALGORITHMS; LOAD-BALANCING; LOCAL INFORMATION; POWER-OF-TWO; QUEUEING ANALYSIS; RANDOMIZED ALGORITHMS; REDUCED SYSTEMS; SCALABLE WEB SERVICES; SERVER LOADS;

ALGORITHMS; CLOUD COMPUTING; COMMUNICATION; ELASTICITY; PARALLEL ARCHITECTURES; QUEUEING THEORY; SOCIAL NETWORKING (ONLINE); SOCIAL SCIENCES COMPUTING;

WEB SERVICES;

EID: 80053383179     PISSN: 01665316     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.peva.2011.07.015     Document Type: Conference Paper

References (16)

1. E. Schurman, J. Brutlag, The user and business impact of server delays, additional bytes and HTTP chunking in web search, in: O'Reilly Velocity Web Performance and Operations Conference, June 23rd 2009.
2. K. Salchow, Load balancing 101: nuts and bolts, White Paper, F5 Networks, Inc., 2007.
3. V. Gupta, M. Harchol-Balter, K. Sigman, and W. Whitt Analysis of join-the-shortest-queue routing for web server farms Perform. Eval. 64 2007 1062 1081 (Pubitemid 47302130)
4. N. Ahmad, A.G. Greenberg, P. Lahiri, D. Maltz, P.K. Patel, S. Sengupta, K.V. Vaid, Distributed load balancer, Google Patents, August 2008. US Patent App. 12/189, 438.
5. N.D. Vvedenskaya, R.L. Dobrushin, and F.I. Karpelevich Queueing system with selection of the shortest of two queues: an asymptotic approach Probl. Inf. Transm. 32 1 1996 20 34
6. M. Mitzenmacher, The power of two choices in randomized load balancing, Ph.D. Thesis, Berkeley, 1996.
7. M. Bramson, Y. Lu, B. Prabhakar, Randomized load balancing with general service time distributions, in: ACM Sigmetrics, 2010.
8. C. Graham Chaoticity on path space for a queueing network with selection of the shortest queue among several J. Appl. Probab. 37 2000 198 211
9. M. Luczak, and C. McDiarmid On the maximum queue length in the supermarket model Ann. Probab. 34 2 2006 493 527 (Pubitemid 43875115)
10. M.S. Squillante, R.D. Nelson, Analysis of task migration in shared-memory multiprocessor scheduling, in: Proc. ACM Conference on the Measurement and Modeling of Computer Systems, 1991, pp. 143155.
11. R.D. Blumofe, C.E. Leiserson, Scheduling multithreaded computations by work stealing, in: Proc. 35th IEEE Conference on Foundations of Computer Science, 1994, pp. 356368.
12. M. Mitzenmacher, Analyses of load stealing models based on differential equations, in: Proc. 10th ACM Symposium on Parallel Algorithms and Architetures, 1998, pp. 212221.
13. J. Dinan, D.B. Larkins, P. Sadayappan, S. Krishnamoorthy, J. Nieplocha, Scalable work stealing, in: Proc. ACM Conf. on High Performance Computing Networking, Storage and Analysis, 2009.
14. Y.-T. Wang, and R. Morris Load sharing in distributed systems IEEE Trans. Comput. C-34 3 1985
15. D.L. Eager, E.D. Lazowska, and J. Zahorjan Adaptive load sharing in homogeneous distributed systems IEEE Trans. Softw. Eng. SE-12 5 1986
16. M. Crovella, and A. Bestavros Self-similarity in world wide web traffic: evidence and possible causes IEEE/ACM Trans. Netw. 5 6 1997 835 846 (Pubitemid 127768491)