Load Balancing at the Edge of Chaos: How Self-Organized Criticality Can Lead to Energy-Efficient Computing

IEEE Transactions on Parallel and Distributed Systems

Volumn 28, Issue 2, 2017, Pages 517-529

  Laredo, Juan Luis Jimenez ^a   Guinand, Frederic ^a,b   Olivier, Damien ^a   Bouvry, Pascal ^c  

^a UNIVERSITÉ DU HAVRE   (France)

^b CARDINAL STEFAN WYSZY SKI UNIVERSITY   (Poland)

^c UNIVERSITY OF LUXEMBOURG   (Luxembourg)

Author keywords

distributed computing; Energy efficiency; nonlinear dynamical systems; scheduling algorithms

Indexed keywords

CRITICALITY (NUCLEAR FISSION); DISTRIBUTED COMPUTER SYSTEMS; DYNAMIC LOADS; DYNAMICAL SYSTEMS; ENERGY UTILIZATION; NONLINEAR DYNAMICAL SYSTEMS; PILES; QUALITY OF SERVICE; SCHEDULING ALGORITHMS;

COMPUTATIONAL WORKLOAD; COMPUTING PERFORMANCE; ENERGY EFFICIENT COMPUTING; PROCESSING ELEMENTS; SELF-ORGANIZED CRITICAL; SELF-ORGANIZED CRITICALITY; TUNING OF PARAMETERS; UTILIZATION OF RESOURCES;

ENERGY EFFICIENCY;

EID: 85014924080     PISSN: 10459219     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPDS.2016.2582160     Document Type: Article

References (34)

1. J. Koomey, Growth in Data Center Electricity Use 2005 to 2010. Oakland, CA: Analytics Press, 2011, 2015. [Online]. Available: http://www.analyticspress.com/datacenters.html. Accessed on: Jun. 2015.
2. CIA, The world factbook, 2015. [Online]. Available: https://www.cia.gov/library/publications/resources/the-world-factbook/. Accessed on: Jun. 2015.
3. L. Barroso and U. Holzle, "The case for energy-proportional computing," Computer, vol. 40, no. 12, pp. 33-37, Dec. 2007.
4. K. Choi, R. Soma, and M. Pedram, "Fine-grained dynamic voltage and frequency scaling for precise energy and performance tradeoff based on the ratio of off-chip access to on-chip computation times," IEEE Trans. Comput.-Aided Des. Integr. Circuits Syst., vol. 24, no. 1, pp. 18-28, 2005.
5. D. J. Brown and C. Reams, "Toward energy-efficient computing," Commun. ACM, vol. 53, no. 3, pp. 50-58, Mar. 2010. [Online]. Available: http://doi.acm.org/10.1145/1666420.1666438
6. M. Guzek, J. E. Pecero, B. Dorronsoro, and P. Bouvry, "Multiobjective evolutionary algorithms for energy-aware scheduling on distributed computing systems," Appl. Soft Comput., vol. 24, no. 0, pp. 432-446, 2014. [Online]. Available: http://www.sciencedirect.com/science/article/pii/S1568494614003408
7. V. Sarkar, S. Amarasinghe, D. Campbell, W. Carlson, A. Chien, W. Dally, E. Elnohazy, R. Harrison, W. Harrod, J. Hiller, S. Karp, C. Koelbel, D. Koester, P. Kogge, J. Levesque, D. Reed, R. Schreiber, M. Richards, A. Scarpelli, J. Shalf, A. Snavely, and T. Sterling, "Exascale software study: Software challenges in extreme scale systems," ExaScale Computing Study DARPA IPTO, 2009, http://users.ece.gatech.edu/mrichard/Exascale-ComputingStudyReports/ECSS%20report%20101909.pdf
8. K. Wang, A. Rajendran, K. Brandstatter, Z. Zhang, and I. Raicu, "Paving the road to exascale with many-task computing," Doctoral Showcase, IEEE/ACM Supercomput/SC, 2012.
9. W. B. Powell, Approximate Dynamic Programming: Solving the curses of dimensionality, vol. 703. New York, NY, USA: Wiley, 2007.
10. J. Kołodziej, S. U. Khan, L. Wang, and A. Y. Zomaya, "Energy efficient genetic-based schedulers in computational grids," Concurrency Comput.: Practice Exp., vol. 27, pp. 809-829, 2012.
11. H. Sheikh, I. Ahmad, and D. Fan, "An evolutionary technique for performance-energy-temperature optimized scheduling of parallel tasks on multi-core processors," IEEE Trans. Parallel Distrib. Syst., vol. 27, no. 3, pp. 668-681, Mar. 2015.
12. K. D. Devine, et al., "New challenges in dynamic load balancing," Appl. Numer. Math., vol. 52, no. 2-3, pp. 133-152, Feb. 2005. [Online]. Available: http://dx.doi.org/10.1016/j.apnum.2004.08.028
13. E. Pinheiro, R. Bianchini, E. V. Carrera, and T. Heath, "Load balancing and unbalancing for power and performance in clusterbased systems," in Proc. Workshop Compilers Oper. Syst. Low Power, vol. 180, 2001, pp. 182-195.
14. P. Bak, How Nature Works: The Science of Self-Organized Criticality. Berlin, Germany: Springer Science & Business Media, 2013.
15. P. Bak, C. Tang, and K. Wiesenfeld, "Self-organized criticality: An explanation of the 1/f noise," Phys. Rev. Lett., vol. 59, pp. 381-384, Jul.1987. [Online]. Available: http://link.aps.org/doi/10.1103/PhysRevLett.59.381
16. Z. Olami, H. J. S. Feder, and K. Christensen, "Self-organized criticality in a continuous, nonconservative cellular automaton modeling earthquakes," Phys. Rev. Lett., vol. 68, pp. 1244-1247, Feb. 1992. [Online]. Available: http://link.aps.org/doi/10.1103/PhysRevLett.68.1244
17. R. V. Solé and S. C. Manrubia, "Extinction and self-organized criticality in a model of large-scale evolution," Phys. Rev. E, vol. 54, pp. R42-R45, Jul.1996. [Online]. Available: http://link.aps.org/doi/10.1103/PhysRevE.54.R42
18. J. M. Beggs and D. Plenz, "Neuronal avalanches in neocortical circuits," J. Neurosci., vol. 23, no. 35, pp. 11167-11177, 2003.
19. S. Wolfram, "Universality and complexity in cellular automata," Physica D: Nonlinear Phenomena, vol. 10, no. 1, pp. 1-35, 1984.
20. C. G. Langton, "Computation at the edge of chaos: phase transitions and emergent computation," Physica D: Nonlinear Phenomena, vol. 42, no. 1, pp. 12-37, 1990.
21. M. Willebeek-LeMair and A. Reeves, "Strategies for dynamic load balancing on highly parallel computers," IEEE Trans. Parallel Distrib. Syst., vol. 4, no. 9, pp. 979-993, Sep. 1993.
22. M. Jelasity, A. Montresor, and O. Babaoglu, "A modular paradigm for building self-organizing peer-to-peer applications," in Engineering Self-Organising Systems, G. Di Marzo Serugendo, Ed. Berlin, Germany: Springer, 2003, pp. 265-282.
23. M. Salman, C. Bertelle, and E. Sanlaville, "The behavior of load balancing strategies with regard to the network structure in distributed computing systems," in Proc. 10th Int. Conf. Signal-Image Technol. Internet-Based Syst., 2014, Nov. 2014, pp. 432-439.
24. J. Hu and R. Klefstad, "Decentralized load balancing on unstructured peer-2-peer computing grids," in Proc. 5th IEEE Int. Symp. Netw. Comput. Appl., Jul. 2006, pp. 247-250.
25. S. Khan and I. Ahmad, "A cooperative game theoretical technique for joint optimization of energy consumption and response time in computational grids," IEEE Trans. Parallel Distrib. Syst., vol. 20, no. 3, pp. 346-360, Mar. 2009.
26. J. Laredo, P. Bouvry, F. Guinand, B. Dorronsoro, and C. Fernandes, "The sandpile scheduler," Cluster Comput., vol. 17, no. 2, pp. 191-204, Jun. 2014. [Online]. Available: http://dx.doi.org/10.1007/s10586-013-0328-x
27. J. Laredo, B. Dorronsoro, J. Pecero, P. Bouvry, J. Durillo, and C. Fernandes, "Designing a self-organized approach for scheduling bag-of-tasks," in Proc. 7th Int. Conf. P2P, Parallel Grid Cloud Internet Comput., Nov. 2012, pp. 315-320.
28. C.-C. Chen, L.-Y. Chiao, Y.-T. Lee, H. wen Cheng, and Y.-M. Wu, "Long-range connective sandpile models and its implication to seismicity evolution," Tectonophysics, vol. 454, no. 4, pp. 104-107, 2008.
29. M. R. Garey and D. S. Johnson, Computers and Intractability; A Guide to the Theory of NP-Completeness. New York, NY, USA: W. H. Freeman & Co., 1990.
30. J. D. C. Little, "A proof for the queuing formula: l l =λw," Operations Res., vol. 9, no. 3, pp. 383-387, 1961.
31. M. Guzek, S. Varrette, V. Plugaru, J. Pecero, and P. Bouvry, "A holistic model of the performance and the energy-efficiency of hypervisors in an hpc environment," in Energy Efficiency in Large Scale Distributed Systems, J.-M. Pierson, G. Da Costa, and L. Dittmann, Eds. Berlin, Germany: Springer, 2013, pp. 133-152. [Online]. Available: http://dx.doi.org/10.1007/978-3-642-40517-4-13
32. M. Harchol-Balter, M. E. Crovella, and C. D. Murta, "On choosing a task assignment policy for a distributed server system," J. Parallel Distrib. Comput., vol. 59, no. 2, pp. 204-228, 1999. [Online]. Available: http://www.sciencedirect.com/science/article/pii/S0743731599915770
33. P. Bak and K. Sneppen, "Punctuated equilibrium and criticality in a simple model of evolution," Phys. Rev. Lett., vol. 71, pp. 4083-4086, Dec. 1993. [Online]. Available: http://link.aps.org/doi/10.1103/PhysRevLett.71.4083
34. N. S. Arora, R. D. Blumofe, and C. G. Plaxton, "Thread scheduling for multiprogrammed multiprocessors," in Proc. 10th Annu. ACM Symp. Parallel Algorithms Archit., New York, NY, USA: ACM, 1998, pp. 119-129. [Online]. Available: http://doi.acm.org/10.1145/277651.277678