Sustainable GPU computing at scale

Proc. - 14th IEEE Int. Conf. on Computational Science and Engineering, CSE 2011 and 11th Int. Symp. on Pervasive Systems, Algorithms, and Networks, I-SPA 2011 and 10th IEEE Int. Conf. on IUCC 2011

Volumn , Issue , 2011, Pages 263-272

  Shi, Justin Y ^a   Taifi, Moussa ^a   Khreishah, Abdallah ^a   Wu, Jie ^a  

^a Temple University   (United States)

Author keywords

Data parallel processing; Fault tolerant GPU computing; Semantic statistical multiplexing; Tuple switching network

Indexed keywords

AUTOMATIC SYSTEMS; BREAK-EVEN POINT; COMMUNICATION COMPONENTS; COMPONENT COUNT; COMPUTATIONAL EXPERIMENT; DATA PARALLEL; FAULT-TOLERANT; GENERAL PURPOSE; GPU COMPUTING; HIGH-PERFORMANCE COMPUTING; MEAN TIME BETWEEN FAILURES; NUMBER OF COMPONENTS; SUSTAINABILITY ANALYSIS; THEORETICAL MODELS;

ALGORITHMS; COMPUTER SOFTWARE SELECTION AND EVALUATION; DATA HANDLING; ENERGY UTILIZATION; MULTIPLEXING; PROGRAM PROCESSORS; SEMANTICS; SUPERCOMPUTERS;

UBIQUITOUS COMPUTING;

EID: 81455155109     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CSE.2011.55     Document Type: Conference Paper

References (34)

1. Wikipedia, "Fastest chinese supercomputer." 2009, [Online], http://en.wikipedia.org/wiki/Tianhe-I.
2. HPCwire, "ORNL looks to NVIDIA Fermi architecture for new supercomputer." 2009, [Online], http://www.hpcwire.com/offthewire/ORNL- Looks-to-NVIDIA-Fermi-Architecture-for-New-Supercomputer-62919517.html.
3. F. Cappello, "Fault tolerance in petascale/ exascale systems: Current knowledge, challenges and research opportunities," Int. J. High Perform. Comput. Appl., vol. 23, pp. 212-226, August 2009. [Online]. Available: http://portal.acm.org/citation.cfm?id=1572226.1572229
4. "HPC resilience consortium," 2010, [Online], http://resilience.latech.edu.
5. P. Baran, "On distributed communications, rm-3420,"http://www. rand.org/about/history/baran.list.html, Tech. Rep., 1964.
6. N. Carriero and D. Gelernter, How to Write Parallel Programs - A First Course. Cambridge, MA: The MIT Press, 1990.
7. A. S. Tanenbaum and M. V. Steen, Distributed Systems: Principles and Paradigms, 1st ed. Upper Saddle River, NJ, USA: Prentice Hall PTR, 2001.
8. P. H. Hargrove and J. C. Duell, "Berkeley lab checkpoint/restart (BLCR) for linux clusters," Journal of Physics: Conference Series, vol. 46, no. 1, p. 494, 2006. [Online]. Available: http://stacks.iop.org/1742-6596/46/i= 1/a=067
9. M. Shultz, G. B. R. Fenandes, D. M. K. Pingali, and P. Stodghill, "Implementation and evaluation of a scalable application-level checkpoint-recovery scheme for MPI programs,"in Proceedings of Supercomputing 2004 Conference, Pittsburgh, PA., November 2004.
10. H. Takizawa, K. Sato, K. Komatsu, and H. Kobayashi, "Checuda: A checkpoint/restart tool for cuda applications,"in Parallel and Distributed Computing, Applications and Technologies, 2009 International Conference on, dec 2009, pp. 408-413.
11. S. Laosooksathit, C. Leangsuksan, A. Dhungana, C. Chandler, K. Chanchio, and A. Farbin, "Lightweight checkpoint mechanism and modeling in GPGPU," in Proceedings of the hpcvirt2010 conference, 2010.
12. Wikipedia, "CUDA-compute unified device architecture,"2010, [Online], http://en.wikipedia.org/wiki/CUDA.
13. H. Rolf, "The MPI standard for message passing," in High-Performance Computing and Networking, ser. Lecture Notes in Computer Science, W. Gentzsch and U. Harms, Eds. Springer Berlin / Heidelberg, 1994, vol. 797, pp. 247-252, 10.1007/3-540-57981-8-126. [Online]. Available: http://dx.doi.org/10.1007/3-540-57981-8-126
14. E. Gabriel, G. E. Fagg, G. Bosilca, T. Angskun, J. J. Dongarra, J. M. Squyres, V. Sahay, P. Kambadur, B. Barrett, A. Lumsdaine, R. H. Castain, D. J. Daniel, R. L. Graham, and T. S. Woodall, "Open MPI: Goals, concept, and design of a next generation MPI implementation," in Recent Advances in Parallel Virtual Machine and Message Passing Interface, ser. Lecture Notes in Computer Science, D. Kranzlmller, P. Kacsuk, and J. J. Dongarra, Eds. Springer Berlin / Heidelberg, 2004, vol. 3241, pp. 353-377, 10.1007/978-3-540-30218-6-19. [Online]. Available: http://dx.doi.org/10.1007/978-3-540-30218-6-19
15. G. Bosilca, A. Bouteiller, F. Cappello, S. Djilali, G. Fedak, C. Germain, T. Herault, P. Lemarinier, O. Lodygensky, F. Magniette, V. Neri, and A. Selikhov, "MPICH-V: Toward a scalable fault tolerant MPI for volatile nodes," in Supercomputing, ACM/IEEE 2002 Conference, nov. 2002, p. 29.
16. M. Koop, T. Jones, and D. Panda, "Mvapich-aptus: Scalable high-performance multi-transport MPI over infiniband," in Parallel and Distributed Processing, 2008. IPDPS 2008. IEEE International Symposium on, april 2008, pp. 1-12.
17. W. Gropp and E. Lusk, "Fault tolerance in message passing interface programs," Int. J. High Perform. Comput. Appl., vol. 18, pp. 363-372, August 2004. [Online]. Available: http://portal.acm.org/citation.cfm?id=1080704. 1080714
18. J. T. Daly, "A higher order estimate of the optimum checkpoint interval for restart dumps," Future Generation Computer Systems, vol. 22, p. 303C312, 2006.
19. E. N. Elnozahy and J. S. Plank, "Checkpointing for peta-scale systems: A look into the future of practical rollback-recovery," IEEE Trans. Dependable Secur. Comput., vol. 1, pp. 97-108, April 2004. [Online]. Available: http://dx.doi.org/10.1109/TDSC.2004.15
20. M. Herlihy and N. Shavit, "The topological structure of asynchronous computability," J. ACM, vol. 46, pp. 858-923, November 1999. [Online]. Available: http://doi.acm.org/10.1145/331524.331529
21. A. Fekete, N. Lynch, Y. Mansour, and J. Spinelli, "The impossibility of implementing reliable communication in the face of crashes," J. ACM, vol. 40, pp. 1087-1107, November 1993. [Online]. Available: http://doi.acm.org/ 10.1145/174147.169676
22. T. Cover and J. Thomas, Elements of Information Theory. John Wiley & Sons, Inc., 1991.
23. J. Saltzer, D. Reed, and D. Clark, "End-to-end arguments in system design," April 1981, pp. 509-512.
24. J. Y. Shi, "Decoupling as a foundation for large scale parallel processing," in Proceedings of 2009 High Performance Computing and Communications, Seoul, Korea, 2009.
25. J. B. Dennis, "Data flow supercomputers," Computer, pp. 48-56, 1980.
26. M. Frigo, P. Halpern, C. E. Leiserson, and S. Lewin-Berlin, "Reducers and other cilk++ hyperobjects," ACM Symposium on Parallelism in Algorithms and Architectures, 2009.
27. Y. Yijian, "Fault tolerance protocol for multiple dependent master protection in a stateless parallel processing framework,"Ph.D. dissertation, Temple University, August 2007.
28. J. Y. Shi, Chapter 5:Fundamentals of cloud application architectures, Cloud computing: methodology, system, and applications. CRC, Taylor & Francis group, 2011.
29. A. M. Law and W. D. Kelton, Simulation Modeling and Analysis, 2nd ed. McGraw-Hill Higher Education, 1997.
30. B. Szymanski, Y. Shi, and N. Prywes, "Synchronized distributed termination," IEEE Transactions on Software Engineering, vol. SE11, no. 10, pp. 1136-1140, 1985.
31. F. Sun, "Automatic program parallelization using stateless parallel processing architecture," Ph.D. dissertation, Temple University, 2004.
32. "Multi-scale modeling and simulation," 2010, [Online], http://www.math.princeton.edu/multiscale/.
33. "High performance FPGA development group," 2010, [Online], http://www.fhpca.org/.
34. J. F. Kurose and K. W. Ross, Computer Networking: A Top-Down Approach Featuring the Internet. Addison-Wesley, July 2000, ch. 3.7 TCP Congestion Control.