A data-oriented method for scheduling dependent tasks on high-density multi-GPU systems

Proceedings - 2015 IEEE 17th International Conference on High Performance Computing and Communications, 2015 IEEE 7th International Symposium on Cyberspace Safety and Security and 2015 IEEE 12th International Conference on Embedded Software and Systems, HPCC-CSS-ICESS 2015

Volumn , Issue , 2015, Pages 694-699

  Zhang, Peng ^a   Gao, Yuxiang ^b   Qiu, Meikang ^c  

^a St Francis Hospital The Heart Center   (United States)

^b Cray Inc   (United States)

^c PACE UNIVERSITY   (United States)

Author keywords

Data scheduling; Heterogeneous multi GPU systems; Parallel computing; Task scheduling

Indexed keywords

COMPUTER ARCHITECTURE; COMPUTER PROGRAMMING; COMPUTERS; DESIGN; EMBEDDED SOFTWARE; EMBEDDED SYSTEMS; NETWORK SECURITY; PARALLEL PROCESSING SYSTEMS; PROGRAM PROCESSORS; SCHEDULING;

DATA ORIENTED METHODS; DATA SCHEDULING; DATA-INTENSIVE APPLICATION; MATRIX MULTIPLICATION; MULTI-GPU SYSTEMS; PROCESSING ELEMENTS; PROGRAMMING ENVIRONMENT; TASK-SCHEDULING;

MATRIX ALGEBRA;

EID: 84961692393     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/HPCC-CSS-ICESS.2015.314     Document Type: Conference Paper

References (22)

1. S. Tomov, R. Nath, H. Ltaief, and J. Dongarra, "Dense linear algebra solvers for multicore with GPU accelerators, " in Parallel & Distributed Processing, Workshops and Phd Forum (IPDPSW), 2010 IEEE International Symposium on, 2010, pp. 1-8.
2. P. Zhang, R. Powell, and Y. Deng, "Interlacing Bypass Rings to Torus Networks for More Efficient Networks, " Parallel and Distributed Systems, IEEE Transactions on, vol. 22, pp. 287-295, 2011.
3. J. Kurzak, D. A. Bader, and J. Dongarra, Scientific Computing with Multicore and Accelerators: CRC Press, Inc., 2010.
4. H. Liu, S. Yu, Z. Chen, B. Hsieh, and L. Shao, "Sparse matrixvector multiplication on nvidia gpu, " Int. J. Numer. Anal. Model, vol. 3, pp. 185-191, 2012.
5. Z. Zheng, Y. Zhu, X. Wang, Z. Que, T. Huang, X. Yin, H. Wang, G. Rong, and M. Qiu, "Revealing feasibility of FMM on ASIC: efficient implementation of N-Body problem on FPGA, " in Computational Science and Engineering (CSE), 2010 IEEE 13th International Conference on, 2010, pp. 132-139.
6. R. Nath, S. Tomov, and J. Dongarra, "BLAS for GPUs, " Scientific Computing with Multicore and Accelerators, Kurzak J, Bader DA, Dongarra J (eds). CRC Press: Boca Raton, FL, 2010.
7. S. Yu, H. Liu, Z. J. Chen, B. Hsieh, and L. Shao, "GPU-based parallel reservoir simulation for large-scale simulation problems, " in SPE Europec/EAGE Annual Conference, 2012.
8. P. Zhang and Y. Gao, "Matrix Multiplication on High-Density Multi-GPU Architectures: Theoretical and Experimental Investigations, " in High Performance Computing. vol. 9137, J. M. Kunkel and T. Ludwig, Eds., ed: Springer International Publishing, 2015, pp. 17-30.
9. C. Augonnet, J. Clet-Ortega, S. Thibault, and R. Namyst, "Data-Aware Task Scheduling on Multi-accelerator Based Platforms, " in Parallel and Distributed Systems (ICPADS), 2010 IEEE 16th International Conference on, 2010, pp. 291-298.
10. P. Zhang, Y. Gao, J. Fierson, and Y. Deng, "Eigenanalysis-Based Task Mapping on Parallel Computers with Cellular Networks, " Mathematics of Computation, vol. 83, pp. 1727-1756, 2014.
11. C. Augonnet, S. Thibault, R. Namyst, and P.-A. Wacrenier, "StarPU: A unified platform for task scheduling on heterogeneous multicore architectures, " in Euro-Par 2009 Parallel Processing, ed: Springer, 2009, pp. 863-874.
12. G. Bosilca, A. Bouteiller, A. Danalis, T. Herault, P. Lemarinier, and J. Dongarra, "DAGuE: A generic distributed DAG engine for high performance computing, " Parallel Computing, vol. 38, pp. 37-51, 2012.
13. A. Duran, E. Ayguadé, R. M. Badia, J. Labarta, L. Martinell, X. Martorell, and J. Planas, "Ompss: a proposal for programming heterogeneous multi-core architectures, " Parallel Processing Letters, vol. 21, pp. 173-193, 2011.
14. T. Lewis and H. El-Rewini, "Parallax: A Tool for Parallel Program Scheduling, " IEEE Parallel Distrib. Technol., vol. 1, pp. 62-72, 1993.
15. P. Zhang, L. Liu, and Y. Deng, "A data-driven paradigm for mapping problems, " Parallel Computing, vol. 48, pp. 108-124, 2015.
16. J. Li, M. Qiu, J.-W. Niu, L. T. Yang, Y. Zhu, and Z. Ming, "Thermal-aware task scheduling in 3D chip multiprocessor with real-time constrained workloads, " ACM Transactions on Embedded Computing Systems (TECS), vol. 12, p. 24, 2013.
17. H. Bouwmeester and J. Langou, "A critical path approach to analyzing parallelism of algorithmic variants. Application to Cholesky inversion, " arXiv preprint arXiv:1010. 2000, 2010.
18. J. Li, M. Qiu, Z. Ming, G. Quan, X. Qin, and Z. Gu, "Online optimization for scheduling preemptable tasks on IaaS cloud systems, " Journal of Parallel and Distributed Computing, vol. 72, pp. 666-677, 2012.
19. Y. Guo, Q. Zhuge, J. Hu, M. Qiu, and E. H.-M. Sha, "Optimal data allocation for scratch-pad memory on embedded multi-core systems, " in Parallel Processing (ICPP), 2011 International Conference on, 2011, pp. 464-471.
20. E. Agullo, J. Demmel, J. Dongarra, B. Hadri, J. Kurzak, J. Langou, H. Ltaief, P. Luszczek, and S. Tomov, "Numerical linear algebra on emerging architectures: The PLASMA and MAGMA projects, " in Journal of Physics: Conference Series, 2009, p. 012037.
21. J. Enmyren and C. W. Kessler, "SkePU: a multi-backend skeleton programming library for multi-GPU systems, " in Proceedings of the fourth international workshop on High-level parallel programming and applications, 2010, pp. 5-14.
22. P. Hénon, P. Ramet, and J. Roman, "PASTIX: a highperformance parallel direct solver for sparse symmetric positive definite systems, " Parallel Computing, vol. 28, pp. 301-321, 2002.