Scheduling concurrent applications on a cluster of CPU-GPU nodes

Future Generation Computer Systems

Volumn 29, Issue 8, 2013, Pages 2262-2271

  Ravi, Vignesh T ^a   Becchi, Michela ^b   Jiang, Wei ^a   Agrawal, Gagan ^a   Chakradhar, Srimat ^c  

^a Ohio State University   (United States)

^b University of Missouri   (United States)

^c NEC LABORATORIES AMERICA   (United States)

Author keywords

CPU GPU systems; Scheduling

Indexed keywords

GRAPHICS PROCESSING UNIT; ROUTERS;

CLOUD ENVIRONMENTS; EXECUTION SCENARIO; HETEROGENEOUS ARCHITECTURES; HETEROGENEOUS CLUSTERS; HETEROGENEOUS NODES; ROUND ROBIN SCHEDULERS; SCHEDULING POLICIES; SCHEDULING SCHEMES;

SCHEDULING;

EID: 84886092852     PISSN: 0167739X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.future.2013.06.002     Document Type: Article

References (37)

1. J. Nickolls, I. Buck, M. Garland, and K. Skadron Scalable parallel programming with CUDA Queue 6 2008 40 53
2. OpenCL. http://www.khronos.org/opencl/.
3. C. Hong, et al. MapCG: writing parallel program portable between CPU and GPU, in: PACT'10, New York, NY, USA, 2010, pp. 217-226.
4. G.F. Diamos, et al. Ocelot: a dynamic optimization framework for bulk-synchronous applications in heterogeneous systems, in: PACT'10, New York, NY, USA, 2010, pp. 353-364.
5. G. Teodoro, et al. Coordinating the use of GPU and CPU for improving performance of compute intensive applications, in: CLUSTER'09, 2009, pp. 1-10.
6. G.F. Diamos, S. Yalamanchili, Harmony: an execution model and runtime for heterogeneous many core systems, in: HPDC'08, New York, NY, USA, 2008, pp. 197-200.
7. C.-K. Luk, S. Hong, H. Kim, Qilin: exploiting parallelism on heterogeneous multiprocessors with adaptive mapping, in: MICRO'09, New York, NY, USA, 2009, pp. 45-55.
8. V.T. Ravi, W. Ma, D. Chiu, G. Agrawal, Compiler and runtime support for enabling generalized reduction computations on heterogeneous parallel configurations, in: ICS'10, New York, NY, USA, 2010, pp. 137-146.
9. M. Becchi, et al. Data-aware scheduling of legacy kernels on heterogeneous platforms with distributed memory, in: SPAA'10, New York, NY, USA, 2010, pp. 82-91.
10. J. Stratton, S. Stone, W. mei Hwu, MCUDA: An efficient implementation of CUDA Kernels for multi-core CPUs, in: 21st Annual Workshop on Languages and Compilers for Parallel Computing, LCPC'2008, 2008. URL http://www.gigascale.org/ pubs/1328.html.
11. PGI CUDA-X86 Compiler. http://www.pgroup.com/resources/cuda-x86.htm.
12. M. Harvey, and G.D. Fabritiis Swan: a tool for porting cuda programs to opencl Computer Physics Communications 182 4 2011 1093 1099 URL http://www.sciencedirect.com/science/article/pii/S0010465511000117
13. S. Lee, and R. Eigenmann OpenMPC: extended openmp programming and tuning for GPUs Proceedings of the 2010 ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis SC'10 2010 IEEE Computer Society Washington, DC, USA 1 11 URL http://dx.doi.org/10.1109/SC.2010.36
14. S. Che, et al. Rodinia: a benchmark suite for heterogeneous computing, in: IISWC'09, Washington, DC, USA, 2009, pp. 44-54.
15. Parboil Benchmark Suite. http://impact.crhc.illinois.edu/parboil.php.
16. A. Kerr, et al. Modeling GPU-CPU workloads and systems, in: GPGPU'10, 2010, pp. 31-42.
17. D.G. Feitelson, L. Rudolph, U. Schwiegelshohn, Parallel job scheduling - a status report, in: JSSPP, 2004, pp. 1-16.
18. A.C. Dusseau, R.H. Arpaci, and D.E. Culler Effective distributed scheduling of parallel workloads SIGMETRICS Performance Evaluation Review 24 1996 25 36 (Pubitemid 126549537)
19. V.K. Naik, M.S. Squillante, S.K. Setia, Performance analysis of job scheduling policies in parallel supercomputing environments, in: Supercomputing'93, New York, NY, USA, 1993, pp. 824-833.
20. G. Sabin, R. Kettimuthu, A. Rajan, P. Sadayappan, Scheduling of parallel jobs in a heterogeneous multi-site environment, in: Proc. of the 9th International Workshop on Job Scheduling Strategies for Parallel Processing, 2003, pp. 87-104.
21. G. Sabin, V. Sahasrabudhe, P. Sadayappan, Assessment and enhancement of meta-schedulers for multi-site job sharing, in: HPDC'05, Washington, DC, USA, 2005, pp. 144-153. (Pubitemid 41543484)
22. R. Kumar Single-isa heterogeneous multi-core architectures for multithreaded workload performance ISCA'04 2004 IEEE Computer Society Washington, DC, USA 64 75
23. M. Becchi, P. Crowley, Dynamic thread assignment on heterogeneous multiprocessor architectures, in: CF'06, New York, NY, USA, 2006, pp. 29-40.
24. SLURM: a highly scalable resource manager. https://computing.llnl.gov/ linux/slurm/slurm.html.
25. K. Furlinger, N.J. Wright, and D. Skinner Comprehensive performance monitoring for GPU cluster systems Proceedings of the 2011 IEEE International Symposium on Parallel and Distributed Processing Workshops and Ph.D. Forum IPDPSW '11 2011 IEEE Computer Society Washington, DC, USA 1377 1386 URL http://dx.doi.org/10.1109/IPDPS.2011.289
26. W. Jiang, G. Agrawal, MATE-CG: a mapreduce-like framework for accelerating data-intensive com-putations on heterogeneous clusters, in: IPDPS'12, 2012, in preparation.
27. Torque Resource Manager. http://www.clusterresources.com/products/torque- resource-manager.php.
28. M. Maheswaran, S. Ali, H.J. Siegel, D. Hensgen, and R.F. Freund Dynamic matching and scheduling of a class of independent tasks onto heterogeneous computing systems Proceedings of the Eighth Heterogeneous Computing Workshop HCW'99 1999 IEEE Computer Society Washington, DC, USA 30
29. A.B. Downey, and D.G. Feitelson The elusive goal of workload characterization SIGMETRICS Performance Evaluation Review 26 1999 14 29 URL http://doi.acm.org/10.1145/309746.309750
30. R.F.t. Freund Scheduling resources in multi-user, heterogeneous, computing environments with smart-net Proceedings of the Seventh Heterogeneous Computing Workshop HCW'98 1998 IEEE Computer Society Washington, DC, USA 3
31. W. Cirne, and F. Berman Using moldability to improve the performance of supercomputer jobs Journal of Parallel and Distributed Computing 62 10 2002 1571 1601
32. S. Srinivasan, V. Subramani, R. Kettimuthu, P. Holenarsipur, and P. Sadayappan Effective selection of partition sizes for moldable scheduling of parallel jobs S. Sahni, V.K. Prasanna, U. Shukla, HiPC Lecture Notes in Computer Science vol. 2552 2002 Springer 174 183 (Pubitemid 36140700)
33. I. Ahmad, M. Dhodhi, and R. Ul-Mustafa DPS: dynamic priority scheduling heuristic for heterogeneous computing systems IEE Proceedings - Computers and Digital Techniques 145 6 1998 411 418
34. Y.S. Kee, H. Casanova, A. Chien, Realistic modeling and synthesis of resources for computational grids, in: SC'04, 2004, pp. 54-63.
35. Y.S. Kee, K. Yocum, A.A. Chien, H. Casanova, Improving grid resource allocation via integrated selection and binding, in: SC'06, 2006.
36. F. Berman New grid scheduling and rescheduling methods in the grads project International Journal of Parallel Programming 2005 209 229 (Pubitemid 41202442)
37. S.K. Garg, R. Buyya, H.J. Siegel, Scheduling parallel applications on utility grids: time and cost trade-off management, in: ACSC'09, 2009, pp. 139-147.