Scheduling concurrent applications on a cluster of CPU-GPU nodes

Proceedings - 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing, CCGrid 2012

Volumn , Issue , 2012, Pages 140-147

  Ravi, Vignesh T ^a   Becchi, Michela ^b   Jiang, Wei ^a   Agrawal, Gagan ^a   Chakradhar, Srimat ^c  

^a Ohio State University   (United States)

^b UNIVERSITY OF MISSOURI   (United States)

^c NEC LABORATORIES AMERICA   (United States)

Author keywords

Heterogeneous Scheduling

Indexed keywords

HETEROGENEOUS ARCHITECTURES; HETEROGENEOUS CLUSTERS; HETEROGENEOUS NODES; MANY-CORE; MULTI CORE; ROUND-ROBIN SCHEDULER; SCHEDULING SCHEMES;

COMPUTER ARCHITECTURE; GRID COMPUTING;

SCHEDULING;

EID: 84863676008     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CCGrid.2012.78     Document Type: Conference Paper

References (37)

1. J. Nickolls, I. Buck, M. Garland, and K. Skadron, "Scalable parallel programming with CUDA," Queue, vol. 6, pp. 40-53, March 2008.
2. "OpenCL," http://www.khronos.org/opencl/.
3. C. Honget al, "MapCG: writing parallel program portable between cpu and gpu," in PACT '10, New York, NY, USA, 2010, pp. 217-226.
4. G. F. Diamos et al, "Ocelot: a dynamic optimization framework for bulk-synchronous applications in heterogeneous systems," in PACT'10, New York, NY, USA, 2010, pp. 353-364.
5. G. Teodoro et al, "Coordinating the use of GPU and CPU for improving performance of compute intensive applications," in CLUSTER '09, 2009, pp. 1-10.
6. G. F. Diamos and S. Yalamanchili, "Harmony: an execution model and runtime for heterogeneous many core systems," in HPDC '08, New York, NY, USA, 2008, pp. 197-200.
7. C.-K. Luk, S. Hong, and H. Kim, "Qilin: exploiting parallelism on heterogeneous multiprocessors with adaptive mapping," in MICRO '09, New York, NY, USA, 2009, pp. 45-55.
8. V. T. Ravi, W. Ma, D. Chiu, and G. Agrawal, "Compiler and runtime support for enabling generalized reduction computations on heterogeneous parallel configurations," in ICS '10, New York, NY, USA, 2010, pp. 137-146.
9. M. Becchi et al, "Data-aware scheduling of legacy kernels on heterogeneous platforms with distributed memory," in SPAA '10, New York, NY, USA, 2010, pp. 82-91.
10. J. Stratton, S. Stone, and W. mei Hwu, "MCUDA: An Efficient Implementation of CUDA Kernels for Multi-Core CPUs,"in 21st Annual Workshop on Languages and Compilers for Parallel Computing (LCPC'2008), July 2008. [Online]. Available: http://www.gigascale.org/pubs/1328.html
11. "PGI CUDA-X86 Compiler," http://www.pgroup.com/resources/cuda- x86.htm.
12. M. Harvey and G. D. Fabritiis, "Swan: A tool for porting cuda programs to opencl," Computer Physics Communications, vol. 182, no. 4, pp. 1093 - 1099, 2011. [Online]. Available: http://www.sciencedirect.com/science/ article/pii/S0010465511000117
13. S. Lee and R. Eigenmann, "OpenMPC: Extended openmp programming and tuning for gpus," in Proceedings of the 2010 ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis, ser. SC '10. Washington, DC, USA: IEEE Computer Society, 2010, pp. 1-11. [Online]. Available: http://dx.doi.org/10.1109/SC.2010.36
14. S. Che et al, "Rodinia: A benchmark suite for heterogeneous computing,"in IISWC '09, Washington, DC, USA, 2009, pp. 44-54.
15. "Parboil Benchmark Suite," http://impact.crhc.illinois.edu/ parboil.php.
16. A. Kerr et al, "Modeling GPU-CPU workloads and systems," in GPGPU '10, 2010, pp. 31-42.
17. D. G. Feitelson, L. Rudolph, and U. Schwiegelshohn, "Parallel job scheduling - a status report," in JSSPP, 2004, pp. 1-16.
18. A. C. Dusseau, R. H. Arpaci, and D. E. Culler, "Effective distributed scheduling of parallel workloads," SIGMETRICS Perform. Eval. Rev., vol. 24, pp. 25-36, May 1996.
19. V. K. Naik, M. S. Squillante, and S. K. Setia, "Performance analysis of job scheduling policies in parallel supercomputing environments," in Supercomputing '93, New York, NY, USA, 1993, pp. 824-833.
20. G. Sabin, R. Kettimuthu, A. Rajan, and P. Sadayappan, "Scheduling of parallel jobs in a heterogeneous multi-site environment," in in Proc. of the 9th International Workshop on Job Scheduling Strategies for Parallel Processing, 2003, pp. 87-104.
21. G. Sabin, V. Sahasrabudhe, and P. Sadayappan, "Assessment and enhancement of meta-schedulers for multi-site job sharing," in HPDC '05, Washington, DC, USA, 2005, pp. 144-153.
22. R. Kumar et al., "Single-isa heterogeneous multi-core architectures for multithreaded workload performance," in ISCA '04. Washington, DC, USA: IEEE Computer Society, 2004, pp. 64-75.
23. M. Becchi and P. Crowley, "Dynamic thread assignment on heterogeneous multiprocessor architectures," in CF '06, New York, NY, USA, 2006, pp. 29-40.
24. "SLURM: A highly scalable resource manager,"https://computing. llnl.gov/linux/slurm/slurm.html.
25. K. Furlinger, N. J. Wright, and D. Skinner, "Comprehensive performance monitoring for gpu cluster systems," in Proceedings of the 2011 IEEE International Symposium on Parallel and Distributed Processing Workshops and PhD Forum, ser. IPDPSW '11. Washington, DC, USA: IEEE Computer Society, 2011, pp. 1377-1386. [Online]. Available: http://dx.doi.org/10.1109/IPDPS.2011. 289
26. W. Jiang and G. Agrawal, "MATE-CG: A mapreduce-like framework for accelerating data-intensive computations on heterogeneous clusters,"in IPDPS '12 (to appear), 2012.
27. "Torque Resource Manager," http://www.clusterresources.com/ products/torque-resource-manager.php.
28. M. Maheswaran, S. Ali, H. J. Siegel, D. Hensgen, and R. F. Freund, "Dynamic matching and scheduling of a class of independent tasks onto heterogeneous computing systems," in Proceedings of the Eighth Heterogeneous Computing Workshop, ser. HCW '99. Washington, DC, USA: IEEE Computer Society, 1999, pp. 30-. [Online]. Available: http://dl.acm.org/ citation.cfm?id=795690.797893
29. A. B. Downey and D. G. Feitelson, "The elusive goal of workload characterization," SIGMETRICS Perform. Eval. Rev., vol. 26, pp. 14-29, March 1999. [Online]. Available: http://doi.acm.org/10.1145/309746.309750
30. R. F. t. Freund, "Scheduling resources in multi-user, heterogeneous, computing environments with smartnet," in Proceedings of the Seventh Heterogeneous Computing Workshop, ser. HCW '98. Washington, DC, USA: IEEE Computer Society, 1998, pp. 3-. [Online]. Available: http://dl.acm.org/citation. cfm?id=795689.797878
31. W. Cirne and F. Berman, "Using moldability to improve the performance of supercomputer jobs," JPDC, vol. 62, no. 10, pp. 1571-1601, 2002.
32. S. Srinivasan, V. Subramani, R. Kettimuthu, P. Holenarsipur, and P. Sadayappan, "Effective selection of partition sizes for moldable scheduling of parallel jobs," in HiPC, 2002, pp. 174-183.
33. I. Ahmad, M. Dhodhi, and R. Ul-Mustafa, "DPS: Dynamic priority scheduling heuristic for heterogeneous computing systems," IEE Proceedings - Computers and Digital Techniques, vol. 145, no. 6, pp. 411-418, 1998. [Online]. Available: http://link.aip.org/link/?ICE/145/411/1
34. Y. S. Kee, H. Casanova, and A. Chien, "Realistic modeling and synthesis of resources for computational grids," in SC '04, 2004, pp. 54-63.
35. Y. S. Kee, K. Yocum, A. A. Chien, and H. Casanova, "Improving grid resource allocation via integrated selection and binding," in SC '06, 2006.
36. F. Berman et al, "New grid scheduling and rescheduling methods in the grads project," International Journal of Parallel Programming, pp. 209-229, 2005.
37. S. K. Garg, R. Buyya, and H. J. Siegel, "Scheduling parallel applications on utility grids: Time and cost trade-off management," in ACSC '09, 2009, pp. 139-147.