Scheduling many-task workloads on supercomputers: Dealing with trailing tasks

2010 3rd Workshop on Many-Task Computing on Grids and Supercomputers, MTAGS10

Volumn , Issue , 2010, Pages

  Armstrong, Timothy G ^a   Zhang, Zhao ^a   Katz, Daniel S ^b   Wilde, Michael ^b   Foster, Ian T ^b  

^a THE UNIVERSITY OF CHICAGO   (United States)

^b ARGONNE NATIONAL LABORATORY   (United States)

Author keywords

High performance computing; Many task computing; Scheduling; Supercomputer systems

Indexed keywords

ECONOMIC AND SOCIAL EFFECTS; PROGRAM PROCESSORS; SCHEDULING;

ALLOCATION POLICIES; ARGONNE NATIONAL LABORATORY; COMMUNICATION PERFORMANCE; COMPUTATIONAL RESOURCES; HIGH PERFORMANCE COMPUTING; MANY-TASK COMPUTING; SCHEDULING TASKS; TIME-TO-SOLUTION;

SUPERCOMPUTERS;

EID: 79951828061     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/mtags.2010.5699433     Document Type: Conference Paper

References (18)

1. I. Raicu, I. Foster, and Y. Zhao, "Many-task computing for grids and supercomputers," in Proc. IEEE Workshop on Many-Task Computing on Grids and Supercomputers (MTAGS08), 2008.
2. IBM Blue Gene team, "Overview of the IBM Blue Gene/P project," IBM Journal of Research and Development, vol. 52, no. 1/2, pp. 199-220, 2008.
3. "Blue Waters computing system," [accessed 13-Sep-2010]. [Online]. Available: http://www.ncsa.illinois.edu/BlueWaters/system.html
4. A. Khan, C. McCreary, and M. Jones, "A comparison of multiprocessor scheduling heuristics," in Proc. 1994 International Conference on Parallel Processing, vol. 2, pp. 243-250, 1994.
5. G. Malewicz, I. Foster, A. Rosenberg, and M. Wilde, "A tool for prioritizing DAGMan jobs and its evaluation," in Proc. 15th International Symposium on High-Performance Distributed Computing, pp. 156-168, 2006.
6. E. L. Lusk, S. C. Pieper, and R. M. Butler, "More scalability, less pain: A simple programming model and its implementation for extreme computing," SciDAC Review, vol. 17, pp. 30-37, spring 2009.
7. M. Harchol-Balter and A. B. Downey, "Exploiting process lifetime distributions for dynamic load balancing," ACM Trans. Comput. Syst., vol. 15, no. 3, pp. 253-285, 1997.
8. I. Raicu, "Many-task computing: Bridging the gap between high throughput computing and high performance computing," Ph.D. dissertation, University of Chicago, 2009.
9. J. Dean and S. Ghemawat, "MapReduce: Simplified data processing on large clusters," in Proc. 8th USENIX Symposium on Operating Systems Design and Implementation, pp. 137-150, 2004.
10. S. T. McCormick and M. L. Pinedo, "Scheduling n independent jobs on m uniform machines with both flowtime and makespan objectives: A parametric analysis," ORSA Journal on Computing, vol. 7, no. 1, pp. 63-77, 1995.
11. M. Wieczorek, S. Podlipnig, R. Prodan, and T. Fahringer, "Bicriteria scheduling of scientific workflows for the grid," in Proc. 2008 Eighth IEEE International Symposium on Cluster Computing and the Grid, pp. 9-16, 2008.
12. P. Brucker, Scheduling Algorithms. Springer-Verlag, 2004.
13. D. S. Hochbaum and D. B. Shmoys, "Using dual approximation algorithms for scheduling problems theoretical and practical results," J. ACM, vol. 34, no. 1, pp. 144-162, 1987.
14. E. Krevat, J. Castaos, and J. Moreira, "Job scheduling for the bluegene/l system," in Job Scheduling Strategies for Parallel Processing, ser. Lecture Notes in Computer Science, D. Feitelson, L. Rudolph, and U. Schwiegelshohn, Eds. Springer Berlin / Heidelberg, 2002, vol. 2537, pp. 38-54.
15. N. Desai, D. Buntinas, D. Buettner, P. Balaji, and A. Chan, "Improving resource availability by relaxing network allocation constraints on Blue Gene/P," International Conference on Parallel Processing, pp. 333-339, 2009.
16. "Allocation management - Argonne Leadership Computing Facility," [accessed 13-Sep-2010]. [Online]. Available: https: //wiki.alcf.anl.gov/index.php/Allocation-Management
17. I. Raicu, Z. Zhang, M. Wilde, I. Foster, P. Beckman, K. Iskra, and B. Clifford, "Toward loosely coupled programming on petascale systems," in Proc. IEEE/ACM Supercomputing 2008, November 2008.
18. D. Moustakas, P. Lang, S. Pegg, E. Pettersen, I. Kuntz, N. Brooijmans, and R. Rizzo, "Development and validation of a modular, extensible docking program: DOCK 5," Journal of Computer-Aided Molecular Design, vol. 20, pp. 601-619, 2006.