Flexible coscheduling: Mitigating load imbalance and improving utilization of heterogeneous resources

Proceedings - International Parallel and Distributed Processing Symposium, IPDPS 2003

Volumn , Issue , 2003, Pages

  Frachtenberg, Eitan ^a,b   Feitelson, Dror G ^b   Petrini, Fabrizio ^a   Fernandez, Juan ^a  

^a LOS ALAMOS NATIONAL LABORATORY   (United States)

^b HEBREW UNIVERSITY OF JERUSALEM   (Israel)

Author keywords

Cluster computing; Gang scheduling; Heterogeneous clusters; Job scheduling; Load balancing; Parallel architectures; STORM

Indexed keywords

CLUSTER COMPUTING; DISTRIBUTED PARAMETER NETWORKS; EFFICIENCY; NETWORK MANAGEMENT; PARALLEL ARCHITECTURES; PARALLEL PROCESSING SYSTEMS; RESOURCE ALLOCATION; SCHEDULING; STORMS;

COMMUNICATION ACTIVITIES; FINE-GRAINED PARALLEL APPLICATION; FLEXIBLE COSCHEDULING; GANG SCHEDULING; HETEROGENEOUS CLUSTERS; HETEROGENEOUS RESOURCES; JOB SCHEDULING; SUB-OPTIMAL PERFORMANCE;

COMPUTER ARCHITECTURE;

EID: 84947237576     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IPDPS.2003.1213191     Document Type: Conference Paper

References (18)

1. A. C. Arpaci-Dusseau, "Implicit Coscheduling: Coordinated Scheduling with Implicit Information in Distributed Systems". ACM Trans. Computer Systems 19(3), pp. 283-331, Aug 2001.
2. ASCI Technology Prospectus: Simulation and Computational Science. Technical Report DOE/DP/ASC-ATP-001, National Nuclear Security Agency (NNSA), Jul 2001.
3. D. E. Culler and J. P. Singh, Parallel Computer Architecture: A Hardware/Software Approach. Morgan Kaufman Publishers, Inc. , 1999.
4. Y. Etsion, D. Tsafrir, and D. G. Feitelson, "Effects of Clock Resolution on the Scheduling of Interactive and Soft Real-Time Processes". In SIGMETRICS Conf. Measurement & Modeling of Comput. Syst. , Jun 2003.
5. D. G. Feitelson and L. Rudolph, "Metrics and Benchmarking for Parallel Job Scheduling". In Job Scheduling Strategies for Parallel Processing, LNCS vol. 1495, pp. 1-24, Springer-Verlag, Mar 1998.
6. E. Frachtenberg, F. Petrini, J. Fernandez, S. Pakin, and S. Coll, "STORM: Lightning-Fast Resource Management". In Supercomputing 2002, Nov 2002.
7. A. Hoisie, D. J. Kerbyson, S. Pakin, F. Petrini, H. J. Wasserman, and J. Fernandez-Peinador, Identifying and Eliminating the Performance Variability on the ASCI Q Machine. Technical Report LA-UR-03-0138, Los Alamos National Lab, Jan 2003.
8. A. Hoisie, O. Lubeck, and H. Wasserman, "Scalability Analysis of Multidimensional Wavefront Algorithms on Large-Scale SMP Clusters ". In 9th Symp. Frontiers of Massively Parallel Computation, Feb 1999.
9. D. Kerbyson, H. Alme, A. Hoisie, F. Petrini, H. Wasserman, and M. Gittings, "Predictive Performance and Scalability Modeling of a Large-Scale Application". In Supercomputing 2001, Nov 2001.
10. J. Kim and D. J. Lilja, "Characterization of Communication Patterns in Message-Passing Parallel Scientific Application Programs". In Workshop on Communication, Architecture, and Applications for Network-Based Parallel Computing, pp. 202-216, Feb 1998.
11. W. Lee, M. Frank, V. Lee, K. Mackenzie, and L. Rudolph, "Implications of I/O for Gang Scheduled Workloads". In Job Scheduling Strategies for Parallel Processing, LNCS vol. 1291, pp. 215-237, Springer-Verlag, Apr 1997.
12. F. Petrini and W. Feng, "Buffered Coscheduling: A New Methodology for Multitasking Parallel Jobs on Distributed Systems". In 14th Intl. Parallel & Distributed Processing Symp. , pp. 439-444, May 2000.
13. F. Petrini, W. Feng, A. Hoisie, S. Coll, and E. Frachtenberg, "The Quadrics Network: High Performance Clustering Technology". IEEE Micro 22(1), pp. 46-57, Jan-Feb 2002.
14. Quadrics Supercomputers World Ltd. , Elan Programming Manual. Jan 1999.
15. Quadrics Supercomputers World Ltd. , Elan Reference Manual. Jan 1999.
16. P. Sobalvarro, S. Pakin, W. E. Weihl, and A. A. Chien, "Dynamic Coscheduling on Workstation Clusters ". In Job Scheduling Strategies for Parallel Processing, LNCS vol. 1459, pp. 231-256, Springer-Verlag, Mar 1998.
17. L. G. Valiant, "ABridging Model for Parallel Computation". Comm. ACM 33(8), pp. 103-111, Aug 1990.
18. Y. Wiseman and D. G. Feitelson, "Paired Gang Scheduling". IEEE Trans. Parallel & Distributed Systems, 2003. (to appear).