When the herd is smart: Aggregate behavior in the selection of job request

IEEE Transactions on Parallel and Distributed Systems

Volumn 14, Issue 2, 2003, Pages 181-192

  Cirne, Walfredo ^a   Berman, Francine ^b  

^a FEDERAL UNIVERSITY OF CAMPINA GRANDE   (Brazil)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Aggregate behavior; Application scheduling; Job scheduling; Parallel supercomputers; Space shared supercomputers

Indexed keywords

COMPETITION; COMPUTER CIRCUITS; JOB ANALYSIS; PERFORMANCE; STORAGE ALLOCATION (COMPUTER); SYNCHRONIZATION; TURNAROUND TIME;

AGGREGATE BEHAVIOR;

PARALLEL PROCESSING SYSTEMS;

EID: 0037297791     PISSN: 10459219     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPDS.2003.1178881     Document Type: Article

References (33)

1. K. Aida, H. Kasahara, and S. Narita, "Job Scheduling Scheme for Pure Space Sharing among Rigid Jobs," Job Scheduling Strategies for Parallel Processing, vol. 1459, 1988.
2. K. Aida, "Effect of Job Size Characteristics on Job Scheduling Performance," Job Scheduling Strategies for Parallel Processing, vol. 1911, 2000.
3. S. Anastasiadis and K. Sevcik, "Parallel Application Scheduling on Networks of Workstations," J. Parallel and Distributed Computing, special issue on Workstation Clusters and Network-based Computing, no. 2, vol. 43, pp. 109-124, June 1997.
4. F. Berman, R. Wolski, S. Figueira, J. Schopf, and G. Shao, "Application-Level Scheduling on Distributed Heterogeneous Networks," Proc. Supercomputing '96, 1996.
5. W. Cirne and F. Berman, "A Model for Moldable Supercomputer Jobs," Proc. Int'l Parallel and Distributed Processing Symp, (IPDPS '01), Apr. 2001.
6. W. Cirne and F. Berman, "A Comprehensive Model of the Supercomputer Workload," Proc. Fourth IEEE Ann, Workshop Workload Characterization (WWC-4), Dec. 2001.
7. W. Cirne and F. Berman,Using Moldability to Improve the Performance of Supercomputer Jobs, accepted for publication J. Parallel and Distributed Computing. Tecnhical Report UFCG/DSC/02/02. Available at http://walfredo.dsc.ufpb.br/resume.html#publications, 2002.
8. S.-H. Chiang, R. Mansharamani, and M. Vernon, "Use of Applications Characteristics and Limited Preemption for Run-to-Completion Parallel Processor Scheduling Policies," Proc. ACM Sigmetrics Conf. Measurement and Modeling of Computer Systems, 1994.
9. A. Downey, "A Model for Speedup of Parallel Programs," Technical Report CSD-97-933, Univ. of California Berkeley, Jan. 1997.
10. A. Downey, "Using Queue Time Predictions for Processor Allocation," Job Scheduling Strategies for Parallel Processing, vol. 1291, 1997.
11. A. Downey and D. Feitelson, "The Elusive Goal of Workload Characterization," Performance Evaluation Rev., vol. 26, no. 4, pp. 14-29, Mar. 1999.
12. D. Eager, J. Zahorjan, and E. Lazowska, "Speedup Versus Efficiency in Parallel Systems," IEEE Trans. Computers, vol. 38, no. 3, Mar. 1989.
13. D. Feitelson, L. Rudolph, U. Schweigelshohn, K. Sevcik, and P. Wong, "Theory and Practice in Parallel Job Scheduling," Job Scheduling Strategies for Parallel Processing, vol. 1291, pp. 1-34, 1997.
14. D. Feitelson and A.M. Weil, "Utilization and Predictability in Scheduling the IBM SP2 with Backfilling," Proc. 12th Int'l Parallel Processing Symp., pp. 542-546, Apr. 1998.
15. D. Feitelson and L. Rudolph, "Metrics and Benchmarking for Parallel Job Scheduling," Job Scheduling Strategies for Parallel Processing, vol. 1459, pp. 1-24, 1998.
16. D. Ghosal, G. Serazzi, and S.K. Tripathi, "The Processor Working Set and its Use in Scheduling Multiprocessor Systems," IEEE Trans. Software Eng., vol. 17, no. 5, pp. 443-453, May 1991.
17. R. Henderson, "Job Scheduling Under the Portable Batch System," Job Scheduling Strategies for Parallel Processing, vol. 949, pp. 337-360, 1995.
18. T. Hogg and B. Huberman, "Controlling Chaos in Distributed Systems," IEEE Trans. Systems, Man, and Cybernetics, vol. 21, no. 6, Nov./Dec. 1991.
19. R. Krishnamurti and E. Ma, "The Processor Partitioning Problem in Special-Purpose Partitionable Systems," Int'l Conf. Parallel Processing, vol. 1, pp. 434-443, 1988.
20. D. Lifka, "The ANL/IBM SP Scheduling System," Job Scheduling Strategies for Parallel Processing, vol. 949, 1995.
21. V. Lo, J. Mache, and K. Windisch, "A Comparative Study of Real Workload Traces and Synthetic Workload Models for Parallel Job Scheduling," Job Scheduling Strategies for Parallel Processing, vol. 1459, pp. 25-46, 1998.
22. Maui High Performance Computing Center. The Maui Scheduler Web Page, http://wailea.mhpcc.edu/maui/, 2002.
23. C. McCann and J. Zahorjan, "Processor Allocation Policies for Message-Passing Parallel Computers," Proc. 1994 ACM SIGMETRICS Conf. Measurement and Modeling of Computer Systems, pp. 19-32, 1994.
24. M. Mitzenmacher, "How Useful is Old Information?" Proc. 16th Ann. ACM Symp. Principles of Distributed Computing (PODC 97), 1997, also in IEEE Trans. Parallel and Distributed Systems, vol. 11, no. 1, pp. 6-20, Jan. 2000.
25. E. Parsons and K. Sevcik, "Benefits of Speedup Knowledge in Memory Constrained Multiprocessor Scheduling," Performance Evaluation, vol. 27, no. 8, pp. 253-272, Oct. 1996.
26. D. Patterson, J. Hennessy, and D. Goldberg, Computer Architecture: A Quantitative Approach, second ed., Morgan Kaufmann, 1996.
27. Platform Computing Corp. Load Sharing Facility Web Page, http://www.platform.com/platform/platform.nsf/webpage/ LSF?OpenDocument, 2000.
28. E. Rosti, E. Smirni, L. Dowdy, G. Serazzi, and B. Carlson, "Robust Partitioning Schemes of Multiprocessor Systems," Performance Evaluation, vol. 19, nos. 2-3, pp. 141-165, Mar. 1994.
29. E. Rosti, E. Smirni, L. Dowdy, G. Serazzi, and B. Carlson, "Analysis of Nonwork-Conserving Processor Partitioning Policies," Job Scheduling Strategies for Parallel Processing, vol. 949, pp. 101-111, 1995.
30. K. Sevcik, "Characterization of Parallelism in Applications and Their Use in Scheduling," Proc. 1989 ACM Sigmetrics Conf., pp. 171-180, May 1989.
31. K. Sevcik, "Application Scheduling and Processor Allocation in Multiprogrammed Parallel Processing Systems," Performance Evaluation, vol. 19, pp. 107-140, 1994.
32. Standard Performance Evaluation Corporation. The SPEC Web Page, http://www.spec.org/, 2002.
33. J. Subhlok, T. Gross, and T. Suzuoka, "Impact of Job Mix on Optimizations for Space Sharing Schedulers," Proc. Supercomputing '96, 1996.