Effective distributed scheduling of parallel workloads

Performance Evaluation Review

Volumn 24, Issue 1, 1996, Pages 25-36

  Dusseau, Andrea C ^a   Arpaci, Remzi H ^a   Culler, David E ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; COMPUTER SIMULATION; COMPUTER SOFTWARE; DATA COMMUNICATION SYSTEMS; PARALLEL PROCESSING SYSTEMS; PERFORMANCE; RESPONSE TIME (COMPUTER SYSTEMS); SCHEDULING; SYNCHRONIZATION;

BLOCKING ALGORITHMS; COSCHEDULING; DISTRIBUTED SCHEDULING; PARALLEL PROGRAM; PARALLEL WORKLOADS;

COMPUTER OPERATING SYSTEMS;

EID: 0030149947     PISSN: 01635999     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/233008.233020     Document Type: Article

References (43)

1. R. H. Arpaci, D. E. Culler, A. Krishnamurthy, S. Steinberg, and K. Yelick. Empirical Evaluation of the CRAY-T3D: A Compiler Perspective. In Proceedings of the 22nd Annual International Symposium on Computer Architecture, June 1995.
2. R. H. Arpaci, A. C. Dusseau, A. M. Vahdat, L. T. Liu, T. E. Anderson, and D. A. Patterson. The Interaction of Parallel and Sequential Workloads on a Network of Workstations. In Proceedings of ACM SIGMETRICS'95/PERFORMANCE'95 Joint International Conference on Measurement and Modeling of Computer Systems, pages 267-278, May 1995.
3. K. Arvind. Probabalistic Clock Synchronization in Distributed Systems. IEEE Transactions on Parallel and Distributed Systems, 5(5):474-87, May 1994.
4. M. J. Atallah, C. L. Black, D. C. Marinescu, H. J. Siegel, and T. L. Casavant. Models and Algorithms for Co-scheduling Compute-Intensive Tasks on a Network of Workstations. Journal of Parallel and Distrbuted Computing, 16:319-327, 1992.
5. R. Chandra, S. Devine, B. Verghese, A. Gupta, and M. Rosenblum. Scheduling and Page Migration for Multiprocessor Compute Servers. In International Conference on Architectural Support for Programming Languages and Operating Systems, Oct. 1994.
6. J. Chapin, M. Rosenblum, S. Devine, T. Lahiri, D. Teodosiu, and A. Gupta. Hive: Fault Containment for Shared-Memory Multiprocessors. In Proceedings of the Fifteenth ACM Symposium on Operating Systems Principles, pages 12-25, Dec. 1995.
7. S.-H. Chiang, R. K. Mansharamani, and M. K. Vernon. Use of Application Characteristics and Limited Preemption for Run-To-Completion Parallel Processor Scheduling Policies. In Proceedings of the 1994 ACM BIOMETRICS Conference on Measurement and Modeling of Computer Systems, pages 34-44, Feb. 1994.
8. M. Crovella, P. Das, C. Dubnicki, T. LeBlanc, and E. Markatos. Multiprogramming on Multiprocessors. In Proceedings of the Third IEEE Symposium on Parallel and Distributed Processing, pages 590-597, Dec. 1991.
9. D. Culler, L. T. Liu, R. Martin, and C. Yoshikawa. LogP Performance Assessment of Fast Network Interfaces. IEEE Micro, Feb. 1996.
10. R. Cypher, A. Ho, S. Konstantinidou, and P. Messina. Architectural Requirements of Parallel Scientific Applications with Explicit Communication. In 20th Annual International Symposium on Computer Architecture, May 1993.
11. J. J. Dongarra, J. R. Bunch, C. B. Moler, and G. W. Stewart. LINPACK User's Guide. SIAM, Philadelphia, Penn., 1979.
12. A. Dusseau, D. Culler, K. Schauser, and R. Martin. Fast Parallel Sorting under LogP: Experience with the CM-5. IEEE Transactions on Parallel and Distributed Systems, 1996. To Appear.
13. S. Evans, K. Clarke, D. Singleton, and B. Smaalders. Optimizing Unix Resource Scheduling for User Interaction. In 1993 Summer Usenix, pages 205-218. USENIX, June 1993.
14. D. G. Feitelson and L. Rudolph. Distributed Hierarchical Control for Parallel Processing. IEEE Computer, 23(5):65-77, May 1990.
15. D. G. Feitelson and L. Rudolph. Gang Scheduling Performance Benefits for Fine-Grained Synchronization. Journal of Parallel and Distributed Computing, 16(4):306-318, Dec. 1992.
16. D. G. Feitelson and L. Rudolph. Coscheduling Based on Run-Time Identification of Activity Working Sets. International Journal of Parallel Programming, 23(2):136-160, Apr. 1995.
17. D. Ghosal, G. Serazzi, and S. K. Tripathi. The Processor Working Set and Its Use in Scheduling Multiprocessor Systems. IEEE Transactions on Software Engineering, 17(5):443-453, May 1991.
18. B. Goodheart and J. Cox. The Magic Garden Explained: The Internals of UNIX System V Release 4. Prentice Hall, 1994.
19. A. Gupta, A. Tucker, and S. Urushibara. The Impact of Operating System Scheduling Policies and Synchronization Methods on the Performance of Parallel Applications. In Proceedings of the 1991 ACM SIGMETRICS Conference on Measurement and Modeling of Computer Systems, pages 120-131, May 1991.
20. High Performance Fortran Forum. High Performance Fortran language specification version 1.0. Draft, Jan. 1993.
21. M. D. Hill, J. R. Larus, S. K. Reinhardt, and D. A. Wood. Cooperative Shared Memory: Software and Hardware for Scalable Multiprocessors. ACM Transactions on Computer Systems, 11(4):300-18, Nov. 1993.
22. A. Karlin, K. Li, M. Manasse, and S. Owicki. Empirical studies of competitive spinning for a shared-memory multiprocessor. In Thirteenth ACM Symposium on Operating Systems Principles, Oct. 1991.
23. K. Keeton, T. Anderson, and D. Patterson. LogP Quantified: The Case for Low-Overhead Local Area Networks. In Proceedings of Hot Interconnects III, Aug. 1995.
24. L. I. Kontothanassis and R. W. Wisniewski. Using Scheduler Information to Achieve Optimal Barrier Synchronization Performance. In Proceedings of the ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, May 1993.
25. S. J. Leffler, M. K. McKusick, M. J. Karels, and J. S. Quarterman. The Design and Implementation of the 4.3BSD UNIX Operating System. Addison-Wesiey, 1990.
26. S. T. Leutenegger and X.-H. Sun. Distributed Computing Feasibility in a Non-Dedicated Homogenous Distributed System. In Proceedings of Supercomputing 93, pages 143-152, 1993.
27. S. T. Leutenegger and M. K. Vernon. The Performance of Multi-programmed Multiprocessor Scheduling Policies. In Proceedings of the ACM SIGMETRICS Conference, pages 226-236, May 1990.
28. R. P. Martin. HPAM: An Active Message Layer for a Network of Workstations. In Proceedings of Hot Interconnects II, July 1994.
29. C. McCann, R. Vaswani, and J. Zahorjan. A Dynamic Processor Allocation Policy for Multi-programmed Shared-Memory Multi-processors. In ACM Transactions on Computer Systems, volume 11, pages 146-178, May 1993.
30. C. McCann and J. Zahorjan. Processor Allocation Policies for Message-Passing Parallel Computers. In Proceedings of the 1994 ACM SIGMETRICS Conference on Measurement and Modeling of Computer Systems, pages 19-32, Feb. 1994.
31. C. McCann and J. Zahorjan. Scheduling Memory Constrained Jobs on Distributed Memory Parallel Computers. In Proceedings of ACM SIGMETRICS'95/PERFORMANCE'95 Joint International Conference on Measurement and Modeling of Computer Systems, pages 208-219, May 1995.
32. L. McVoy and C. Staelin. lmbench: Portable Tools for Performance Analysis. In Proceedings of the 1996 Winter USENIX, Jan. 1996.
33. V. K. Naik, S. K. Setia, and M. S. Squillante. Performance Analysis of Job Scheduling Policies in Parallel Supercomputing Environments. In Proceedings of Supercomputing '93, pages 824-833, Nov. 1993.
34. A. Olson and K. G. Shin. Fault-tolerant Clock Synchronization in Large Multicomputer Systems. IEEE Transactions on Parallel and Distributed Systems, 5(9):912-923, Sept. 1994.
35. J. K. Ousterhout. Scheduling Techniques for Concurrent Systems. In Third International Conference on Distributed Computing Systems, pages 22-30, May 1982.
36. V. G. Peris, M. S. Squillante, and V. K. Naik. Analysis of the Impact of Memory in Distributed Parallel Processing Sytems. In 1994 ACM BIOMETRICS Conference on Measurement and Modeling of Computer Systems, pages 5-18, Feb. 1994.
37. K. C. Sevcik. Characterizations of Parallelism in Applications and their Use in Scheduling. In Proceedings of the 1989 ACM SIGMETRICS Conference on Measurement and Modeling of Computer Systems, pages 171-180, May 1989.
38. J. P. Singh, W.-D. Weber, and A. Gupta. SPLASH: Stanford Parallel Applications for Shared Memory. Computer Architecture News, 20(1):5-44, Mar. 1992.
39. P. G. Sobalvarro and W. E. Weihl. Demand-based Coscheduling of Parallel Jobs on Multiprogrammed Multiprocessors. In Proceedings of the IPPS '95 Workshop on Job Scheduling Strategies for Parallel Processing, pages 63-75, Apr. 1995.
40. T. von Eicken, A. Basu, V. Buch, and W. Vogels. U-Net: A User-Level Network Interface for Parallel and Distributed Computing. In Proceedings of the Fifteenth ACM Symposium on Operating System Principles, pages 40-51, Dec. 1995.
41. T. von Eicken, D. E. Culler, S. C. Goldstein, and K. E. Schauser. Active Messages: a Mechanism for Integrated Communication and Computation. In Proceedings of the 19th International Symposium on Computer Architecture, May 1992.
42. R. W. Wisniewski, L. I. Kontothanassis, and M. L. Scott. High Performance Synchronization Algorithms for Multiprogrammed Multiprocessors. In Proceedings of the Fifth ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, pages 199-206, July 1995.
43. J. Zahorjan and E. D. Lazowska. Spinning Versus Blocking in Parallel Systems with Uncertainty. In Proceedings of the IFIP International Seminar on Performance of Distributed and Parallel Systems, pages 455-472, Dec. 1988.