Highly efficient gang scheduling implementation

Proceedings of the International Conference on Supercomputing

Volumn 1998-November, Issue , 1998, Pages

  Hori, Atsushi ^a   Tezuka, Hiroshi ^a   Ishikawa, Yutaka ^a  

^a Real World Computing Partnership   (Japan)

Author keywords

Distributed termination detection; Gang scheduling; Network preemption; User level communication

Indexed keywords

PARALLEL PROGRAMMING;

BENCHMARK PROGRAMS; DISTRIBUTED TERMINATION; DISTRIBUTED TERMINATION DETECTION; GANG SCHEDULING; GLOBAL STATE; NAS PARALLEL BENCHMARKS; NETWORK CONTEXTS; NETWORK PREEMPTION; TERMINATION DETECTION; USER-LEVEL COMMUNICATION;

SCHEDULING;

EID: 85117213324     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/SC.1998.10007     Document Type: Conference Paper

References (22)

1. M. J. Bach. The Design of The UNIX Operating System. Prentice-Hall, 1986.
2. D. H. Bailey, J. T. Barton, T. A. Lasinski, and H. D. Simon. The NAS Parallel Benchmarks. NASA Technical Memorandum 103863, NASA Ames Research Center, 1993.
3. N. J. Boden, D. Cohen, R. E. Felderman, A. E. Kulawik, C. L. Seitz, J. N. Seizovic, and W.K. Su. Myrinet: A Gigabit-per-Second Local Area Network. IEEE Micro, 15(1):29-36, February 1995.
4. M. Chandy and L. Lamport. Distributed snapshot: Determining global states of distributed systems. ACM Transactions on Computer Systems, 3(1):63-75, February 1985.
5. B. N. Chun, A. M. Mainwaring, and D. E. Culler. Virtual Network Transport Protocols for Myrinet. In Hot Interconnect'97, August 1997.
6. D. G. Feitelson and L. Rudolph. Gang Scheduling Performance Benefits for Fine-Grain Synchronization. Journal of Parallel and Distributed Computing, 16(4):306-318, 1992.
7. H. Franke, P. Pattnaik, and L. Rudolph. Gang Scheduling for Highly Efficient Distributed Multiprocessor Systems. In Frontier'96, pages 1-9, October 1996.
8. A. Gupta, A. Tucker, and S. Urushibara. The Impact of Operating System Scheduling Policies and Synchronization Methods on the Performance of Parallel Applications. In ACM SIGMETRICS, pages 120-132, 1991.
9. A. Hori, H. Tezuka, and Y. Ishikawa. Global State Detection using Network Preemption. In D. G. Feitelson and L. Rudolph, editors, IPPS'97 Workshop on Job Scheduling Strategies for Parallel Processing, volume 1291 of Lecture Notes in Computer Science, pages 262-276. Springer-Verlag, April 1997.
10. A. Hori, H. Tezuka, Y. Ishikawa, N. Soda, H. Konaka, and M. Maeda. Implementation of Gang-Scheduling on Workstation Cluster. In D. G. Feitelson and L. Rudolph, editors, IPPS'96 Workshop on Job Scheduling Strategies for Parallel Processing, volume 1162 of Lecture Notes in Computer Science, pages 76-83. Springer-Verlag, April 1996.
11. A. Hori, H. Tezuka, F. O'Carroll, and Y. Ishikawa. Gang Scheduling vs. Coscheduling: A Comparison with Data-Parallel Workload. In H. R. Arabnia, editor, Proceedings of the International Conference on Parallel and Distributed Processing Techniques and Applications, volume II, pages 1050-1057, July 1998.
12. A. Hori, H. Tezuka, F. O'Carroll, and Y. Ishikawa. Overhead Analysis of Preemptive Gang Scheduling. In D. G. Feitelson and L. Rudolph, editors, IPPS'98 Workshop on Job Scheduling Strategies for Parallel Processing, volume 1459 of Lecture Notes in Computer Science. Springer-Verlag, April 1998.
13. Intel Corporation. Pentium Pro Family Developer's Manual Volume 3 Operating System Writer's Guide, December 1995.
14. Y. Ishikawa. Multi Thread Template Library - MPC Version 2.0 Level 0 Document -. Technical Report TR-96012, RWC, September 1996.
15. M. A. Jette. Performance Characteristics of Gang Scheduling in Multiprogrammed Environments. In SC97, November 1997.
16. J. Misra. Detecting termination of distributed computations using markers. In Second ACM Symposium on Principles Distributed Computing, pages 290-294, August 1983.
17. J. K. Ousterhout. Scheduling Techniques for Concurrent Systems. In Proceedings of Third International Conference on Distributed Computing Systems, pages 22-30, 1982.
18. S. Pakin, M. Lauria, and A. Chien. High Performance Messaging on Workstations: Illinoi Fast Messages (FM) for Myrinet. In Supercomputing'95, December 1995.
19. H. Tezuka, A. Hori, Y. Ishikawa, and M. Sato. PM: An Operating System Coordinated High Performance Communication Library. In P. S. Bob Hertzberger, editor, High-Performance Computing and Networking, volume 1225 of Lecture Notes in Computer Science, pages 708-717. Springer-Verlag, April 1997.
20. H. Tezuka, F. O'Carroll, A. Hori, and Y. Ishikawa. Pin-down Cache: A Virtual Memory Management Technique for Zero-copy Communication. In IPPS/SPDP'98, pages 308-314. IEEE, April 1998.
21. Thinking Machines Corporation. NI Systems Programming, October 1992. Version 7.1.
22. T. von Eicken, A. Basu, and W. Vogels. U-Net: A User Level Network Interface for Parallel and Distributed Computing. In Fifteenth ACM Sumposium on Operating Systems Principles, pages 40-53, 1995.