Cluster communication protocols for parallel-programming systems

ACM Transactions on Computer Systems

Volumn 22, Issue 3, 2004, Pages 281-325

  Verstoep, Kees ^a   Bhoedjang, Raoul A F ^a   Rühl, Tim ^a   Bal, Henri E ^a   Hofman, Rutger F H ^a  

^a VU UNIVERSITY AMSTERDAM   (Netherlands)

Author keywords

Clusters; Parallel programming systems; System area networks

Indexed keywords

CLUSTERS; HOST PROCESSORS; PARALLEL PROGRAMMING SYSTEMS; SYSTEMS AREA NETWORK;

BENCHMARKING; COMMUNICATION SYSTEMS; COMPUTER PROGRAMMING; DATA STORAGE EQUIPMENT; DATA TRANSFER; DISTRIBUTED COMPUTER SYSTEMS; INTERCONNECTION NETWORKS; INTERFACES (COMPUTER); PARALLEL PROCESSING SYSTEMS;

NETWORK PROTOCOLS;

EID: 4444332600     PISSN: 07342071     EISSN: None     Source Type: Journal    
DOI: 10.1145/1012268.1012269     Document Type: Review

References (47)

1. ARAKI, S., BILAS, A., DUBNICKI, C., EDLER, J., KONISHI, K., AND PHILBIN, J. 1998. User-space communication: A quantitative study. In Proceedings of Supercomputing'98 (Orlando, Fla.).
2. AUMAGE, O., BOUGÉ, L., DENIS, A., MÉHAUT, J.-F., MERCIER, G., NAMYST, R., AND PRYLLI, L. 2000. A portable and efficient communication library for high-performance cluster computing. In Proceedings of the IEEE International Conference on Cluster Computing. IEEE Computer Society Press, Los Alamitos, Calif., 78-87.
3. BAL, H., BHOEDJANG, R., HOFMAN, R., JACOBS, C., LANGENDOEN, K., RÜHL, T., AND KAASHOEK, M. 1998. Performance evaluation of the Orca shared object system. ACM Trans. Comput. Syst. 16, 1 (Feb.), 1-40.
4. BEGEL, A., BUONADONNA, P., CULLER, D., AND GAY, D. 2002. An analysis of VI architecture primitives in support of parallel and distributed communication. Concurr. Comput.: Pract. Exper. 14, 1 (Jan.), 55-76.
5. BHOEDJANG, R., RÜHL, T., AND BAL, H. 1998a. Efficient multicast on Myrinet using link-level flow control. In Proceedings of the 27th International Conference on Parallel Processing (ICPP). (Minneapolis, Minn.). 381-390.
6. BHOEDJANG, R., RÜHL, T., AND BAL, H. 1998b. User-level network interface protocols. IEEE Comput. 31, 11 (Nov.), 53-60.
7. BHOEDJANG, R., VERSTOEP, K. BAL, H., AND RÜHL, T. 2000a. Reducing data and control transfer overhead through network-interface support. In Proceedings of the 1st Myrinet User Group Conference (Lyon, France).
8. BHOEDJANG, R., VERSTOEP, K., RÜHL, T., BAL, H., AND HOFMAN, R. 2000b. Evaluating design alternatives for reliable communication on high-speed networks. In Proceedings of the 9th International Conference on Architectural Support for Programming Languages and Operating Systems (ASP-LOS) (Cambridge, Mass.). 71-81.
9. BILAS, A., JIANG, D., ZHOU, Y., AND SINGH, J. 1999a. Limits to the performance of software shared memory: A layered approach. In Proceedings of the 5th International Symposium on High-Performance Computer Architecture (HPCA). (Orlando, Fla.). 193-202.
10. BILAS, A., LIAO, C., AND SINGH, J. 1999b. Using network interface support to avoid asynchronous protocol processing in shared virtual memory systems. In Proceedings of the 26th International Symposium on Computer Architecture (ISCA) (Atlanta, Ga.). 282-293.
11. BODEN, N., COHEN, D., FELDERMAN, R., KULAWIK, A., SEITZ, C., SEIZOVIC, J., AND SU, W. 1995. Myrinet: A gigabit-per-second local area network. IEEE Micro 15, 1 (Feb.), 29-36.
12. BUZZARD, G., JACOBSON, D., MACKEY, M., MAROVICH, S., AND WILKES, J. 1996. An implementation of the Hamlyn sender-managed interface architecture. In Proceedings of the 2nd USENIX Symposium on Operating Systems Design and Implementation (OSDI) (Seattle, Wa.). 245-259.
13. CANONICO, R., CRISTALDI, R., AND IANNELLO, G. 1999. A scalable flow control algorithm for the Fast Messages communication library. In Proceedings of the Workshop on Communication, Architecture, and Applications for Network-Based Parallel Computing (CANPC) (Orlando, Fla.). 77-90.
14. CHANG, C.-C., CZAJKOWSKI, G., HAWBLITZEL, C., AND VON EICKEN, T. 1996. Low-latency communication on the IBM RISC System/6000 SP. In Proceedings of Supercomputing '96 (Pitsburgh, Pa.).
15. CHEN, Y., BILAS, A., DAMIANAKIS, S., AND DUBNICKI, C. 1998. UTLB: A mechanism for address translation on network interfaces. In Proceedings of the 8th International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) (San Jose, Calif.). 193-204.
16. CHUN, B., MAINWARING, A., AND CULLER, D. 1997. Virtual network transport protocols for Myrinet. In Proceedings of Hot Interconnects V (Stanford, Calif.).
17. CULLER, D., LIU, L., MARTIN, R., AND YOSHIKAWA, C. 1996. Assessing fast network interfaces. IEEE Micro 16, 1 (Feb.), 35-43.
18. DRUSCHEL, P., PETERSON, L., AND DAVIE, B. 1994. Experiences with a high-speed network adaptor: A software perspective. In Proceedings of the 1994 Conference on Communications Architectures, Protocols, and Applications (SIGCOMM) (London, U.K.). ACM New York, 2-12.
19. DUBNICKI, C., BILAS, A., CHEN, Y., DAMIANAKIS, S., AND LI, K. 1997a. VMMC-2: Efficient support for reliable, connection-oriented communication. In Proceedings of Hot Interconnects V (Stanford, Calif.).
20. DUBNICKI, C., BILAS, A., LI, K., AND PHILBIN, J. 1997b. Design and implementation of virtual memory-mapped communication on Myrinet. In Proceedings of the 11th Int. Parallel Processing Symp. (IPPS) (Geneva, Switzerland). 388-396.
21. FILLO, M. AND GILLETT, R. 1997. Architecture and implementation of Memory Channel 2. Dig. Tech. J. 9, 1, 27-41.
22. FRANK, M., AGARWAL, A., AND VERNON, M. 1997. LoPC: Modeling contention in parallel algorithms. In Proceedings of the 6th Symposium on Principles and Practice of Parallel Programming (PPOPP) (Las Vegas Nev.). 276-287.
23. GROPP, W., LUSK, E., DOSS, N., AND SKJELLUM, A. 1996. A high-performance, portable implementation of the MPI message passing interface standard. Paral. Comput. 22, 6 (Sept.), 789-828.
24. HUANG, Y. AND MCKINLEY, P. 1996. Efficient collective operations with ATM network interface support. In Proceedings of the 25th International Conference on Parallel Processing (ICPP) (Bloomingdale, Ill.). 34-43.
25. INFINIBAND TRADE ASSOCIATION. 2002. InfiniBand Architecture Specification Release 1.1. Available from http://www.infinibandta.org.
26. JOHNSON, K., KAASHOEK, M., AND WALLACH, D. 1995. CRL: High-performance all-software distributed shared memory. In Proceedings of the 15th Symposium on Operating Systems Principles (SOSP) (Copper Mountain, Col). 213-226.
27. KARAMCHETI, V. AND CHIEN, A. 1994. Software overhead in messaging layers: Where does the time go? In Proceedings of the 6th International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) (San Jose, Calif.). 51-60.
28. KESAVAN, R. AND PANDA, D. 1997. Optimal multicast with packetization and network interface support. In Proceedings of the 26th International Conference on Parallel Processing (ICPP) (Bloomingdale, Ill.). 370-377.
29. KIELMANN, T., BAL, H., GORLATCH, S., VERSTOEP, K., AND HOFMAN, R. 2001. Network performance-aware collective communication for clustered wide area systems. Paral. Comput. 27, 11, 1431-1456.
30. KRISHNAMURTHY, A., SCHAUSER, K., SCHEIMAN, C., WANG, R., CULLER, D., AND YELICK, K. 1996. Evaluation of architectural support for global address-based communication in large-scale parallel machines. In Proceedings of the 7th International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) (Cambridge, Mass.). 37-48.
31. MAQUELIN, O., GAO, G., HUM, H., THEOBALD, K., AND TIAN, X. 1996. Polling watchdog: Combining polling and interrupts for efficient message handling. In Proceedings of the 23rd International Symposium on Computer Architecture (ISCA) (Philadelphia, Pa.). 179-188.
32. MARTIN, R., VAHDAT, A., CULLER, D., AND ANDERSON, T. 1997. Effects of communication latency, overhead, and bandwidth in a cluster architecture. In Proceedings of the 24th International Symposium on Computer Architecture (ISCA) (Denver Colo.). 85-97.
33. MPI FORUM. 1994. A message passing interface standard. Int. J. Supercomput. Appl. 8, 3/4.
34. PAKIN, S., LAURIA, M., AND CHIEN, A. 1995. High performance messaging on workstations: Illinois Fast Messages (FM) for Myrinet. In Proceedings of Supercomputing '95 (San Diego, Calif.).
35. PETRINI, F., FENG, W., HOISIE, A., COLL, S., AND FRACHTENBERG, E. 2001. Quadrics network (QsNet): High-performance clustering technology. In Proceedings of Hot Interconnects IX (Stanford, Calif.).
36. PRYLLI, L., TOURANCHEAU, B., AND WESTRELIN, R. 1999. The Design for a high-performance MPI implementation on the Myrinet network. In Proceedings 6th European PVM/MPI Users' Group (Barcelona, Spain). Lecture Notes in Computer Science, vol. 1697 Springer Verlag, New York, 223-230.
37. ROMEIN, J. AND BAL, H. 2003. Solving the game of Awari using parallel retrograde analysis. IEEE Comput. 36, 10 (Oct.), 26-33.
38. ROMEIN, J., BAL, H., SCHAEFFER, J., AND PLAAT, A. 2002. A performance analysis of transposition-table-driven scheduling in distributed search. IEEE Trans. Parall. Distrib. Syst. 13, 5 (May), 447-459.
39. SPEIGHT, E., ABDEL-SHAFI, H., AND BENNETT, J. 1999. Realizing the performance potential of the Virtual Interface architecture. In Proceedings of the 13th International Conference on Supercomputing (ICS). Rhodes, Greece, 184-192.
40. TANG, J. AND BILAS, A. 2002. Tolerating network failures in system area networks. In Proceedings of the 2002 International Conference on Parallel Processing (ICPP) (Vancouver, B. C., Canada), 121-130.
41. TEZUKA, H., HORI, A., ISHIKAWA, Y., AND SATO, M. 1997. PM: An operating system coordinated high-performance communication library. In High-Performance Computing and Networking (Vienna, Austria) Lecture Notes in Computer Science, vol. 1225.
42. TEZUKA, H., O'CARROLL, F., HORI, A., AND ISHIKAWA, Y. 1998. Pin-down cache: A virtual memory management technique for zero-copy communication. In Proceedings of the 12th International Parallel Processing Symposium (IPPS) (Orlando, Fla.). 308-314.
43. VERSTOEP, K., LANGENDOEN, K., AND BAL, H. 1996. Efficient reliable multicast on Myrinet. In Proceedings of the 25th International Conference on Parallel Processing (ICPP) (Bloomingdale, Ill.). 156-165.
44. VON EICKEN, T., BASU, A., BUCH, V., AND VOGELS, W. 1995. U-Net: A user-level network interface for parallel and distributed computing. In Proceedings of the 15th Symposium on Operating Systems Principles (SOSP) (Copper Mountain, Colo.), 303-316.
45. VON EICKEN, T., CULLER, D., GOLDSTEIN, S., AND SCHAUSER, K. 1992. Active messages: A mechanism for integrated communication and computation. In Proceedings of the 19th International Symposium on Computer Architecture (ISCA) (Gold Coast, Australia). 256-266.
46. WANG, R., KRISHNAMURTHY, A., MARTIN, R., ANDERSON, T., AND CULLER, D. 1998. Modeling and optimizing communication pipelines. In Proceedings of the 1998 Conference on Measurement and Modeling of Computer Systems (SIGMETRICS) (Madison, W. Sc.). 22-32.
47. WELSH, M., BASU, A., AND VON EICKEN, T. 1997. Incorporating memory management into user-level network interfaces. In Proceedings of Hot Interconnects V (Stanford, Calif.)