Performance analysis of message-passing libraries on high-speed clusters

Computer Systems Science and Engineering

Volumn 25, Issue 1, 2010, Pages 63-78

  Taboada, Guillermo L ^a   Touriño, Juan ^a   Doallo, Ramón ^a  

^a UNIVERSITY OF A CORUÑA   (Spain)

Author keywords

Cluster; Java; Message passing; MPI; Myrinet; Performance analysis; SCI

Indexed keywords

APPLICATION PERFORMANCE; CLUSTER PERFORMANCE; COMMUNICATION MODELS; COMMUNICATION OVERHEADS; COMMUNICATION PERFORMANCE; EVALUATION PROCESS; HIGH-SPEED; LINEAR MODEL; MICRO-BENCHMARK; MODEL-BASED; MULTIPLE PROCESSORS; MYRINET; PARALLEL APPLICATION; PERFORMANCE ANALYSIS; PERFORMANCE METRICS; PERFORMANCE MODEL; PERFORMANCE OPTIMIZATIONS;

BENCHMARKING; COMMUNICATION; INFORMATION THEORY; LIBRARIES;

MESSAGE PASSING;

EID: 77949870137     PISSN: 02676192     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (27)

1. M. Lobosco, C. L. de Amorim, and O. Loques. Java for High-Performance Network-Based Computing: a Survey. Concurrency and Computation: Practice and Experience, 14(1): 1-31, 2002.
2. D. Culler, R. Karp, D. Patterson, A. Sahay, K. E. Schauser, E. Santos, R. Subramonian and T. von Eicken. LogP: Towards a Realistic Model of Parallel Computation. In Proc. 4th ACM SIGPLAN Symp. on Principles and Practice of Parallel Programming (PPoPP'93), pages 1-12, San Diego, CA, 1993.
3. A. Alexandrov, M. F. Ionescu, K. E. Schuser and C. Scheiman. LogGP: Incorporating Long Messages into the LogP Model -one Step Closer Towards a Realistic Model for Parallel Computation. Journal of Parallel and Distributed Computing, 44(1): 71-79, 1997.
4. M. I. Frank, A. Agarwal and M. K. Vernon. LoPC: Modeling Contention in Parallel Algorithms. In Proc. 6th ACM SIGPLAN Symp. on Principles and Practice of Parallel Programming (PPoPP'97), pages 276-287, Las Vegas, NV, 1997.
5. C. A. Moritz and M. Frank. LoGPC: Modeling Network Contention in Message-Passing Programs. IEEE Transactions on Parallel and Distributed Systems, 12(4): 404-415, 2001.
6. F. Ino, N. Fujimoto and K. Hagihara. LogGPS: A Parallel Computational Model for Synchronization Analysis. In Proc. 8th ACM SIGPLAN Symp. on Principles and Practice of Parallel Programming (PPoPP'01), pages 133-142, Snowbird, UT, 2001.
7. Y. Touyama and S. Horiguchi. Performance Evaluation of Practical Parallel Computation Model LogPQ. In Proc. 1999 IEEE Int. Symp. on Parallel Architectures, Algorithms and Networks (IS-PAN'99), pages 215-221, Fremantle, Australia, 1999.
8. K. W. Cameron and X.-H. Sun. Quantifying Locality Effect in Data Access Delay: Memory logP. In Proc. 17th Int. Parallel & Distributed Processing Symp. (IPDPS'03), page 48 (8 pages), Nice, France, 2003.
9. T. Kielmann, H. Bal, S. Gorlatch, K. Verstoep, and R. Hofman. Network Performance-aware Collective Communication for Clustered Wide Area Systems. Parallel Computing,21(11): 1431-1456, 2001.
10. K. W. Cameron and R. Ge. Predicting and Evaluating Distributed Communication Performance. In Proc. 16th Int. Conf. on High Performance Computing and Communications (SC04), page 43 (15 pages), Pittsburgh, PA, 2004.
11. B. A. Vianna, A. A. Fonseca, N. T. Moura, L. T. Mendes, J. A. Silva, C. Boeres and V. E. F. Rebello. A Tool for the Design and Evaluation of Hybrid Scheduling Algorithms for Computational Grids. In Proc. 2nd ACM Workshop on Middleware for Grid Computing (MGC'04), pages 41-46, Toronto, Canada, 2004.
12. J. Touriño and R. Doallo. Characterization of Message-Passing Overhead on the AP3000 Multicomputer. In 30th Int. Conference on Parallel Processing (ICPP'01), pages 321-328, Valencia, Spain, 2001.
13. G. L. Taboada, J. Touriño, and R. Doallo. Performance Analysis of Java Message-Passing Libraries on Fast Ethernet, Myrinet and SCI Clusters. In Proc. 5th IEEE Int. Conf. on Cluster Computing (CLUSTER'03), pages 118-126, Hong Kong, China, 2003.
14. M. Baker and B. Carpenter. MPJ: a Proposed Java Message Passing API and Environment for High Performance Computing. In Proc. 2nd Int. Workshop on Java for Parallel and Distributed Computing (JAVAPDC'00), LNCS 1800, Springer-Verlag, pages 552-559, Cancún, Mexico, 2000.
15. M. Baker, B. Carpenter, G. Fox, S. Ko, and S. Lim. mpiJava: an Object-Oriented Java Interface to MPI. In Proc. 1st Int. Workshop on Java for Parallel and Distributed Computing (JAVAPDC'99), LNCS 1586, Springer-Verlag, pages 748-762, San Juan, Puerto Rico, 1999.
16. M. Bornemann, R. V. van Nieuwpoort, and T. Kielmann. MPJ/Ibis: A Flexible and Efficient Message Passing Platform for Java. In Proc. 12th European PVM/MPI Users' Group Meeting, (PVM/MPI'05), LNCS 3666, Springer-Verlag, pages 217-224, Sorrento, Italy, 2005.
17. M. Baker, B. Carpenter, and A. Shafi. MPJ Express: Towards Thread Safe Java HPC. In Proc. 8th IEEE Int. Conference on Cluster Computing (CLUSTER'06), pages 1-8, Barcelona, Spain, 2006.
18. R. V. van Nieuwpoort, J. Maassen, G. Wrzesinska, R. Hofman, C. Jacobs, T. Kielmann, and H. Bal. Ibis: a Flexible and Efficient Java-based Grid Programming Environment. Concurrency and Computation: Practice & Experience, 17(7-8): 1079-1107, 2005.
19. A. Nelisse, J. Maassen, T. Kielmann, and H.E. Bal. CCJ: ObjectBased Message Passing and Collective Communication in Java. Concurrency and Computation: Practice & Experience, 15(3-5): 341-369, 2003.
20. S. Morin, I. Koren, and C. M. Krishna. JMPI: Implementing the Message Passing Standard in Java. In Proc. 4th Int. Workshop on Java for Parallel and Distributed Computing (JAVAPDC'02), pages 118-123, Fort Lauderdale, FL, 2002.
21. R. Thakur, R. Rabenseifner, and W. Gropp. Optimization of Collective Communication Operations in MPICH. Int. Journal of High Performance Computing Applications, 19(1): 49-66, 2005.
22. S. S. Vadhiyar, G. E. Fagg, and J. J. Dongarra. Towards an Accurate Model for Collective Communications. Int. Journal of High Performance Computing Applications, 18(1): 159-167, 2004.
23. L. A. Barchet-Estefanel and G. Mounie. Fast Tuning of Intra-cluster Collective Communications. In Proc. 11th European PVM/MPI Users' Group Meeting (PVM/MPI'04), LNCS 3241, SpringerVerlag, pages 28-35, Budapest, Hungary, 2004.
24. L. A. Smith, J. M. Bull, and J. Obdržálek. A Parallel Java Grande Benchmark Suite. In Proc. of the 2001 ACM/IEEE Conf. on Supercomputing (SC'01), page 8 (10 pages), Denver, CO, 2001.
25. J. A. Mathew, P. D. Coddington, and K. A. Hawick. Analysis and Development of Java Grande Benchmarks. In Proc. of the ACM 1999 Conference on Java Grande (JAVA '99), pages 72-80, San Francisco, CA, 1999.
26. S. G. Caglar, G. D. Benson, Q. Huang, and C.-W. Chu. USFMPI: A Multi-threaded Implementation of MPI for Linux Clusters. In Proc. 15th Int. Conf. on Parallel and Distributed Computing and Systems (PDCS'03), pages 674-680, Marina del Rey, CA, 2003.
27. A. A. G. Alves, A. Pina, J. L. P. Exposto, and J. Rufino. Scalable Multithreading in a Low Latency Myrinet Cluster. In Proc. 5th Int. Conf. on High Performance Computing in Computational Sciences (VECPAR'02), LNCS 2565, Springer-Verlag, pages 579-592, Porto, Portugal, 2002.