Optimizing collective communication on multicores

1st USENIX Workshop on Hot Topics in Parallelism, HotPar 2009

Volumn , Issue , 2009, Pages

  Nishtala, Rajesh ^a   Yelick, Katherine A ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

SEMANTICS;

APPLICATION PERFORMANCE; AUTOMATIC TUNING TECHNIQUES; COLLECTIVE COMMUNICATION OPERATIONS; COLLECTIVE COMMUNICATIONS; COMMUNICATION COMPONENTS; COMMUNICATION OPERATION; MULTI-CORE SYSTEMS; PARTITIONED GLOBAL ADDRESS SPACE;

SYNCHRONIZATION;

EID: 85092794892     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (21)

1. Intel Xeon Quad Processor. http://www.intel.com/products/processor/xeon5000.
2. Sun Fire X4600 M2 Server Information. http://www.sun.com/servers/x64/x4600/.
3. Sun Ultra Sparc T2 Processor Information. http://www.sun.com/processors/UltraSPARC-T2/.
4. ALMÁSI, G., HEIDELBERGER, P., ARCHER, C. J., MARTORELL, X., ERWAY, C. C., MOREIRA, J. E., STEINMACHERBUROW, B., AND ZHENG, Y. Optimization of mpi collective communication on BlueGene/L systems. In ICS '05: Proceedings of the 19th annual international conference on Supercomputing (New York, NY, USA, 2005), ACM Press, pp. 253-262.
5. ASANOVIC, K., BODIK, R., CATANZARO, B. C., GEBIS, J. J., HUSBANDS, P., KEUTZER, K., PATTERSON, D. A., PLISHKER, W. L., SHALF, J., WILLIAMS, S. W., AND YELICK, K. A. The landscape of parallel computing research: A view from berkeley. Tech. Rep. UCB/EECS-2006-183, EECS Department, University of California, Berkeley, Dec 2006.
6. BALAJI, P., BUNTINAS, D., BALAY, S., SMITH, B., THAKUR, R., AND GROPP, W. Nonuniformly communicating noncontiguous data: A case study with petsc and mpi. In IEEE Parallel and Distributed Processing Symposium (IPDPS) (2006).
7. BELL, C., BONACHEA, D., NISHTALA, R., AND YELICK, K. Optimizing bandwidth limited problems using one-sided communication and overlap. In The 20th Int'l Parallel and Distributed Processing Symposium (IPDPS) (2006).
8. BRUCK, J., HO, C.-T., UPFAL, E., KIPNIS, S., AND WEATHERSBY, D. Efficient algorithms for all-to-all communications in multiport message-passing systems. IEEE Trans. Parallel Distrib. Syst. 8, 11 (1997), 1143-1156.
9. COARFA, C., DOTSENKO, Y., ECKHARDT, J., AND MELLORCRUMMEY, J. Co-array Fortran performance and potential: An NPB experimental study. In 16th Int'l Workshop on Languages and Compilers for Parallel Processing (LCPC) (October 2003).
10. CULLER, D. E., KARP, R. M., PATTERSON, D. A., SAHAY, A., SCHAUSER, K. E., SANTOS, E., SUBRAMONIAN, R., AND VON EICKEN, T. LogP: Towards a realistic model of parallel computation. In Proc. 4th ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming (1993), pp. 1-12.
11. DATTA, K., MURPHY, M., VOLKOV, V., WILLIAMS, S., CARTER, J., OLIKER, L., PATTERSON, D., SHALF, J., AND YELICK, K. Stencil Computation Optimization and Auto-tuning on State-of-the-Art Multicore Architectures. In Supercomputing 2008 (SC08) (November 2008).
12. MAMIDALA, A., KUMAR, R., DE, D., AND PANDA, D. K. Mpi collectives on modern multicore clusters: Performance optimizations and communication characteristics. Int'l Symposium on Cluster Computing and the Grid, Lyon, France (May 2008).
13. MELLOR-CRUMMEY, J. M., AND SCOTT, M. L. Algorithms for scalable synchronization on shared-memory multiprocessors. ACM Trans. Comput. Syst. 9, 1 (1991), 21-65.
14. MPI: A message-passing interface standard, v1.1. Technical report, University of Tennessee, Knoxville, June 12, 1995.
15. NISHTALA, R., ALMASI, G., AND CASCAVAL, C. Performance without pain = productivity: Data layout and collective communication in upc. In Principles and Practices of Parallel Programming (PPoPP) (2008).
16. PJEŠIVAC-GRBOVIĆ, J. Towards Automatic and Adaptive Optimizations of MPI Collective Operations. PhD thesis, University of Tennessee, Knoxville, December 2007.
17. QIAN, Y., AND AFSAHI, A. Efficient rdma-based multi-port collectives on multi-rail qsnetii clusters. In The 6th Workshop on Communication Architecture for Clusters (CAC 2006), In Proceedings of the 20th International Parallel and Distributed Processing Symposium (IPDPS 2006) (2006).
18. UPC language specifications, v1.2. Tech. Rep. LBNL-59208, Berkeley National Lab, 2005.
19. WILLIAMS, S., CARTER, J., OLIKER, L., SHALF, J., AND YELICK, K. Lattice Boltzmann simulation optimization on leading multicore platforms. In Interational Conference on Parallel and Distributed Computing Systems (IPDPS) (2008).
20. WILLIAMS, S., OLIKER, L., VUDUC, R., SHALF, J., YELICK, K., AND DEMMEL, J. Optimization of sparse matrix-vector multiplication on emerging multicore platforms. In Proceedings of Supercomputing 2007 (2007).
21. YELICK, K., SEMENZATO, L., PIKE, G., MIYAMOTO, C., LIBLIT, B., KRISHNAMURTHY, A., HILFINGER, P., GRAHAM, S., GAY, D., COLELLA, P., AND AIKEN, A. Titanium: a high performance java dialect. In Proc. of ACM 1998 Workshop on Java for High-Performance Network Computing (February 1998).