Dodging non-uniform I/O access in hierarchical collective operations for multicore clusters

IEEE International Symposium on Parallel and Distributed Processing Workshops and Phd Forum

Volumn , Issue , 2011, Pages 788-794

  Goglin, Brice ^a   Moreaud, Stéphanie ^a  

^a UNIVERSITÉ DE BORDEAUX   (France)

Author keywords

[No Author keywords available]

Indexed keywords

BROADCAST OPERATIONS; CLUSTER TOPOLOGY; COLLECTIVE OPERATIONS; HYPERTRANSPORT; I/O DEVICE; INPUT/OUTPUT; MEMORY BANKS; MULTI-CORE CLUSTER; MULTIPLE STRATEGY; NETWORK ACCESS; NON UNIFORM MEMORY ACCESS; SCALABILITY ISSUE; SINGLE PROCESSORS; THROUGHPUT IMPROVEMENT;

DISTRIBUTED PARAMETER NETWORKS;

MEMORY ARCHITECTURE;

EID: 83455229663     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IPDPS.2011.222     Document Type: Conference Paper

References (16)

1. R. Yang, J. Antony, P. P. Janes, and A. P. Rendell, "Memory and Thread Placement Effects as a Function of Cache Usage: A Study of the Gaussian Chemistry Code on the SunFire X4600 M2," in Proceedings of the International Symposium on Parallel Architectures, Algorithms, and Networks (i-span 2008), 2008, pp. 31-36.
2. S. Moreaud and B. Goglin, "Impact of NUMA Effects on High-Speed Networking with Multi-Opteron Machines," in The 19th IASTED International Conference on Parallel and Distributed Computing and Systems (PDCS 2007). Cambridge, USA: ACTA Press, Nov. 2007. [Online]. Available: http://hal.inria.fr/ inria-00175747
3. S. Moreaud, B. Goglin, and R. Namyst, "Adaptive MPI Multirail Tuning for Non-Uniform Input/Output Access," in Recent Advances in the Message Passing Interface. The 17th European MPI User's Group Meeting (EuroMPI 2010), ser. Lecture Notes in Computer Science, E. G. Rainer Keller and J. Dongarra, Eds., vol. 6305. Stuttgart, Germany: Springer-Verlag, Sep. 2010, pp. 239-248. [Online]. Available: http://hal.inria.fr/inria-00486178
4. C. N. Keltcher, K. J. McGrath, A. Ahmed, and P. Conway, "The AMD Opteron Processor for Multiprocessor Servers," IEEE Micro, vol. 23, no. 2, pp. 66-76, Mar. 2003.
5. I. Corp., "An Introduction to the Intel QuicPath Interconnect," Jan. 2009. [Online]. Available: http://www.intel.com/technology/quickpath/ introduction.pdf
6. E. Jeannot and G. Mercier, "Near-optimal placement of MPI processes on hierarchical NUMA architecture," in Proceedings of the 16th International Euro-Par Conference, Lecture Notes in Computer Science, ser. Lecture Notes in Computer Science, vol. 6272. Ischia, Italy: Springer, Aug. 2010.
7. R. Thakur and W. Gropp, "Improving the Performance of Collective Operations in MPICH," in Proceedings of the 10th European PVM/MPI Users' Group Meeting (Euro PVM/MPI 2003), Recent Advances in Parallel Virtual Machine and Message Passing Interface, ser. Lecture Notes in Computer Science, vol. 2840. Venice, Italy: Springer, Sep. 2003, pp. 257-267.
8. R. L. Graham and G. Shipman, "MPI Support for Multi-core Architectures: Optimized Shared Memory Collectives," in Proceedings of the 15th European PVM/MPI Users' Group Meeting, Recent Advances in Parallel Virtual Machine and Message Passing Interface, ser. Lecture Notes In Computer Science, vol. 5208. Dublin, Ireland: Springer-Verlag, Sep. 2008, pp. 130-140.
9. A. R. Mamidala, R. Kumar, D. De, and D. K. Panda, "MPI Collectives on Modern Multicore Clusters: Performance Optimizations and Communication Characteristics," in Proceedings of the Int'l Symposium on Cluster Computing and the Grid (CCGrid). Lyon, France: IEEE Computer Society Press, May 2008.
10. R. Kumar, A. Mamidala, and D. K. Panda, "Scaling Alltoall Collective on Multi-core Systems," in Workshop on Communication Architecture for Clusters, held in conjunction with IPDPS '08. Miami, USA: IEEE Computer Society Press, Apr. 2008.
11. E. Gabriel, G. E. Fagg, G. Bosilca, T. Angskun, J. J. Dongarra, J. M. Squyres, V. Sahay, P. Kambadur, B. Barrett, A. Lumsdaine, R. H. Castain, D. J. Daniel, R. L. Graham, and T. S. Woodall, "Open MPI: Goals, concept, and design of a next generation MPI implementation," in Proceedings, 11th European PVM/MPI Users' Group Meeting, Budapest, Hungary, Sep. 2004, pp. 97-104.
12. J. M. Squyres and A. Lumsdaine, "The component architecture of open MPI: Enabling third-party collective algorithms," in Proceedings, 18th ACM International Conference on Supercomputing, Workshop on Component Models and Systems for Grid Applications, V. Getov and T. Kielmann, Eds. St. Malo, France: Springer, July 2004, pp. 167-185.
13. G. Fagg, G. Bosilca, J. Pjeivac-Grbovi, T. Angskun, and J. Dongarra, "Tuned: An Open MPI Collective Communications Component," in Distributed and Parallel Systems, P. Kacsuk, T. Fahringer, and Z. Nmeth, Eds. Springer, 2007, pp. 65-72.
14. "Intel MPI Benchmarks," http://software.intel.com/en-us/ articles/intel-mpi-benchmarks/.
15. H.-C. Jang and H.-W. Jin, "MiAMI: Multi-core Aware Processor Affinity for TCP/IP over Multiple Network Interfaces," in Proceedings of the 17th Annual Symposium on HighPerformance Interconnects (HotI'09), New York, USA, Aug. 2009, pp. 73-82.
16. K. Kandalla, H. Subramoni, G. Santhanaraman, M. Koop, and D. K. Panda, "Designing Multi-Leader-Based Allgather Algorithms for Multi-Core Clusters," in CAC 2009: The 9th Workshop on Communication Architecture for Clusters, held in conjunction with IPDPS 2009. Roma, Italy: IEEE Computer Society Press, May 2009.