Programming many-core architectures - A case study: Dense matrix computations on the Intel single-chip cloud computer processor

Concurrency and Computation: Practice and Experience

Volumn 24, Issue 12, 2012, Pages 1317-1333

  Marker, Bryan ^a   Chan, Ernie ^a   Poulson, Jack ^b   Van De Geijn, Robert ^a   Van Der Wijngaart, Rob F ^c   Mattson, Timothy G ^c   Kubaska, Theodore E ^d  

^a University of Texas at Austin   (United States)

^b UNIVERSITY OF TEXAS AT AUSTIN   (United States)

^c INTEL CORPORATION   (United States)

^d I Ntel Corporation   (United States)

Author keywords

collective communication; dense linear algebra library; many core architecture

Indexed keywords

CLOUD COMPUTING; COMPUTER PROGRAMMING; MATRIX ALGEBRA; MESSAGE PASSING;

COLLECTIVE COMMUNICATIONS; DENSE LINEAR ALGEBRA; DISTRIBUTED MEMORY; DISTRIBUTED-MEMORY PARALLEL COMPUTERS; MANY-CORE ARCHITECTURE; PROTOTYPE ARCHITECTURE; SINGLE-CHIP CLOUD COMPUTERS; STATE OF THE ART;

MEMORY ARCHITECTURE;

EID: 84864646753     PISSN: 15320626     EISSN: 15320634     Source Type: Journal    
DOI: 10.1002/cpe.1832     Document Type: Article

References (29)

1. Chandrakasan AP, Potkonjak M, Mehra R, Rabaey J, Brodersen RW,. Optimizing power using transformations. IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems 1995; 14 (1): 12-31.
2. Howard J, Dighe S, Hoskote Y, Vangal S, Finan D, Ruhl G, Jenkins D, Wilson H, Borkar N, Schrom G, Pailet F, Jain S, Jacob T, Yada S, Marella S, Salihundam P, Erraguntla V, Konow M, Riepen M, Droege G, Lindemann J, Gries M, Apel T, Henriss K, Lund-larsen T, Steibl S, Borkar S, De V, VanDer Wijngaart R, Mattson T,. A 48-core ia-32 message-passing processor with DVFS in 45nm CMOS, Isscc '10: Proceedings of the international solidstate circuits conference, 2010.
3. Mattson TG, Vander Wijngaart RF, Riepen M, Lehnig T, Brett P, Haas W, Kennedy P, Howard J, Vangal S, Borkar N, Ruhl G, Dighe S,. The 48-core SCC processor: The programmer's view, Sc'10: Proceedings of the 2010 acm/ieee conference on supercomputing, 2010.
4. Poulson J, Marker B, Hammond JR, Romero NA, vande Geijn R,. Elemental: A new framework for distributed memory dense matrix computations. ACM Transactions on Mathematical Software submitted.
5. Vander Wijngaart R, Mattson TG, Haas W,. Light-weight communications on Intel's single-chip cloud computer processor. ACM Operating Systems Review 2011; 45 (1): 73-83.
6. Choi J, Dongarra JJ, Pozo R, Walker DW,. 1992. Scalapack: A scalable linear algebra library for distributed memory concurrent computers, In Proceedings of the fourth symposium on the frontiers of massively parallel computation, IEEE Comput. Soc. Press, 120-127.
7. vande Geijn RA,. Using PLAPACK: Parallel Linear Algebra Package, The MIT Press: Cambridge, 1997.
8. Anderson D, Shanley T,. Pentium Processor System Architecture, Addison Wesley: Boston, MA, USA, 1995.
9. Gropp W, Lusk E, Skjellum A,. Using MPI, The MIT Press: Cambridge, 1994.
10. Dongarra JJ, Bunch JR, Moler CB, Stewart GW,. Linpack Users' Guide, SIAM: Philadelphia, 1979.
11. Lawson CL, Hanson RJ, Kincaid DR, Krogh FT,. Basic linear algebra subprogrm for Fortran usage. ACM Transactions on Mathematical Software 1979; 5 (3): 308-323. (Pubitemid 10415072)
12. Anderson E, Bai Z, Bischof C, Demmel J, Dongarra J, Du Croz J, Greenbaum A, Hammarling S, McKenney A, Blackford S, Sorensen D,. LAPACK Users' Guide, SIAM: Philadelphia, 1987.
13. Dongarra JJ, DuCroz J, Hammarling S, Duff I,. A set of level 3 basic linear algebra subprograms. ACM Transactions on Mathematical Software 1990; 16 (1): 1-17. (Pubitemid 20684794)
14. Dongarra JJ, DuCroz J, Hammarling S, Hanson RJ,. An extended set of FORTRAN basic linear algebra subprograms. ACM Transactions on Mathematical Software 1988; 14 (1): 1-17. (Pubitemid 18618260)
15. Van Zee FG,. libflame: The Complete Reference, 2009. www.lulu.com.
16. Bientinesi P, Quintana-Ortí ES, vande Geijn RA,. Representing linear algebra algorithms in code: The FLAME application programming interfaces. ACM Transactions on Mathematical Software 2005; 31 (1): 27-59. (Pubitemid 40557861)
17. Gunnels JA, Gustavson FG, Henry GM, vande Geijn RA,. Flame: Formal linear algebra methods environment. ACM Transactions on Mathematical Software 2001; 27 (4): 422-455. (Pubitemid 33602331)
18. Bientinesi P, Gunnels JA, Myers ME, Quintana-Ortí ES, vande Geijn RA,. The science of deriving dense linear algebra algorithms. ACM Transactions on Mathematical Software 2005; 31 (1): 1-26. (Pubitemid 40557860)
19. Hendrickson BA, Womble DE,. The torus-wrap mapping for dense matrix calculations on massively parallel computers. SIAM Journal on Scientific Computing 1994; 15 (5): 1201-1226.
20. Schreiber R,. Scalability of sparse direct solvers. Graph Theory and Sparse Matrix Computations 1992; 56: 191-209.
21. Stewart GW,. Communication and matrix computations on large message passing systems. Parallel Computing 1990; 16: 27-40.
22. vande Geijn RA, Quintana-Ortí ES,. The science of programming matrix computations, 2008. www.lulu.com.
23. Chan E, Heimlich M, Purkayastha A, vande Geijn R,. Collective communication: theory, practice, and experience: Research articles. Concurrency and Computation: Practice and Experience 2007; 19: 1749-1783.
24. Sanders P, Träff JL,. 2002. The hierarchical factor algorithm for all-to-all communication (research note), In Proceedings of the 8th international euro-par conference on parallel processing, Euro-Par '02, Springer-Verlag, London, UK; 799-804.
25. Dongarra JJ, Luszczek P, Petitet A,. The LINPACK benchmark: Past, present, and future. Concurrency and computation: Practice and experience. Concurrency and Computation: Practice and Experience 2003; 15: 803-820.
26. Gorlatch S,. Send-receive considered harmful: Myths and realities of message passing. ACM Transactions on Programming Languages and Systems 2004; 26: 47-56.
27. Dongarra JJ, vande Geijn RA, Whaley RC,. Two dimensional basic linear algebra communication subprograms, Proceedings of the sixth siam conference on parallel processing for scientific computing, 1993.
28. Quintana-Ortí G, Quintana-Ortí ES, vande Geijn RA, Van Zee FG, Chan E,. Programming matrix algorithms-by-blocks for thread-level parallelism. ACM Transactions on Mathematical Software 2009; 36 (3): 1-26.
29. Igual FD, Quintana-Ortí G,. 2010. Solving linear algebra problems on distributed-memory computers using serial codes, Technical Report DICC 2010-07-01, Universidad Jaume I, Depto. de Ingenieria y Ciencia de Computadores.