DAGuE: A generic distributed DAG engine for High Performance Computing

Parallel Computing

Volumn 38, Issue 1-2, 2012, Pages 37-51

  Bosilca, George ^a   Bouteiller, Aurelien ^a   Danalis, Anthony ^a   Herault, Thomas ^a   Lemarinier, Pierre ^b   Dongarra, Jack ^a,c  

^a University of Tennessee   (United States)

^b UNIVERSITÉ DE RENNES 1   (France)

^c OAK RIDGE NATIONAL LABORATORY   (United States)

Author keywords

Architecture aware scheduling; Heterogeneous architectures; HPC; Micro task DAG

Indexed keywords

ACYCLIC GRAPHS; DATA DEPENDENCIES; GENERIC FRAMEWORKS; HETEROGENEOUS ARCHITECTURES; HIGH PERFORMANCE COMPUTING; HPC; MANY-CORE; MICRO-TASK DAG; MICROTASKS; PROGRAMMING ENVIRONMENT;

ARTS COMPUTING; BENCHMARKING; COMPUTER SOFTWARE SELECTION AND EVALUATION; LINEAR ALGEBRA; SCHEDULING;

ARCHITECTURE;

EID: 84655174868     PISSN: 01678191     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.parco.2011.10.003     Document Type: Article

References (33)

1. A.J. Bernstein Analysis of programs for parallel processing IEEE Transactions on Electronic Computers EC-15 5 1966 757 763
2. E.G. Coffman, Jr., P.J. Denning, Operating Systems Theory, Prentice Hall Professional Technical Reference, 1973.
3. J.A. Sharp Data Flow Computing: Theory and Practice 1992 Ablex Publishing Corp
4. J. Yu, R. Buyya, A taxonomy of workflow management systems for grid computing, Tech. rep., Journal of Grid Computing, 2005.
5. O. Delannoy, N. Emad, S. Petiton, Workflow global computing with YML, in: 7th IEEE/ACM International Conference on Grid Computing, 2006.
6. A. Buttari, J. Dongarra, J. Kurzak, J. Langou, P. Luszczek, and S. Tomov The impact of multicore on math software Applied Parallel Computing. State of the Art in Scientific Computing, 8th International Workshop, PARA Lecture Notes in Computer Science vol. 4699 2006 Springer 1 10
7. E. Chan, F.G. Van Zee, P. Bientinesi, E.S. Quintana-Ortí, G. Quintana-Ortí, and R. van de Geijn Supermatrix: a multithreaded runtime scheduling system for algorithms-by-blocks PPoPP '08: Proceedings of the 13th ACM SIGPLAN Symposium on Principles and practice of parallel programming 2008 ACM 123 132
8. E. Agullo, J. Demmel, J. Dongarra, B. Hadri, J. Kurzak, J. Langou, H. Ltaief, P. Luszczek, S. Tomov, Numerical linear algebra on emerging architectures: The PLASMA and MAGMA projects, Journal of Physics: Conference Series 180.
9. R. Dolbeau, S. Bihan, F. Bodin, HMPP: A hybrid multi-core parallel programming environment, in: Workshop on General Purpose Processing on Graphics Processing Units (GPGPU 2007), 2007.
10. C. Augonnet, S. Thibault, R. Namyst, and P.-A. Wacrenier StarPU: a unified platform for task scheduling on heterogeneous multicore architectures Concurrency and Computation: Practice and Experience 23 2 2011 187 198
11. J. Perez, R. Badia, J. Labarta, A dependency-aware task-based programming environment for multi-core architectures, in: IEEE International Conference on Cluster Computing, 2008, pp. 142-151.
12. F. Song, A. YarKhan, and J. Dongarra Dynamic task scheduling for linear algebra algorithms on distributed-memory multicore systems SC '09: Proceedings of the Conference on High Performance Computing Networking, Storage and Analysis 2009 ACM New York, NY, USA 1 11
13. C. Augonnet, S. Thibault, R. Namyst, P.-A. Wacrenier, StarPU: A Unified Platform for Task Scheduling on Heterogeneous Multicore Architectures, in: Euro-Par 2009 Euro-par'09 Proceedings, LNCS, Delft Pays-Bas, 2009.
14. M. Cosnard, and E. Jeannot Automatic parallelization techniques based on compact DAG extraction and symbolic scheduling Parallel Processing Letters 11 2001 151 168 (Pubitemid 32697656)
15. M. Cosnard, E. Jeannot, and T. Yang Compact DAG representation and its symbolic scheduling Journal of Parallel and Distributed Computing 64 8 2004 921 935 (Pubitemid 40000764)
16. E. Jeannot, Automatic multithreaded parallel program generation for message passing multiprocessors using parameterized task graphs, in: International Conference 'Parallel Computing 2001' (ParCo2001), 2001.
17. P. Husbands, and K.A. Yelick Multi-threading and one-sided communication in parallel lu factorization B. Verastegui, Proceedings of the ACM/IEEE Conference on High Performance Networking and Computing, SC 2007, November 10-16, 2007, Reno, Nevada, USA 2007 ACM Press
18. F.G. Gustavson, L. Karlsson, and B. Kgström Distributed SBP cholesky factorization algorithms with near-optimal scheduling ACM Transactions on Mathematical Software 36 2 2009 1 25
19. W. Pugh, The omega test: a fast and practical integer programming algorithm for dependence analysis, in: Supercomputing '91: Proceedings of the 1991 ACM/IEEE Conference on Supercomputing, New York, NY, USA, 1991, pp. 4-13.
20. U.A. Acar, G.E. Blelloch, R.D. Blumofe, The data locality of work stealing., in: SPAA'00, 2000, pp. 1-12.
21. F. Broquedis, J. Clet Ortega, S. Moreaud, N. Furmento, B. Goglin, G. Mercier, S. Thibault, R. Namyst, hwloc: a Generic Framework for Managing Hardware Affinities in HPC Applications, in: IEEE (Ed.), PDP 2010 - The 18th Euromicro International Conference on Parallel, Distributed and Network-Based Computing, Pisa Italy, 2010.
22. F.G. Gustavson, J.A. Gunnels, and J.C. Sexton Minimal data copy for dense linear algebra factorization Applied Parallel Computing, State of the Art in Scientific Computing, 8th International Workshop, PARA 2006 vol. 4699 2006 LNCS Ume, Sweden 540 549
23. G.W. Stewart, Matrix algorithms, Society for Industrial and Applied Mathematics, Philadelphia, PA, USA, 2001.
24. A. Buttari, J. Langou, J. Kurzak, and J. Dongarra A class of parallel tiled linear algebra algorithms for multicore architectures Parallel Computation 35 1 2009 38 53
25. A. Buttari, J. Langou, J. Kurzak, and J.J. Dongarra Parallel tiled QR factorization for multicore architectures Concurrency Computation: Practice and Experience 20 13 2008 1573 1590
26. R. Schreiber, and C. van Loan A storage-efficient WY representation for products of householder transformations J. Sci. Stat. Comput. *** 10 1991 53 57
27. E.S. Quintana-Ortí, and R.A. van de Geijn Updating an LU factorization with pivoting ACM Transactions on Mathematical Software 35 2 2008 11
28. R. Bolze, F. Cappello, E. Caron, M.J. Daydé, F. Desprez, E. Jeannot, Y. Jégou, S. Lanteri, J. Leduc, N. Melab, G. Mornet, R. Namyst, P. Primet, B. Quétier, O. Richard, E.-G. Talbi, and I. Touche Grid'5000: a large scale and highly reconfigurable experimental grid testbed IJHPCA 20 4 2006 481 494 (Pubitemid 44605333)
29. L.S. Blackford, J. Choi, A.J. Cleary, E.F. D'Azevedo, J. Demmel, I.S. Dhillon, J. Dongarra, S. Hammarling, G. Henry, A. Petitet, K. Stanley, D.W. Walker, and R.C. Whaley ScaLAPACK: a linear algebra library for message-passing computers Proceedings of the Eighth SIAM Conference on Parallel Processing for Scientific Computing 1997 SIAM
30. J.J. Dongarra, P. Luszczek, and A. Petitet The LINPACK benchmark: past, present and future Concurrency and Computation: Practice and Experience 15 9 2003 803 820
31. J. Choi, J. Demmel, I.S. Dhillon, J. Dongarra, S. Ostrouchov, A. Petitet, K. Stanley, D.W. Walker, and R.C. Whaley ScaLAPACK: a portable linear algebra library for distributed memory computers - design issues and performance J. Dongarra, K. Madsen, J. Wasniewski, Applied Parallel Computing, Computations in Physics, Chemistry and Engineering Science, Second International Workshop, PARA '95, Lyngby, Denmark, August 21-24, 1995, Proceedings Lecture Notes in Computer Science vol. 1041 1995 Springer 95 106 (Pubitemid 126043350)
32. Q.O. Snell, A.R. Mikler, J.L. Gustafson, Netpipe: A network protocol independent performance evaluator, in: IASTED International Conference on Intelligent Information Management and Systems, 1996.
33. J. Dongarra, P. Beckman, et al., The international exascale software project roadmap, Tech. rep., IESP, 2011, http://www.exascale.org/iesp.