HP-DAEMON: High performance distributed adaptive energy-efficient matrix-multiplication

Procedia Computer Science

Volumn 29, Issue , 2014, Pages 599-613

  Tan, Li ^a   Chen, Longxiang ^a   Chen, Zizhong ^a   Zong, Ziliang ^b   Ge, Rong ^c   Li, Dong ^d  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b TEXAS STATE UNIVERSITY   (United States)

^c MARQUETTE UNIVERSITY   (United States)

^d OAK RIDGE NATIONAL LABORATORY   (United States)

Author keywords

Adaptive; Binomial tree broadcast; DPLASMA; DVFS; Energy; Memory aware; Performance; Pipeline broadcast; ScaLAPACK

Indexed keywords

DYNAMIC FREQUENCY SCALING; ENERGY CONSERVATION; HARDWARE; MATRIX ALGEBRA; PIPELINES; TIME SWITCHES; VOLTAGE SCALING;

ADAPTIVE; BINOMIAL TREE; DPLASMA; DVFS; ENERGY; MEMORY AWARE; PERFORMANCE; SCALAPACK;

ENERGY EFFICIENCY;

EID: 84902816979     PISSN: 18770509     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1016/j.procs.2014.05.054     Document Type: Conference Paper

References (24)

1. Automatically Tuned Linear Algebra Software (ATLAS). http://math-atlas. sourceforge.net/.
2. DPLASMA: Distributed Parallel Linear Algebra Software for Multicore Architectures. http://icl.cs.utk.edu/dplasma/.
3. ScaLAPACK - Scalable Linear Algebra PACKage. http://www.netlib.org/ scalapack/.
4. P. Alonso, M. F. Dolz, F. D. Igual, R. Mayo, and E. S. Quintana-Orti. Saving energy in the LU factorization with partial pivoting on multi-core processors. In Proc. PDP, pages 353-358, 2012.
5. E. Chan, R. van de Geijn, W. Gropp, and R. Thakur. Collective communication on architectures that support simultaneous communication over multiple links. In Proc. PPoPP, pages 2-11, 2006.
6. G. Chen, K. Malkowski, M. Kandemir, and P. Raghavan. Reducing power with performance constraints for parallel sparse applications. In Proc. IPDPS, pages 1-8, 2005.
7. J. Choi. A new parallel matrix multiplication algorithm on distributed-memory concurrent computers. In Proc. HPC-Asia, pages 224-229, 1997.
8. J. Choi, J. J. Dongarra, L. S. Ostrouchov, A. P. Petitet, D. W. Walker, and R. C. Whaley. The design and implementation of the ScaLAPACK LU, QR and Cholesky factorization routines. Scientific Programming, 5(3):173-184, August 1996.
9. A. Faraj and X. Yuan. Automatic generation and tuning of MPI collective communication routines. In Proc. ICS, pages 393-402, 2005.
10. V. W. Freeh and D. K. Lowenthal. Using multiple energy gears in MPI programs on a powerscalable cluster. In Proc. PPoPP, pages 164-173, 2005.
11. R. Ge, X. Feng, S. Song, H.-C. Chang, D. Li, and K. W. Cameron. PowerPack: Energy profiling and analysis of high-performance systems and applications. IEEE Trans. Parallel Distrib. Syst., 21(5):658-671, May 2010.
12. C.-H. Hsu and W.-C. Feng. A power-aware run-time system for high-performance computing. In Proc. SC, page 1, 2005.
13. S. Hunold and T. Rauber. Automatic tuning of PDGEMM towards optimal performance. In Proc. Euro-Par, pages 837-846, 2005.
14. N. Kappiah, V. W. Freeh, and D. K. Lowenthal. Just in time dynamic voltage scaling: Exploiting inter-node slack to save energy in MPI programs. In Proc. SC, page 33, 2005.
15. C. Karlsson, T. Davies, C. Ding, H. Liu, and Z. Chen. Optimizing process-to-core mappings for two dimensional broadcast/reduce on multicore architectures. In Proc. ICPP, pages 404-413, 2011.
16. A. Karwande, X. Yuan, and D. K. Lowenthal. CC-MPI: A compiled communication capable MPI prototype for ethernet switched clusters. In Proc. PPoPP, pages 95-106, 2003.
17. H. Kimura, M. Sato, Y. Hotta, T. Boku, and D. Takahashi. Empirical study on reducing energy of parallel programs using slack reclamation by DVFS in a power-scalable high performance cluster. In Proc. CLUSTER, pages 1-10, 2006.
18. D. Li, B. R. de Supinski, M. Schulz, K. W. Cameron, and D. S. Nikolopoulos. Hybrid MPI/OpenMP power-aware computing. In Proc. IPDPS, pages 1-12, 2010.
19. A. Miyoshi, C. Lefurgy, E. V. Hensbergen, R. Rajamony, and R. Rajkumar. Critical power slope: Understanding the runtime effects of frequency scaling. In Proc. ICS, pages 35-44, 2002.
20. B. Rountree, D. K. Lowenthal, S. Funk, V. W. Freeh, B. R. de Supinski, and M. Schulz. Bounding energy consumption in large-scale MPI programs. In Proc. SC, pages 1-9, 2007.
21. R. Springer, D. K. Lowenthal, B. Rountree, and V. W. Freeh. Minimizing execution time in MPI programs on an energy-constrained, power-scalable cluster. In Proc. PPoPP, pages 230-238, 2006.
22. L. Tan, L. Chen, Z. Chen, Z. Zong, R. Ge, and D. Li. Improving performance and energy efficiency of matrix multiplication via pipeline broadcast. In Proc. CLUSTER, pages 1-5, 2013.
23. L. Tan, Z. Chen, Z. Zong, R. Ge, and D. Li. A2E: Adaptively aggressive energy efficient DVFS scheduling for data intensive applications. In Proc. IPCCC, pages 1-10, 2013.
24. M. Weiser, B. Welch, A. Demers, and S. Shenker. Scheduling for reduced CPU energy. In Proc. OSDI, page 2, 1994.