Tuning parallel applications in parallel

Parallel Computing

Volumn 35, Issue 8-9, 2009, Pages 475-492

  Tiwari, Ananta ^a   Tabatabaee, Vahid ^a   Hollingsworth, Jeffrey K ^a  

^a University of Maryland   (United States)

Author keywords

Active Harmony; Nelder Mead simplex algorithm; Parallel application tuning; Parallel Rank Ordering algorithm

Indexed keywords

ACTIVE HARMONY; ACTIVE HARMONY SYSTEMS; BENCHMARK CODES; NELDER-MEAD ALGORITHMS; NELDER-MEAD SIMPLEX ALGORITHM; OPTIMIZATION ALGORITHMS; PARALLEL APPLICATION; PARALLEL APPLICATION TUNING; PARALLEL RANK ORDERING ALGORITHM; PARAMETER-TUNING; PERFORMANCE VARIABILITY;

COMMUNICATION CHANNELS (INFORMATION THEORY); TUNING;

PARALLEL ALGORITHMS;

EID: 69949091115     PISSN: 01678191     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.parco.2009.07.001     Document Type: Article

References (35)

1. D. Abramson, A. Lewis, T. Peachey, C. Fletcher, An automatic design optimization tool and its application to computational fluid dynamics, in: Supercomputing '01: Proceedings of the 2001 ACM/IEEE Conference on Supercomputing (CDROM), ACM, New York, NY, USA, 2001.
2. F. Berman, R. Wolski, Scheduling from the perspective of the application, in: HPDC '96: Proceedings of the 5th IEEE International Symposium on High Performance Distributed Computing, IEEE Computer Society, Washington, DC, USA, 1996.
3. C. Cascaval, E. Duesterwald, P. Sweeney, R.W. Wisniewski, Multiple page size modeling and optimization, Parallel Architectures and Compilation Techniques, 2005, PACT 2005, 14th International Conference on 17-21 September, 2005, pp. 339-349.
4. I.-H. Chung, J.K. Hollingsworth, Using information from prior runs to improve automated tuning systems, in: SC '04: Proceedings of the 2004 ACM/IEEE Conference on Supercomputing, IEEE Computer Society, Washington, DC, USA, 2004.
5. Crovella M., and Bestavros A. Self-similarity in world wide web traffic: evidence and possible causes. IEEE/ACM Trans. Network. 5 6 (1997) 835-846 December
6. Crovella M.E., and Taqqu M.S. Estimating the heavy tail index from scaling properties. Method. Comput. Appl. Prob. 1 1 (1999) 55-79
7. C. Ţǎpuş, I.-H. Chung, J.K. Hollingsworth, Active harmony: towards automated performance tuning, in: Supercomputing '02: Proceedings of the 2002 ACM/IEEE Conference on Supercomputing, IEEE Computer Society Press, Los Alamitos, CA, USA, 2002.
8. Dennis Jr. J.E., and Torczon V. Direct search methods on parallel machines. SIAM J. Optimiz. 1 4 (1991) 448-474
9. Dorland W., Jenko F., Kotschenreuther M., and Rogers B. Electron temperature gradient turbulence. Phys. Rev. Lett. 85 26 Pt 1 (2000) 5579-5582
10. J.B. Drake, S. Hammond, R. James, P.H. Worley, Performance tuning and evaluation of a parallel community climate model, in: Supercomputing '99: Proceedings of the 1999 ACM/IEEE Conference on Supercomputing (CDROM), ACM, New York, NY, USA, 1999.
11. Dukowicz J.K., Smith R.D., and Malone R.C. A reformulation and implementation of the Bryan-Cox-Semtner ocean model. J. Atmos. Oceanic Technol. 10 (1993) 195-208
12. Fursin G., Cohen A., O'Boyle M., and Temam O. Quick and practical run-time evaluation of multiple program optimizations. Trans. High-Perform. Embedded Architect. Compilers 1 1 (2006) 13-31
13. Goto-Webpage, (last accessed 05.10.07).
14. Jones P.W., Worley P.H., Yoshida Y., White I.J.B., and Levesque J. Practical performance portability in the parallel ocean program (pop): research articles. Concurr. Comput.: Pract. Exp. 17 10 (2005) 1317-1327
15. T. Kisuki, P.M.W. Knijnenburg, M.F.P. O'Boyle, Combined selection of tile sizes and unroll factors using iterative compilation, in: PACT '00: Proceedings of the 2000 International Conference on Parallel Architectures and Compilation Techniques, IEEE Computer Society, Washington, DC, USA, 2000.
16. Kolda T.G., Lewis R.M., and Torczon V. Optimization by direct search: new perspectives on some classical and modern methods. SIAM Rev. 45 3 (2004) 385-482
17. Kotschenreuther M., Rewoldt G., and Tang W.M. Comparison of initial value and eigenvalue codes for kinetic toroidal plasma instabilities. Comput. Phys. Commun. 88 (1995) 128-140
18. W.T.C. Kramer, C. Ryan, Performance variability of highly parallel architectures, in: International Conference on Computational Science, 2003.
19. Lagarias J.C., Reeds J.A., Wright M.H., and Wright P.E. Convergence properties of the Nelder-Mead simplex algorithm in low dimensions. SIAM J. Optimiz. 9 (1998) 112-147
20. B.C. Lee, D.M. Brooks, B.R. de Supinski, M. Schulz, K. Singh, S.A. McKee, Methods of inference and learning for performance modeling of parallel applications, in: PPoPP '07: Proceedings of the 12th ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, ACM, New York, NY, USA, 2007.
21. R.M. Lewis, V. Torczon, Rank Ordering and Positive Bases in Pattern Search Algorithms, Tech. Rep. TR-96-71, Institute for Computer Applications in Science and Engineering, NASA Langley Research Center, Hampton, VA, 1996.
22. McKinnon K.I.M. Convergence of the Nelder-Mead simplex method to a nonstationary point. SIAM J. Optimiz. 9 1 (1998) 148-158
23. Nelder J.A., and Mead R. A simplex method for function minimization. Comput. J. 7 (1965) 308-313
24. Noble B.D., Satyanarayanan M., Narayanan D., Tilton J.E., Flinn J., and Walker K.R. Agile application-aware adaptation for mobility. SIGOPS Oper. Syst. Rev. 31 5 (1997) 276-287
25. F. Petrini, D.J. Kerbyson, S. Pakin, The case of the missing supercomputer performance: achieving optimal performance on the 8192 processors of asci q, in: SC '03: Proceedings of the 2003 ACM/IEEE Conference on Supercomputing, IEEE Computer Society, Washington, DC, USA, 2003.
26. POP-Webpage, (last accessed 06.10.07).
27. Qasem A., Kennedy K., and Mellor-Crummey J. Automatic tuning of whole applications using direct search and a performance-based transformation system. J. Supercomput. 36 2 (2006) 183-196
28. R.L. Ribler, J.S. Vetter, H. Simitci, D.A. Reed, Autopilot: adaptive control of distributed applications, in: HPDC '98: Proceedings of the 7th IEEE International Symposium on High Performance Distributed Computing, IEEE Computer Society, Washington, DC, USA, 1998.
29. Singh K., İpek E., McKee S.A., de Supinski B.R., Schulz M., and Caruana R. Predicting parallel application performance via machine learning approaches. Concurr. Comput. Pract. Exp. 19 17 (2007) 2219-2235
30. R.D. Smith, J.K. Dukowicz, R.C. Malone, Parallel ocean general circulation modeling, in: Proceedings of the Eleventh Annual International Conference of the Center for Nonlinear Studies on Experimental mathematics: Computational Issues in Nonlinear Science, Elsevier North-Holland, Inc., Amsterdam, The Netherlands, 1992.
31. S. Triantafyllis, M. Vachharajani, N. Vachharajani, D.I. August, Compiler optimization-space exploration, in: CGO '03: Proceedings of the International Symposium on Code Generation and Optimization, IEEE Computer Society, Washington, DC, USA, 2003.
32. M. Trosset, On the Use of Direct Search Methods for Stochastic Optimization, Tech. Rep. 00-20, Department of Computational & Applied Mathematics, Rice University, June 2000.
33. Vuduc R., Demmel J.W., and Yelick K.A. Oski: a library of automatically tuned sparse matrix kernels. J. Phys.: Conf. Ser. 16 (2005) 521-530
34. R.C. Whaley, J.J. Dongarra, Automatically tuned linear algebra software, in: Supercomputing '98: Proceedings of the 1998 ACM/IEEE Conference on Supercomputing (CDROM), IEEE Computer Society, Washington, DC, USA, 1998.
35. P.H. Worley, I.T. Foster, Parallel spectral transform shallow water model: a runtime-tunable parallel benchmark code, in: J.J. Dongarra, D.W. Walker (Eds.), Proceedings of Scalable High Performance Computing Conference, IEEE Computer Society Press, Los Alamitos, CA, 1994, pp. 207-214.