Taming parallel I/O complexity with auto-tuning

International Conference for High Performance Computing, Networking, Storage and Analysis, SC

Volumn , Issue , 2013, Pages

  Behzad, Babak ^a   Luu, Huong Vu Thanh ^a   Huchette, Joseph ^b   Byna, Surendra ^c   Prabhat, ^c   Aydt, Ruth ^d   Koziol, Quincey ^d   Snir, Marc ^a  

^a UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

^b RICE UNIVERSITY   (United States)

^c LAWRENCE BERKELEY NATIONAL LABORATORY   (United States)

^d HDF Group   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER PROGRAMMING; COMPUTER SCIENCE;

AUTOTUNING; CPU CORES; LARGE SPACES; PARALLEL I/O; PARAMETER SETTING; SYSTEM USE; TEST CONFIGURATIONS; TUNABLE PARAMETER;

BENCHMARKING;

EID: 84899681813     PISSN: 21674329     EISSN: 21674337     Source Type: Conference Proceeding    
DOI: 10.1145/2503210.2503278     Document Type: Conference Paper

References (35)

1. G. A. Alvarez, E. Borowsky, S. Go, T. H. Romer, R. Becker-Szendy, R. Golding, A. Merchant, M. Spasojevic, A. Veitch, and J. Wilkes. Minerva: An Automated Resource Provisioning Tool for Large-scale Storage Systems. ACM Trans. Comput. Syst., 19(4):483-518, Nov. 2001.
2. E. Anderson, M. Hobbs, K. Keeton, S. Spence, M. Uysal, and A. Veitch. Hippodrome: Running Circles Around Storage Administration. In Proceedings of the 1st USENIX Conference on File and Storage Technologies, FAST'02, Berkeley, CA, USA, 2002. USENIX Association.
3. T. Back and H.-P. Schwefel. An overview of evolutionary algorithms for parameter optimization. Evol. Comput., 1(1):1-23, Mar. 1993.
4. B. Behzad, J. Huchette, H. V. T. Luu, R. Aydt, S. Byna, Y. Yao, Q. Koziol, and Prabhat. A framework for auto-tuning HDF5 applications. In Proceedings of the 22nd international symposium on High-performance parallel and distributed computing, HPDC'13, pages 127-128, New York, NY, USA, 2013. ACM.
5. E. W. Bethel, J. M. Shalf, C. Siegerist, K. Stockinger, A. Adelmann, A. Gsell, B. Oswald, and T. Schietinger. Progress on H5Part: A Portable High Performance Parallel Data Interface for Electromagnetics Simulations. In Proceedings of the 2007 IEEE Particle Accelerator Conference (PAC 07). 25-29 Jun 2007, Albuquerque, New Mexico. 22nd IEEE Particle Accelerator Conference, p. 3396, 2007.
6. K. J. Bowers, B. J. Albright, L. Yin, B. Bergen, and T. J. T. Kwan. Ultrahigh performance three-dimensional electromagnetic relativistic kinetic plasma simulation. Physics of Plasmas, 15(5):7, 2008.
7. S. Byna, J. Chou, O. Rubel, Prabhat, and et al. Parallel I/O, analysis, and visualization of a trillion particle simulation. In Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis, SC'12, pages 59:1-59:12, 2012.
8. H. Casanova, D. Zagorodnov, F. Berman, and A. Legrand. Heuristics for Scheduling Parameter Sweep Applications in Grid Environments. In Proceedings of the 9th Heterogeneous Computing Workshop, HCW'00, pages 349-, Washington, DC, USA, 2000. IEEE Computer Society.
9. Y. Chen, M. Winslett, Y. Cho, and S. Kuo. Automatic parallel I/O performance optimization using genetic algorithms. In High Performance Distributed Computing, 1998. Proceedings. The Seventh International Symposium on, pages 155-162, jul 1998.
10. Y. Chen, M. Winslett, Y. Cho, S. Kuo, and C. Y. Chen. Automatic Parallel I/O Performance Optimization in Panda. In In Proceedings of the 10th Annual ACM Symposium on Parallel Algorithms and Architectures, pages 108-118, 1998.
11. Y. Chen, M. Winslett, S.-w. Kuo, Y. Cho, M. Subramaniam, and K. Seamons. Performance modeling for the panda array I/O library. In Proceedings of the 1996 ACM/IEEE conference on Supercomputing (CDROM), Supercomputing'96, 1996.
12. K. Datta, M. Murphy, V. Volkov, S. Williams, J. Carter, L. Oliker, D. Patterson, J. Shalf, and K. Yelick. Stencil Computation Optimization and Auto-tuning on state-of-the-art Multicore Architectures. In Proceedings of the 2008 ACM/IEEE conference on Supercomputing, SC'08, pages 4:1-4:12, 2008.
13. K. Deb, A. Anand, and D. Joshi. A computationally efficient evolutionary algorithm for real-parameter optimization. Evol. Comput., 10(4):371-395, Dec. 2002.
14. Frigo, Matteo, Johnson, and S. G. FFTW: An adaptive software architecture for the FFT. In Proc. 1998 IEEE Intl. Conf. Acoustics Speech and Signal Processing, volume 3, pages 1381-1384. IEEE, 1998.
15. M. Howison, Q. Koziol, D. Knaak, J. Mainzer, and J. Shalf. Tuning HDF5 for Lustre File Systems. In Proceedings of 2010 Workshop on Interfaces and Abstractions for Scientific Data Storage (IASDS10), Heraklion, Crete, Greece, Sept. 2010. LBNL-4803E.
16. B. Je, A. Krste, C. Chee-Whye, and D. Jim. Optimizing matrix multiply using PHiPAC: A portable, high-performance, ANSI C coding methodology. In Proceedings of the 11th international conference on Supercomputing, ICS'97, pages 340-347, 1997.
17. H. Jordan, P. Thoman, J. J. Durillo, S. Pellegrini, P. Gschwandtner, T. Fahringer, and H. Moritsch. A Multi-Objective Auto-tuning Framework for Parallel Codes. In Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis, SC'12, pages 10:1-10:12, Los Alamitos, CA, USA, 2012. IEEE Computer Society Press.
18. S. Lang, P. Carns, R. Latham, R. Ross, K. Harms, and W. Allcock. I/O performance challenges at leadership scale. In Proceedings of the Conference on High Performance Computing Networking, Storage and Analysis, SC'09, pages 40:1-40:12, New York, NY, USA, 2009. ACM.
19. C. Nieter and J. R. Cary. VORPAL: A versatile plasma simulation code. Journal of Computational Physics, 196:448-472, 2004.
20. C. S. Perone. Pyevolve: A Python open-source framework for genetic algorithms. SIGEVOlution, 4(1):12-20, 2009.
21. D. Randall, M. Khairoutdinov, A. Arakawa, and W. Grabowski. Breaking the Cloud Parameterization Deadlock. Bull. Amer. Meteor. Soc., 84(11):1547-1564, Nov. 2003.
22. K. Schulz. Experiences from the Deployment of TACC's Stampede System, March 2013 2013.
23. K. Seymour, H. You, and J. Dongarra. A comparison of search heuristics for empirical code optimization. In Cluster Computing, 2008 IEEE International Conference on, pages 421-429, 29 2008-oct. 1 2008.
24. J. Strunk, E. Thereska, C. Faloutsos, and G. R. Ganger. Using utility to provision storage systems. In Proceedings of the 6th USENIX Conference on File and Storage Technologies, FAST'08, pages 21:1-21:16. USENIX Association, 2008.
25. M. Sweet. Mini-XML, a small XML parsing library, 2003-2011.
26. R. Thakur, W. Gropp, and E. Lusk. Data Sieving and Collective I/O in ROMIO. In Proceedings of the The 7th Symposium on the Frontiers of Massively Parallel Computation, FRONTIERS'99, pages 182-, Washington, DC, USA, 1999. IEEE Computer Society.
27. The HDF Group. Hierarchical data format version 5, 2000-2010.
28. A. Tiwari and J. K. Hollingsworth. Online Adaptive Code Generation and Tuning. In Proceedings of the 2011 IEEE International Parallel & Distributed Processing Symposium, IPDPS'11, pages 879-892, Washington, DC, USA, 2011. IEEE Computer Society.
29. R. Vuduc, J. Demmel, and K. Yelick. OSKI: A library of automatically tuned sparse matrix kernels. In Proceedings of SciDAC 2005, Journal of Physics: Conference Series, 2005.
30. R. C. Whaley, A. Petitet, and J. J. Dongarra. Automated empirical optimization of software and the ATLAS project. Parallel Computing, 27(1-2):3-35, 2001.
31. S. Williams, K. Datta, J. Carter, L. Oliker, J. Shalf, K. A. Yelick, and D. Bailey. PERI: Autotuning memory intensive kernels for multicore. In Journal of Physics, SciDAC PI Conference: Conference Series: 123012001, 2008.
32. S. Williams, L. Oliker, R. Vuduc, J. Shalf, K. Yelick, and J. Demmel. Optimization of sparse matrix-vector multiplication on emerging multicore platforms. In Proceedings of the 2007 ACM/IEEE conference on Supercomputing, SC'07, pages 38:1-38:12, 2007.
33. A. H. Wright. Genetic Algorithms for Real Parameter Optimization. In Foundations of Genetic Algorithms, pages 205-218. Morgan Kaufmann, 1991.
34. H. You, Q. Liu, Z. Li, and S. Moore. The Design of an Auto-tuning I/O Framework on Cray XT5 System.
35. W. Yu, J. Vetter, and H. Oral. Performance characterization and optimization of parallel I/O on the Cray XT. In Parallel and Distributed Processing, 2008. IPDPS 2008. IEEE International Symposium on, pages 1-11, april 2008.