Filesystem aware scalable I/O framework for data-intensive parallel applications

Proceedings - IEEE 27th International Parallel and Distributed Processing Symposium Workshops and PhD Forum, IPDPSW 2013

Volumn , Issue , 2013, Pages 2007-2014

  Xu, Rengan ^a   Araya Polo, Mauricio ^b   Chapman, Barbara ^a  

^a University of Houston   (United States)

^b Repsol USA   (United States)

Author keywords

Dynamic Load Blancing; Parallel File System; Parallel I O

Indexed keywords

DYNAMIC LOADS; FILE ORGANIZATION; GEOPHYSICS; MAPPING; PETROLEUM PROSPECTING;

COMMUNICATION AND SYNCHRONIZATIONS; COMMUNICATION OVERHEADS; GEOPHYSICAL APPLICATIONS; OIL AND GAS EXPLORATION; PARALLEL APPLICATION; PARALLEL FILE SYSTEM; PARALLEL I/O; STORAGE INFRASTRUCTURE;

DIGITAL STORAGE;

EID: 84899721086     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IPDPSW.2013.196     Document Type: Conference Paper

References (18)

1. HDF5. http://www.hdfgroup.org/HDF5.
2. IOR. http://sourceforge.net/project/ior-sio.
3. IOZone. http://www.iozone.org.
4. PnetCDF. http://trac.mcs.anl.gov/projects/parallel-netcdf.
5. N. Ali, P. Carns, K. Iskra, D. Kimpe, S. Lang, R. Latham, R. Ross, L. Ward, and P. Sadayappan. Scalable I/O Forwarding Framework for High-performance Computing Systems. In Cluster Computing and Workshops, 2009. CLUSTER'09. IEEE International Conference on, pages 1-10. IEEE, 2009.
6. Araya-Polo M., Cabezas J., Hanzich M., Pericas M., Rubio F., Gelado I., Shafiq M., Morancho E., Cela J.M., Valero M. Assessing Accelerator-Based HPC Reverse Time Migration. IEEE Transactions on Parallel and Distributed Systems, 22(1):147-162, January 2011.
7. J. Bent, G. Gibson, G. Grider, B. McClelland, P. Nowoczynski, J. Nunez, M. Polte, and M. Wingate. PLFS: A Checkpoint Filesystem for Parallel Applications. In Proceedings of the Conference on High Performance Computing Networking, Storage and Analysis, page 21. ACM, 2009.
8. P. Carns, R. Latham, R. Ross, K. Iskra, S. Lang, and K. Riley. 24/7 Characterization of Petascale I/O Workloads. In Cluster Computing and Workshops, 2009. CLUSTER'09. IEEE International Conference on, pages 1-10. IEEE, 2009.
9. P.M. Chen, E.K. Lee, G.A. Gibson, R.H. Katz, and D.A. Patterson. RAID: High-performance, Reliable Secondary Storage. ACM Computing Surveys (CSUR), 26(2):145-185, 1994.
10. T. Ilsche, J. Schuchart, J. Cope, D. Kimpe, T. Jones, A. Kn̈upfer, K. Iskra, R. Ross, W.E. Nagel, and S. Poole. Enabling Event Tracing at Leadership-Class Scale through I/O Forwarding Middleware. In Proceedings of the 21st international symposium on High-Performance Parallel and Distributed Computing, pages 49-60. ACM, 2012.
11. A. Kn̈upfer, H. Brunst, J. Doleschal, M. Jurenz, M. Lieber, H. Mickler, M.S. M̈uller, and W.E. Nagel. The Vampir Performance Analysis Tool-set. Tools for High Performance Computing, pages 139-155, 2008.
12. R. Latham, R. Ross, R. Thakur, and B. Toonen. Implementing MPI-IO Shared File Pointers without File System Support. Recent Advances in Parallel Virtual Machine and Message Passing Interface, pages 84-93, 2005.
13. J.F. Lofstead, S. Klasky, K. Schwan, N. Podhorszki, and C. Jin. Flexible IO and Integration for Scientific Codes Through The Adaptable IO System (adios). In Proceedings of the 6th international workshop on Challenges of large applications in distributed environments, pages 15-24. ACM, 2008.
14. E.L. Lusk, S.C. Pieper, R.M. Butler, et al. More Scalability, Less Pain: A Simple Programming Model and its Implementation for Extreme Computing. SciDAC Rev, 17:30-37, 2010.
15. D. Nagle, D. Serenyi, and A. Matthews. The Panasas Activescale Storage Cluster: Delivering Scalable High Bandwidth Storage. In Proceedings of the 2004 ACM/IEEE conference on Supercomputing, page 53. IEEE Computer Society, 2004.
16. B. Nichols, D. Buttlar, and J.P. Farrell. Pthreads Programming. O'Reilly Media, Incorporated, 1996.
17. R. Thakur, W. Gropp, and E. Lusk. On Implementing MPIIO Portably and with High Performance. In Proceedings of the sixth workshop on I/O in parallel and distributed systems, pages 23-32. ACM, 1999.
18. Brent Welch, Marc Unangst, Zainul Abbasi, Garth Gibson, Brian Mueller, Jason Small, Jim Zelenka, and Bin Zhou. Scalable Performance of the Panasas Parallel File System. In Proceedings of the 6th USENIX Conference on File and Storage Technologies, FAST'08, pages 2:1-2:17, Berkeley, CA, USA, 2008. USENIX Association.