LACIO: A new collective I/O strategy for parallel I/O systems

Proceedings - 25th IEEE International Parallel and Distributed Processing Symposium, IPDPS 2011

Volumn , Issue , 2011, Pages 794-804

  Chen, Yong ^a   Sun, Xian He ^b   Thakur, Rajeev ^c   Roth, Philip C ^d   Gropp, William D ^e  

^a Department of Electrical and Computer Engineering   (United States)

^b Illinois Institute of Technology   (United States)

^c ARGONNE NATIONAL LABORATORY   (United States)

^d OAK RIDGE NATIONAL LABORATORY   (United States)

^e University of Illinois at Urbana Champaign   (United States)

Author keywords

Collective I O; Data Intensive Computing; High Performance Computing; Parallel Applications; Parallel File Systems; Parallel I O; Storage Systems

Indexed keywords

COLLECTIVE I/O; DATA-INTENSIVE COMPUTING; HIGH PERFORMANCE COMPUTING; PARALLEL APPLICATION; PARALLEL FILE SYSTEM; PARALLEL I/O; STORAGE SYSTEMS;

COMPUTER ARCHITECTURE; COMPUTER SOFTWARE SELECTION AND EVALUATION; DISTRIBUTED COMPUTER SYSTEMS; DISTRIBUTED PARAMETER NETWORKS; FILE ORGANIZATION;

PARALLEL PROCESSING SYSTEMS;

EID: 80053254499     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IPDPS.2011.79     Document Type: Conference Paper

References (46)

1. N. Ali, P. H. Carns, K. Iskra, D. Kimpe, S. Lang, R. Latham, R. B. Ross, L. Ward, P. Sadayappan. Scalable I/O Forwarding Framework for High-performance Computing Systems. Proceedings of the 2009 IEEE International Conference on Cluster Computing, 2009.
2. J. Bent, G. Gibson, G. Grider, B. McClelland, P. Nowoczynski, J. Nunez, M. Polte, and M. Wingate. PLFS: A Checkpoint Filesystem for Parallel Applications. In Proc. of ACM/IEEE Supercomputing Conference, 2009.
3. S. Byna, Y. Chen, X.-H. Sun, R. Thakur, and W. Gropp. Parallel I/O Prefetching Using MPI File Caching and I/O Signatures. In Proc. of the ACM/IEEE Supercomputing Conference, 2008.
4. J. G. Blas, F. Isaila, D. E. Singh, and J. Carretero. View-based Collective I/O for MPI-IO. In Proc. of IEEE International Symposium on Cluster Computing and the Grid, 2008.
5. J. G. Blas, F. Isaila, J. Carretero, R. Latham, R. Ross. Multiple-Level MPI File Write-Back and Prefetching for Blue Gene Systems. In Proc. of PVM/MPI 2009.
6. R. Bordawekar, J. M. Rosario, and A. N. Choudhary. Design and Evaluation of primitives for Parallel I/O. In Proc. of ACM/IEEE Supercomputing Conference, 1993.
7. P. H. Carns, W. B. Ligon III, R. B. Ross, and R. Thakur. PVFS: A Parallel File System For Linux Clusters. In Proc. of the 4th Annual Linux Showcase and Conference, 2000.
8. Y. Chen, S. Byna, X.-H. Sun, R. Thakur, and W. Gropp. Hiding I/O Latency with Pre-execution Prefetching for Parallel Applications. In Proc. of the ACM/IEEE Supercomputing Conference, 2008.
9. Cluster File Systems Inc. Lustre: A Scalable, High Performance File System. Whitepaper, http://www.lustre.org/docs/whitepaper.pdf.
10. F. Chang and G. A. Gibson. Automatic I/O Hint Generation Through Speculative Execution. In Proc. of the 3rd Symposium on Operating Systems Design and Implementation, 1999.
11. A. W. Ching, A. Choudhary, W.-K. Liao, R. Ross, and W. Gropp. Noncontiguous I/O through PVFS. Proceedings of 2002 IEEE International Conference on Cluster Computing, 2002.
12. M. Eshel, R. L. Haskin, D. Hildebrand, M. Naik, F. B. Schmuck, R. Tewari. Panache: A Parallel File System Cache for Global File Access. In Proc. of the 8th USENIX Conference on File and Storage Technologies, 2010.
13. J. Griffioen, and R. Appleton. Performance Measurements of Automatic Prefetching. In Proc. of the 8th International Conference on Parallel and Distributed Computing Systems, 1995.
14. W. D. Gropp, E. Lusk, and R. Thakur. Using MPI-2. MIT Press, 1999.
15. J. Hennessy, and D. Patterson. Computer Architecture: A Quantitative Approach, 2006.
16. T. Highley, and P. Reynolds. Marginal Cost-Benefit Analysis for Predictive File Prefetching. In Proc. of the 41st Annual ACM Southeast Conference, 2003.
17. Interleaved or Random (IOR) Benchmark. http://sourceforge.net/projects/ ior-sio/.
18. K. Iskra, J. W. Romein, K. Yoshii, and P. Beckman. ZOID: I/O Forwarding Infrastructure for Petascale Architectures. In Proceedings of the 13th ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, pp. 153-162, 2008.
19. D. Kotz. Disk-directed I/O for MIMD Multiprocessors. ACM Transactions on Computer Systems, 15(1):41-74, 1997. (Pubitemid 127449837)
20. M. A. Kandaswamy, M. Kandemir, A. Choudhary, and D. Bernholdt. An Experimental Evaluation of I/O Optimizations on Different Applications. IEEE Transactions on Parallel and Distributed Systems, 13(12), 2002.
21. S. Lang, P. Carns, R. Latham, R. Ross, K. Harms, and W. Allcock. I/O Performance Challenges at Leadership Scale. In Proc. of ACM/IEEE Supercomputing Conference, 2009.
22. J. F. Lofstead, S. Klasky, K. Schwan, N. Podhorszki, and C. Jin. Flexible IO and Integration for Scientific Codes Through the Adaptable IO System (ADIOS). In Proc. of the 6th International Workshop on Challenges of Large Applications in Distributed Environments, 2008.
23. W.-K. Liao, A. Ching, K. Coloma, A. Choudhary, and L. Ward. An Implementation and Evaluation of Client-Side File Caching for MPI-IO. In Proc. of IEEE International Parallel and Distributed Processing Symposium, 2007.
24. W.-K Liao, and A. N. Choudhary. Dynamically Adapting File Domain Partitioning Methods for Collective I/O based on Underlying Parallel File System Locking Protocols. In Proc. of ACM/IEEE Supercomputing Conference, 2008.
25. H. Lei, and D. Duchamp. An Analytical Approach to File Prefetching. In Proc. of the 1997 USENIX Annual Technical Conference, 1997.
26. J. May. Parallel I/O for High Performance Computing. Morgan Kaufmann Publishing, 2001.
27. X. Ma, M. Winslett, J. Lee, and S. Yu. Faster Collective Output through Active Buffering. In Proc. of IEEE International Parallel and Distributed Processing Symposium, 2002.
28. Message Passing Interface Forum. MPI-2: Extensions to the Message-Passing Interface. http://www.mpiforum.org/docs/docs.html, 1996.
29. B. Nitzberg, and V. M. Lo. Collective Buffering: Improving Parallel I/O Performance. In Proc. of High-performance Parallel and Distributed Computing, 1997.
30. R. Oldfield, L. Ward, R. Riesen, A. B. Maccabe, P. Widener, and T. Kordenbrock. Lightweight I/O for Scientific Applications. In Proc. of IEEE International Conference on Cluster Computing, 2006.
31. R. H. Patterson, G. A. Gibson, E. Ginting, D. Stodolsky, and J. Zelenka. Informed Prefetching and Caching. In Proc. of the 15th ACM Symposium on Operating Systems Principles, 1995.
32. PVFS2 Development Team. PVFS Developer's Guide. http://www.pvfs.org/cvs/ pvfs-2-8-branch-docs/doc//pvfs2-guide.pdf.
33. PVFS Development Team. PVFS2 Tuning. http://www.pvfs.org/cgibin/pvfs2/ viewcvs/viewcvs.cgi/pvfs2/doc/pvfs2-tuning.tex#rev1.2.
34. ROMIO website. http://www-unix.mcs.anl.gov/romio/.
35. J. Del Rosario, R. Bordawekar, and A. Choudhary. Improved Parallel I/O via a Two-Phase Run-time Access Strategy. In Proc. of the Workshop on I/O in Parallel Computer Systems at IPPS, 1993.
36. R. Ross, R. Latham, M. Unangst, and B. Welch. Paralell I/O in Practice, tutorial in the ACM/IEEE Supercomputing Conference, 2009.
37. K. Seamons, Y. Chen, P. Jones, J. Jozwiak, and M. Winslett. Server-Directed Collective I/O in Panda. In Proc. of Supercomputing Conference, 1995.
38. F. Schmuck, and R. Haskin. GPFS: A Shared-Disk File System for Large Computing Clusters. In First USENIX Conference on File and Storage Technologies, 2002.
39. R. Thakur, W. Gropp, and E. Lusk. Data Sieving and Collective I/O in ROMIO. In Proc. of the 7th Symposium on the Frontiers of Massively Parallel Computation, 1999.
40. R. Thakur, W. Gropp, and E. Lusk. An Abstract-Device Interface for Implementing Portable Parallel-I/O Interfaces. In Proc. of the 6th Symposium on the Frontiers of Massively Parallel Computation, 1996.
41. R. Thakur, and A. Choudhary. An Extended Two-Phase Method for Accessing S ections of Out-of-Core Arrays. Scientific Programming, (5)4:301-317, 1996.
42. N. Tran, and D. A. Reed. Automatic ARIMA Time Series Modeling for Adaptive I/O Prefetching. IEEE Transactions on Parallel and Distributed Systems, 15(4):362-377, 2004.
43. M. Vilayannur, A. Sivasubramaniam, M. T. Kandemir, R. Thakur, R. Ross. Discretionary Caching for I/O on Clusters. Cluster Computing 9(1): 29-44, 2006. (Pubitemid 43125593)
44. S. A. Weil, S. A. Brandt, E. L. Miller, D. D.E. Long, C. Maltzahn. Ceph: A Scalable, High-Performance Distributed File System. In Proc. of USENIX Symposium on Operating Systems Design and Implementation, 2006.
45. B. Welch, M. Unangst, Z. Abbasi, G. Gibson, B.Mueller, J. Small, J. Zelenka, and B. Zhou. Scalable Performance of the Panasas Parallel File System. In Proc. of the 6th USENIX Conference on File and Storage Technologies, 2008.
46. X. Zhang, S. Jiang, and K. Davis. Making Resonance a Common Case: A High-performance Implementation of Collective I/O on Parallel File Systems. In Proc. of the 23rd IEEE International Symposium on Parallel and Distributed Processing, 2009.