A segment-level adaptive data layout scheme for improved load balance in parallel file systems

Proceedings - 11th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing, CCGrid 2011

Volumn , Issue , 2011, Pages 414-423

  Song, Huaiming ^a   Yin, Yanlong ^a   Sun, Xian He ^a   Thakur, Rajeev ^b   Lang, Samuel ^b  

^a Illinois Institute of Technology   (United States)

^b ARGONNE NATIONAL LABORATORY   (United States)

Author keywords

adaptive data layout; file segment; I O performance; optimal stripe size; parallel file system

Indexed keywords

DATA LAYOUTS; FILE SEGMENT; I/O PERFORMANCE; OPTIMAL STRIPE SIZE; PARALLEL FILE SYSTEM;

CLUSTER COMPUTING; FILE ORGANIZATION; GRID COMPUTING; OPTIMIZATION;

PARALLEL PROCESSING SYSTEMS;

EID: 79961162536     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CCGrid.2011.26     Document Type: Conference Paper

References (42)

1. "High-performance Storage Architecture and Scalable Cluster File System," Lustre File System White Paper, December 2007.
2. F. Schmuck and R. Haskin, "GPFS: A Shared-disk File System for Large Computing Clusters," in FAST '02: Proceedings of the 1st USENIX Conference on File and Storage Technologies. Berkeley, CA, USA: USENIX Association, 2002, p. 19.
3. G. Gibson, B. Welch, G. Goodson, and P. Corbett, "Parallel NFS Requirements and Design Considerations," Internet Draft, October 2004. [Online]. Available: http://bgp.potaroo.net/ietf/idref/draft-gibsonpnfs- reqs/
4. I. F. Haddad, "PVFS: A Parallel Virtual File System for Linux Clusters," Linux Journal, p. 5, 2000.
5. D. Nagle, D. Serenyi, and A. Matthews, "The Panasas Activescale Storage Cluster: Delivering Scalable High Bandwidth Storage," in SC '04: Proceedings of the 2004 ACM/IEEE conference on Supercomputing. Washington, DC, USA: IEEE Computer Society, 2004, p. 53.
6. B. Welch, M. Unangst, Z. Abbasi, G. Gibson, B. Mueller, J. Small, J. Zelenka, and B. Zhou, "Scalable Performance of the Panasas Parallel File System," in FAST'08: Proceedings of the 6th USENIX Conference on File and Storage Technologies. Berkeley, CA, USA: USENIX Association, 2008, pp. 1-17.
7. X.-H. Sun, Y. Chen, and Y. Yin, "Data Layout Optimization for Petascale File Systems," in PDSW '09: Proceedings of the 4th Annual Workshop on Petascale Data Storage. New York, NY, USA: ACM, 2009, pp. 11-15.
8. H. Song, X.-H. Sun, H. Jin, and Y. Chen, "Trace-based Adaptive Data Layout Optimization for Parallel File Systems (poster presentation)," in PDSW '10: Proceedings of the 5th Annual Workshop on Petascale Data Storage, 2010.
9. H. Song, X.-H. Sun, Y. Yin, and Y. Chen, "A Cost-based Application-specific Data Layout Scheme for Parallel File Systems (on review)," submitted to IPDPS '11: 25th IEEE International Parallel and Distributed Processing Symposium, 2011.
10. D. Kotz and N. Nieuwejaar, "File-system Workload on a Scientific Multiprocessor," IEEE Parallel Distrib. Technol., vol. 3, pp. 51-60, March 1995. [Online]. Available: http://portal.acm.org/citation.cfm?id=613774.613889
11. A. Choudhary, R. Bordawekar, M. Harry, R. Krishnaiyer, R. Ponnusamy, T. Singh, and R. Thakur, "Passion: Parallel and Scalable Software for Input-output," Tech. Rep., 1994.
12. R. Thakur, W. Gropp, and E. Lusk, "Data Sieving and Collective I/O in ROMIO," in FRONTIERS '99: Proceedings of the The 7th Symposium on the Frontiers of Massively Parallel Computation. Washington, DC, USA: IEEE Computer Society, 1999, p. 182.
13. R. Bordawekar, J. M. del Rosario, and A. Choudhary, "Design and Evaluation of Primitives for Parallel I/O," in Supercomputing '93: Proceedings of the 1993 ACM/IEEE conference on Supercomputing. New York, NY, USA: ACM, 1993, pp. 452-461.
14. R. Thakur and A. Choudhary, "An Extended Two-phase Method for Accessing Sections of Out-of-core Arrays," Sci. Program., vol. 5, no. 4, pp. 301-317, 1996.
15. J. M. May, Parallel I/O for High Performance Computing. San Francisco, CA, USA: Morgan Kaufmann Publishers Inc., 2001.
16. Y. Chen, X.-H. Sun, R. Thakur, H. Song, and H. Jin, "Improving Parallel I/O Performance with Data Layout Awareness," in Cluster '10: Proceedings of the IEEE International Conference on Cluster Computing 2010. Washington, DC, USA: IEEE Computer Society, 2010.
17. A. Ching, A. Choudhary, K. Coloma, W.-k. Liao, R. Ross, and W. Gropp, "Noncontiguous I/O Accesses through MPI-IO," in CCGRID '03: Proceedings of the 3st International Symposium on Cluster Computing and the Grid. Washington, DC, USA: IEEE Computer Society, 2003, p. 104.
18. A. Ching, A. Choudhary, W.-k Liao, R. Ross, and W. Gropp, "Efficient Structured Data Access in Parallel File Systems," Cluster Computing, IEEE International Conference on, vol. 0, p. 326, 2003.
19. B. Nitzberg and V. Lo, "Collective Buffering: Improving Parallel I/O Performance," in HPDC '97: Proceedings of the 6th IEEE International Symposium on High Performance Distributed Computing. Washington, DC, USA: IEEE Computer Society, 1997, p. 148.
20. W.-k Liao, A. Ching, K. Coloma, A. Choudhary, and Lee Ward, "An Implementation and Evaluation of Client-side File Caching for MPI-IO," Parallel and Distributed Processing Symposium, International, vol. 0, p. 49, 2007.
21. X. Ma, M. Winslett, J. Lee, and S. Yu, "Faster Collective Output through Active Buffering," in IPDPS '02: Proceedings of the 16th International Parallel and Distributed Processing Symposium. Washington, DC, USA: IEEE Computer Society, 2002, p. 151.
22. H. Lei and D. Duchamp, "An Analytical Approach to File Prefetching," in ATEC '97: Proceedings of the annual conference on USENIX Annual Technical Conference. Berkeley, CA, USA: USENIX Association, 1997, pp. 21-21.
23. N. Tran and D. A. Reed, "Automatic Arima Time Series Modeling for Adaptive I/O Prefetching," IEEE Trans. Parallel Distrib. Syst., vol. 15, no. 4, pp. 362-377, 2004.
24. Y. Chen, S. Byna, X.-H. Sun, R. Thakur, and W. Gropp, "Hiding I/O Latency with Pre-execution Prefetching for Parallel Applications," in SC '08: Proceedings of the 2008 ACM/IEEE conference on Supercomputing. Piscataway, NJ, USA: IEEE Press, 2008, pp. 1-10.
25. S. Byna, Y. Chen, X.-H. Sun, R. Thakur, and W. Gropp, "Parallel I/O Prefetching using MPI File Caching and I/O Signatures," in SC '08: Proceedings of the 2008 ACM/IEEE conference on Supercomputing. Piscataway, NJ, USA: IEEE Press, 2008, pp. 1-12.
26. D. Kotz, "Disk-directed I/O for MIMD Multiprocessors," ACM Trans. Comput. Syst., vol. 15, no. 1, pp. 41-74, 1997.
27. K. E. Seamons, Y. Chen, P. Jones, J. Jozwiak, and M. Winslett, "Server-directed Collective I/O in Panda," in Supercomputing '95: Proceedings of the 1995 ACM/IEEE conference on Supercomputing (CDROM). New York, NY, USA: ACM, 1995, p. 57.
28. W. B. Ligon III and R. B. Ross, "Implementation and Performance of a Parallel File System for High Performance Distributed Applications," in HPDC '96: Proceedings of the 5th IEEE International Symposium on High Performance Distributed Computing. Washington, DC, USA: IEEE Computer Society, 1996, p. 471.
29. R. B. Ross and W. B. Ligon III, "Server-side Scheduling in Cluster Parallel I/O Systems," Calculateurs Parallles Journal Special Issue on Parallel I/O for Cluster Computing, 2001.
30. S. Rubin, R. Bodík, and T. Chilimbi, "An Efficient Profile-analysis Framework for Data-layout Optimizations," SIGPLAN Not., vol. 37, no. 1, pp. 140-153, 2002.
31. Y. Wang and D. Kaeli, "Profile-guided I/O Partitioning," in Proceedings of the 17th annual international conference on Supercomputing, ser. ICS '03. New York, NY, USA: ACM, 2003, pp. 252-260. [Online]. Available: http://doi.acm.org/10.1145/782814.782850
32. W. W. Hsu, A. J. Smith, and H. C. Young, "The Automatic Improvement of Locality in Storage Systems," ACM Trans. Comput. Syst., vol. 23, no. 4, pp. 424-473, 2005.
33. M. Bhadkamkar, J. Guerra, L. Useche, S. Burnett, J. Liptak, R. Ran-gaswami, and V. Hristidis, "BORG: Block-reorganization for Self-optimizing Storage Systems," in In FAST '09: Proccedings of the 7th conference on File and storage technologies, San Fancisco, CA, USA, 2009, pp. 183-196.
34. H. Huang, W. Hung, and K. G. Shin, "FS2: Dynamic Data Replication in Free Disk Space for Improving Disk Performance and Energy Consumption," in Proceedings of the 20th ACM symposium on Operating systems principles, ser. SOSP '05. New York, NY, USA: ACM, 2005, pp. 263-276. [Online]. Available: http://doi.acm.org/10.1145/1095810.1095836
35. R. Koller and R. Rangaswami, "I/O Deduplication: Utilizing Content Similarity to Improve I/O Performance," Trans. Storage, vol. 6, pp. 13:1-13:26, September 2010. [Online]. Available: http://doi.acm.org/10.1145/ 1837915.1837921
36. X. Zhang and S. Jiang, "InterferenceRemoval: Removing Interference of Disk Access for MPI Programs through Data Replication," in Proceedings of the 24th International Conference on Supercomputing, 2010, pp. 223-232.
37. A. Konwinski, J. Bent, J. Nunez, and M. Quist, "Towards an I/O Tracing Framework Taxonomy," in Proceedings of the 2nd international workshop on Petascale data storage: held in conjunction with Supercomputing '07, ser. PDSW '07. New York, NY, USA: ACM, 2007, pp. 56-62. [Online]. Available: http://doi.acm.org/10.1145/1374596.1374610
38. K. Vijayakumar, F. Mueller, X. Ma, and P. C. Roth, "Scalable I/O Tracing and Analysis," in PDSW '09: Proceedings of the 4th Annual Workshop on Petascale Data Storage. New York, NY, USA: ACM, 2009, pp. 26-31.
39. P. Lu and K. Shen, "Multi-layer Event Trace Analysis for Parallel I/O Performance Tuning," in Proceedings of the 2007 International Conference on Parallel Processing, p. 12, 2007.
40. S. Ghemawat, H. Gobioff, and S.-T. Leung, "The Google File System," SIGOPS Oper. Syst. Rev., vol. 37, no. 5, pp. 29-43, 2003.
41. "HDFS Architecture Guide," HDFS 0.21 Documentation. [Online]. Available: http://hadoop.apache.org/hdfs/docs/r0.21.0/hdfs design.html
42. E. M. Gengbin Zheng, Abhinav Bhatele and L. V. Kale, "Periodic Hierarchical Load Balancing for Large Supercomputers," International Journal of High Performance Computing Applications (IHHPCA), 2010.