Profile-Guided I/O Partitioning

Proceedings of the International Conference on Supercomputing

Volumn , Issue , 2003, Pages 252-260

  Wang, Yijian ^a   Kaeli, David ^a  

^a Northeastern University   (United States)

Author keywords

Clusters; Parallel I O; Profile guided I O

Indexed keywords

ALGORITHMS; BANDWIDTH; DATA COMMUNICATION SYSTEMS; DATA REDUCTION; DATABASE SYSTEMS; MIDDLEWARE; OPTIMIZATION; PARALLEL PROCESSING SYSTEMS; PROGRAM COMPILERS; THROUGHPUT;

CLUSTERS; PARALLEL I/O; PROFILE-GUIDED I/O;

INPUT OUTPUT PROGRAMS;

EID: 1142293063     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/782848.782850     Document Type: Conference Paper

References (28)

1. R. Bordawekar, A. Choudhary, and R. Thakur. Data Access Reorganizations in Compiling Out-of-Core Parallel Programs on Distributed Memory Machines. Technical report, September 1994.
2. P. Brezany, A. Choudhary, and M. Dang. Language and Compiler Support for Out-of-Core Irregular Applications on Distributed-Memory Multiprocessors. In Languages, Compilers, and Run- Time Systems for Scalable Computers, pages 343-350, 1998.
3. A. D. Brown, T. Mowry, and O. Krieger. Compiler-Based I/O Prefetching for Out-of-Core Applications. A CM Transactions on Computer Systems, 19(2):111-170, 2001.
4. P. Chen and E. Lee. Striping in a RAID Level 5 Disk Array. In Proceedings of the 1995 ACM SIGMETRICS Joint International Conference on Measurement and Modeling of Computer Systems, pages 136-145, Ottawa, Canada, 15-19 1995.
5. T. Chilimbi, M. Hill, and J. Larus. Cache-Conscious Structure Layout. In SIGPLAN Conference on Programming Language Design and Implementation, pages 1-12, 1999.
6. G. Cooperman and X. Ma. Overcoming the Memory Wall in Symbolic Algebra: A Faster Permutation Algorithm. In SIGSAM Bulletin, 2003.
7. D. Kaeli, L. Fong, D. Renfrew, K. Imming and R. Booth. Performance of a CC-NUMA Prototype. IBM Journal of Research and Development, 41(3):205-214, 1997.
8. D. Kotz. Disk-directed i/o for an out-of-core computation. Technical report, 1995.
9. E. Smini and D.A. Reed. Lessons from Characterizing the Input/Output Behavior of Parallel Scientific Applications. Performance Evaluation, 3:27-44, 1998.
10. D. Genius and S. Lelait. Improving Data Layout through Coloring-directed Array Merging. Technical Report iratr-1999-3, Universitát Karlsruhe, 1999.
11. H. Simitci and D.A. Reed. A Comparison of Logical and Physical Parallel I/O Patterns. International Journal of High Performance Computing Applications, 12(3):364-380, 1998.
12. M. Kandemir, R. Bordawekar, A. Choudhary, and J. Ramanujam. A Unified Titling Approach for Out-of-Core Computation. Technical report, 1996.
13. M. Kandemir, A. Choudhary, J. Ramanujam, and R. Bordawekar. Optimizing Out-of-Core Computations in Uniprocessors. In Proceedings of the Workshop on Interaction between Compilers and Computer Architectures, pages 1-10, 1997.
14. M. Ashouei, D. Jiang, W. Meleis, D. Kaeli, M. El-Shenawee, E. Mizan, Y. Wang, C. Rappaport and C. DiMarzio. Profile-based characterization and tuning for subsurface sensing and imaging applications. International Journal of Systems, Science and Technology, pages 40-55, Sep 2002.
15. T. Madhyastha and D. Reed. Learning to classify parallel input/output access patterns. IEEE Transactions On Parallel And Distributed Systems, 13(8), 2002.
16. K. S. McKinley, S. Carr. and C.-W. Tseng. Improving Data Locality with Loop Transformations. ACM Transactions on Programming Languages and Systems, 18(4):424-453, July 1996.
17. G. Memik, M. Kandemir, and A. Choudhary. Design and Evaluation of a Compiler-directed Collective I/O technique. In Proceedings of 6th Annual EuroPar Conference, pages 1263-1272, Aug-Sept 2000.
18. K. Moor. I/O Performance Enhancements of Out-of-Core Applications. Notre Dame University, Department of Computer Science and Engineering.
19. MPICH - A Portable Implementation of MPI. URL: www-unix.mcs.anl.gov/mpi/mpich.
20. N. Nieuwejaar, D. Kotz, A. Purakayastha, C. Ellis. and M. Best. File-Access Characteristics of Parallel Scientific Workloads. IEEE Transactions on Parallel and Distributed Systems, 7(10):1075-1089, 1996.
21. D. Patterson, G. Gibson, and R. Katz. A Case for Redundant Arrays of Inexpensive Disks (RAID). In Proceedings of the 1988 ACM SIGMOD International Conference on Management of Data, pages 109-116, 1995.
22. R. Patterson, G. Gibson, E. Ginting, D. Stodolsky, and J. Zelenka. Informed Prefetching and Caching. In Proceedings of the 15th ACM Symposium on Operating System Principles, pages 79-95, Dec 1995.
23. R. Bagrodia, A. Chien, Y. Hsu and D. Reed. Input/output: Instrumentation, characterization, modeling and management policy. Technical report, CalTech Concurrent Supercomputing Facilities, CalTech, 1994.
24. A. N. Reddy and P. Bannerjee. A Study of I/O Behavior of Perfect Benchmarks on a Multicomputer. In Proceedings of the 17th Annual International Symposium on Computer Architecture, pages 312-321, 1990.
25. R. Thakur, R. Bordawekar, and A. Choudhary. Compiler and Runtime Support for Out-of-Core HPF Programs. In Proceedings of the 8th ACM International Conference on Supercomputing, pages 382-391, Manchester, UK, 1994. ACM Press.
26. R. Thakur, W. Gropp, and E. Lusk. Users Guide for ROMIO: A High-Performance, Portable MPI-IO Implementation. Mathematics and Computer Science Division, Argonne National Laboratory, Oct. 1997. ANL/MCS-TM-234.
27. R. Thakur, W. Gropp, and E. Lusk. Data Sieving and Collective I/O in ROMIO. In Proceedings of the 7th Symposium on Frontiers of Massively Parallel Computation, February 1999.
28. R. Thakur, W. Gropp, and E. Lusk. On Implementing MPI-IO Portably and with High Performance. In Proceedings of the Sixth Workshop on Input/Output in Parallel and Distributed Systems, pages 23-32, 1999.