Cashing in on hints for better prefetching and caching in PVFS and MPI-IO

HPDC 2010 - Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing

Volumn , Issue , 2010, Pages 191-202

  Patrick, Christina M ^a   Kandemir, Mahmut ^a   Karaköy, Mustafa ^b   Woo Son, Seung ^c   Choudhary, Alok ^d  

^a PENNSYLVANIA STATE UNIVERSITY   (United States)

^b IMPERIAL COLLEGE LONDON   (United Kingdom)

^c ARGONNE NATIONAL LABORATORY   (United States)

^d NORTHWESTERN UNIVERSITY   (United States)

Author keywords

Caching; Hints; I O; MPI IO; Performance; Prefetching; PVFS

Indexed keywords

CACHING; HINTS; I/O; MPI-IO; PERFORMANCE; PREFETCHING; PVFS;

CACHE MEMORY; FILE ORGANIZATION;

OPTIMIZATION;

EID: 78650035887     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1851476.1851499     Document Type: Conference Paper

References (51)

1. A. Aho, M. Lam, R. Sethi, and J. Ullman. Compilers: Principles, Techniques, and Tools. Addison-Wesley, 2nd edition, 2006.
2. M. Annavaram, J. Patel, and E. Davidson. Data prefetching by dependence graph precomputation. SIGARCH Comput. Archit. News, 29(2):52-61, 2001.
3. R. Bordawekar, A. Choudhary, K. Kennedy, C. Koelbel, and M. Paleczny. A model and compilation strategy for out-of-core data parallel programs. In PPOPP, pages 1-10, 1995.
4. A. R. Butt, C. Gniady, and Y. C. Hu. The performance impact of kernel prefetching on buffer cache replacement algorithms. SIGMETRICS Perf. Eval. Rev., 33(1):157-168, 2005.
5. S. Byna, Y. Chen, X.-H. Sun, R. Thakur, and W. Gropp. Parallel I/O prefetching using MPI file caching and I/O signatures. In SC, pages 1-12, 2008.
6. P. H. Carns, W. B. Ligon III, R. B. Ross, and R. Thakur. PVFS: A parallel file system for linux clusters. In ALS, pages 317-327, 2000.
7. F. Chang and G. A. Gibson. Automatic I/O hint generation through speculative execution. In OSDI, pages 1-14, 1999.
8. Y. Chen, S. Byna, X.-H. Sun, R. Thakur, and W. Gropp. Hiding I/O latency with pre-execution prefetching for parallel applications. In SC, pages 1-10, 2008.
9. C. Coarfa, Y. Dotsenko, J. Eckhardt, and J. Mellor-Crummey. Co-array Fortran performance and potential: An NPB experimental study. In LCPC, pages 2-4, 2003.
10. U. Consortium. UPC specifications, v1.2. Technical Report LBNL-59208, Lawrence Berkeley National Lab Tech Report, 2005.
11. X. Ding, S. Jiang, F. Chen, K. Davis, and X. Zhang. Diskseen: exploiting disk layout and access history to enhance I/O prefetch. In USENIX, pages 1-14, 2007.
12. M. P. I. Forum. MPI-2: Extensions to the message passing interface. 1997.
13. K. Fraser and F. Chang. Operating system I/O speculation: How two invocations are faster than one. In USENIX, pages 325-338, 2003.
14. B. Gill and L. A. Bathen. AMP: adaptive multi-stream prefetching in a shared cache. In FAST, pages 185-198, 2007.
15. B. Gill and D. Modha. SARC: sequential prefetching in adaptive replacement cache. In USENIX, pages 293-308, 2005.
16. J. Griffioen and R. Appleton. Reducing file system latency using a predictive approach. In USENIX, pages 13-13, 1994.
17. IBM. Report on the experimental language X10. http://x10.codehaus.org/, 2006.
18. M. Kandemir, R. Bordawekar, and A. Choudhary. Data access reorganizations in compiling out-of-core data parallel programs on distributed memory machines. In IPPS, pages 559-564, 1997.
19. K. Keeton, G. Alvarez, E. Riedel, and M. Uysal. Characterizing I/O intensive workload sequentiality on modern disk arrays. In Computer Architecture Evaluation using Commercial Workloads, 2001.
20. D. Kim and D. Yeung. A study of source-level compiler algorithms for automatic construction of pre-execution code. ACM TOCS, 22(3):326-379, 2004.
21. D. Kotz and N. Nieuwejaar. Dynamic file-access characteristics of a production parallel scientific workload. In SC, pages 640-649, 1994.
22. D. F. Kotz and C. S. Ellis. Prefetching in file systems for MIMD multiprocessors. IEEE TPDS, 1(2):218-230, 1990.
23. T. M. Kroeger and D. D. E. Long. Design and implementation of a predictive file prefetching algorithm. In USENIX, pages 105-118, 2001.
24. C. Li, K. Shen, and A. Papathanasiou. Competitive prefetching for concurrent sequential I/O. In EuroSys, pages 189-202, 2007.
25. X. Li, A. Aboulnaga, K. Salem, A. Sachedina, and S. Gao. Second-tier cache management using write hints. In FAST, pages 115-128, 2005.
26. W.-K. Liao, A. Ching, K. Coloma, A. Choudhary, and L. Ward. Implementation and evaluation of client-side file caching for MPI-IO. In IPDPS, pages 1-10, 2007.
27. T. Madhyastha and D. Reed. Learning to classify parallel input/output access patterns. IEEE TPDS, 13(8):802-813, 2002.
28. S. Microsystems. The Fortress language specification version 1.0. http://research.sun.com/projects/plrg/fortress.pdf, 2008.
29. E. Miller and R. Katz. Input/output behavior of supercomputing applications. In SC, pages 567-576, 1991.
30. T. Mowry, A. Demke, and O. Krieger. Automatic compiler-inserted I/O prefetching for out-of-core applications. In OSDI, pages 3-17, 1996.
31. N. Nieuwejaar, D. Kotz, A. Purakayastha, C. S. Ellis, and M. Best. File-access characteristics of parallel scientific workloads. IEEE TPDS, 7(10):1075-1089, 1996.
32. A. Papathanasiou and M. Scott. Energy efficient prefetching and caching. In USENIX, pages 255-268, 2004.
33. R. H. Patterson, G. A. Gibson, E. Ginting, D. Stodolsky, and J. Zelenka. Informed prefetching and caching. SIGOPS OSR, 29(5):79-95, 1995.
34. M. S. Pérez, J. Carretero, F. García, J. M. Peña, and V. Robles. MAPFS: A flexible multiagent parallel file system for clusters. Future Generation Computer Systems, 22(5):620-632, 2006.
35. J.-P. Prost, R. Treumann, R. Hedges, B. Jia, and A. Koniges. MPI-IO/GPFS, an optimized implementation of MPI-IO on top of GPFS. SC, pages 58-58, 2001.
36. E. Santos-Neto, S. Al-Kiswany, N. Andrade, S. Gopalakrishnan, and M. Ripeanu. Enabling cross-layer optimizations in storage systems with custom metadata. In HPDC, pages 213-216, 2008.
37. P. Sarkar and J. Hartman. Efficient cooperative caching using hints. In OSDI, pages 35-46, 1996.
38. P. Sarkar and J. H. Hartman. Hint-based cooperative caching. ACM TOCS, 18(4):387-419, 2000.
39. E. Smirni and D. Reed. Workload characterization of input/output intensive parallel applications. In Proceedings of the 9th International Conference on Computer Performance Evaluation: Modelling Techniques and Tools, pages 169-180, 1997.
40. S. W. Son, S. P. Muralidhara, O. Ozturk, M. Kandemir, I. Kolcu, and M. Karakoy. Profiler and compiler assisted adaptive I/O prefetching for shared storage caches. In PACT, pages 112-121, 2008.
41. J. Stribling, Y. Sovran, I. Zhang, X. Pretzer, J. Li, F. Kaashoek, and R. Morris. Flexible, wide-area storage for distributed systems with WheelFS. In NSDI, 2009.
42. R. Thakur, W. Gropp, and E. Lusk. Data sieving and collective I/O in ROMIO. In FRONTIERS, page 182, 1999.
43. D. Thiébaut, H. S. Stone, and J. L. Wolf. Improving disk cache hit-ratios through cache partitioning. IEEE TOC, 41(6):665-676, 1992.
44. A. Tomkins, H. Patterson, and G. Gibson. Informed multi-process prefetching and caching. In SIGMETRICS, pages 100-114, 1997.
45. S. Vanderwiel and D. Lilja. Data prefetch mechanisms. ACM CSUR, 32(2):174-199, 2000.
46. M. Vilayannur, M. Kandemir, and A. Sivasubramaniam. Kernel-level caching for optimizing I/O by exploiting inter-application data sharing. Cluster Computing, 0:425, 2002.
47. M. Wachs, M. Abd-El-Malek, E. Thereska, and G. R. Ganger. Argon: performance insulation for shared storage servers. In FAST, pages 61-76, 2007.
48. M. Wolfe. High Performance Compilers for Parallel Computing. Addison-Wesley, 1995.
49. G. Yadgar, M. Factor, K. Li, and A. Schuster. MC2: Multiple clients on a multilevel cache. In ICDCS, pages 722-730, 2008.
50. G. Yadgar, M. Factor, and A. Schuster. Karma: Know-it-all replacement for a multilevel cache. In FAST, pages 169-184, 2006.
51. C.-K. Yang, T. Mitra, and T.-C. Chiueh. A decoupled architecture for application-specific file prefetching. In USENIX, pages 157-170, 2002.