Xen-based HPC: A parallel I/O perspective

Proceedings CCGRID 2008 - 8th IEEE International Symposium on Cluster Computing and the Grid

Volumn , Issue , 2008, Pages 154-161

  Yu, Weikuan ^a   Vetter, Jeffrey S ^a  

^a OAK RIDGE NATIONAL LABORATORY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER NETWORKS; DATA STORAGE EQUIPMENT; ETHERNET; HIGH PERFORMANCE LIQUID CHROMATOGRAPHY; LOCAL AREA NETWORKS; TECHNICAL PRESENTATIONS; TRANSMISSION CONTROL PROTOCOL; TUNING;

PARALLEL I/O;

GRID COMPUTING;

EID: 50649092497     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CCGRID.2008.119     Document Type: Conference Paper

References (36)

1. "IOR Benchmark." http://www.llnl.gov/asci/purple/benchmarks/ limited/ior.
2. "Oprofile, A System Profiler for Linux ". http://oprofile. sourceforge.net/news/.
3. "The Parallel Virtual File System, Version 2." http://www.pvfs.org/PVFS.
4. "TOP 500 Supercomputers." http://www.top500.org/.
5. Argonne National Laboratory, "MPICH2." http://wwwunix.mcs.anl. gov/mpi/mpich2/.
6. P. Barham, B. Dragovic, K. Fraser, S. Hand, T. Harris, A.Ho, R. Neugebauer, I. Pratt, and A. Warfield, "Xen and the Art of Virtualization.," 19th ACM Symposium on Operating Systems Principles, 2003.
7. A. Ching, A. Choudhary, W.-k. Liao, R. B. Ross, and W. Gropp, "Noncontiguous I/O through PVFS," IEEE Cluster Computing, Chicago, IL, 2002.
8. J. Dike, "User Mode Linux," http://user-mode-linux.sourceforge. net.
9. J. Duell, P. Hargrove, and E. Roman, "The Design and Implementation of Berkeley Lab's Linux Checkpoint/Restart," Technical Report Berkeley Lab 2002.
10. L. C. a. R. Gardner, "Measuring CPU Overhead for I/O Processing in the Xen Virtual Machine Monitor," The USENIX Annual Technical Conference, Short Paper, 2005.
11. R. Gioiosa, J. C. Sancho, S. Jiang, and F. Petrini, "Transparent Incremental Checkpointing at Kernel Level: A Foundation for Fault Tolerance for Parallel Computers," Proceedings of ACM/IEEE SC'2005, Seattle, WA, 2005.
12. W. Huang, J. Liu, B. Abali, and D. K. Panda, "A Case of High Performance Computing with Virtual Machines," The 20th ACM International Conference on Supercomputing (ICS '06), 2006.
13. InfiniBand Trade Association, "InfiniBand Architecture Specification, Release 1.2.."
14. Intel, "Intelligent Platform Management Interface." http://www.intel.com/design/servers/ipmi/.
15. H. Jung, D. Shin, H. Han, J. W. Kim, H. Y. Yeom, and J. Lee, "Design and Implementation of Multiple Fault-Tolerant MPI over Myrinet (M3)," ACM/IEEE Supercomputing, Seattle, WA, 2005.
16. J. Li, W. Liao, A. Choudhary, R. Ross, R. Thakur, W. Gropp, and R. Latham, "Parallel netCDF: A High Performance Scientific I/O Interface," Proceedings of the Supercomputing '03, 2003.
17. Z. Lin, S. Ethier, T. S. Hahm, and W. M. Tang, "Size Scaling of Turbulent Transport in Magnetically Confined Plasmas," Phys. Rev. Lett., vol. 88, pp. 195004, 2002.
18. J. Liu, W. Huang, B. Abali, and D. K. Panda, "High Performance VMM-Bypass I/O in Virtual Machines," The USENIX Annual Technical Conference, 2006.
19. S. Makineni and R. Iyer, "Architectural characterization of TCP/IP packet processing on the Pentium M microprocessor," the 10th International Symposium on High Performance Computer Architecture, 2004.
20. A. Menon, A. L. Cox, and W. Zwaenepoel, "Optimizing Network Virtualization in Xen," The USENIX Annual Technical Conference, 2006.
21. A. Menon, J. R. Santos, Y. Turner, G. J. Janakiraman, and W. Zwaenepoel, "Diagnosing Performance Overheads in the Xen Virtual Machine Environment," First ACM/USENIX Conference on Virtual Execution Environments (VEE'05), 2005.
22. D. Minturn, G. Regnier, J. Krueger, R. Iyer, and S. Makineni, "Addressing TCP/IP Processing Challenges Using the IA and IXP Processors," Intel Technology Journal, 2003.
23. I. Myricom, "Myrinet Express (MX): A high-performance, low-level, message passing interface for Myrinet."
24. A. Nagarajan and F. Mueller, "Proactive Fault Tolerance for HPC with Xen Virtualization," Technical Report, January, 2007.
25. NASA, "NAS Parallel Benchmarks." http://www.nas.nasa.gov-/ Software/NPB/.
26. Network-Based Computing Laboratory, "MVAPICH: MPI for InfiniBand on VAPI Layer." http://nowlab.cse.ohiostate.edu/projects/mpi-iba/.
27. P. H. Carns and W. B. Ligon III and R. B. Ross and R. Thakur, "PVFS: A Parallel File System For Linux Clusters," Proceedings of the 4th Annual Linux Showcase and Conference, Atlanta, GA, 2000.
28. PCI-SIG, "PCI I/O Virtualization." http://www.pcisig.com/.
29. J. Sugerman, G. Venkitachalam, and B. Lim, "Virtualizing I/O devices on VMware Workstation's Hosted Virtual Machine Monitor," The USENIX Annual Technical Conference, 2001.
30. R. Thakur, W. Gropp, and E. Lusk, "An Abstract-Device Interface for Implementing Portable Parallel-I/O Interfaces," Proceedings of Frontiers '96: The Sixth Symposium on the Frontiers of Massively Parallel Computation, 1996.
31. R. Thakur, W. Gropp, and E. Lusk, "On Implementing MPI-IO Portably and with High Performance," Proceedings of the 6th Workshop on I/O in Parallel and Distributed Systems, 1999.
32. The National Center for SuperComputing, "HDF5 Home Page."
33. A. Whitaker, M. Shaw, and S. Gribble, "Denali: Lightweight virtual machines for distributed and networked applications," the USENIX Annual Technical Conference, Monterey, CA, 2002.
34. A. Whitaker, M. Shaw, and S. Gribble, "Scale and Performance in the Denali Isolation Kernel," Operating Systems Design and Implementation, 2002.
35. P. Wong and R. F. Van der Wijngaart, "NAS Parallel Benchmarks I/O Version 2.4," Technical Report NAS-03-002, NASA Advanced Supercomputing (NAS) Division 2002.
36. L. Youseff, R. Wolski, B. Gorda, and C. Krintz, "Paravirtualization for HPC Systems.," Workshop on Xen in High-Performance Cluster and Grid Computing, 2006.