Enhancing I/O throughput via efficient routing and placement for large-scale parallel file systems

Conference Proceedings of the IEEE International Performance, Computing, and Communications Conference

Volumn , Issue , 2011, Pages

  Dillow, David A ^a   Shipman, Galen M ^a   Oral, Sarp ^a   Zhang, Zhe ^b   Kim, Youngjae ^a  

^a OAK RIDGE NATIONAL LABORATORY   (United States)

^b IBM T J WATSON RESEARCH CENTER   (United States)

Author keywords

Lustre file systems; Network congestion; SeaStar network; Spider

Indexed keywords

COMPUTE RESOURCES; COMPUTING FACILITIES; CONGESTION POINTS; EFFICIENT ROUTING; FILE SYSTEMS; LARGE DATASETS; NETWORK CONGESTION; PARALLEL FILE SYSTEM; PETASCALE; RUNTIMES; SCIENTIFIC APPLICATIONS; SPIDER; STORAGE NODES; STORAGE SYSTEMS;

BANDWIDTH; COMPUTER SOFTWARE SELECTION AND EVALUATION;

FILE ORGANIZATION;

EID: 84862932185     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/PCCC.2011.6108062     Document Type: Conference Paper

References (26)

1. Innovative and Novel Computational Impact on Theory and Experiment (INCITE) Awards Fact Sheet. http://science.energy.gov/~/media/ascr/pdf/incite/ docs/2011-incite-factsheets.pdf.
2. Dennis Abts. The Cray XT4 and Seastar 3-D Torus Interconnect. http://research.google.com/pubs/archive/36896.pdf, 2010.
3. Dennis Abts and Deborah Weisser. Age-based packet arbitration in large-radix k-ary n-cubes. In SC, 2007.
4. Sadaf R. Alam, Jeffery A. Kuehn, Richard F. Barrett, Jeff M. Larkin, Mark R. Fahey, Ramanan Sankaran, and Patrick H. Worley. Cray xt4: an early evaluation for petascale scientific simulation. In Proceedings of the 2007 ACM/IEEE conference on Supercomputing, SC '07, pages 39:1-39:12, New York, NY, USA, 2007. ACM.
5. B. Azeez, H. Kim, Y. Jin, and E.J. Kim. I/O Node Placement for Performance and Reliability in Torus Networks. In International Conference on Parallel and Distributed Computing and Systems (PCDS2006), IASTED, 2006.
6. Arthur Bland, Ricky Kendall, Douglas Kothe, James Rogers, and Galen Shipman. Jaguar: The world's most powerful computer. In Proceedings of the Cray User Group Conference, 2009.
7. Ron Brightwell, Trammell Hudson, Kevin Pedretti, Rolf Riesen, and Keith D. Underwood. Implementation and performance of Portals 3.3 on the Cray XT3. In Proceedings of the 2005 IEEE International Conference on Cluster Computing, 2005.
8. Ron Brightwell, Kevin Pedretti, and Trammell Hudson. Smartmap: operating system support for efficient data sharing among processes on a multi-core processor. In Proceedings of the 2008 ACM/IEEE conference on Supercomputing, SC '08, pages 25:1-25:12, Piscataway, NJ, USA, 2008. IEEE Press.
9. Ron Brightwell, Kevin Pedretti, and Keith D. Underwood. Initial performance evaluation of the cray seastar interconnect. High-Performance Interconnects, Symposium on, 0:51-57, 2005.
10. Ron Brightwell, Kevin T. Pedretti, Keith D. Underwood, and Trammell Hudson. Seastar interconnect: Balanced bandwidth for scalable performance. IEEE Micro, 26:41-57, May 2006.
11. Christian Y. Cardall, Eirik Endeve, Reuben D. Budiardja, Pedro Marronetti, and Anthony Mezzacappa. Towards exascale supernova simulations with GenAsis. In Proceedings of the SciDAC 2010 Workshop, 2010.
12. C.S. Chang and S. Ku. Spontaneous rotation sources in a quiescent tokamak edge plasma. Physics of Plasmas, 15, 2008.
13. J. Cummings, A. Pankin, N. Podhorszki, G. Park, Ku S., R. Barreto, S. Klaksy, C.S. Chang, H Strauss, L. Sugiyama, P. Snyder, D. Pearlstein, B. Ludascher, G. Bateman, A. Kritz, and the CPES Team. Plasma edge kinetic-mhd modeling in tokamaks using kepler workflow for code coupling, data management and visualization. Communications in Computational Physics, 4:675-702, 2008.
14. Data Direct Networks. DDN S2A9900. http://www.ddn.com/9900.
15. Patrick Geoffray and Torsten Hoefler. Adaptive routing strategies for modern high performance networks. High-Performance Interconnects, Symposium on, 0:165-172, 2008.
16. G. Grider, H. Chen, J. Nunez, S. Poole, R. Wacha, P. Fields, R. Martinez, P. Martinez, S. Khalsa, A. Matthews, and G. Gibson. Pascal - a new parallel and scalable server io networking infrastructure for supporting global storage/file systems in large-size linux clusters. Performance, Computing, and Communications Conference, 2002. 21st IEEE International, 0:46, 2006.
17. GTC (Global Gyrokinetic Toroidal Code). http://w3.pppl.gov/theory/GPSC. html.
18. E.R. Hawkes, R. Sankaran, J.C. Sutherland, and J.H. Chen. Direct numerical simulation of turbulent combustion: fundamental insights towards predictive models. Journal of Physics: Conference Series, 16:6579, 2005.
19. David Nagle, Denis Serenyi, and Abbie Matthews. The panasas activescale storage cluster: Delivering scalable high bandwidth storage. In Proceedings of the 2004 ACM/IEEE conference on Supercomputing, SC'04, pages 53-, Washington, DC, USA, 2004. IEEE Computer Society.
20. Fabrizio Petrini, Wu-chun Feng, Adolfy Hoisie, Salvador Coll, and Eitan Frachtenberg. The quadrics network: High-performance clustering technology. IEEE Micro, 22:46-57, January 2002.
21. H. Shan and J. Shalf. Using IOR to analyze the I/O performance of XT3. In Proceedings of the 49th Cray User Group (CUG) Conference 2007, Seattle, WA, 2007.
22. Galen M. Shipman, David Dillow, Sarp Oral, and Feiyi Wang. The Spider center wide file system: From concept to reality. In Proceedings of the Cray User Group Conference, 2009.
23. Sun Microsystems. Lustre networking: High-performance features and flexible support for a wide array of networks. white paper, Sun Microsystems, 2008.
24. J.C. Sutherland. Evaluation of mixing and reaction models for large-eddy simulation of nonpremixed combustion using direct numerical simulation. Phd dissertation, Department of Chemical and Fuels Engineering, University of Utah, 2004.
25. Feiyi Wang, Sarp Oral, Galen Shipman, Oleg Drokin, Tom Wang, and Isaac Huang. Understanding Lustre Filesystem Internals. Technical Report ORNL/TM-2009/117, Oak Ridge National Lab., National Center for Computational Sciences, 2009.
26. Dong Xiang, Yi Pan, Qi Wang, and Zhen Chen. Deadlock-free fully adaptive routing in 2-dimensional tori based on new virtual network partitioning scheme. Distributed Computing Systems, International Conference on, 0:454-461, 2008.