Experiences with a lightweight supercomputer kernel: Lessons learned from Blue Gene's CNK

2010 ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis, SC 2010

Volumn , Issue , 2010, Pages

  Giampapa, Mark ^a   Gooding, Thomas ^b   Inglett, Todd ^b   Wisniewski, Robert W ^a  

^a IBM T J WATSON RESEARCH CENTER   (United States)

^b IBM   (United States)

Author keywords

HPC system; Lightweight kernel; Supercomputer

Indexed keywords

BLUE GENE; CURRENT GENERATION; HARDWARE FEATURES; HPC SYSTEM; LIGHTWEIGHT KERNEL; LINUX ENVIRONMENT; LOW NOISE; PETA-SCALE COMPUTING; PETASCALE; REPRODUCIBILITIES;

COMPUTER OPERATING SYSTEMS; GENES;

SUPERCOMPUTERS;

EID: 78650828119     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/SC.2010.22     Document Type: Conference Paper

References (27)

1. Argonne's Blue Gene/P open source repository. http://wiki.bg.anlexternal. org/index.php.
2. International exascale software project. www.exascale.org.
3. Kitten lightweight kernel. https://software.sandia.gov/trac/kitten.
4. The l4 microkernel. http://ertos.nicta.com.au/research/l4/.
5. NASA's Pleiades Machine. http://www.nas.nasa.gov/Resources/Systems/ pleiades.html.
6. Red Storm web page. http://www.sandia.gov/ASC/redstorm.html.
7. SGI's Altix Family. http://www.sgi.com/products/servers/altix/.
8. The FTQ/FWQ Benchmark at LLNL. https://asc.llnl.gov/sequoia/benchmarks/ FTQs-ummary-v1.1.pdf.
9. The Phloem Benchmark at LLNL. https://asc.llnl.gov/sequoia/benchmarks/ PhloemMPIBenchmarks-summary-v1.0.pdf.
10. ZeptoOS: The small linux for big computers. http://www.mcs.anl.gov/ research/projects/zeptoos/.
11. S. Alam, R. Barrett, M. Bast, M. Fahey, J. Kuehn, C. McCurdy, J. Rogers, P. Roth, R. Sankaran, J. Vetter, P. Worley, and W. Yu. Early evaluation of BlueGene/P. In Supercomputing, 2008.
12. R. Brightwell. Catamount N-Way Lightweight Kernel. http://www.sandia.gov/ mission/ste/r&d100/2009winners/CNWFinal.pdf.
13. K. B. Ferreira, P. Bridges, and R. Brightwell. Characterizing application sensitivity to os interference using kernel-level noise injection. In Supercomputing, 2008.
14. M. E. Giampapa, R. Bellofatto, M. A. Blumrich, D. Chen, M. B. Dombrowa, A. Gara, R. A. Haring, P. Heidelberger, D. Hoenicke, G. V. Kopcsay, B. J. Nathanson, B. D. Steinmacher-Burow, M. Ohmacht, V. Salapura, and P. Vranas. Blue gene/l advanced diagnostics environment. IBM Journal for Research and Development, 49(2), 2005.
15. J. N. Glosli, K. J. Caspersen, J. A. Gunnels, D. F. Richards, R. E. Rudd, and F. H. Streitz. Extending stability beyond cpu millennium a micron-scale atomistic simulation of kelvin-helmholtz instability. In Supercomputing, Reno, November 2007.
16. E. V. Hensbergen, C. Forsyth, J. McKie, and R. Minnich. Petascale Plan 9 on Blue Gene. In Usenix 2007, Santa Clara, CA, June 17-22 2007.
17. IBM Blue Gene Team. Overview of the Blue Gene/P project. IBM Journal for Research and Development, 52(1/2), January 2008.
18. L. S. Kaplan. Lightweight Linux for high-performance computing. Linux World.com, http://www.linuxworld.com/news/2006/120406-lightweight-linux.html, December 2006.
19. S. Kelly and R. Brightwell. Software architecture of the lightweight kernel, Catamount. In Cray Users' Group Annual Technical Conference, Albuquerque, New Mexico, June 2005.
20. S. Kumar, G. Dozsa, G. Almasi, D. Chen, M. E. Giampapa, P. Heidelberger, M. Blocksome, A. Faraj, J. Parker, J. Ratterman, B. Smith, and C. Archer. The deep computing messaging framework: Generalized scalable message passing on the Blue Gene/P Supercomputer. In ICS, June 2008.
21. J. Lange, K. Pedretti, T. Hudson, P. Dinda, Z. Cui, L. Xia, P. Bridges, A. Gocke, S. Jaconette, M. Levenhagen, and R. Brightwell. Palacios: A new open source virtual machine monitor for scalable high performance computing. In IPDPS, April 2010.
22. J. Lange, K. Pedretti, T. Hudson, P. Dinda, Z. Cui, L. Xia, P. Bridges, S. Jaconette, M. Levenhagen, R. Brightwell, and P. Widener. Palacios and Kitten: High performance operating systems for scalable virtualized and native supercomputing. Technical report, EECS Northwestern University, July 2009.
23. J. Moreira, M. Brutman, J. Castanos, T. Engelsiepen, M. Giampapa, T. Gooding, R. Haskin, T. Inglett, D. Lieber, P. McCarthy, M. Mundy, J. Parker, and B. Wallenfelt. Designing a highly-scalable operating system. In Supercomputing, November 2006.
24. F. Petrini, D. J. Kerbyson, and S. Pakin. The case of the missing supercomputer performance: Achieving optimal performance on the 8, 192 processors of ASCI Q. In Supercomputing 2003, November 2003.
25. R. Riesen, R. Brightwell, P. G. Bridges, T. Hudson, A. B. Maccabe, P. M. Widener, and K. Ferreira. Designing and implementing lightweight kernels for capability computing. Concurrency and Computation: Practice and Experience, 21(6):793-817, April 2009.
26. E. Shmueli, G. Almasi, J. Brunheroto, J. Castanos, G. Dozsa, S. Kumar, and D. Lieber. Evaluating the effect of replacing CNK with Linux on the compute-nodes of Blue Gene/L. In 22nd ACM International Conference on Supercomputing, Island of Kos, Aegean Sea, Greece, June 7-12 2008.
27. D. Wallace. Compute Node Linux: Overview, progress to date & roadmap. http://www.nccs.gov/wpcontent/uploads/2007/08/wallacepaper.pdf, 2007.