Provisioning a multi-tiered data staging area for extreme-scale machines

Proceedings - International Conference on Distributed Computing Systems

Volumn , Issue , 2011, Pages 1-12

  Prabhakar, Ramya ^a   Vazhkudai, Sudharshan S ^b   Kim, Youngjae ^b   Butt, Ali R ^c   Li, Min ^c   Kandemir, Mahmut ^a  

^a PENNSYLVANIA STATE UNIVERSITY   (United States)

^b OAK RIDGE NATIONAL LABORATORY   (United States)

^c VIRGINIA POLYTECHNIC INSTITUTE AND STATE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CHECK POINTING; COMPONENT TECHNOLOGIES; COST SAVING; DATA STAGING; DYNAMIC DATA; HIGH DATA RATE; HIGH PERFORMANCE COMPUTING SYSTEMS; I/O PERFORMANCE; LARGE-SCALE CLUSTERS; MULTI-TIERED; PARALLEL FILE SYSTEM; PARALLEL SCIENTIFIC APPLICATIONS; PERFORMANCE REQUIREMENTS; STORAGE SOLUTIONS;

COMPUTER SOFTWARE SELECTION AND EVALUATION; DATA HANDLING; DISTRIBUTED COMPUTER SYSTEMS; FILE ORGANIZATION; SUPERCOMPUTERS;

DYNAMIC RANDOM ACCESS STORAGE;

EID: 80051867217     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICDCS.2011.33     Document Type: Conference Paper

References (32)

1. Jaguar. http://www.nccs.gov/computing-resources/jaguar/2010.
2. National Institute for Computational Sciences. http://www.nics.tennessee. edu/computing-resources/kraken, 2010.
3. Samer Al-Kiswany, Matei Ripeanu, and Sudharshan S. Vazhkudai. Aggregate memory as an intermediate checkpoint storage device. Technical Report 013521, Oak Ridge National Laboratory, Oak Ridge, TN, November 2008.
4. Guillermo A. Alvarez, Elizabeth Borowsky, Susie Go, Theodore H. Romer, Ralph Becker-Szendy, Richard Golding, Arif Merchant, Mirjana Spasojevic, Alistair Veitch, and John Wilkes. Minerva: An automated resource provisioning tool for large-scale storage systems. ACM Trans. Comput. Syst., 19:483-518, November 2001. (Pubitemid 33614267)
5. Eric Anderson, Michael Hobbs, Kimberly Keeton, Susan Spence, Mustafa Uysal, and Alistair Veitch. Hippodrome: Running circles around storage administration. In Proceedings of the 1st USENIX Conference on File and Storage Technologies, FAST'02, Berkeley, CA, USA, 2002. USENIX Association.
6. Eric Anderson, Mahesh Kallahalla, Susan Spence, Ram Swaminathan, and Qian Wang. Ergastulum: Quickly finding near-optimal storage system designs. In Technical Report HPLSSP 200105, Hewlett-Packard Laboratories,, 2001.
7. Microsoft Corporation. Microsoft windows ready-boost. http://www.microsoft.com/windows/windows-vista/features/readyboost.aspx.
8. FUSE Development. Fuse: Filesystem in user space. http://sourceforge.net/ apps/mediawiki/fuse/index.php.
9. M. Meisner et al. Making the most of your ssd: a case for differentiated storage services. In FAST, Work in Progress, 2009.
10. Jiahua He, Jeffrey Bennett, and Allan Snavely. Dash-io: an empirical study of flash-based io for hpc. In Proceedings of the 2010 TeraGrid Conference, TG'10, pages 10:1-10:8, New York, NY, USA, 2010. ACM.
11. Intel. Intel x25-e extreme sata solid-state drive. http://www.intel.com/ design/flash/nand/extreme/index.htm.
12. Taeho Kgil, David Roberts, and Trevor Mudge. Improving nand flash based disk caches. In Proceedings of the 35th Annual International Symposium on Computer Architecture, ISCA'08, pages 327-338, Washington, DC, USA, 2008. IEEE Computer Society.
13. Youngjae Kim, Aayush Gupta, and Bhuvan Urgaonkar. Mixedstore: An enterprise-scale storage system combining solid-state and hard disk drives. Technical Report CSE-08-017, Dept. of Computer Science and Engineering, The Pennsylvania State University, University Park, PA, August 2008.
14. Pavan Konanki and Ali R. Butt. An exploration of hybrid hard disk designs using an extensible simulator. In Masters Thesis, Virginia Tech, 2008.
15. Min Li, Sudharshan S. Vazhkudai, Ali R. Butt, Fei Meng, Xiaosong Ma, Youngjae Kim, Christian Engelmann, and Galen M. Shipman. Functional partitioning to optimize end-to-end performance on manycore architectures. In Proceedings of the 2010 ACM/IEEE conference on Supercomputing, SC'10, 2010.
16. Thanos Makatos, Yannis Klonatos, Manolis Marazakis, Michail D. Flouris, and Angelos Bilas. Using transparent compression to improve ssd-based i/o caches. In Proceedings of the 5th European conference on Computer systems, EuroSys'10, pages 1-14, New York, NY, USA, 2010. ACM.
17. Jeanna Matthews, Sanjeev Trika, Debra Hensgen, Rick Coulson, and Knut Grimsrud. Intel turbo memory: Nonvolatile disk caches in the storage hierarchy of mainstream computer systems. Trans. Storage, 4:4:1-4:24, May 2008.
18. Dushyanth Narayanan, Eno Thereska, Austin Donnelly, Sameh Elnikety, and Antony Rowstron. Migrating server storage to ssds: analysis of tradeoffs. In Proceedings of the 4th ACM European conference on Computer systems, EuroSys'09, pages 145-158, New York, NY, USA, 2009. ACM.
19. Michael L. Norman and Allan Snavely. Accelerating data-intensive science with gordon and dash. In Proceedings of the 2010 TeraGrid Conference, TG'10, pages 14:1-14:7, New York, NY, USA, 2010. ACM.
20. U.S. Department of Energy. DOE exascale initiative technical roadmap, December 2009. http://extremecomputing.labworks.org/hardware/collaboration/EI- RoadMapV21-SanDiego.pdf.
21. Ruston Panabaker. Hybrid hard disk and readydrive technology: Improving performance and power for windows vista mobile pcs. http://www.microsoft.com/ whdc/system/sysperf/accelerator.mspx.
22. Stan Park and Kai Shen. A performance evaluation of scientific i/o workloads on flash-based ssds. In Workshop on Interfaces and Architectures for Scientific Data Storage (IASDS'09), 2009.
23. James S. Plank, Kai Li, and Michael A. Puening. Diskless checkpointing. IEEE Transactions on Parallel and Distributed Systems, 9(10):972- 986, October 1998. (Pubitemid 128747893)
24. Hannes Prayer, Marco A.A. Sanvido, Zvonimir Z. Bandic, and Christoph M. Kirsch. Combo drive: Optimizing cost and performance in a heterogeneous storage device. In First Workshop on Integrating Solid-state Memory into the Storage Hierarchy, March 2009.
25. David Roberts, Taeho Kgil, and Trevor Mudge. Integrating nand flash devices onto servers. Commun. ACM, 52:98-103, April 2009.
26. Mohit Saxena and Michael M. Swift. Flashvm: virtual memory management on flash. In Proceedings of the 2010 USENIX conference on USENIX annual technical conference, USENIXATC'10, pages 14-14, Berkeley, CA, USA, 2010. USENIX Association.
27. Gokul Soundararajan, Vijayan Prabhakaran, Mahesh Balakrishnan, and Ted Wobber. Extending ssd lifetimes with disk-based write caches. In Proceedings of the 8th USENIX conference on File and storage tech- nologies, FAST'10, Berkeley, CA, USA, 2010. USENIX Association.
28. John D. Strunk, Eno Thereska, Christos Faloutsos, and Gregory R. Ganger. Using utility to provision storage systems. In Proceedings of the 6th USENIX Conference on File and Storage Technologies, FAST'08, pages 21:1-21:16, Berkeley, CA, USA, 2008. USENIX Association.
29. Top 500 Supercomputers. http://www.top500.org.
30. TSUBAME2. http://www.gsic.titech.ac.jp/en/tsubame2.
31. W.X. Wang, Z. Lin, W.M. Tang, W.W. Lee, S. Ethier, J.L.V. Lewandowski, G. Rewoldt, T.S. Hahm, and J. Manickam. Gyrokinetic simulation of global turbulent transport properties in tokamak experiments. Physics of Plasmas, 13, 2006.
32. Fang Zheng, Hasan Abbasi, Ciprian Docan, Jay Lofstead, Qing Liu, Scott Klasky, Manish Parashar, Norbert Podhorszki, Karsten Schwan, and Matthew Wolf. Predata - preparatory data analytics on petascale machines. In 24th IEEE International Parallel and Distributed Processing Symposium (IPDPS), 2010.