High-performance storage support for scientific applications on the cloud

ScienceCloud 2015 - Proceedings of the 6th Workshop on Scientific Cloud Computing, Part of HPDC 2015

Volumn , Issue , 2015, Pages 33-36

  Zhao, Dongfang ^a   Yang, Xu ^a   Sadooghi, Iman ^a   Garzoglio, Gabriele ^b   Timm, Steven ^b   Raicu, Ioan ^a,c  

^a ILLINOIS INSTITUTE OF TECHNOLOGY   (United States)

^b FERMI NATIONAL ACCELERATOR LABORATORY   (United States)

^c ARGONNE NATIONAL LABORATORY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CLOUD COMPUTING;

AMAZON EC2; DATA-INTENSIVE APPLICATION; DISTRIBUTED STORAGE; FILE SYSTEMS; SCIENTIFIC APPLICATIONS; STORAGE SUBSYSTEMS; STORAGE SYSTEMS;

DIGITAL STORAGE;

EID: 84981287230     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2755644.2755648     Document Type: Conference Paper

References (26)

1. K. Shvachko, et al. The hadoop distributed file system. In MSST, 2010.
2. S. Ghemawat, et al. The Google file system. In SOSP, 2003.
3. P. Carns, et al. Small-file access in parallel file systems. In IPDPS, 2009.
4. S3FS. https://code.google.com/p/s3fs/.
5. FUSE. http://fuse.sourceforge.net.
6. S. Weil, et al. Ceph: A scalable, high-performance distributed file system. In OSDI, 2006.
7. D. Zhao, et al. FusionFS: Toward supporting data-intensive scientific applications on extreme-scale distributed systems. In Big Data Conference, 2014.
8. S. Weil, et al. Crush: Controlled, scalable, decentralized placement of replicated data. In SC, 2006.
9. D. Zhao, et al. Distributed file systems for exascale computing. In SC, 2012.
10. D. Zhao, et al. Towards high-performance and cost-effective distributed storage systems with information dispersal algorithms. In CLUSTER, 2013.
11. D. Zhao, et al. Distributed data provenance for large-scale data-intensive computing. In CLUSTER, 2013.
12. D. Zhao, et al. Hycache+: Towards scalable high-performance caching middleware for parallel file systems. In CCGrid, 2014.
13. D. Zhao, et al. HyCache: A user-level caching middleware for distributed file systems. In IPDPSW, 2013.
14. D. Zhao, et al. Virtual chunks: On supporting random accesses to scientific data in compressible storage systems. In Big Data Conference, 2014.
15. D. Zhao, et al. Improving the i/o throughput for data-intensive scientific applications with efficient compression mechanisms. In SC, 2013.
16. Kodiak. https://www.nmc-probe.org/wiki/machines:kodiak.
17. Amazon EC2. http://aws.amazon.com/ec2.
18. FermiCloud. http://fclweb.fnal.gov/.
19. B. Welch, et al. Optimizing a hybrid SSD/HDD HPC storage system based on file size distributions. In MSST, 2013.
20. D. Nagle, et al. The Panasas activescale storage cluster: Delivering scalable high bandwidth storage. In SC, 2004.
21. D. Zhao, et al. Exploring reliability of exascale systems through simulations. In HPC, 2013.
22. F. Schmuck, et al. GPFS: A shared-disk file system for large computing clusters. In FAST, 2002.
23. P. Schwan. Lustre: Building a file system for 1,000-node clusters. In Linux symposium, 2003.
24. H. Wu, et al. A reference model for virtual machine launching overhead. IEEE Transactions on Cloud Computing, 2014.
25. H. Wu, et al. Modeling the virtual machine launching overhead under fermicloud. In CCGrid, 2014.
26. P. Carns, et al. PVFS: A parallel file system for linux clusters. In Annual Linux Showcase and Conference, 2000.