RobuSTore: A distributed storage architecture with robust and high performance

Proceedings of the 2007 ACM/IEEE Conference on Supercomputing, SC'07

Volumn , Issue , 2007, Pages

  Xia, Huaxia ^a,b   Chien, Andrew A ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b GOOGLE INC   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTERS; DISKS (MACHINE COMPONENTS); SPEED CONTROL; TELECOMMUNICATION SYSTEMS; WATER WELL PUMPS;

ACCESS LATENCIES; ACCESS MECHANISMS; DISK PERFORMANCES; DISTRIBUTED ENVIRONMENTS; DISTRIBUTED STORAGES; ERASURE CODES; GB DATUMS; I/O OPERATIONS; LARGE DATUMS; PARALLEL STORAGE SYSTEMS; PARALLEL WRITE; READ OPERATIONS; ROBUST PERFORMANCES; SCIENTIFIC APPLICATIONS; SIMULATION RESULTS; STANDARD DEVIATIONS; STORAGE CAPACITIES;

DISKS (STRUCTURAL COMPONENTS);

EID: 56749183898     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1362622.1362682     Document Type: Conference Paper

References (29)

1. Smarr, L.L., et al., The OptIPuter. Communications of the ACM, 2003. 46(11): p. 58-67.
2. iGrid2005. San Diego, CA, Sep 26-30, 2005; http://www.igrid2005. org.
3. Grochowski, E. and R.D. Halem, Technological impact of magnetic hard disk drives on storage systems. IBM Systems Journal, 2003. 42(2): p. 338-346.
4. Luby, M. LT Codes. in Proc. IEEE Symp. On Foundations of Computer Science 2002. 2002.
5. Shokrollahi, A., Raptor codes. 2003, Digital Fountain and EPFL.
6. Plank, J.S., A Tutorial on Reed-Solomon Coding for Fault-Tolerance in RAID-like Systems. Software - Practice & Experience, 1997. 27(9): p. 995-1012.
7. Reed, I. and G. Solomon, Polynomial codes over certain finite fields. Journal of the Society for Industrial and Applied Mathematics, 1960. 8(2): p. 300-304.
8. Gallager, R.G., Low Density Parity-Check Codes. 1963, Cambridge, MA: MIT Press.
9. Uyeda, F., H. Xia, and A. Chien, Evaluation of a High Performance Erasure Code Implementation. 2004, UCSD.
10. Bucy, J.S. and G.R. Ganger, The DiskSim Simulation Environment Version 3.0 Reference Manual. 2003, Carnegie Mellon University.
11. Biomedical Informatics Research Network (BIRN). http://www.nbirn.net.
12. GriPhyN: Grid Physics Network. http://www.griphyn.org.
13. The EarthScope Project. http://www.earthscope.org.
14. Patterson, D.A., G.A. Gibson, and R.H. Katz. A Case for Redundant Arrays of Inexpensive Disks (RAID). in International Conference on Management of Data (SIGMOD). 1988.
15. Cams, P.H., et al. PVFS: A Parallel File System For Linux Clusters. in 4th Annual Linux Showcase and Conference. 2000. Atlanta, GA.
16. Schmuck, F. and R. Haskin. GPFS: A Shared-Disk File System for Large Computing Clusters. in USENIX Conference on File and Storage Technologies (FAST). 2002. Monterey, CA.
17. System, C.F., Lustre: A Scalable, High-Performance File System. 2002, Lustre File System v1.0 Architecture White Paper from clusterfs.org.
18. Nagle, D., D. Serenyi, and A. Matthews. The Panasas ActiveScale Storage Cluster - Delivering Scalable High Bandwidth Storage. in ACM/IEEE Conference on Supercomputing, 2004 (SC'04). 2004. Pittsburgh, PA.
19. Kazaa. http://www.kazaa.com.
20. BitTorrent. http://www.bittorrent.com.
21. Corbett, P.F. and D.G. Feitelson, The Vesta parallel file system. ACM Transactions on Computer Systems, 1996. 14: p. 225-264.
22. Abd-El-Malek, M., et al. Fault-Scalable Byzantine Fault-Tolerant Services. in Symposium on Operating Systems Principles. 2005. Brighton, UK.
23. Kubiatowicz, J., D. Bindel, and e. al. OceanStore: An Architecture for Global-Scale Persistent Storage. in the Ninth international Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS). 2000. Cambridge, MA.
24. Bhagwan, R., et al. Total recall: System support for automated availability management. in the First ACM/XJsenix Symposium on Networked Systems Design and Implementation (NSDI). 2004. San Francisco, CA.
25. Weatherspoon, H. and J.D. Kubiatowicz. Erasure Coding vs. Replication: A Quantitative Comparison. in the First International Workshop on Peer-to-Peer Systems (IPTPS). 2002. Cambridge, MA.
26. Aguilera, M.K., R. Janakiraman, and L. Xu. Using Erasure Codes Efficiently for Storage in a Distributed System. in DSN 2005: The International Conference on Dependable Systems and Networks. 2005. Yokohama, Japan.
27. Collins, R.L. and J.S. Plank. Assessing the performance of Erasure Codes in the Wide Area. in DSN-2005: The International Conference on Dependable Systems and Networks. 2005. Yokohama, Japan.
28. Lumb, C.R., R. Golding, and G.R. Ganger, D-SPTF: decentralized request distribution in brick-based storage systems, in 11th International Conference on Architectural Support for Programming Languages and Operating Systems. 2004: Boston, MA.
29. Wu, C. and R. Burns, Improving I/O Performance of Clustered Storage Systems by Adaptive Request Distribution, in The 15th IEEE International Symposium on High Performance Distributed Computing (HPDC-15). 2006: Paris.