RAID-x: A new distributed disk array for I/O-centric cluster computing

Proceedings of the IEEE International Symposium on High Performance Distributed Computing

Volumn 2000-January, Issue , 2000, Pages 279-286

  Hwang, Kai ^a   Jin, Hai ^a,b   Ho, Roy ^b  

^a UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

^b UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

Bandwidth; Checkpointing; Computer applications; Computer architecture; Concurrent computing; Distributed computing; Linux; Packaging; Reliability; Scalability

Indexed keywords

BANDWIDTH; BENCHMARKING; CLUSTER COMPUTING; COMPUTER APPLICATIONS; COMPUTER ARCHITECTURE; COMPUTER OPERATING SYSTEMS; COMPUTER SOFTWARE MAINTENANCE; LINUX; NONVOLATILE STORAGE; PACKAGING; RELIABILITY; SCALABILITY; INPUT OUTPUT PROGRAMS; INTERCONNECTION NETWORKS; INTERNET; MAGNETIC DISK STORAGE; PERSONAL COMPUTERS; UNIX;

ALL DISTRIBUTED; CHECK POINTING; CLUSTER ENVIRONMENTS; COMPUTING APPLICATIONS; CONCURRENT COMPUTING; DISTRIBUTED I/O; DISTRIBUTED RAID; SYSTEM RELIABILITY;

DISTRIBUTED COMPUTER SYSTEMS; PARALLEL PROCESSING SYSTEMS;

CENTRIC CLUSTER COMPUTING; DISTRIBUTED DISK ARRAY; ORTHOGONAL STRIPING AND MIRRORING; REDUNDANT ARRAY OF INEXPENSIVE DISK;

EID: 0033720549     PISSN: 10828907     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/HPDC.2000.868660     Document Type: Conference Paper

References (32)

1. T. Anderson, M. Dahlin, J. Neefe, D. Patterson, D. Roselli, and R. Wang. "Serverless Network File Systems". ACM Trans. on Computer Systems, Jan. 1996, pp.41-79.
2. Rajkumar Buyya (ed.). High Perf. Cluster Computing, Prentice Hall PTR, New Jersey, 1999.
3. L. F. Cabrera, and D. E. Long, "Swift: Using Distributed Disk Striping to Provide High I/O Data Rates", Proceedings of USENIX Computing Systems, Fall 1991, pp.405-433.
4. P. Cao, S. B. Lim, S. Venkataraman, and J. Wilkes, "The TickerTAlP Parallel RAID Architecture", ACM Trans. on Computer System, Vol.12, No.3, August 1994, pp.236-269.
5. P. M. Chen, E. K. Lee, G. A. Gibson, R. H. Katz and D. A. Patterson; "RAID: High-Performance, Reliable Secondary Storage", ACM Computing Surveys, Vol.26, No.2, June 1994, pp. 145-185.
6. M. Dahlin, R. Wang, T. Anderson, D. Patterson. "Cooperative Caching: Using Remote Client Memory to Improve File System Performance". Proc. of Operating System Design and Implementation, 1994.
7. I. Foster and C. Kesselman, (Eds.). The Grid: Buleprint for a New Computing Infrastructure. Morgan-Kaufmann, 1998.
8. I. Foster, D. Kohr, Jr., R. Krishnaiyer, and J. Mogill. "Remote I/O: Fast Access to Distant Storage". Proc. of the Fifth Annual Workshop on I/O in Parallel and Distri. Systems, Nov. 1997, pp.14-25.
9. G. Gibson, D. Nagle, K. Amiri, F. Chang, H. Gobioff, E. Riedel, D. Rochberg and J. Zelenka, "A Cost-effective, High-bandwidth Storage Architecture", Proc. of the 8th Conf. on Architectural Support for Programming Langagues and Operating Systems, 1998.
10. J. H. Hartman, I. Murdock, and T. Spalink. "The Swarm Scalable Storage System." Proceedings of the 19th IEEE International Conf. on Distributed Computing Systems (ICDCS'99), June 1999.
11. J. H. Hartman, and J. K. Ousterhout, "The Zebra Striped Network File System", ACM Transactions on Computer System, Vol.13, No3, Aug. 1995, pp.274-310.
12. J. H. Howard, et al., "Scale and Performance in a Distributed File System". ACM Trans. on Computer System, Vol.6, No.1, pp.51-81, February, 1988.
13. th International Data Engineering Conf., 1990, pp.456-465.
14. Y. Hu and Q. Yang, "DCD - Disk Caching Disk: A New Approach for Boosting I/O Performance", Proc. of the 23rd International Symp. on Computer Architecture, 1996, pp. 169-177.
15. K. Hwang, H. Jin, et al, "Reliable Cluster Computing with a New Checkpointing RAID-x Architecture", Proc. of 9-th Heter. Comp. Workshop (HCW-2000), Cancun, Mexico, May 1, 2000, pp.171-184.
16. K. Hwang, H. Jin, E. Chow, C.L. Wang, and Z. Xu. "Designing SSI Clusters with Hierarchical Checkpointing and Single I/O Space". IEEE Concurrency, March 1999, pp.60-69.
17. K. Hwang and Z. Xu. Scalable Parallel Computing, McGraw-Hill, New York, 1998.
18. H. Jin and K. Hwang, "Striped Mirroring Disk Array", Journal of Systems Architecture, Elsevier Science, Vol.46, No.6, April, 2000, pp.543-550.
19. E. K. Lee and C. A. Thekkath. "Petal: Distributed Virtual Disks". Proc. of the Seventh Int'l Conf. on Arch. Support for Prog. Languages and Operating Systems, October 1996, pp.84-92.
20. W. B. Ligon and R. B. Ross. "An Overview of the Parallel Virtual File System". Proceedings of the 1999 Extreme Linux Workshop, June 1999.
21. J. Nieplocha, I. Foster, H. Dachsel, "Distant I/O: One-Sided Access to Secondary Storage on Remote Processors", Proc. of Symp. High Perf. Distri. Computing (HPDC-7), 1998, pp. 148-154.
22. N. Nieuwejaar and D. Kotz. "Performance of the Galley Parallel File System". Proceedings of the Fourth Workshop on I/O in Parallel and Distributed Systems, pp.83-94, Philadelphia, May 1996.
23. W. Ro and K. Hwang, "Striped and Staggered Checkpointing on Distributed RAID", Technical Report, University of Southern California.
24. RAID Advisory Board, The RAIDbook, Seventh Edition, December, 1998.
25. R. Sandberg, D. Goldberg, S. Kleiman, D. Walsh, and B. Lyon, "Design and Implementation of the Sun Network Filesystem", Proc. of the USENIX Conference, June 1985, pp.119-130.
26. S. Savage and J. Wilkes, "AFRAID - A Frequently Redundant Array of Independent Disks", Proc. of 1996 USENIX Technical Conference, January 1996, pp. 27-39.
27. M. Stonebraker and G. A. Schloss, "Distributed RAID - a New Multiple Copy Algorithm", Proc. of the Sixth International Conf. on Data Engineering, Feb. 1990, pp.430-437.
28. N. Talagala, S. Asami, D. Patterson, and K. Lutz, "Tertiary Disk: Large Scale Distributed Storage", UCB Technical Report No. UCB//CSD-98-989.
29. C. A. Thekkath, T. Mann, and E. K. Lee. "Frangipani: A Scalable Distributed File System". Proceedings of ACM Symp. of Operating Systems Principles, Oct. 1997, pp.224-237.
30. N. H. Vaidya, "A Case for Two-Level Distributed Recovery Schemes", Proc. ACM International Conf. on Measurement and Modeling of Computer Systems (Sigmetrics '95), pp.64-73.
31. J. Wilkes, R. Golding, C. Staelin, and T. Sullivan, "The HP AutoRAID Hierarchical Storage System", ACM Transactions on Computer Systems, Vol.14, No.1, February 1996, pp.108-136.
32. N. H. Vaidya, "Staggered Consistent Checkpointing", IEEE Transactions on Parallel and Distributed Systems, 1999, Vol. 10, No. 7, pp. 694-702.