The HP AutoRAID hierarchical storage system

High Performance Mass Storage and Parallel I/O: Technologies and Applications

Volumn , Issue , 2001, Pages 90-106

  Wilkes, John ^a   Golding, Richard ^a   Staelin, Carl ^a   Sullivan, Tim ^a  

^a HEWLETT PACKARD LABORATORIES   (United States)

Author keywords

Aerospace electronics; Arrays; Hardware; Layout; Performance evaluation; Random access memory; Redundancy

Indexed keywords

COMPUTER HARDWARE; HARDWARE; REDUNDANCY;

AEROSPACE ELECTRONICS; ARRAYS; LAYOUT; PERFORMANCE EVALUATIONS; RANDOM ACCESS MEMORY;

RANDOM ACCESS STORAGE;

EID: 84929755167     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1109/9780470544839.ch7     Document Type: Chapter

References (61)

1. Akyrek, S., and Salem, K. 1993. Adaptive block rearrangement. Tech. Rep. CS-TR-2854.1, Department of Computer Science, Univ. of Maryland, College Park, Maryland.
2. Baker, M., Asami, S., Deprit, E., Ousterhout, J., and Seltzer, M. 1992. Non-volatile memory for fast, reli able file systems. In Proceedings of 5th International Conference on Architectural Supportfor Programming Languages and Operating Systems. Comput. Arch. News 20, ocr., 10-22.
3. Blackwell, T., Harris, J., and Seltzer, M. 1995. Heuristic cleaning algorithms in log-structured file systems. In Proceedings ofUSENIX 1995 Technical Conference on UNIX and Advanced Computing Systems. Use nix Association, Berkeley, Calif., 277-88.
4. Burkes, T., Diamond, B., and Voigt, D. 1995. Adaptive hierarchical RAID: a solution to the RAID 5 write problem. Part No. 5963-9151. Hewlett-Packard Storage Systems Division, Boise, Idaho.
5. Burrows, M., Jerian, c., Lampson, B., and Mann, T. 1992. On-line data compression in a log -structured file system. In Proceedings of 5th International Conference on Architectural Support for Programming Languages and Operating Systems. Comput. Arch. News 20, Oct., 2-9.
6. Cao, P., Lim, S. B., Venkataraman, S., and Wilkes, J. 1994. The TickerTAIP parallel RAID architecture. In ACM Trans. Comput. Syst. 12, 3 (Aug.), 236-269.
7. Carson, S., and Setia, S. 1992. Optimal write batch size in log-structured file systems. In USENIX Workshop on File Systems. USENIX Association, Berkeley, Calif., 79-91.
8. Cate, V. 1990. Two levels of filesystem hierarchy on one disk. Tech. Rep. CMU-CS-90-129. CarnegieMellon Univ., Pittsburgh, Penn.
9. Chao, C., English, R., Jacobson, D., Stepanov, A., and Wilkes, J. 1992. Mime: a high performance storage device with strong recovery guarantees. Tech. Rep. HPL92-44. Hewlett-Packard Laboratories, Palo Alto, Calif.
10. Chen, P. 1973. Optimal file allocation in multi -level storage hierarchies. In Proceedings of National Computer Conference. 277-82.
11. Chen, P. M., and Lee, E. K. 1993. Striping in a RAID level-5 disk array. Tech. Rep. CSE-TR-181-93. The Univ: ofMichigan, Ann Arbor, Mich.
12. Chen, P. M., Lee, E. K., Gibson, G. A., Katz, R. H., and Patterson, D. A. 1994. RAID: high-performance, reliable secondary storage. In ACM Comput. Surv. 26, 2 (June), 145-85.
13. Clegg, F. W., Ho, G. S.-F., Kusmer, S. R., and Sontag, J. R. 1986. The HP-UX operating system on HP Precision Architecture computers. In Hewlett-Packard Journal 37, 12 (Dec.). Hewlett-Packard Company, Palo Alto, Calif., 4-22.
14. Cohen, E. I., King, G. M., and Brady, J. T. 1989. Storage hierarchies. In IBM Systems Journal 28, 1. IBM Corp., Armonk, New York, 62-76.
15. DEC. 1993. POLYCENTER storage management for OpenVMS VAX systems. Digital Equipment Corp., Maynard, Mass.
16. de Jonge, W., Kaashoek, M. F., and Hsieh, W. C. 1993. The Logical Disk: a new approach to improving file systems. In Proceedings of 14th ACM Symposium on Operating Systems Principles. ACM, New York, 1528.
17. Deshpande, M. B., and Bunt, R. B. 1988. Dynamic file management techniques. In Proceedings of 7th IEEE Phoenix Conference on Computers and Communication.IEEE, New York, 86-92.
18. Art Rudeseal Private communication, Nov., 1994.
19. Dunphy, R. H. Jr., Walsh, R., Bowers, J. H., and Rudeseal, G. A. 1991. Disk drive memory. U. S. Patent 5,077,736; filed 13 Feb. 1990, granted 31 December 1991.
20. English, R. M., and Stepanov, A.A. 1992. Loge:a self-organizing storage device. In Proceedings of USENIX Winter’92 Technical Conference. Usenix Association, Berkeley, Calif., 237-251.
21. Epoch Systems Inc. 1988. Mass storage: server puts optical discs on line for workstations. In Electronics, November 1988.
22. Ewing, J. 1993. RAID: an overview. Part No. W17004A 09/93. Storage Technology Corporation, Louisville, Colo. Available as http://www.stortek.com: 80/S torageTek/RAID.html.
23. Floyd, R. A., and Schlatter Ellis, C. 1989. Directory reference patterns in hierarchical file systems. In IEEE Trans. Know. Data Eng. 1,2 (June), 238-247.
24. Geist, R., Reynolds, R., and Suggs, D. 1994. Minimizing mean seek distance in mirrored disk systems by cylinder remapping. In Performance Evaluation 20,1-3 (May), 97-114.
25. Gelb, J. P. 1989. System managed storage. In IBM Systems Journal 28, 1. IBM Corp., Armonk, New York, 77-103.
26. Golding, R., Staelin, C., Sullivan, T., and Wilkes, J. 1994. “Tel cures 98.3% of all known simulation configuration problems” claims astonished researcher! In Proceedings of Tcl/Tk Workshop. Available as Tech. Rep. HPL-CCD-94-11, Concurrent Computing Department, Hewlett-Packard Laboratories, Palo Alto, Calif.
27. Golding, R., Bosch, P., Staelin, C., Sullivan, T., and Wilkes, J. 1995. Idleness is not sloth. In Proceedings of USENIX 1995 Technical Conference on UNIX and Advanced Computing Systems. Usenix Association, Berkeley, Calif., 201-212.
28. Gray, J. 1990. A census of Tandem system availability between 1985 and 1990. Tech. Rep. 90.1. Tandem Computers Incorporated, Cupertino, Calif.
29. Henderson, R. L., and Poston, A. 1989. MSS-II and RASH: a mainframe Unix based mass storage system with a rapid access storage hierarchy file management system. In Proceedings of USENIX Winter 1989 Conference.Usenix Association, Berkeley, Calif., 65-84.
30. Holland, M., and Gibson, G.A. 1992. Parity declustering for continuous operation in redundant disk arrays. In Proceedings of5th International Conference on Architectural Support for Programming Languages and Operating Systems. omput. Arch. News 20, Oct., 2335.
31. Jacobson, D. M., and Wilkes, J. 1991. Disk scheduling algorithms based on rotational position. Tech. Rep. HPL-CSP-91-7. Hewlett-Packard Laboratories, Palo Alto, Calif.
32. Katz, R. H., Anderson, T. E., Ousterhout, I. K., and Patterson, D. A. 1991. Robo-line storage: low-latency, high capacity storage systems over geographically distributed networks. UCB/CSD 91/651. Computer Science Div., Department of Electrical Engineering and Computer Science, University of California at Berkeley, Berkeley, Calif.
33. Kohl, J. T., Staelin, C., and Stonebraker, M. 1993. HighLight: using a log-structured file system for tertiary storage management. In Proceedings of Winter 1993 USENIX. Usenix Association, Berkeley, Calif., 435-447.
34. Lawlor, F. D. 1981. Efficient mass storage parity recovery mechanism. In IBM Technical Discl. Bulletin24,2 (July). IBM Corp., Armonk, New York, 986-987.
35. Majumdar, S. 1984. Locality and file referencing behaviour: principles and applications. MSc thesis published as Tech. Rep. 84-14. Department of Computer Science, University ofSaskatchewan, Saskatoon, Saskatchewan.
36. McDonald, M. S., and Bunt, R. B. 1989. Improving file system performance by dynamically restructuring disk space. In Proceedings of Phoenix Conference on Computers and Communication. IEEE, New York, 264-269.
37. McNutt, B. 1994. Background data movement in a log-structured disk subsystem. IBM J. Res. and Development38,1. IBM Corp., Armonk, New York, 47-58.
38. Menon, J., and Kasson, J. 1989. Methods for improved update performance of disk arrays. Tech. Rep. RJ 6928 (66034). IBM Almaden Research Center, San Jose, Calif. Declassified 21 Nov., 1990.
39. Menon, J., and Kasson, J. 1992. Methods for improved update performance of disk arrays. In Proceedings of 25th International Conference on System Sciences.Vol. 1. IEEE, New York, 74-83.
40. Menon, J., and Mattson, D. 1992. Comparison of sparing alternatives for disk arrays. In Proceedings of19th International Symposium on Computer Architecture.ACM, New York, 318-329.
41. Menon, J., and Courtney, J. 1993. The architecture of a fault-tolerant cached RAID controller. In Proceedings of 20th International Symposium on Computer Architecture.ACM, New York, 76-86.
42. Miller, E. L. 1991. File migration on the Cray YMP at the National Center for Atmospheric Research. UCB/CSD 91/638, Computer Science Division, Department ofElectrical Engineering and Computer Science, University of California at Berkeley, Berkeley, Calif.
43. Misra, P. N. 1981. Capacity analysis of the mass storage system. In IBM Systems Journal 20, 3. IBM Corp., Armonk, New York, 346-361.
44. Mogi, K., and Kitsuregawa, M. 1994. Dynamic parity stripe reorganizations for RAID5 disk arrays. In Proceedings of Parallel and Distributed Information Systems International Conference. IEEE, New York, 1726.
45. Ousterhout, J., and Douglis, F. 1989. Beating the I/O bottleneck: a case for log-structured file systems. In Operating Systems Review 23, 1 (Jan.), 11-27.
46. Ousterhout, J. K. 1994. Tcl and the Tk toolkit, Professional Computing series. Addison-Wesley, Reading, Mass. and London.
47. Park, A., and Balasubramanian, K. 1986. Providing fault tolerance in parallel secondary storage systems. Tech. Rep. CS-TR-057-86. Department of Computer Science, Princeton University, Princeton, New Jersey.
48. Patterson, D. A., Gibson, G., and Katz, R. H. 1988. A case for redundant arrays of inexpensive disks (RAID). In Proceedings of 1988 ACM SIGMOD International Conference on Management ofData. ACM, New York.
49. Patterson, D. A., Chen, P., Gibson, G., and Katz, R. H. 1989. Introduction to redundant arrays of inexpensive disks (RAID). In Spring COMPCON '89. IEEE, New York, 112-117.
50. Rosenblum, M., and Ousterhout, J. K. 1992. The design and implementation of a log-structured file system. In ACM Trans. on Comput. Syst. 10, 1 (Feb.), 26-52.
51. Ruemmler, C., and Wilkes, J. 1991. Disk shuffling. Tech. Rep. HPL-91-156, Hewlett-Packard Laboratories, Palo Alto, Calif.
52. Ruemmler, C., and Wilkes, J. 1993. UNIX disk access patterns. In Proceedings ofWinter 1993 USENIX.Usenix Association, Berkeley, Calif., 405-420.
53. Ruemmler, C., and Wilkes, J. 1994. An introduction to disk drive modeling. In IEEE Computer 27, 3 (March), 17-28.
54. SCSI. 1991. Secretariat, Computer and Business Equipment Manufacturers Association 1991. Draft proposed American National Standardfor information systems - Small Computer System Interface-2 (SCSI2), Draft ANSI standard X3T9.2/86-109., 2 February 1991 (revision 10d).
55. Seltzer, M., Chen, P., and Ousterhout, J. 1990. Disk scheduling revisited. In Proceedings of Winter 1990 USENIX Conference. USENIX Association, Berkeley, Calif., 313-323.
56. Seltzer, M., Bostic, K., McKusick, M. K., and Staelin, C. 1993. An implementation of a log-structured file system for UNIX. In Proceedings of Winter 1993 USENIX. USENIX Association, Berkeley, Calif., 307-326.
57. Seltzer, M., Smith, K. A., Balakrishnan, H., Chang, J., McMains, S., and Padmanabhan, V. 1995. File system logging versus clustering: a performance comparison. In Conference Proceedings ofUSENIX 1995 Technical Conference on UNIX and Advanced Computing Systems.USENIX Association, Berkeley, Calif., 249-264.
58. Sienknecht, T. F., Friedrich, R. J., Martinka, J. J., and Friedenbach, P. M. 1994. The implications of distributed data in a commercial environment on the design of hierarchical storage management. In Performance Evaluation 20, 1-3 (May). North-Holland, Amsterdam, 3-25.
59. Smith, A. J. 1981. Optimization of I/O systems by cache disks and file migration: a summary. In Performance Evaluation 1. North-Holland, Amsterdam, 249-262.
60. STK. 1995. Iceberg 9200 disk array subsystem. Storage Technology Corporation, Louisville, Colo. Available as http://www.stortek.com: 80/StorageTek/iceberg.html.
61. Taunton, M. 1991. Compressed executables: an exercise in thinking small. In Proceedings of Summer USENIX. USENIX Association, Berkeley, Calif., 385-403.