The HP AutoRAID Hierarchical Storage System

ACM Transactions on Computer Systems

Volumn 14, Issue 1, 1996, Pages 108-136

  Wilkes, John ^a   Golding, Richard ^a   Staelin, Carl ^a   Sullivan, Tim ^a  

^a HEWLETT PACKARD LABORATORIES   (United States)

Author keywords

B.4.2 Input Output and Data Communications : Input Output Devices Channels and controllers; B.4.5 Input Output and Data Communications : Reliability, Testing, and Fault Tolerance redundant design

Indexed keywords

ALGORITHMS; COMPUTER HARDWARE; COMPUTER OPERATING SYSTEMS; COMPUTER SIMULATION; DATA COMMUNICATION SYSTEMS; HIERARCHICAL SYSTEMS; MAGNETIC DISK STORAGE; PERFORMANCE; RELIABILITY; SECURITY OF DATA; SYSTEMS ANALYSIS;

DATA BLOCKS; DISK ARRAY; HIERARCHICAL STORAGE SYSTEM;

INFORMATION RETRIEVAL SYSTEMS;

EID: 0030085468     PISSN: 07342071     EISSN: None     Source Type: Journal    
DOI: 10.1145/225535.225539     Document Type: Article

References (60)

1. AKYÜREK, S. AND SALEM, K. 1993. Adaptive block rearrangement. Tech. Rep. CS-TR-2854.1, Dept. of Computer Science, Univ. of Maryland, College Park, Md.
2. BAKER, M., ASAMI, S., DEPRIT, E., OUSTERHOUT, J., AND SELTZER, M. 1992. Non-volatile memory for fast, reliable file systems. In Proceedings of 5th International Conference on Architectural Support for Programming Languages and Operating Systems. Comput. Arch. News 20, (Oct.), 10-22.
3. BLACKWELL, T., HARRIS, J., AND SELTZER, M. 1995. Heuristic cleaning algorithms in log-structured file systems. In Proceedings of USENIX 1995 Technical Conference on UNIX and Advanced Computing Systems. USENIX Assoc., Berkeley, Calif., 277-288.
4. BURKES, T., DIAMOND, B., AND VOIGT, D. 1995. Adaptive hierarchical RAID: A solution to the RAID 5 write problem. Part No. 5963-9151, Hewlett-Packard Storage Systems Division, Boise, Idaho.
5. BURROWS, M., JERIAN, C., LAMPSON, B., AND MANN, T. 1992. On-line data compression in a log-structured file system. In Proceedings of 5th International Conference on Architectural Support for Programming Languages and Operating Systems. Comput. Arch News 20, (Oct.), 2-9.
6. CAO, P., LIM, S. B., VENKATARAMAN, S., AND WILKES, J. 1994. The TickerTAIP parallel RAID architecture. ACM Trans. Comput. Syst. 12, 3 (Aug.), 236-269.
7. CARSON, S. AND SETIA, S. 1992. Optimal write batch size in log-structured file systems. In USENIX Workshop on File Systems. USENIX Assoc., Berkeley, Calif., 79-91.
8. CATE, V. 1990. Two levels of file system hierarchy on one disk. Tech. Rep. CMU-CS-90-129, Dept. of Computer Science, Carnegie-Mellon Univ., Pittsburgh, Pa.
9. CHAO, C., ENGLISH, R., JACOBSON, D., STEPANOV, A., AND WILKES, J. 1992. Mime: A high performance storage device with strong recovery guarantees. Tech. Rep. HPL-92-44, Hewlett-Packard Laboratories, Palo Alto, Calif.
10. CHEN, P. 1973. Optimal file allocation in multi-level storage hierarchies. In Proceedings of National Computer Conference and Exposition. AFIPS Conference Proceedings, vol. 42. AFIPS Press, Montvale, N.J., 277-282.
11. CHEN, P. M. AND LEE, E. K. 1993. Striping in a RAID level-5 disk array. Tech. Rep. CSE-TR-181-93, The Univ. of Michigan, Ann Arbor, Mich.
12. CHEN, P. M., LEE, E. K., GIBSON, G. A., KATZ, R. H., AND PATTERSON, D. A. 1994. RAID: High-performance, reliable secondary storage. ACM Comput. Surv. 26, 2 (June), 145-185.
13. CLEGG, F. W., Ho, G. S.-F., KUSMER, S. R., AND SONTAG, J. R. 1986. The HP-UX operating system on HP Precision Architecture computers. Hewlett-Packard J. 37, 12 (Dec.), 4-22.
14. COHEN, E. I., KING, G. M., AND BRADY, J. T. 1989. Storage hierarchies. IBM Syst. J. 28, 1, 62-76.
15. DEC. 1993. POLYCENTER Storage Management for OpenVMS VAX Systems. Digital Equipment Corp., Maynard, Mass.
16. DE JONGE, W., KAASHOEK, M. F., AND HSIEH, W. C. 1993. The Logical Disk: A new approach to improving file systems. In Proceedings of the 14th ACM Symposium on Operating Systems Principles. ACM, New York, 15-28.
17. DESHPANDE, M. B. AND BUNT, R. B. 1988. Dynamic file management techniques. In Proceedings of the 7th IEEE Phoenix Conference on Computers and Communication. IEEE, New York, 86-92.
18. DUNPHY, R. H., JR., WALSH, R., BOWERS, J. H., AND RUDESEAL, G. A. 1991. Disk drive memory. U.S. Patent 5,077,736, U.S. Patent Office, Washington, D.C.
19. ENGLISH, R. M. AND STEPANOV, A. A. 1992. Loge: A self-organizing storage device. In Proceedings of USENIX Winter '92 Technical Conference. USENIX Assoc., Berkeley, Calif., 237-251.
20. EPOCH SYSTEMS. 1988. Mass storage: Server puts optical discs on line for workstations. Electronics (Nov.).
21. EWING, J. 1993. RAID: An overview. Part No. W 17004-A 09/93, Storage Technology Corp., Louisville, Colo. Available as http://www.stortek.com:80/StorageTek/raid.html.
22. FLOYD, R. A. AND SCHLATTER ELLIS, C. 1989. Directory reference patterns in hierarchical file systems. IEEE Trans. Knowl. Data Eng. 1, 2 (June), 238-247.
23. GEIST, R., REYNOLDS, R., AND SUGGS, D. 1994. Minimizing mean seek distance in mirrored disk systems by cylinder remapping. Perf. Eval. 20, 1-3 (May), 97-114.
24. GELB, J. P. 1989. System managed storage. IBM Syst. J. 28, 1, 77-103.
25. GOLDING, R., STAELIN, C., SULLIVAN, T., AND WILKES, J. 1994. "Tcl cures 98.3% of all known simulation configuration problems" claims astonished researcher! In Proceedings of Tcl/Tk Workshop. Available as Tech. Rep. HPL-CCD-94-11, Concurrent Computing Dept., Hewlett-Packard Laboratories, Palo Alto, Calif.
26. GOLDING, R., BOSCH, P., STAELIN, C., SULLIVAN, T., AND WILKES, J. 1995. Idleness is not sloth. In Proceedings of USENIX 1995 Technical Conference on UNIX and Advanced Computing Systems. USENIX Assoc., Berkeley, Calif, 201-212.
27. GRAY, J. 1990. A census of Tandem system availability between 1985 and 1990. Tech. Rep. 90.1, Tandem Computers Inc., Cupertino, Calif.
28. HENDERSON, R. L. AND POSTON, A. 1989. MSS-II and RASH: A mainframe Unix based mass storage system with a rapid access storage hierarchy file management system. In Proceedings of USENIX Winter 1989 Conference. USENIX Assoc., Berkeley, Calif., 65-84.
29. HOLLAND, M. AND GIBSON, G. A. 1992. Parity declustering for continuous operation in redundant disk arrays. In Proceedings of 5th International Conference on Architectural Support for Programming Languages and Operating Systems. Comput. Arch. News 20, (Oct.), 23-35.
30. JACOBSON, D. M. AND WILKES, J. 1991. Disk scheduling algorithms based on rotational position. Tech. Rep. HPL-CSP-91-7, Hewlett-Packard Laboratories, Palo Alto, Calif.
31. KATZ, R. H., ANDERSON, T. E., OUSTERHOUT, J. K., AND PATTERSON, D. A. 1991. Robo-line storage: Low-latency, high capacity storage systems over geographically distributed networks. UCB/CSD 91/651, Computer Science Div., Dept. of Electrical Engineering and Computer Science, Univ. of California at Berkeley, Berkeley, Calif.
32. KOHL, J. T., STAELIN, C., AND STONEBRAKER, M. 1993. Highlight: Using a log-structured file system for tertiary storage management. In Proceedings of Winter 1993 USENIX. USENIX Assoc., Berkeley, Calif., 435-447.
33. LAWLOR, F. D. 1981. Efficient mass storage parity recovery mechanism. IBM Tech. Discl. Bull. 24, 2 (July), 986-987.
34. MAJUMDAR, S. 1984. Locality and file referencing behaviour: Principles and applications. M.Sc. thesis, Tech. Rep. 84-14, Dept. of Computer Science, Univ. of Saskatchewan, Saskatoon, Saskatchewan, Canada.
35. MCDONALD, M. S. AND BUNT, R. B. 1989. Improving file system performance by dynamically restructuring disk space. In Proceedings of Phoenix Conference on Computers and Communication. IEEE, New York, 264-269
36. MCNUTT, B. 1994. Background data movement in a log-structured disk subsystem. IBM J. Res. Devel. 38, 1, 47-58.
37. MENON, J. AND COURTNEY, J. 1993. The architecture of a fault-tolerant cached RAID controller. In Proceedings of 20th International Symposium on Computer Architecture. ACM, New York, 76-86.
38. MENON, J. AND KASSON, J. 1989. Methods for improved update performance of disk arrays. Tech. Rep. RJ 6928 (66034), IBM Almaden Research Center, San Jose, Calif. Declassified Nov. 21, 1990.
39. MENON, J. AND KASSON, J. 1992. Methods for improved update performance of disk arrays. In Proceedings of 25th International Conference on System Sciences. Vol. 1. IEEE, New York, 74-83.
40. MENON, J. AND MATTSON, D. 1992. Comparison of sparing alternatives for disk arrays. In Proceedings of 19th International Symposium on Computer Architecture. ACM, New York, 318-329.
41. MILLER, E. L. 1991. File migration on the Cray Y-MP at the National Center for Atmospheric Research. UCB/CSD 91/638, Computer Science Div., Dept. of Electrical Engineering and Computer Science, Univ. of California at Berkeley, Berkeley, Calif.
42. MISRA, P. N. 1981. Capacity analysis of the mass storage system. IBM Syst. J. 20, 3, 346-361.
43. MOGI, K. AND KITSUREGAWA, M. 1994. Dynamic parity stripe reorganizations for RAID5 disk arrays. In Proceedings of Parallel and Distributed Information Systems International Conference. IEEE, New York, 17-26.
44. OUSTERHOUT, J. AND DOUGLIS, F. 1989. Beating the I/O bottleneck: A case for log-structured file systems. Oper. Syst. Rev. 23, 1 (Jan.), 11-27.
45. OUSTERHOUT, J. K. 1994. Tcl and the Tk Toolkit. Addison-Wesley, Reading, Mass.
46. PARK, A. AND BALASUBRAMANIAN, K. 1986. Providing fault tolerance in parallel secondary storage systems. Tech. Rep. CS-TR-057-86, Dept. of Computer Science, Princeton Univ., Princeton, N.J.
47. PATTERSON, D. A., CHEN, P., GIBSON, G., AND KATZ, R. H. 1989. Introduction to redundant arrays of inexpensive disks (RAID). In Spring COMPCON '89. IEEE, New York, 112-117.
48. PATTERSON, D. A., GIBSON, G., AND KATZ, R. H. 1988. A case for redundant arrays of inexpensive disks (RAID). In Proceedings of 1988 ACM SIGMOD International Conference on Management of Data. ACM, New York.
49. ROSENBLUM, M. AND OUSTERHOUT, J. K. 1992. The design and implementation of a log-structured file system. ACM Trans. Comput. Syst. 10, 1 (Feb.), 26-52.
50. RUEMMLER, C. AND WILKES, J. 1991. Disk shuffling. Tech. Rep. HPL-91-156, Hewlett-Packard Laboratories, Palo Alto, Calif.
51. RUEMMLER, C. AND WILKES, J. 1993. UNIX disk access patterns. In Proceedings of the Winter 1993 USENIX Conference. USENIX Assoc., Berkeley, Calif., 405-420.
52. RUEMMLER, C. AND WILKES, J. 1994. An introduction to disk drive modeling. IEEE Comput. 27, 3 (Mar.), 17-28.
53. SCSI. 1991. Draft proposed American National Standard for information systems - Small Computer System Interface-2 (SCSI-2). Draft ANSI standard X3T9.2/86-109, (revision 10d). Secretariat, Computer and Business Equipment Manufacturers Association.
54. SELTZER, M., BOSTIC, K., MCKUSICK, M. K., AND STAELIN, C. 1993. An implementation of a log-structured file system for UNIX. In Proceedings of the Winter 1993 USENIX Conference. USENIX Assoc., Berkeley, Calif., 307-326.
55. SELTZER, M., CHEN, P., AND OUSTERHOUT, J. 1990. Disk scheduling revisited. In Proceedings of the Winter 1990 USENIX Conference. USENIX Assoc., Berkeley, Calif., 313-323.
56. SELTZER, M., SMITH, K. A., BALAKRISHNAN, H., CHANG, J., MCMAINS, S., AND PADMANABHAN, V. 1995. File system logging versus clustering: A performance comparison. In Conference Proceedings of USENIX 1995 Technical Conference on UNIX and Advanced Computing Systems. USENIX Assoc., Berkeley, Calif, 249-264.
57. SIENKNECHT, T. F., FRIEDRICH, R. J., MARTINKA, J. J., AND FRIEDENBACH, P. M. 1994. The implications of distributed data in a commercial environment on the design of hierarchical storage management. Perf. Eval. 20, 1-3 (May), 3-25.
58. SMITH, A. J. 1981. Optimization of I/O systems by cache disks and file migration: A summary. Perf. Eval. 1, 249-262.
59. STK. 1995. Iceberg 9200 disk array subsystem. Storage Technology Corp., Louisville, Colo. Available as http://www.stortek.com:80/StorageTek/iceberg.html.
60. TAUNTON, M. 1991. Compressed executables: An exercise in thinking small. In Proceedings of Summer USENIX. USENIX Assoc., Berkeley, Calif., 385-403.