The costs and limits of availability for replicated services

ACM Transactions on Computer Systems

Volumn 24, Issue 1, 2006, Pages 70-113

  Yu, Haifeng ^a,c   Vahdat, Amin ^b,d  

^a CARNEGIE MELLON UNIVERSITY   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c University of California ^*  (United States)

^d UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Availability; Continuous consistency; Network services; Replication; Trade off; Upper bound

Indexed keywords

AVAILABILITY; COMMUNICATION SYSTEMS; COMPUTER SYSTEMS; MATHEMATICAL MODELS; NETWORK PROTOCOLS;

CONTINUOUS CONSISTENCY; NETWORK SERVICES; REPLICATION; TRADE-OFF; UPPER BOUND;

ELECTRONIC COMMERCE;

EID: 33745220038     PISSN: 07342071     EISSN: 07342071     Source Type: Journal    
DOI: 10.1145/1124153.1124156     Document Type: Article

References (61)

1. AKYÜREK, S. AND SALEM, K. 1995. Adaptive block rearrangement. ACM Trans. Comput. Syst. 13, 2 (May), 89-121.
2. BAKER, M. G., HARTMAN, J. H., KUPFER, M. D., SHIRRIFF, K. W., AND OUSTERHOUT, J. K. 1991. Measurements of a distributed file system. In Proceedings of the ACM Symposium on Operating Systems Principles (SOSP, Pacific Grove, CA). 198-212.
3. BAKKE, B. E., Huss, F. L., MOERTL, D. F., AND WALK, B. M. 1998. Method and apparatus for adaptive localization of frequently accessed, randomly addressed data. U.S. Patent 5765204. Filed June 5, 1996. Issued June 9, 1998.
4. CARSON, S. D. AND REYNOLDS, JR. P. F. 1989. Adaptive disk reorganization. Tech. rep. UMIACSTR-89-4. Department of Computer Science, University of Maryland, College Park, MD.
5. CHEE, C. L., LU, H., TANG, H., AND RAMAMOORTHY, C. V. 1998. Adaptive prefetching and storage reorganization in a log-structured storage system. IEEE Trans. Knowl. Data. Eng. 10, 5 (Sept.), 824-838.
6. CHEN, P. M., LEE, E. K., GIBSON, G. A., KATZ, R. H., AND PATTERSON, D. A. 1994. RAID: High-performance, reliable secondary storage. ACM Comput. Surv. 26, 2 (June), 145-185.
7. DAHLIN, M., MATHER, C., WANG, R., ANDERSON, T., AND PATTERSON, D. 1994. A quantitative analysis of cache policies for scalable network file systems. In Proceedings of the ACM Conference on Measurement and Modeling of Computer Systems (SIGMETRICS). 150-160.
8. EXECUTIVE SOFTWARE INTERNATIONAL INC. 2001. Diskeeper 6.0 second edition for Windows. Go on-line to http://www.execsoft.com/diskeeper/diskeaper.asp.
9. FERRARI, D. 1976. Improvement of program behavior. Comput. 9, 11 (Nov.), 39-47.
10. GANGER, G. R. AND KAASHOEK, M. F. 1997. Embedded inodes and explicit grouping: Exploiting disk bandwidth for small files. In Proceedings of the USENIX Technical Conference (Anaheim, CA). 1-17.
11. GANGER, G. R., WORTHINGTON, B. L., AND PATT, Y. N. 1999. The DiskSim Simulation Environment Version 2.0 Reference Manual. Carnegie-Mellon University, Pittsburgh, PA/University of Michigan, Ann Arbor, MI.
12. GRAY, J. 1998. Put EVERYTHING in the storage device. Talk at NASD Workshop on Storage Embedded Computing. Go online to http://www.nsic.org/nasd/ 1998-jun/gray.pdf.
13. GRIFFIOEN, J. AND APPLETON, R. 1994. Reducing file system latency using a predictive approach. In Proceedings of the Summer USENIX Conference. 197-207.
14. GRIMSRUD, K. S., ARCHIBALD, J. K., AND NELSON, B. E. 1993. Multiple prefetch adaptive disk caching. IEEE Trans. Knowl. Data Eng. 5, 1 (Feb.), 88-103.
15. GROCHOWSKI, E. 2002. IBM magnetic hard disk drive technology. Go online to http://ww.hgst. com/hdd/technolo/grochows/grocho01.htm.
16. HEISCH, R. R. 1994. Trace-directed program restructuring for AIX executables. IBM J. Res. Develop. 38, 5 (Sept.), 595-603.
17. HENNESSY, J. L. AND PATTERSON, D. A. 1996. Computer Architecture A Quantitative Approach, 2nd ed. Morgan Kaufmann, San Francisco, CA.
18. HSU, W. W. 2002. Dynamic locality improvement techniques for increasing effective storage performance. Ph.D. dissertation. University of California, Berkeley, Berkeley, CA. Available as Tech. rep. CSD-03-1223, Computer Science Division, University of California, Berkeley, Berkeley, CA (2003).
19. HSU, W. W. AND SMITH, A. J. 2003. Characteristics of I/O traffic in personal computer and server workloads. IBM Syst. J. 42, 2, 347-372.
20. HSU, W. W. AND SMITH, A. J. 2004. The performance impact of I/O optimizations and disk improvements. IBM J. Res. Develop. 48, 2, 255-289. Also available as Chapter 3 of Hsu [2002].
21. HSI, W. W., SMITH, A. J., AND YOUNG, H. C. 2000. Projecting the performance of decision support workloads on systems with smart storage (SmartSTOR). In Proceedings of the IEEE Seventh International Conference on Parallel and Distributed Systems (ICPADS, Iwate, Japan). 417-425.
22. HSU, W. W., SMITH, A. J., AND YOUNG, H. C. 2001a. Analysis of the characteristics of production database workloads and comparison with the TPC benchmarks. IBM Syst. J. 40, 3, 781-802.
23. HSU, W. W., SMITH, A. J., AND YOUNG, H. C. 2001b. I/O reference behavior of production database workloads and the TPC benchmarks - an analysis at the logical level. ACM Trans. Database Syst. 26, 1 (Mar.), 96-143.
24. HSU, W. W., SMITH, A. J., AND YOUNG, H. C. 2003. The automatic improvement of locality in storage systems. Tech. rep. CSD-03-1264. Computer Science Division, University of California, Berkeley, Berkeley, CA. Also available as Chapter 4 of [Hsu 2002].
25. IBM CORP. 2001a. Autonomie computing: IBM's perspective on the state of information technology. Go online to http://www.research.ibm.com/autonomic/ manifesto/autonomicomputing.pdf.
26. IBM CORP. 2001b. Ultrastar 73LZX product summary version 1.1. IBM, Yorktown Heights, NY.
27. INTEL CORP. 1998. Intel application launch accelerator. Go online to http://www.intel.com/ial/ala.
28. KEETON, K., PATTERSON, D., AND HELLERSTEIN, J. 1998. A case for intelligent disks (IDISKs). ACM SIGMOD Rec. 27, 3, 42-52.
29. KNUTH, D. E. 1973. The Art of Computer Programming, vol. 3. Addison-Wesley, Reading, MA.
30. KROEGER, T. M. AND LONG, D. D. E. 1996. Predicting file system actions from prior events. In Proceedings of the USENIX Annual Technical Conference. 319-328.
31. LEI, H. AND DUCHAMP, D. 1997. An analytical approach to file prefetching. In Proceedings of the USENIX Annual Technical Conference (Anaheim, CA). 275-288.
32. LORCH, J. R. AND SMITH, A. J. 2000. The VTrace tool: Building a system tracer for Windows NT and Windows 2000. MSDN Mag. 15, 10 (Oct.), 86-102.
33. LUMB, C., SCHINDLER, GANGER, G. R., RIEDEL, E., AND NAGLE, D. F. 2000. Towards higher disk head utilization: Extracting "free" bandwidth from busy disk drives. In Proceedings of the USENIX Symposium on Operating Systems Design and Implementation (OSDI, San Diego, CA). 87-102.
34. MASUDA, T., SHIOTA, H., NOGUCHI, K., AND OHKI, T. 1974. Optimization of program organization by cluster analysis. In Proceedings of IFIP Congress. 261-265.
35. MATTHEWS, J. N., ROSELLI, D., COSTELLO, A. M., WANG, R. Y., AND ANDERSON, T. E. 1997. Improving the performance of log-structured file systems with adaptive methods. In Proceedings of the ACM Symposium on Operating System Principles (SOSP, Saint-Malo, France). 238-251.
36. MCDONALD, S. 1988. Dynamically restructuring disk space for improved file system performance. Tech. rep. 88-14. Department of Computational Science, University of Saskatchewan, Saskatoon, Sask. Canada.
37. MCKUSICK, M. K., JOY, W. N., LEFFLER, S. J., AND FABRY, R. S. 1984. A fast file system for UNIX. ACM Trans. Comput. Syst. 2, 3 (Aug.), 181-197.
38. MCNUTT, B. 1995. MVS DASD survey: Results and trends. In Proceedings of the Computer Measurement Group (CMG) Conference (Nashville, TN). 658-667.
39. MCVOY, L. W. AND KLEIMAN, S. R. 1991. Extent-like performance from a UNIX file system. In Proceedings of the Winter USENIX Conference (Dallas, TX). 33-43.
40. MESQUITE SOFTWARE INC. 1994. CSIM18 simulation engine (C++ version). Mesquite Software Inc., Austin, TX.
41. NG, S. W. 1991. Improving disk performance via latency reduction. IEEE Trans. Comput. 40, 1 (Jan.), 22-30.
42. OUSTERHOUT, J. AND DOUGLIS, F. 1989. Beating the I/O bottleneck: A case for log-structured file systems. Operat. Syst. Rev. 23, 1 (Jan.), 11-28.
43. PALMER, M. AND ZDONIK, S. B. 1991. Fido: A cache that learns to fetch. Tech. rep. CS-91-15. Department of Computer Science, Brown University, Providence, RI.
44. PEACOCK, J. K. 1988. The counterpoint fast file system. In USENIX Conference Proceedings (Dallas, TX). 243-249.
45. RIEDEL, E., GIBSON, G. A., AND FALOUTSOS, C. 1998. Active storage for large-scale data mining and multimedia. In Proceedings of the International Conference on Very Large Data Bases (VLDB, New York, NY). 62-73.
46. ROSELLI, D., LORCH, J. R., AND ANDERSON, T. E. 2000. A comparison of file system workloads. In Proceedings of the USENIX Annual Technical Conference (Berkeley, CA). 41-54.
47. RUEMMLER, C. AND WILKES, J. 1991. Disk shuffling. Tech. rep. HPL-91-156. HP Laboratories. Menlo Park, CA.
48. RUEMMLER, C. AND WILKES, J. 1993. UNIX disk access patterns. In Proceedings of the USENIX Winter Conference (San Diego, CA). 405-420.
49. SMITH, A. J. 1978. Sequentially and prefetching in database systems. ACM Trans. Database Syst. 3, 3 (Sept.), 223-247.
50. SMITH, A. J. 1985. Disk cache - miss ratio analysis and design considerations. ACM Trans. Comput. Syst. 3, 3 (Aug.), 161-203.
51. SMITH, A. J. 1994. Trace driven simulation in research on computer architecture and operating systems. In Proceedings of the Conference on New Directions in Simulation for Manufacturing and Communications (Tokyo, Japan). 43-49.
52. STAELIN, C. AND GARCIA-MOLINA, H. 1991. Smart filesystems. In Proceedings of USENIX Winter Conference, 45-52.
53. SYMANTEC CORP. 2001. Norton utilities 2002. Go online to http://www.symantec.com/nu/nu-9x.
54. TSANGARIS, M. M. AND NAUGHTON, J. F. 1992. On the performance of object clustering techniques. In Proceedings of the ACM SIGMOD International Conference on Management of Data. 144-153.
55. UHLIG, R. A. AND MUDGE, T. N. 1997. Trace-driven memory simulation: A survey. ACM Comput. Surv. 29, 2 (June), 128-170.
56. VEHHOFSTAD, J. S. M. 1978. Recovery techniques for database systems. ACM Comput. Surv. 10, 2 (June), 167-195.
57. VOGELS, W. 1999. File system usage in Windows NT 4.0. In Proceedings of the ACM Symposium on Operating Systems Principles (SOSP). 93-109.
58. VONGSATHORN, P. AND CARSON, S. D. 1990. A system for adaptive disk rearrangement. Softw.: Pract. Exper. 20, 3 (Mar.), 225-242.
59. WHIPPLE II, A. E. 1994. Optimizing a magnetic disk by allocating files by the frequency a file is acessed/updated or by designating a file to a fixed location on a disk. U.S. Patent 5333311. Filed Dec. 10, 1990. Issued July 26, 1994.
60. YU, X., GUM, B., CHEN, Y., WANG, W., LI, K., KRISHNAMURTHY, A., AND ANDERSON, A. 2000. Trading capacity for performance in a disk array. In Proceedings of the Symposium on Operating Systems Design and Implementation (OSDI, San Diego, CA). 243-258.
61. ZHOU, M. AND SMITH, A. J. 1999. Analysis of personal computer workloads. In Proceedings of the International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunications Systems (MASCOTS, College Park, MD). 208-217.