Pesto: Online storage performance management in virtualized datacenters

Proceedings of the 2nd ACM Symposium on Cloud Computing, SOCC 2011

Volumn , Issue , 2011, Pages

  Gulati, Ajay ^a   Shanmuganathan, Ganesha ^a   Ahmad, Irfan ^a   Waldspurger, Carl ^b   Uysal, Mustafa ^a  

^a VMWARE INC   (United States)

^b NONE

Author keywords

Device; Modeling; QoS; Storage; Virtualization; VM

Indexed keywords

BLACK BOXES; COMMERCIAL PRODUCTS; CONGESTION MANAGEMENT; DATA CENTERS; DEVICE; DEVICE THROUGHPUT; FIRST SYSTEMS; MANAGEMENT SYSTEMS; PERFORMANCE MODEL; SHARED STORAGE; STORAGE PERFORMANCE; SYSTEM ADMINISTRATORS; TEST CASE; VIRTUALIZATIONS; VM;

CLOUD COMPUTING; ENERGY STORAGE; EQUIPMENT; MODELS; QUALITY OF SERVICE; VIRTUAL STORAGE;

COST BENEFIT ANALYSIS;

EID: 82155203102     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2038916.2038935     Document Type: Conference Paper

References (40)

1. Filebench. http://solarisinternals.com/si/tools/ filebench/index.php.
2. Iometer. http://www.iometer.org.
3. G. A. Alvarez, E. Borowsky, S. Go, T. H. Romer, R. Becker-Szendy, R. Golding, A. Merchant, M. Spasojevic, A. Veitch, and J. Wilkes. Minerva: An Automated Resource Provisioning Tool for Large-Scale Storage Systems. In ACM Transactions on Computer Systems, Nov. 2001.
4. E. Anderson. Simple table-based modeling of storage devices. Technical report, HPL-SSP-2001-4, HP Labs, July 2001.
5. E. Anderson, M. Hobbs, K. Keeton, S. Spence, M. Uysal, and A. Veitch. Hippodrome: running circles around storage administration. In Proceedings of the 1st USENIX conference on File and Storage Technologies, FAST'02, Berkeley, CA, USA, 2002. USENIX Association.
6. S. Chen and D. Towsley. The Design and Evaluation of RAID 5 and Parity Striping Disk Array Architectures. Journal on Parallel and Distributed Computing, 17(1-2):58-74, 1993.
7. S. Chen and D. Towsley. A performance evaluation of RAID architectures. IEEE Transactions on Computers, 45:1116-1130, 1996. (Pubitemid 126768540)
8. T. E. Denehy, J. Bent, F. I. Popovici, A. C. Arpaci-Dusseau, and R. H. Arpaci-Dusseau. Deconstructing storage arrays. In Proceedings of the 11th international conference on Architectural support for programming languages and operating systems, ASPLOS-XI, pages 59-71, New York, NY, USA, 2004. ACM.
9. G. Ganger. Automated disk drive characterization. http://www.pdl.cmu.edu/ Dixtrac/index.shtml.
10. C. C. Gotlieb and G. H. MacEwen. Performance of Movable-Head Disk Storage Devices. Journal of the ACM, 20(4):604-623, 1973.
11. A. Gulati, I. Ahmad, and C. A. Waldspurger. PARDA: Proportional allocation of resources for distributed storage access. In Proccedings of the 7th conference on File and Storage Technologies, pages 85-98, Berkeley, CA, USA, 2009. USENIX Association.
12. A. Gulati, C. Kumar, and I. Ahmad. Storage Workload Characterization and Consolidation in Virtualized Environments. In Workshop on Virtualization Performance: Analysis, Characterization, and Tools (VPACT), 2009.
13. A. Gulati, C. Kumar, I. Ahmad, and K. Kumar. BASIL: Automated IO load balancing across storage devices. In Proceedings of the 8th USENIX conference on File and Storage Technologies, FAST'10, Berkeley, CA, USA, 2010. USENIX Association.
14. J. L. Hennessy and D. A. Patterson. Computer Architecture: A Quantitative Approach, Fourth edition. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, 2007.
15. R. Jain and I. Chlamtac. The P2 algorithm for dynamic calculation of quantiles and histograms without storing observations. Communications of the ACM, 28:1076-1085, October 1985. (Pubitemid 15587962)
16. T. Kelly, I. Cohen, M. Goldszmidt, and K. Keeton. Inducing models of black-box storage arrays. Technical Report HPL-2004-108, HP Labs, 2004.
17. M. Kim and A. Tantawi. Asynchronous disk interleaving: Approximating access delays. IEEE Transactions on Computers, 40(7):801-810, 1991. (Pubitemid 21704805)
18. E. K. Lee and R. H. Katz. An analytic performance model of disk arrays. SIGMETRICS Performance Evaluation Review, 21(1):98-109, 1993.
19. J. D. C. Little. A Proof for the Queuing Formula: L = λW. Operations Research, 9(3), 1961.
20. A. Mashtizadeh, E. Celebi, T. Garfinkel, and M. Cai. The Design and Evolution of Live Storage Migration in VMware ESX. In Proc. USENIX Annual Technical Conference (ATC '11), June 2011.
21. A. Merchant and P. S. Yu. An analytical model of reconstruction time in mirrored disks. Performance Evaluation, 20:115-129, May 1994.
22. A. Merchant and P. S. Yu. Analytic Modeling of Clustered RAID with Mapping Based on Nearly Random Permutation. IEEE Transactions on Computers, 45(3), 1996.
23. D. R. Merrill. Storage economics: Four principles for reducing total cost of ownership. May 2009. http://www.hds.com/assets/pdf/four-principles-for- reducing-total-cost-of-ownership.pdf.
24. M. P. Mesnier, M. Wachs, R. R. Sambasivan, A. X. Zheng, and G. R. Ganger. Modeling the relative fitness of storage. SIGMETRICS Performance Evaluation Review, 35(1), 2007.
25. J. D. Padhye, A. L. Rahatekar., and L. W. Dowdy. A Simple LAN File Placement Strategy. In International CMG Conference, 1995.
26. C. Ruemmler and J. Wilkes. An introduction to disk drive modeling. IEEE Computer, 27:17-28, 1994.
27. E. Shriver, A. Merchant, and J. Wilkes. An Analytic Behavior Model for Disk Drives with Readahead Caches and Request Reordering. SIGMETRICS Performance Evaluation Review, 26(1):182-191, 1998. (Pubitemid 128593234)
28. N. Simpson. Building a data center cost model. Jan 2010. http://www.burtongroup.com/Research/DocumentList. aspx?cid=49.
29. E. Thereska, M. Abd-El-Malek, J. J. Wylie, D. Narayanan, and G. R. Ganger. Informed data distribution selection in a self-predicting storage system. In International Conference on Autonomic Computing, 2006.
30. E. Thereska and G. R. Ganger. IRONModel: Robust performance models in the wild. SIGMETRICS Performance Evaluation Review, 36:253-264, June 2008.
31. A. Thomasian and J. Menon. Performance analysis of RAID5 disk arrays with a vacationing server model for rebuild mode operation. In Proceedings of the Tenth International Conference on Data Engineering, pages 111-119. IEEE Computer Society, 1994.
32. M. Uysal, G. A. Alvarez, and A. Merchant. A modular, analytical throughput model for modern disk arrays. In IEEE International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunications Systems (MASCOTS), 2001.
33. E. Varki, A. Merchant, J. Xu, and X. Qiu. Issues and challenges in the performance analysis of real disk arrays. IEEE Transactions on Parallel and Distributed Systems, 15:559-574, 2004.
34. VMware, Inc. VMware Storage VMotion: Non-Disruptive, Live Migration of Virtual Machine Storage, 2007. http:// vmware.com/files/pdf/ storagefivmotionfidatasheet.pdf.
35. VMware, Inc. vSphere Resource Management Guide: ESX 4.1, ESXi 4.1, vCenter Server 4.1. 2010.
36. VMware, Inc. VMware vSphere. 2011. http://www.vmware.com/products/ vsphere/overview.html.
37. VMware, Inc. VMware vStorage VMFS. 2011. http://www.vmware.com/files/pdf/ VMware-vStorage- VMFS-DS-EN.pdf.
38. T. Voellm. Useful IO profiles for simulating various workloads. http://blogs.msdn.com/b/tvoellm/archive/ 2009/05/07/useful-io-profiles-for- simulating-various-workloads.aspx.
39. M. Wang, K. Au, A. Ailamaki, A. Brockwell, C. Faloutsos, and G. R. Ganger. Storage Device Performance Prediction with CART Models. In IEEE International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunications Systems (MASCOTS), pages 588-595, 2004. (Pubitemid 40455477)
40. P. S. Yu and A. Merchant. Analytic modeling and comparisons of striping strategies for replicated disk arrays. IEEE Transactions on Computers, 44:419-433, March 1995.