Bursting the cloud data bubble: Towards transparent storage elasticity in IaaS clouds

Proceedings of the International Parallel and Distributed Processing Symposium, IPDPS

Volumn , Issue , 2014, Pages 135-144

  Nicolae, Bogdan ^a   Riteau, Pierre ^b   Keahey, Kate ^c  

^a IBM RESEARCH   (United States)

^b UNIVERSITY OF CHICAGO   (United States)

^c ARGONNE NATIONAL LABORATORY   (United States)

Author keywords

adaptive resizing; cloud computing; elastic storage; I O access pattern prediction

Indexed keywords

CLOUD COMPUTING; DISTRIBUTED COMPUTER SYSTEMS; DISTRIBUTED PARAMETER NETWORKS; ELASTICITY; INFRASTRUCTURE AS A SERVICE (IAAS);

ACCESS PATTERNS; ADAPTIVE RESIZING; APPLICATION COMPLEXITY; DATA-INTENSIVE APPLICATION; DATA-INTENSIVE WORKLOADS; ELASTIC STORAGE; STORAGE REQUIREMENTS; TRANSPARENT SOLUTIONS;

DIGITAL STORAGE;

EID: 84906685947     PISSN: 15302075     EISSN: 23321237     Source Type: Conference Proceeding    
DOI: 10.1109/IPDPS.2014.25     Document Type: Conference Paper

References (33)

1. L. M. Vaquero, L. Rodero-Merino, J. Caceres, and M. Lindner, "A break in the clouds: Towards a cloud definition," ACM SIGCOMM Computer Communication Review, vol. 39, no. 1, pp. 50-55, Jan. 2009.
2. M. Mao and M. Humphrey, "Auto-scaling to minimize cost and meet application deadlines in cloud workflows," in SC '11: Proc. 24th International Conference for High Performance Computing, Networking, Storage and Analysis, Seattle, USA, 2011, pp. 49:1-49:12.
3. M. Caballer, C. De Alfonso, F. Alvarruiz, and G. Moltó, "EC3: Elastic cloud computing cluster," J. Comput. Syst. Sci., vol. 79, no. 8, pp. 1341-1351, Dec. 2013.
4. K. Keahey, P. Armstrong, J. Bresnahan, D. LaBissoniere, and P. Riteau, "Infrastructure outsourcing in multi-cloud environment," in FederatedClouds '12: Proceedings of the 2012 workshop on cloud services, federation, and the 8th OpenCirrus summit, San Jose, USA, 2012, pp. 33-38.
5. R. N. Calheiros, A. N. Toosi, C. Vecchiola, and R. Buyya, "A coordinator for scaling elastic applications across multiple clouds," Future Gener. Comput. Syst., vol. 28, no. 8, pp. 1350-1362, Oct. 2012.
6. J. Dean and S. Ghemawat, "MapReduce: Simplified data processing on large clusters," in 6th Symposium on Operating Systems Design and Implementation, 2004, pp. 137-149.
7. P. Marshall, K. Keahey, and T. Freeman, "Elastic site: Using clouds to elastically extend site resources," in CCGrid'10: Proceedings of the 10th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing, Melbourne, Australia, 2010, pp. 43-52.
8. L. Beernaert, M. Matos, R. Vilaça, and R. Oliveira, "Automatic elasticity in OpenStack," in SDMCMM '12: Proceedings of the Workshop on Secure and Dependable Middleware for Cloud Monitoring and Management. Montreal, Quebec, Canada: ACM, 2012, pp. 2:1-2:6.
9. B. Nicolae, "On the benefits of transparent compression for costeffective cloud data storage," Transactions on Large-Scale Data- and Knowledge-Centered Systems, vol. 3, pp. 167-184, 2011.
10. S. A. Baset, "Open source cloud technologies," in SoCC '12: Proceedings of the 3rd ACM Symposium on Cloud Computing, San Jose, USA, 2012, pp. 28:1-28:2.
11. "Amazon Elastic Block Storage (EBS)," http://aws.amazon.com/ ebs/.
12. J. L. Gonzalez and T. Cortes, "Increasing the capacity of RAID5 by online gradual assimilation," in SNAPI '04: Proceedings of the international workshop on Storage network architecture and parallel I/Os, Antibes Juan-les-Pins, France, 2004, pp. 17-24.
13. W. Zheng and G. Zhang, "FastScale: Accelerate RAID scaling by minimizing data migration," in FAST'11: Proceedings of the 9th USENIX conference on File and Storage Technologies, San Jose, USA, 2011.
14. C. Wu and X. He, "GSR: A global stripe-based redistribution approach to accelerate RAID-5 scaling," in ICPP '12: Proceedings of the 41st International Conference on Parallel Processing, Pittsburgh, USA, 2012, pp. 460-469.
15. O. Rodeh, J. Bacik, and C. Mason, "BTRFS: The linux b-tree filesystem," Trans. Storage, vol. 9, no. 3, pp. 9:1-9:32, Aug. 2013.
16. B. Nicolae, G. Antoniu, L. Bougé, D. Moise, and A. Carpen- Amarie, "BlobSeer: Next-generation data management for large scale infrastructures," Journal of Parallel and Distributed Computing, vol. 71, no. 2, pp. 169-184, Feb. 2011.
17. H. C. Lim, S. Babu, and J. S. Chase, "Automated control for elastic storage," in ICAC '10: Proceedings of the 7th international conference on Autonomic computing, Washington DC, USA, 2010, pp. 1-10.
18. P. Xia, D. Feng, H. Jiang, L. Tian, and F. Wang, "FARMER: A novel approach to file access correlation mining and evaluation reference model for optimizing peta-scale file system performance," in HPDC '08: Proceedings of the 17th international symposium on High performance distributed computing, Boston, MA, USA, 2008, pp. 185-196.
19. M. Iritani and H. Yokota, "Effects on performance and energy reduction by file relocation based on file-access correlations," in EDBT-ICDT '12: Proceedings of the 2012 Joint EDBT/ICDT Workshops. Berlin, Germany: ACM, 2012, pp. 79-86.
20. Z. Li, Z. Chen, and Y. Zhou, "Mining block correlations to improve storage performance," Trans. Storage, vol. 1, no. 2, pp. 213-245, May 2005.
21. M. Stokely, A. Mehrabian, C. Albrecht, F. Labelle, and A. Merchant, "Projecting disk usage based on historical trends in a cloud environment," in ScienceCloud '12: Proceedings of the 3rd International Workshop on Scientific Cloud Computing, Delft, The Netherlands, 2012, pp. 63-70.
22. J. He, J. Bent, A. Torres, G. Grider, G. Gibson, C. Maltzahn, and X.-H. Sun, "I/O acceleration with pattern detection," in HPDC '13: Proceedings of the 22nd International Symposium on High-Performance Parallel and Distributed Computing, New York, USA, 2013, pp. 25-36.
23. J. Oly and D. A. Reed, "Markov model prediction of I/O requests for scientific applications," in ICS '02: Proceedings of the 16th international conference on Supercomputing, New York, USA, 2002, pp. 147-155.
24. "RackSpace," http://www.rackspace.com/.
25. "The QCOW2 Image Format," https://people.gnome.org/?markmc/ qcow-image-format.html.
26. B. Nicolae, J. Bresnahan, K. Keahey, and G. Antoniu, "Going back and forth: Efficient multi-deployment and multi-snapshotting on clouds," in HPDC '11: 20th International ACM Symposium on High-Performance Parallel and Distributed Computing, San José, USA, 2011, pp. 147-158.
27. N. Draper and H. Smith, Applied regression analysis, ser. Probability and mathematical statistics. New York: Wiley, 1966.
28. F. Bellard, "QEMU, a fast and portable dynamic translator," in ATEC '05: Proceedings of the 2005 USENIX Annual Technical Conference, Anaheim, USA, 2005, pp. 41-46.
29. "KVM: Kernel Based Virtual Machine," http://www.linux-kvm.org/.
30. Y. Bu, B. Howe, M. Balazinska, and M. D. Ernst, "The HaLoop approach to large-scale iterative data analysis," The VLDB Journal, vol. 21, no. 2, pp. 169-190, Apr. 2012.
31. H.-H. Bock, "Clustering methods: A history of K-Means algorithms," in Selected Contributions in Data Analysis and Classification, ser. Studies in Classification, Data Analysis, and Knowledge Organization. Springer Berlin Heidelberg, 2007, pp. 161-172.
32. W. Zhao, H. Ma, and Q. He, "Parallel K-Means clustering based on MapReduce," in CloudCom '09: Proceedings of the 1st International Conference on Cloud Computing, Beijing, China, 2009, pp. 674-679.
33. "PUMA: Purdue MapReduce benchmarks suite," http://web.ics. purdue. edu/?fahmad/benchmarks.htm.