Towards lightweight and swift storage resource management in big data cloud era

Proceedings of the International Conference on Supercomputing

Volumn 2015-June, Issue , 2015, Pages 133-142

  Zhou, Ruijin ^a   Chen, Huixiang ^a   Li, Tao ^a  

^a UNIVERSITY OF FLORIDA   (United States)

Author keywords

Distributed storage management; Snapshot; Storage migration; Storage virtualization

Indexed keywords

BIG DATA; DIGITAL STORAGE; INTELLIGENT CONTROL; NATURAL RESOURCES MANAGEMENT; REAL TIME SYSTEMS; RESOURCE ALLOCATION; STORAGE MANAGEMENT; VIRTUAL REALITY; VIRTUAL STORAGE;

ACCURATE PERFORMANCE; DISTRIBUTED STORAGE; EMPIRICAL EVALUATIONS; EXPONENTIALLY WEIGHTED MOVING AVERAGE; SNAPSHOT; STORAGE RESOURCE MANAGEMENT; STORAGE VIRTUALIZATION; VIRTUALIZED ENVIRONMENT;

INFORMATION MANAGEMENT;

EID: 84957592538     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2751205.2751230     Document Type: Conference Paper

References (33)

1. Understanding VMware vSphere® 5.1 Storage DRS, VMware Technical white paper, March 2013.
2. VMware Distributed Resource Scheduler, White Paper.
3. Ajay Gulati, Chethan Kumar, Irfan Ahmad, and Karan Kumar, BASIL: Automated IO Load Balancing across Storage Devices. USENIX FAST, 2010.
4. Ajay Gulati, et al., Pesto: Online Storage Performance Management in Virtualized Datacenters. SOCC, 2011.
5. Nohhyun Park, Irfan Ahmad, and David Lilja, Romano: Autonomous Storage Management using Performance Prediction in Multi-Tenant Datacenters, SOCC, 2012.
6. Ali Mashtizadeh, Emre Celebi, Tal Garfinkel, and Min Cai, The Design and Evolution of Live Storage Migration in VMware ESX, USENIX ATC, 2011.
7. Jayanta Basak, et al., Model Building for Dynamic Multitenant Provider Environments, ACM SIGOPS Operating Systems Review, 2012.
8. Mengzhi Wang, et al., Storage Device Performance Prediction with CART Models, MASCOT, 2014.
9. Aameek Singh, Madhukar Korupolu, and Dushmanta Mohapatra, Server-Storage Virtualization: Integration and Load Balancing in Data Centers, SC, 2008.
10. Hadoop, http://hadoop.apache.org.
11. Hibench, https://github.com/intel-hadoop/HiBench.
12. QEMU, http://wiki.qemu.org.
13. KVM, http://www.linux-kvm.org/page/Main-Page.
14. pt-diskstats, http://www.percona.com/doc/perconatoolkit/2.1/pt-diskstats.html.
15. Libvirt 1.2.1, http://libvirt.org.
16. Amazon AWS, http://aws.amazon.com.
17. Azure, http://www.azure.microsoft.com/en-us/.
18. Oracle Information Architecture: An Architect's Guide to Big Data, Oracle White Paper, 2012.
19. Swaroop Kavalanekar, Bruce Worthington, Qi Zhang, and Vishal Sharda, Characterization of Storage Workload Traces from Production Windows Servers, IISWC 2008.
20. Ajay Gulati, Chethan Kumar, and Irfan Ahmad, Storage Workload Characterization and Consolidation in Virtualized Environments, VPACT, 2009.
21. Eric Anderson, et al., Hippodrome: Running Circles around Storage Administration, FAST, 2002.
22. George Alvarez, et al., MINERVA: An Automated Resource Provisioning Tool for Large-Scale Storage Systems, ACM Transactions on Computer Systems, 2001.
23. Chenyang Lu, et al., Aqueduct: Online Data Migration with Performance Guarantees, USENIX FAST, 2002.
24. Bhaskar Prasad Rimal, Eunmi Choi, and Ian Lumb, A Taxonomy and Survery of Cloud Computing System, Fifth International Joint Conference on INC, IMS and IDC, 2009.
25. Divyakant Agrawal, et al., Big data and cloud computing: current state and future opportunities, EDBT/ICDT, 2011.
26. Xuelian Lin, et al., A Practical Performance Model for Hadoop MapReduce, Cluster Computing Workshops, 2012.
27. Herodotos Herodotou, Hadoop Performance Models, Technical Report, Duke University, CS-2011-05.
28. Irfan Ahmad, et al., Storage Workload Characterization and Consolidation in Virtualized Environments, VPACT, 2009.
29. Ruijin Zhou, et al., Optimizing Virtual Machine Live Storage Migration in Heterogeneous Storage Environment, VEE, 2013.
30. Arkaitz Ruiz-Alvarez, et al., An Automated Approach to Cloud Storage Service Selection, ScienceCloud, 2011.
31. IOmeter, http://www.iometer.org
32. Carl A. Waldspurger, Memory Resource Management in VMware ESX Server, OSDI, 2002.
33. Minkyong Kim, and Brian Noble, Mobile Network Estimation, MobiCom, 2001.