A Self-Learning Scheduling in Cloud Software Defined Block Storage

IEEE International Conference on Cloud Computing, CLOUD

Volumn 2017-June, Issue , 2017, Pages 415-422

  Ravandi, Babak ^a   Papapanagiotou, Ioannis ^b  

^a PURDUE UNIVERSITY   (United States)

^b NETFLIX INC   (United States)

Author keywords

Black Box Scheduling; Cinder; Cloud Block Storage; Cloud Infrastructure; Cloud Scheduler; Cloud Scheduling; Machine Learning; OpenStack; Software Defined Storage

Indexed keywords

CLOUD COMPUTING; DIGITAL STORAGE; LEARNING SYSTEMS; NETWORK FUNCTION VIRTUALIZATION; PLATFORM AS A SERVICE (PAAS); SCHEDULING; STORAGE MANAGEMENT;

BLACK BOXES; CINDER; CLOUD INFRASTRUCTURES; CLOUD SCHEDULING; OPENSTACK;

INFORMATION MANAGEMENT;

EID: 85032198260     PISSN: 21596182     EISSN: 21596190     Source Type: Conference Proceeding    
DOI: 10.1109/CLOUD.2017.60     Document Type: Conference Paper

References (25)

1. J. Samp, P. Garca-Lpez, and M. Snchez-Artigas, "Vertigo: Programmable micro-controllers for software-defined object storage, " in 2016 IEEE 9th International Conference on Cloud Computing (CLOUD), June 2016, pp. 180-187.
2. B. Ravandi, I. Papapanagiotou, and B. Yang, "A black-box self-learning scheduler for cloud block storage systems, " in 2016 IEEE 9th International Conference on Cloud Computing (CLOUD), June 2016, pp. 820-825.
3. "Cinder support matrix. " [Online]. Available: https://wiki. openstack. org/wiki/CinderSupportMatrix.
4. "Software defined block storage-scaleio. " [Online]. Available: https://www. emc. com/en-us/storage/scaleio/index. htm.
5. "Emc scaleio block storage driver configuration. " [Online]. Available: https://docs. openstack. org/draft/configreference/block-storage/drivers/emc-scaleio-driver. html.
6. "Solidfire all-flash array. " [Online]. Available: http://www. netapp. com/us/products/storagesystems/solidfire/index. aspx.
7. J. Shafer, "I/o virtualization bottlenecks in cloud computing today, " in Proceedings of the 2nd conference on I/O virtualization. USENIX Association, 2010, pp. 5-5.
8. L. Yin, S. Uttamchandani, and R. Katz, "An empirical exploration of black-box performance models for storage systems, " in Modeling, Analysis, and Simulation of Computer and Telecommunication Systems, 2006. MASCOTS 2006. 14th IEEE International Symposium on. IEEE, 2006, pp. 433-440.
9. Y. Zhang and B. Bhargava, "Self-learning disk scheduling, " Knowledge and Data Engineering, IEEE Transactions on, vol. 21, no. 1, pp. 50-65, 2009.
10. D. Skourtis, S. Kato, and S. Brandt, "Qbox: Guaranteeing i/o performance on black box storage systems, " in Proceedings of the 21st international symposium on High-Performance Parallel and Distributed Computing. ACM, 2012, pp. 73-84.
11. "Puppet. cloud management solution. " [Online]. Available: https://puppet. com/.
12. "Chef. continuous automation for continuous enterprise, " [Online]. Available: https://puppet. com/.
13. Z. Yao, I. Papapanagiotou, and R. D. Callaway, "SLA-aware resource scheduling for cloud storage, " in IEEE International Conference on Cloud Networking (CloudNet). IEEE, 2014.
14. -, "Multi-dimensional scheduling in cloud storage systems, " in International Communications Conference (ICC). IEEE, 2015.
15. Z. Yao, I. Papapanagiotou, and R. Griffith, "Serifos: Workload consolidation and load balancing for SSD based cloud storage systems, " arXiv preprint arXiv: 1512. 06432, 2015.
16. Z. Yao and I. Papapanagiotou, "A trace-driven evaluation of cloud computing schedulers for IaaS, " in International Communications Conference (ICC), 2017 IEEE, May 2017.
17. "Block device and openstack, " [Online]. Available: http://docs. ceph. com/docs/master/rbd/rbd-openstack/.
18. "Netapp data management and cloud storage solutions. " [Online]. Available: http://www. netapp. com/us/index. aspx.
19. "Openstack cinder, " [Online]. Available: https://wiki. openstack. org/wiki/Cinder.
20. J. Dougherty, R. Kohavi, M. Sahami et al., "Supervised and unsupervised discretization of continuous features, " in Machine learning: proceedings of the twelfth international conference, vol. 12, 1995, pp. 194-202.
21. F. Provost and P. Domingos, "Tree induction for probabilitybased ranking, " Machine Learning, vol. 52, no. 3, pp. 199-215, 2003.
22. J. Pearl, "Reverend Bayes on inference engines: A distributed hierarchical approach, " in AAAI, 1982, pp. 133-136.
23. "Fio-flexible i/o tester synthetic benchmark, " [Online]. Available: https://github. com/axboe/fio/blob/master/HOWTO.
24. "Clusterhq docker hub, " [Online]. Available: https://hub. docker. com/r/clusterhq/fio-tool/.
25. S. B. Kotsiantis, I. Zaharakis, and P. Pintelas, "Supervised machine learning: A review of classification techniques, " Informatica, vol. 31, pp. 249-268, 2007.