Balancing fairness and efficiency in tiered storage systems with bottleneck-aware allocation

Proceedings of the 12th USENIX Conference on File and Storage Technologies, FAST 2014

Volumn , Issue , 2014, Pages 229-242

  Wang, Hui ^a   Varman, Peter ^a  

^a RICE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER OPERATING SYSTEMS; SIMULATION PLATFORM;

ALLOCATION MODEL; FAIR ALLOCATION; FAIRNESS PROPERTIES; HETEROGENEOUS DEVICES; HIGH-EFFICIENCY; LINUX PLATFORM; MULTIPLE RESOURCES; SYSTEM UTILIZATION;

EFFICIENCY;

EID: 85077079346     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (49)

1. Storage performance council (umass trace repository), 2007. http://traces.cs.umass.edu/index.php/Storage.
2. EMC: Fully automate storage tiering. http://www.emc.com/about/glossary/fast.htm, 2012.
3. Tintri: VM aware storage. http://www.tintri.com, 2012.
4. BANGA, G., DRUSCHEL, P., AND MOGUL, J. C. Resource containers: a new facility for resource management in server systems. In OSDI’99.
5. BENJAMIN, H., AND ET. AL. Mesos: a platform for fine-grained resource sharing in the data center. In NSDI’11.
6. BERTSIMAS, D., FARIAS, V. F., AND TRICHAKIS, N. On the efficiency-fairness trade-off. Manage. Sci. 58, 12 (Dec. 2012), 2234–2250.
7. BERTSIMAS, D., FARIAS, V. F., AND TRICHAKIS, V. F. The price of fairness. Operations Research 59, 1 (Jan. 2011), 17–31.
8. BRUNO, J., BRUSTOLONI, J., GABBER, E., OZDEN, B., AND SILBERSCHATZ, A. Disk scheduling with Quality of Service guarantees. In Proceedings of the IEEE International Conference on Multimedia Computing and Systems, Volume 2 (1999), IEEE Computer Society.
9. DEMERS, A., KESHAV, S., AND SHENKER, S. Analysis and simulation of a fair queuing algorithm. Journal of Internetworking Research and Experience 1, 1 (September 1990), 3–26.
10. DEVANUR, N. R., HARTLINE, J. D., AND YAN, Q. Envy freedom and prior-free mechanism design. CoRR abs/1212.3741 (2012).
11. DOLEV, D., FEITELSON, D. G., HALPERN, J. Y., KUPFERMAN, R., AND LINIAL, N. No justified complaints: On fair sharing of multiple resources. In Proceedings of the 3rd Innovations in Theoretical Computer Science Conference (New York, NY, USA, 2012), ITCS’12, ACM, pp. 68–75.
12. EGI, N., IANNACCONE, G., MANESH, M., MATHY, L., AND RATNASAMY, S. Improved parallelism and scheduling in multicore software routers. The Journal of Supercomputing 63, 1 (2013), 294–322.
13. ELNABLY, A., DU, K., AND VARMAN, P. Reward scheduling for QoS scheduling in cloud applications. In 12th IEEE/ACM International Conference on Cluster, Cloud, and Grid Computing (CCGRID’12, May 2012).
14. ELNABLY, A., AND VARMAN, P. Application specific QoS scheduling in storage servers. In 24th ACM Symposium on Parallel Algorithms and Architectures (SPAA’12, June 2012).
15. ELNABLY, A., WANG, H., GULATI, A., AND VARMAN, P. Efficient QoS for multi-tiered storage systems. In 4th USENIX Workshop on Hot Topics in Storage and File Systems (June 2012).
16. GHODSI, A., SEKAR, V., ZAHARIA, M., AND STOICA, I. Multi-resource fair queueing for packet processing. In Proceedings of the ACM SIGCOMM 2012 Conference on Applications, Technologies, Architectures, and Protocols for Computer Communication (New York, NY, USA, 2012), SIGCOMM’12, ACM, pp. 1–12.
17. GHODSI, A., ZAHARIA, M., HINDMAN, B., KONWINSKI, A., SHENKER, S., AND STOICA, I. Dominant resource fairness: fair allocation of multiple resource types. In Proceedings of the 8th USENIX conference on Networked systems design and implementation (Berkeley, CA, USA, 2011), NSDI’11, USENIX Association, pp. 24–24.
18. GOYAL, P., VIN, H. M., AND CHENG, H. Start-time fair queueing: a scheduling algorithm for integrated services packet switching networks. IEEE/ACM Trans. Netw. 5, 5 (1997), 690–704.
19. GULATI, A., AHMAD, I., AND WALDSPURGER, C. PARDA: Proportional Allocation of Resources in Distributed Storage Access. In (FAST’09)Proceedings of the Seventh Usenix Conference on File and Storage Technologies (Feb 2009).
20. GULATI, A., KUMAR, C., AHMAD, I., AND KUMAR, K. Basil: Automated io load balancing across storage devices. In Usenix FAST (2010), pp. 169–182.
21. GULATI, A., MERCHANT, A., AND VARMAN, P. pClock: An arrival curve based approach for QoS in shared storage systems. In ACM SIGMETRICS (2007).
22. GULATI, A., MERCHANT, A., AND VARMAN, P. mClock: Handling Throughput Variability for Hypervisor IO Scheduling . In USENIX OSDI (2010).
23. GULATI, A., SHANMUGANATHAN, G., ZHANG, X., AND VARMAN, P. Demand based hierarchical qos using storage resource pools. In Proceedings of the 2012 USENIX conference on Annual Technical Conference (Berkeley, CA, USA, 2012), USENIX ATC’12, USENIX Association, pp. 1–1.
24. GULATI, A., SHANMUGANATHAN, G., ZHANG, X., AND VARMAN, P. Demand based hierarchical qos using storage resource pools. In Proceedings of the 2012 USENIX Conference on Annual Technical Conference (Berkeley, CA, USA, 2012), USENIX ATC’12, USENIX Association, pp. 1–1.
25. GUTMAN, A., AND NISAN, N. Fair allocation without trade. CoRR abs/1204.4286 (2012).
26. JACKSON, M. O., AND KREMER, I. Envy-freeness and implementation in large economies. Review of Economic Design 11, 3 (2007), 185–198.
27. JIN, W., CHASE, J. S., AND KAUR, J. Interposed proportional sharing for a storage service utility. In ACM SIGMETRICS’04 (2004).
28. JOE-WONG, C., SEN, S., LAN, T., AND CHIANG, M. In INFOCOM (2012), A. G. Greenberg and K. Sohraby, Eds., IEEE, pp. 1206–1214.
29. KARLSSON, M., KARAMANOLIS, C., AND ZHU, X. Triage: Performance differentiation for storage systems using adaptive control. Trans. Storage 1, 4 (2005), 457–480.
30. KASH, I., PROCACCIA, A. D., AND SHAH, N. No agent left behind: Dynamic fair division of multiple resources. In Proceedings of the 2013 International Conference on Autonomous Agents and Multi-agent Systems (Richland, SC, 2013), AAMAS’13, International Foundation for Autonomous Agents and Multiagent Systems, pp. 351–358.
31. KAVALANEKAR, S., WORTHINGTON, B., ZHANG, Q., AND SHARDA, V. Characterization of storage workload traces from production windows servers. In Workload Characterization, 2008. IISWC 2008. IEEE International Symposium on (2008), pp. 119–128.
32. LUMB, C., MERCHANT, A., AND ALVAREZ, G. Façade: Virtual storage devices with performance guarantees. File and Storage technologies (FAST’03) (March 2003), 131–144.
33. LUMB, C. R., SCHINDLER, J., GANGER, G. R., NAGLE, D. F., AND RIEDEL, E. Towards higher disk head utilization: extracting free bandwidth from busy disk drives. In Usenix OSDI (2000).
34. PARK, S., AND SHEN, K. Fios: A fair, efficient flash i/o scheduler. In FAST (2012).
35. PARK, S., AND SHEN, K. Flashfq: A fair queueing i/o scheduler for flash-based ssds. In Usenix ATC (2013).
36. PARKES, D. C., PROCACCIA, A. D., AND SHAH, N. Beyond dominant resource fairness: Extensions, limitations, and indivisibilities. In Proceedings of the 13th ACM Conference on Electronic Commerce (New York, NY, USA, 2012), EC’12, ACM, pp. 808–825.
37. POVZNER, A., KALDEWEY, T., BRANDT, S., GOLDING, R., WONG, T. M., AND MALTZAHN, C. Efficient guaranteed disk request scheduling with Fahrrad. SIGOPS Oper. Syst. Rev. 42, 4 (2008), 13–25.
38. PROCACCIA, A. D. Cake cutting: Not just child’s play. Communications of the ACM 56, 7 (2013), 78–87.
39. SHAKSHOBER, D. J. Choosing an I/O Scheduler for Red Hat Enterprise Linux 4 and the 2.6 Kernel. In In Red Hat magazine (June 2005).
40. SHREEDHAR, M., AND VARGHESE, G. Efficient fair queueing using deficit round robin. In Proc. of SIGCOMM’95 (August 1995).
41. STOICA, I., ABDEL-WAHAB, H., AND JEFFAY, K. On the duality between resource reservation and proportional-share resource allocation. SPIE (February 1997).
42. VALENTE, P., AND CHECCONI, F. High Throughput Disk Scheduling with Fair Bandwidth Distribution. In IEEE Transactions on Computers (2010), no. 9, pp. 1172–1186.
43. WACHS, M., ABD-EL-MALEK, M., THERESKA, E., AND GANGER, G. R. Argon: performance insulation for shared storage servers. In USENIX FAST (Berkeley, CA, USA, 2007).
44. WALDSPURGER, C. A., AND WEIHL, W. E. Lottery scheduling: flexible proportional-share resource management. In Usenix OSDI (1994).
45. WANG, Y., AND MERCHANT, A. Proportional-share scheduling for distributed storage systems. In Usenix FAST (Feb 2007).
46. WONG, T. M., GOLDING, R. A., LIN, C., AND BECKERSZENDY, R. A. Zygaria: Storage performance as a managed resource. In Proceedings of the 12th IEEE Real-Time and Embedded Technology and Applications Symposium (Washington, DC, USA, 2006), RTAS’06, IEEE Computer Society, pp. 125–134.
47. WU, X., AND REDDY, A. L. N. Exploiting concurrency to improve latency and throughput in a hybrid storage system. In MASCOTS (2010), pp. 14–23.
48. ZHANG, J., SIVASUBRAMANIAM, A., WANG, Q., RISKA, A., AND RIEDEL, E. Storage performance virtualization via throughput and latency control. In MASCOTS (2005), pp. 135–142.
49. ZHANG, L. VirtualClock: A new traffic control algorithm for packet-switched networks. ACM Trans. Comput. Syst. 9, 2, 101–124.