Scalable load balancing in cluster storage systems

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 7049 LNCS, Issue , 2011, Pages 101-122

  You, Gae Won ^a   Hwang, Seung Won ^a   Jain, Navendu ^b  

^a Pohang University of Science and Technology (POSTECH)   (South Korea)

^b MICROSOFT RESEARCH   (United States)

Author keywords

linear programming; Load balancing; optimization; storage

Indexed keywords

APPROXIMATION TECHNIQUES; CLOUD DATA; CLUSTER STORAGE SYSTEMS; DATA CENTERS; DATA MIGRATION; DATA OBJECTS; DIVIDE AND CONQUER; HOT SPOT; HOTSPOTS; LARGE SYSTEM; LOAD-BALANCING; NODE SELECTION; OPTIMIZATION PROBLEMS; PETABYTES; RECONFIGURATION COSTS; STORAGE NODES; STORAGE SOLUTIONS; STORAGE SYSTEMS; SYSTEM RECONFIGURATION; TOPOLOGY AWARE; CLOUD DATA CENTERS; DATA CENTER NETWORKS;

BANDWIDTH; COSTS; DATA STORAGE EQUIPMENT; ENERGY STORAGE; LINEAR PROGRAMMING; MIDDLEWARE; OPTIMIZATION; PARALLEL ARCHITECTURES; COST EFFECTIVENESS; NETWORK MANAGEMENT; RECONFIGURABLE HARDWARE; RESOURCE ALLOCATION;

COMPUTER SYSTEMS PROGRAMMING; DIGITAL STORAGE;

EID: 83755228953     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-25821-3_6     Document Type: Conference Paper

References (27)

1. Amazon S3, http://aws.amazon.com/s3/
2. Windows azure, http://www.microsoft.com/windowsazure/
3. Abd-El-Malek, M., Courtright II, W.V., Cranor, C., Ganger, G.R., Hendricks, J., Klosterman, A.J., Mesnier, M., Prasad, M., Salmon, B., Sambasivan, R.R., Sinnamohideen, S., Strunk, J.D., Thereska, E., Wachs, M., Wylie, J.J.: Ursa Minor: Versatile Cluster-based Storage. In: Proc. of FAST (2005)
4. Chang, F., Dean, J., Ghemawat, S., Hsieh, W.C., Wallach, D.A., Burrows, M., Chandra, T., Fikes, A., Gruber, R.E.: Bigtable: A Distributed Storage System for Structured Data. In: Proc. of OSDI (2006)
5. Curino, C., Jones, E., Zhang, Y., Madden, S.: Schism: a Workload-Driven Approach to Database Replication and Partitioning. In: Proc. of VLDB (2010)
6. Curino, C., Jones, E., Zhang, Y., Wu, E., Madden, S.: Relational Cloud: The Case for a Database Service. Technical Report MIT-CSAIL-TR-2010-014, MIT (2010)
7. Das, S., Nishimura, S., Agrawal, D., Abbadi, A.E.: Live Database Migration for Elasticity in a Multitenant Database for Cloud Platforms. Technical report, UCSB (2010)
8. Dean, J., Ghemawat, S.: MapReduce: Simplified Data Processing on Large Clusters. In: Proc. of OSDI (2004)
9. Elmore, A., Das, S., Agrawal, D., Abbadi, A.E.: Who's Driving this Cloud? Towards Efficient Migration for Elastic and Autonomic Multitenant Databases. Technical report, UCSB (2010)
10. Elmore, A., Das, S., Agrawal, D., Abbadi, A.E.: Zephyr: Live Migration in Shared Nothing Databases for Elastic Cloud Platforms. In: Proc. of SIGMOD (2011)
11. Eric, E.A., Spence, S., Swaminathan, R., Kallahalla, M., Wang, Q.: Quickly Finding Near-optimal Storage Designs. ACM Transactions on Computer Systems 23, 337-374 (2005)
12. Ghemawat, S., Gobioff, H., Leung, S.-T.: The Google File System. SIGOPS Operating System Review 37, 29-43 (2003)
13. Greenberg, A.G., Hamilton, J.R., Jain, N., Kandula, S., Kim, C., Lahiri, P., Maltz, D.A., Patel, P., Sengupta, S.: VL2: A Scalable and Flexible Data Center Network. In: Proc. of SIGCOMM (2009)
14. Gulati, A., Kumar, C., Ahmad, I., Kumar, K.: BASIL: Automated IO Load Balancing Across Storage Devices. In: Proc. of FAST (2010)
15. Hiller, F.S., Lieberman, G.J.: Introduction to Operations Research, 8th edn. McGraw-Hill (2005)
16. Kunkle, D., Schindler, J.: A Load Balancing Framework for Clustered Storage Systems. In: Sadayappan, P., Parashar, M., Badrinath, R., Prasanna, V.K. (eds.) HiPC 2008. LNCS, vol. 5374, pp. 57-72. Springer, Heidelberg (2008)
17. Lang, W., Patel, J.M., Naughton, J.F.: On Energy Management, Load Balancing and Replication. SIGMOD Record 38, 35-42 (2010)
18. Litwin, W.: Linear Hashing: A New Tool for File and Table Addressing. In: Proc. of VLDB (1980)
19. Narayanan, D., Donnelly, A., Thereska, E., Elnikety, S., Rowstron, A.: Everest: Scaling Down Peak Loads through I/O Off-loading. In: Proc. of OSDI (2008)
20. Savinov, S., Daudjee, K.: Dynamic Database Replica Provisioning through Virtualization. In: Proc. of CloudDB (2010)
21. Tam, H.V., Chen, C., Ooi, B.C.: Towards Elastic Transactional Cloud Storage with Range Query Support. In: Proc. of VLDB (2010)
22. Thereska, E., Donnelly, A., Narayanan, C.: Sierra: A Power-proportional, Distributed Storage System. In: Technical Report MSR-TR-2009-153 (2009)
23. Venkataramani, A., Kokku, R., Dahlin, M.: TCP Nice: A Mechanism for Background Transfers. In: Proc. of OSDI (2002)
24. Verma, A., Ahuja, P., Neogi, A.: pMapper: Power and Migration Cost Aware Application Placement in Virtualized Systems. In: Issarny, V., Schantz, R. (eds.) Middleware 2008. LNCS, vol. 5346, pp. 243-264. Springer, Heidelberg (2008)
25. Weil, S.A., Brand, S.A., Miller, E.L., Long, D.D.E., Maltzahn, C.: Ceph: A Scalable, High-performance Distributed File System. In: Proc. of OSDI (2006)
26. Yin, Q., Schüpbach, A., Cappos, J., Baumann, A., Roscoe, T.: Rhizoma: A Runtime for Self-deploying, Self-managing Overlays. In: Bacon, J.M., Cooper, B.F. (eds.) Middleware 2009. LNCS, vol. 5896, pp. 184-204. Springer, Heidelberg (2009)
27. Zeng, L., Feng, D., Wang, F., Zhou, K.: A Strategy of Load Balancing in Objects Storage System. In: Proc. of CIT (2005)