Optimized Cloud Resource Management and Scheduling: Theories and Practices

Optimized Cloud Resource Management and Scheduling: Theories and Practices

Volumn , Issue , 2014, Pages 1-266

  Tian, Wenhong ^a   Zhao, Yong ^a  

^a UNIVERSITY OF ELECTRONIC SCIENCE AND TECHNOLOGY OF CHINA   (China)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATION THEORY; ENERGY EFFICIENCY; INDUSTRIAL RESEARCH; INFORMATION MANAGEMENT; NATURAL RESOURCES MANAGEMENT; RESOURCE ALLOCATION; SCHEDULING ALGORITHMS; STUDENTS;

CLOUD DATA CENTERS; CLOUD PLATFORMS; COMPUTING RESOURCE; CONSUMER APPLICATIONS; EFFICIENT MANAGEMENTS; ENERGY-EFFICIENT SCHEDULING; GRADUATE LEVELS; RESOURCE MANAGEMENT AND SCHEDULING;

SCHEDULING;

EID: 84941712443     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1016/C2013-0-13415-0     Document Type: Book

References (294)

1. IBM. Virtualization and Cloud computing (in Chinese), 2009.
2. Wiki, March 15, 2014. http://en.wikipedia.org/wiki/Wiki.
3. Armbrust M. Above the Clouds: a Berkeley view of Cloud computing. Technical report, 2009.
4. Foster I, Zhao Y, Raicu I, Lu S. Cloud computing and grid computing 360-degree compared, 2008.
5. HP Cloud research, March 10, 2014. http://www.hpl.hp.com/research/cloud.html.
6. IDC's digital universe study (sponsored by EMC), December 2012.
7. Amazon Elastic Compute Cloud. March 12, 2014. http://aws.amazon.com/ec2/.
8. Microsoft, Azure. March 10, 2014. http://www.microsoft.com/windowsazure/.
9. VMware Cloud Computing. March 10, 2014. http://www.vmware.com/solutions/cloud-computing/.
10. Reilly O. Hadoop. The Definitive Guide, 2009.
11. The Hadoop Project. March 10, 2014. http://hadoop.apache.org.
12. Eucalyptus Public Cloud. March 12, 2014. http://open.eucalyptus.com/wiki/Documentation.
13. Zikopoulos P.C., Eaton C., DeRoos D., Deutsch T., Lapis G. Understanding big data 2012, McGraw-Hill, New York, NY.
14. Bell G., Hey T., Szalay A. Beyond the data deluge. Science 2009, 323(5919):1297-1298.
15. Manyika J., Chui M., Brown B., Bughin J., Dobbs R., Roxburgh C., et al. Big data: the next frontier for innovation, competition, and productivity 2011, MacKinsey Global Institute.
16. Big Data Research and Development Initiative. http://www.whitehouse.gov/sites/default/files/microsites/ostp/big_data_press_release_final_2.pdf.
17. http://wikibon.org/wiki/v/Big_Data_Market_Size_and_Vendor_RevenuesBig_Data_Market_Size_and_Vendor_Revenues.
18. Gupta R., Gupta H., Mohania M. Cloud computing and big data analytics: what is new from databases perspective?. Big data analytics 2012, Springer, Berlin, Heidelberg, p. 42-61.
19. Li G.J., Cheng X.Q. Research status and scientific thinking of big data. Bull Chin Acad Sci 2012, 27(6):647-657. (In Chinese).
20. Apache Hadoop. http://hadoop.apache.org/.
21. Khetrapal A., Ganesh V. HBase and hypertable for large scale distributed storage systems 2006, Department of Computer Science, Purdue University.
22. http://cassandra.apache.org/.
23. http://www.mongodb.org/.
24. Labrinidis A., Jagadish H.V. Challenges and opportunities with big data. Proc VLDB Endowment 2012, 5(12):2032-2033.
25. http://mahout.apache.org/.
26. Foster I, Zhao Y, Raicu I, Shiyong L. Cloud computing and grid computing 360-degree compared. Grid computing environments workshop, IEEE, 2008. p. 1-10.
27. OpenNebula. http://www.opennebula.org.
28. OpenNebulaArchitecture. http://www.opennebula.org/documentation:archives:rel2.2:architecture.
29. Nurmi D, Wolski R, Grzegorczyk C, Obertelli G, Soman S, Youseff L, et al. The eucalyptus open-source cloud-computing system. Ninth IEEE/ACM international symposium on cluster computing and the grid, 2009. p. 124-31.
30. Keahey K, Freeman T. Contextualization: providing one-click virtual clusters. IEEE fourth international conference on eScience, 2008. p. 301-08.
31. Openstack. http://www.openstack.org.
32. Barham P., Dragovic B., Fraser K., Hand S., Harris T., Ho A., et al. Xen and the art of virtualization. ACM SIGOPS Oper Syst Rev 2003, 37(5):164-177.
33. KVM (Kernel Based Virtual Machine). http://www.linux-kvm.org/page/Main.
34. Ghemawat S., Gobioff H., Leung S.T. The Google file system. Proceedings of the 19th ACM symposium on operating systems principles 2003, ACM Press, New York, NY, p. 29-43.
35. Zheng Q.L., Fang M., Wang S., Wang X.Q., Wu X.W., Wang H. Scientific parallel computing based on MapReduce model. Micro Electron Comput 2009, 26(8):13-17. (In Chinese).
36. Dean J., Ghemawat S. MapReduce: simplified data processing on large clusters. Commun ACM 2008, 51(1):107-113.
37. Li Y.L., Dong J. Study and improvement of MapReduce based on Hadoop. Comput Eng Des 2012, 33(8):3110-3116. (In Chinese).
38. Chang F., Dean J., Ghemawat S., Hsieh W.C., Wallach D.A., Burrows M., et al. BigTable: a distributed storage system for structured data. Proceedings of the seventh USENIX symposium on operating systems design and implementation 2006, USENIX Association, Berkeley, p. 205-18.
39. Baker J, Bond C, Corbett JC, Furman JJ, Khorlin A, Larson J, et al. Megastore: providing scalable, highly available storage for interactive services. CIDR 2011, 11: p. 223-34.
40. Taylor R.C. An overview of the Hadoop/MapReduce/HBase framework and its current applications in bioinformatics. BMC Bioinformatics 2010, 11(Suppl. 12):S1.
41. Avro. http://avro.apache.org/.
42. Thusoo A., Sarma J.S., Jain N., Shao Z., Chakka P., Anthony S., et al. Hive: a warehousing solution over a map-reduce framework. Proc VLDB Endowment 2009, 2(2):1626-1629.
43. Olston C., Reed B., Srivastava U., Kumar R., Tomkins A. Pig latin: a not-so-foreign language for data processing. Proceedings of the 2008 ACM SIGMOD international conference on management of data 2008, ACM, p. 1099-110.
44. Gopalakrishna K., Hu G., Seth P. Communication layer using ZooKeeper 2009, Yahoo! Inc., Tech. Rep.
45. Swift Workflow System. http://www.ci.uchicago.edu/Swift/main/.
46. Zhao Y, Hategan M, Clifford B, Foster I, von Laszewski G, Nefedova V, et al. Swift: fast, reliable, loosely coupled parallel computation. IEEE congress on Services, 2007. p. 199-206.
47. Malewicz G., Austern M.H., Bik A.J.C., Dehnert J.C., Horn I., Leiser N., et al. Pregel: a system for large-scale graph processing. Proceedings of the 2010 ACM SIGMOD international conference on management of data 2010, ACM, p. 135-46.
48. Melnik S., Gubarev A., Long J.J., Romer G., Shivakumar S., Tolton M., et al. Dremel: interactive analysis of web-scale datasets. Proc VLDB Endowment 2010, 3(1-2):330-339.
49. Scribe. https://github.com/facebook/scribe.
50. Kafka. http://kafka.apache.org/.
51. Flume. https://github.com/cloudera/flume.
52. TimeTunnel. http://code.taobao.org/p/TimeTunnel/src/.
53. Rabkin A., Katz R. Chukwa: a system for reliable large-scale log collection. Proceedings of the 24th international conference on large installation system administration 2010, USENIX Association, p. 1-15.
54. Zaharia M, Chowdhury M, Franklin MJ, Shenker S, Stoica I. Spark: cluster computing with working sets. Proceedings of the second USENIX conference on hot topics in cloud computing. 2010. p. 10-10.
55. Zaharia M., Chowdhury M., Das T., Dave A., Ma J., McCauley M., et al. Resilient distributed datasets: a fault-tolerant abstraction for in-memory cluster computing. Proceedings of the 9th USENIX conference on Networked Systems Design and Implementation 2012, USENIX Association, p. 2-2.
56. Kornacker M, Erickson J. Cloudera Impala: real-time queries in Apache Hadoop, for real. 2012. http://blog.cloudera.com/blog/2012/10/cloudera-impala-real-time-queries-in-apache-hadoop-for-real/.
57. Schroedl S, Kesari A, Neumeyer L. Personalized ad placement in web search. Proceedings of the fourth annual international workshop on data mining and audience intelligence for online advertising (AdKDD), Washington, DC. 2010.
58. Malkin J, Schroedl S, Nair A, Neumeyer L. Tuning hyperparameters on live traffic with S4. In TechPulse 2010: Internal Yahoo! Conference, 2010.
59. Neumeyer L, Robbins B, Nair A, Kesari A. S4: distributed stream computing platform. IEEE international conference on data mining workshops (ICDMW). 2010. p. 170-7.
60. Amini L., Andrade H., Bhagwan R., Eskesen F., King R., Selo P., et al. SPC: a distributed, scalable platform for data mining. Proceedings of the fourth international workshop on data mining standards, services and platforms 2006, ACM, p. 27-37.
61. Storm. Distributed and fault-tolerant real-time computation, http://storm-project.net/.
62. Tableau. http://www.tableausoftware.com/.
63. Visual.ly. http://visuanl.ly/.
64. Meng X.F., Ci X. Big data management: concept, techniques and challenges. J Comput Res Dev 2013, 50(1):146-169. (In Chinese).
65. Tao X.J., Hu X.F., Liu Y. Overview of big data research. J Syst Simul 2013, 25S:142-146. (In Chinese).
66. Yan X.F., Zhang D.X. Big data research. Comput Technol Dev 2013, 23(4):168-172. (In Chinese).
67. Wang S., Wang H.J., Qin X.P., Zhou X. Architecting big data: challenges, studies and forecasts. Chin J Comput 2011, 34(10):1741-1752. (In Chinese).
68. Abouzeid A., Bajda-Pawlikowski K., Abadi D., Silberschatz A., Rasin A. HadoopDB: an architectural hybrid of MapReduce and DBMS technologies for analytical workloads. Proc VLDB Endowment 2009, 2(1):922-933.
69. Abouzied A., Bajda-Pawlikowski K., Huang J.W., Abadi D.J., Silberschatz A. HadoopDB in action: building real world applications. Proceedings of the SIGMOD 2010, 1111-1114. ACM Press, Indianapolis, IN. doi:10.1145/1807167.1807294, A.K. Elmagarmid, D. Agrawal (Eds.).
70. Qin X.P., Wang H.J., Du X.Y., Wang S. Big data analysis-competition and symbiosis of RDBMS and MapReduce. J Softw 2012, 23(1):32-45. (In Chinese).
71. Qin X.P., Wang H.J., Li F.R., Li C.P., Chen H., Zhou X., et al. New landscape of data management technologies. J Softw 2013, 24(2):175-197. (In Chinese).
72. Shen D.R., Yu G., Wang X.T., Nie T.Z., Kou Y. Survey on NoSQL for management of big data. J. Softw 2013, 24(8):1786-1803. (In Chinese).
73. Hull D., Wolstencroft K., Stevens R., Goble C., Pocock M.R., Li P., et al. Taverna: a tool for building and running workflows of services. Nucleic Acids Res 2006, 34(Suppl. 2):W729-W732.
74. Ludäscher B., Altintas I., Berkley C., Higgins D., Jaeger E., Jones M., et al. Scientific workflow management and the Kepler system. Concurrency Comput: Pract Exp 2006, 18(10):1039-1065.
75. Freire J., Silva C.T., Callahan S.P., Santos E., Scheidegger C.E., Vo H.T. Managing rapidly-evolving scientific workflows. Provenance and annotation of data 2006, Springer, Berlin, Heidelberg, p. 10-18.
76. Deelman E., Singh G., Su M.H., Blythe J., Gil Y., Kesselman C., et al. Pegasus: a framework for mapping complex scientific workflows onto distributed systems. Sci Programming 2005, 13(3):219-237.
77. Lin C, Lu S, Lai Z, Chebotko A, Fei X, Hua J, et al. Service-oriented architecture for VIEW: a visual scientific workflow management system. IEEE international conference on Services computing, 2008, 1: p. 335-42.
78. Zhao Y, Li Y, Tian W, Xue R. Scientific-workflow-management-as-a-service in the Cloud. Second international conference on cloud and green computing (CGC). 2012. p. 97-104.
79. Fujistu, API design for IaaS Cloud computing service, 2010.
80. IBM IaaS Resource Model & REST APIs Document Version 1.0, July 02, 2010.
81. DMTF 2009-11-11, White paper, Interoperable Clouds: Distributed Management Task Force, Inc. (DMTF).
82. Amazon, Amazon Elastic Compute Cloud, last access, March 26, 2014. http://aws.amazon.com/ec2/.
83. IBM: IBM Cloud Computing, last access, April 2, 2014. http://www.ibm.com/ibm/cloud/.
84. VMWare: Vmware Cloud computing, last access, March 25, 2014. http://www.vmware.com/solutions/cloud-computing/.
85. Hyser C, et al. Autonomic virtual machine placement in the data center, HP Laboratories, February 26, 2008.
86. Google: Barroso L, et al. The datacenter as a computer: an introduction to the design of warehouse-scale machines, 2009.
87. Amazon Elastic Compute Cloud. 2014. http://aws.amazon.com/ec2/.
88. Vouk M. Cloud Computing-Issues, Research and implementations, 30th international conference on information technology interfaces, 2008.
89. Vouk M, Averitt S, et al. Using Virtual Computing Laboratory (VCL) technology to power Cloud computing, In: The proceedings of second international conference on the virtual computing initiative, 2008.
90. HP Cloud Research, 2014. http://www.hpl.hp.com/research/cloud.html.
91. Hpdatacenter, 2014. http://h20195.www2.hp.com/v2/GetPDF.aspx/4AA1-8079ENW.pdf.
92. Patel CD, et al. Cost model for planning, development and operation of a data center, 2005.
93. Introduction Cloud Computing Architecture White Paper, 2009.
94. Vmware Cloud Computing, 2014. http://www.vmware.com/solutions/cloud-computing/.
95. Tian W, Jing C, Hu J, Analysis of resource allocation and scheduling policies in Cloud datacenter, accepted for publication. In: IEEE third international conference on networks security wireless communications and trusted computing, 2011.
96. Barroso L, et al. The datacenter as a computer: an introduction to the design of warehouse-scale machines, 2009.
97. IBM Cloud Computing, 2014. http://www.ibm.com/ibm/cloud/.
98. Cisco Cloud computing-Data center strategy, architecture, and solutions point of view, White Paper for U.S. Public Sector, 2009.
99. The Hadoop Project. Available at: 2014. http://hadoop.apache.org.
100. Hyser C, et al. Autonomic virtual machine placement in the data center, 2008.
101. Sun Cloud Computing, 2014. http://www.sun.com/solutions/cloudcomputing/.
102. Cloud-Standards, 2014. http://cloud-standards.org/wiki/index.php?title=Main_Page#NIST_Working_Definition_of_Cloud_Computing.
103. Wang L, et al. Towards thermal aware workload data center. In: The proceedings of the tenth international symposium on pervasive systems, algorithms and networks, 2009.
104. Tang Q, et al. Energy-efficient, thermal-aware task scheduling for homogeneous, high performance computing data centers: a cyber-physical approach, IEEE transactions on parallel and distributed systems, 2008.
105. Bianchini R, et al. Power and energy management for server systems, Computer, 2004.
106. Wang L. Efficient power management of heterogeneous soft real-time clusters. In: The proceedings of real-time systems symposium, Barcelona, 2008.
107. Cardosa M, et al. Shares and utilities based power consolidation in virtualized server environments. In: The proceedings of 11th IFIP/IEEE international symposium on integrated network management, IEEE communications society, 2009.
108. Pacific Northwest National Laboratory, Data center energy efficiency, 2007. http://esdc.pnl.gov/SC07_BOF/SC07BOF_Tschudi.pdf.
109. Andre L, et al. The datacenter as a computer: an introduction to the design of warehouse-scalemachines, Ebook, 2009.
110. Armbrust M, et al. Above the Clouds: a Berkeley view of Cloud computing, Technical Report, 2009.
111. Foster I, Zhao Y, Raicu I, Lu S. Cloud computing and grid computing 360-degree compared. In: IEEE international workshop on grid computing environments (GCE) 2008, Co-located with IEEE/ACM supercomputing, 2008.
112. Buyya R, Ranjan R, Calheiros RN. Modeling and simulation of scalable cloud computing environments and the CloudSim toolkit: challenges and opportunities. In: Proceedings of the seventh high performance computing and simulation conference, HPCS 2009, Leipzig, Germany, June 21-24, 2009.
113. Wickremasinghe B, et al. CloudAnalyst: a CloudSim-based tool for modelling and analysis of large scale cloud computing environments. In: Proceedings of the 24th IEEE international conference on advanced information networking and applications (AINA 2010), Perth, Australia, April 20-23, 2010.
114. Wood T, et al. Black-box and gray-box strategies for virtual machine migration. In: Proceedings of symposium on networked systems design and implementation (NSDI), 2007.
115. Zhang W. Research and implementation of elastic network service, PhD dissertation, National University of Defense Technology, China, 2000 (in Chinese).
116. Singh A, Korupolu M, Mohapatra D. Server-storage virtualization: integration and load balancing in data centers, International conference for high performance computing, networking, storage and analysis, 2008.
117. Arzuaga E, Kaeli DR. Quantifying load imbalance on virtualized enterprise servers. In: Proceedings of WOSP/SIPEW 10, San Jose, CA, January 28-30, 2010.
118. Tian W. Adaptive dimensioning of cloud data centers. In: Proceeding of the eighth IEEE international conference on dependable, automatic and secure computing, DACS, 2009.
119. Sun X., Xu P., Shuang K., et al. Multi-dimensional aware scheduling for co-optimizing utilization in data center. China Commun 2011, 8(6):19-27.
120. Tian W, Jing C, Hu J. Analysis of resource allocation and scheduling policies in Cloud datacenter. In: Proceedings of the IEEE third international conference on networks security wireless communications and trusted computing, March 2011.
121. Li K, Xu G, Zhao G, et al. Cloud task scheduling based on load balancing ant colony optimization, 2011 sixth annual China grid conference, 2011, p. 3-9.
122. Galloway JM, Smith KL, Vrbsky SS. Power aware load balancing for cloud computing. In: Proceedings of the world congress on engineering and computer science 2011, WCECS 2011, vol. I, October 19-21, 2011.
123. Hu J, Gu J, Sun G, et al. A scheduling strategy on load balancing of virtual machine resources in cloud computing environment, 2010 third international symposium on parallel architectures, algorithms and programming (PAAP), December 18-20, 2010, p. 89-96.
124. Kleinberg J., Tardos E. Algorithm design 2005, Pearson Education Inc.
125. Coffman E.G., Garey M.R., Johnson D.S. Bin-packing with divisible item sizes. J Complexity 1987, 3:406-428.
126. Graham R.L. Bounds on multiprocessing timing anomalies. SIAM J Appl Math 1969, 17(2):416-429.
127. Zheng H., Zhou L., Wu J. Design and implementation of load balancing in web server cluster system. J Nanjing Univ Aeronaut Astronaut 2006, 38(3).
128. Gulati A., Shanmuganathan G., Holler A., Ahmad I. Cloud-scale resource management: challenges and techniques. VMware Tech J 2011.
129. Hebrew University, Experimental Systems Lab, 2007. http://www.cs.huji.ac.il/labs/parallel/workload.
130. Amazon, Amazon Elastic Compute Cloud, 2012. http://aws.amazon.com/ec2/.
131. Armbrust M., Fox A., Griffith J., Anthony D.K., Randy H.K., Andrew L., et al. Above the Clouds: a Berkeley view of Cloud computing 2009, EECS Department, University of California, Berkeley.
132. Google App Engine. http://code.google.com/intl/zh-CN/appengine/.
133. IBM (2007) blue cloud, http://www.ibm.com/grid/.
134. Amazon EC2. http://aws.amazon.com/ec2/.
135. Microsoft Inc., Windows Azure, December 2013. http://www.microsoft.com/windowsazure.
136. Beloglazov A., Buyya R., Lee Y.C., Zomaya A. A taxonomy and survey of energy-efficient data centers and Cloud computing systems, advances in computers 2011, vol. 82. Elsevier, Amsterdam, The Netherlands, ISBN: 978-0-12-385512-1.
137. Boss G, et al. Cloud computing, IBM Corporation white paper, November 2007. http://download.boulder.ibm.com/ibmdl/pub/software/dw/wes/hipods/Cloud_computing_wp_final_8Oct.pdf.
138. Foster I, et al. Cloud computing and grid computing 360-degree compared [R]. IEEE International Workshop on Grid Computing Environments (GCE) 2008, co-located with IEEE/ACM Supercomputing, 2008.
139. Youseff L, et al. Toward a unified ontology of Cloud computing. In: The proceedings of grid computing environments workshop, GCE'08, 2008.
140. Tian WH. Adaptive dimensioning of Cloud datacenters. In: The proceedings of IEEE the eighth international conference on dependable, autonomic and secure computing (DASC-09), Chengdu, China; December 12-14, 2009.
141. Liu L., Wang H., Liu X., Jin X., He W.B., Wang Q.B., et al. GreenCloud: a new architecture for green data center. Proceedings of the sixth international conference industry session on autonomic computing and communications industry session, ICAC-INDST'09 2009, ACM, New York, NY, p. 29-38.
142. Distributed Management Task Force Inc., Interoperable Clouds: A white paper from the open cloud standards Incubator, November 2009. http://www.dmtf.org/about/policies/disclosures.php.
143. Nurmi D, et al. The Eucalyptus open-source Cloud-computing system. In: Proceedings of ninth IEEE international symposium on cluster computing and the grid, Shanghai, China, 2008.
144. Tian WH, Zhao Y, Zhong YL, Xu MX, Jing C. A dynamic and integrated load-balancing scheduling algorithm for Cloud data centers. In: the proceedings of CCIS 2011, Beijing.
145. Garg SK, Yeo CS, Buyya R. GreenCloud framework for improving carbon efficiency of Clouds. In: Proceedings of the 17th international European conference on parallel and distributed computing (EuroPar 2011, LNCS, Springer, Germany), Bordeaux, France; August 29-September 2, 2011.
146. Jing S., Ali S., She K., Zhong Y. State-of-the-art research study for green Cloud computing. J Supercomputing, Special Issue on Cloud Computing 2011. 2013, 65(1):445-468.
147. Srikantaiah S, Kansal A, Zhao F. Energy aware consolidation for Cloud computing. In: Proceedings of the 2008 conference on power aware computing and systems.
148. Lee Y., Zomaya A.Y. Energy efficient utilization of resource in Cloud computing systems. J Supercomput May 2012, 60(2):268-280.
149. Beloglazov A., Abawajy J., Buyya R. Energy-aware resource allocation heuristics for efficient management of data centers for Cloud computing. Future Gener Comput Syst May 2012, 28(5):755-768.
150. Liu H, Xu C, Jin H, Gong J, Liao X. Performance and energy modeling for live migration of virtual machines. In: The proceedings of HPDC'11, June 8-11, San Jose, CA; 2011.
151. Guazzone M, Anglano C, Canonico M. Energy-Efficient Resource Management for Cloud Computing Infrastructures. In the proceedings of CloudCom, 2011.
152. Kim K, Beloglazov A, Buyya R. Power-aware provisioning of virtual machines for real-time Cloud services, Concurrency and Computation: Practice and Experience, vol. 23, Number 13, New York, NY: Wiley Press; September 10, 2011. p. 1491-505. ISSN: 1532-0626.
153. Kolen AWJ, Lenstra JK, Papadimitriou CH, Spieksma FCR. Interval scheduling: a survey, Published online 16 March 2007 in Wiley InterScience http://www.interscience.wiley.com.
154. Kovalyov M.Y., Ng C.T., Cheng E. Fixed interval scheduling: models, applications, computational complexity and algorithms. Eur J Operational Res 2007, 178(2):331-342.
155. Economou D, Rivoire S, Kozyrakis C, Ranganathan P. Full-system power analysis and modeling for server environments, 2006. Stanford University/HP Labs workshop on modeling, benchmarking, and simulation (MoBS) June 18, 2006.
156. Garey R., Johnson D.S. Computing and intractability: a guide to the theory of NP-completeness 1978, W.H. Freeman, San Francisco, CA.
157. Kleinberg J., Tardos E. Algorithm design 2005, Pearson Education, ISBN: 0321295358.
158. Coffman E.G., Garey M.R., Johnson D.S. Bin-packing with divisible item sizes. J Complexity 1987, 3:406-428.
159. Mathew V, Sitaraman RK, Shenoy P. Energy-aware load balancing in content delivery networks. In: The proceedings of INFOCOM, 2012.
160. Rao L, Liu X, Xie L, Liu WY. Minimizing electricity cost: optimization of distributed Internet data centers in a multi-electricity-market environment. In INFOCOM, 2010.
161. Lin M, Wierman A, Andrew LLH, Thereska E. Dynamic right- sizing for power-proportional data centers. In: Proceedings of the IEEE INFOCOM, Shanghai, China; 2011. p. 10-5.
162. Hoogeveen J.A., van de Velde S.L., Veltman B. Complexity of scheduling multiprocessor tasks with prespecified processor allocations. Discrete Appl Math 1994, 55(3):259-272.
163. Khandekar R., Schieber B., Shachnai H., Tamir T. Minimizing busy time in multiple machine real-time scheduling. Proceedings of IARCS annual conference on foundations of software technology and theoretical computer science (FSTTCS 2010) 2010, vol. 8. LIPIcs, Schloss Dagstuhl-Leibniz-Zentrum fuer Informatik, Chennai, India, p. 169-80.
164. Brucker P. Scheduling algorithms 2007, Springer, Berlin, Heidelberg, New York. 5th ed.
165. Beloglazov A., Buyya R., Lee Y.C., Zomaya A.Y. A taxonomy and survey of energy-efficient data centers and Cloud computing systems. Adv Comput 2011, 82:47-111.
166. Jing S.Y., Ali S., She K., Zhong Y. State-of-the-art research study for green Cloud computing. J Supercomput 2011, 1-24.
167. Amazon EC2. Available from: 2013 [accessed 15.06.13]. http://www.amazon.com/ec2.
168. Graham R.L. Bounds on multiprocessing timing anomalies. SIAM J Appl Math 1969, 17(2):416-429.
169. Kleinberg J.M., Tardos E. Algorithm design 2006, Addison-Wesley: Pearson Education, Inc., Boston, MA.
170. Kovalyov M.Y., Ng C.T., Cheng T.C.E. Fixed intervals scheduling: models, applications, computational complexity and algorithms. Eur J Oper Res 2007, 178(2):331-342.
171. Beloglazov A., Abawajy J.H., Buyya R. Energy-aware resource allocation heuristics for efficient management of data centers for Cloud computing. Future Gen Comput Syst 2012, 28(5):755-768.
172. Winkler P., Zhang L. Wavelength assignment generalized interval graph coloring. Proceedings of fourteenth annual ACM-SIAM symposium on discrete algorithms (SODA 2003) 2003, ACM/SIAM, Baltimore, MD, p. 830-1.
173. Flammini M., Monaco G., Moscardelli L., Shachnai H., Shalom M., Tamir T., et al. Minimizing total busy time in parallel scheduling with application to optical networks. Theor Comput Sci 2010, 411(40-42):3553-3562.
174. Kolen A.W., Lenstra J.K., Papadimitriou C.H., Spieksma F.C. Interval scheduling: a survey. Nav Res Log 2007, 54(5):530-543.
175. Srikantaiah S., Kansal A., Zhao F. Energy aware consolidation for Cloud computing. Proceedings of USENIX workshop on power aware computing and systems (HotPower 2008) 2008, USENIX, San Diego, CA, p. 10-4.
176. Lee Y.C., Zomaya A.Y. Energy efficient utilization of resources in Cloud computing systems. J Supercomput 2012, 60(2):268-280.
177. Liu H, Xu C, Jin H, Gong J, Liao X. Performance and energy modeling for live migration of virtual machines, the 20th international symposium on high performance distributed computing. 2011. p. 171-82.
178. Kim K.H., Beloglazov A., Buyya R. Power-aware provisioning of virtual machines for real-time Cloud services. Concurr Comput Pract Exp 2011, 23(13):1491-1505.
179. Mathew V., Sitaraman R.K., Shenoy P.J. Energy-aware load balancing in content delivery networks. Proceedings of IEEE INFOCOM 2012, IEEE, Orlando, FL, p. 954-62.
180. Rao L., Liu X., Xie L., Liu W. Minimizing electricity cost: optimization of distributed internet data centers in a multi-electricity-market environment. Proceedings of IEEE INFOCOM 2010 2010, IEEE, San Diego, CA, p. 1145-53.
181. Lin M., Wierman A., Andrew L.L.H., Thereska E. Dynamic right-sizing for power-proportional data centers. Proceedings of IEEE INFOCOM 2011 2011, IEEE, Shanghai, China, p. 1098-106.
182. Mertzios G.B., Shalom M., Voloshin A., Wong P.W.H., Zaks S. Optimizing busy time on parallel machines. Proceedings of IPDPS 2012, IEEE, Shanghai, China, p. 238-48.
183. Garey M.R., Johnson D.S. Computers and intractability: a guide to the theory of NP-completeness 1979, W. H. Freeman and Co., New York, NY.
184. Coffman E.G., Garey M.R., Johnson D.S. Bin packing with divisible item sizes. J Complexity 1987, 3(4):406-428.
185. Armbrust M., Fox A., Griffith R., Joseph A.D., Katz R.H., Konwinski A., et al. A view of Cloud computing. Commun ACM 2010, 53(4):50-58.
186. Eucalyptus. Available from: 2013 [accessed 15.06.13]. http://open.eucalyptus.com.
187. Tian W, Zhao Y, Xu M, Zhong Y, Sun X. A toolkit for modeling and simulation of real-time virtual machine allocation in a Cloud data center. IEEE Transactions on Automation Science and Engineering 2013. Available from:. doi:10.1109/TASE.2013.2266338.
188. Parallel Workloads Archive. Available from: 2013 [accessed 10.07.13]. http://www.cs.huji.ac.il/labs/parallel/workload.
189. Cloud-Standards. http://cloud-standards.org/wiki/index.php?title=Main_Page#NIST_WorkingDefinition_of_Cloud_Computing.
190. Kang C., Wei-Min Z. Cloud computing: system instance and current research. J Softw 2009, 20(5):1339-1348.
191. Bing G., Yan S., Zi-Li S. The redefinition and some discussion about green computing. Chin J Comput 2009, 32(12):2311-2319.
192. Liu P., Cloud computing, Publishing House of Electronics Industry, China, 2010.
193. Lin C., Tian Y., Yao M. Green networks and green evaluation: the energy-saving mechanism, model and evaluation. Chin J Comput 2011, 34(4):593-612.
194. Ye K.-J., Wu Z.-H., Jiang X.-H., He Q.-M. Power management of virtualized Cloud computing platform. Chin J Comput 2012.
195. Tan Y.-M., Zeng G.-S., Wang W. Policy of energy optimal management for Cloud computing platform with stochastic tasks. J Softw 2012, 23(2):266-278.
196. Tian W., Zhao Y. Cloud computing: resource scheduling and management 2011, National Defense Industry Press, China.
197. Lee Y.C., Zomaya A.Y. Energy efficient utilization of resource in Cloud computing systems. J Supercomput 2010, [Published online March 19, 2010].
198. Pinheiro E, Bianchini R, Carrera EV, Heath T. Load balancing and unbalancing for power and performance in cluster-based systems, the workshop on compilers and operating systems for low power. 2001. p. 182-95.
199. Flammini M., Monaco G., Moscardelli L., Shachnai H., Shalom M., Tamir T., et al. Minimizing total busy time in parallel scheduling with application to optical networks. Theor Comput Sci 2010, 411(40-42):3553-3562.
200. Khandekar R, Schieber B, Shachnai H, Tamir T, Minimizing busy time in multiple machine real-time scheduling, IARCS annual conference on foundations of software technology and theoretical computer science, 2010, December 15-18. Chennai, India, 2010.
201. Shalom M., Voloshin A., Wong P.W.H., Yung F.C.C., Zaks S. Online optimization of busy time on parallel machines, theory and applications of models of computation. Lect Notes Comput Sci 2012, 7287:448-460.
202. Gandhia A., Guptaa V., Harchol-Baltera M., Kozuchb M.A. Optimality analysis of energy-performance trade-off for server farm management. Perform Eva 2010, 1-23.
203. Tian W, Su S, Lu G. A framework for implementing and managing platform as a service in a virtual Cloud computing lab, International workshop on education technology and computer science, 2010, 6-7 March. 2010. p. 273-76.
204. Tian WH. Adaptive dimensioning of Cloud datacenters. In: Proceedings of the IEEE eighth international conference on dependable, autonomic and secure computing (DASC-09), Chengdu, China, December 12-14, 2009; 2009.
205. Tian W-H, Yeo C-S, Xue R. Power-aware scheduling of real-time virtual machines in Cloud data centers considering fixed processing intervals. In: Proceedings of IEEE CCIS 2012, Hangzhou.
206. Tian W.-H., Yao C.S Minimizing total busy time of offline real-time parallel scheduling with application to energy efficiency in Cloud computing. Concurr Comput Pract Exp 2012, 10.
207. Tian W.-H., et al. Energy-efficient online real-time parallel scheduling with application to Cloud computing. J Supercomput 2012, 9.
208. Moore J, Chase J, Ranganathan P. Making scheduling cool: temperature-aware workload placement in data centers. In: Proceedings of the annual conference on USENIX annual technical conference (ATC'05), 2005; 2005.
209. Kovalyov M.Y., Ng C.T., Cheng E. Fixed interval scheduling: models, applications, computational complexity and algorithms. Eur J Oper Res 2007, 178(2):331-342.
210. Foster I, et al. Cloud computing and grid computing 360-degree compared. IEEE international workshop on grid computing environments (GCE) 2008, co-located with IEEE/ACM Supercomputing 2008; 2008.
211. Leverich J., Kozyrakis C. On the energy (in)efficiency of Hadoop clusters. SIGOPS Oper Syst Rev 2010, 44(1):61-65.
212. Chen Y., Ganapathi A.S., Fox A., Katz R.H., Patterson D.A. Statistical workloads for energy efficient MapReduce: Technical Report 2010, UCB/EECS, Berkeley.
213. Chen Y., Keys L., Katz.R.H. Towards energy efficient MapReduce: Technical Report 2009, UCB/EECS, Berkeley.
214. Nedevschi S., Popa L., Iannaccone G., et al. Reducing network energy consumption via rate-adaption and sleeping: Technical Report 2007, UCB/EECS, Berkeley.
215. Polo J, Carrera D, Becerra Y, Beltran V, Torres J, Ayguad E. Performance management of accelerated MapReduce workloads in heterogeneous clusters. ICPP2010 2010:653-62.
216. Xie J, Yin S, Ruan X, Ding Z, Tian Y, Majors J, et al. Improving MapReduce performance through data placement in heterogeneous Hadoop clusters. IPDPSW 2010:1-9.
217. Polo J., Carrera D., Becerra Y., Beltran V., Torres J., Ayguadé E. Performance management of accelerated MapReduce workloads in heterogeneous clusters. Proceedings of the ICPP 2010, IEEE Press, San Diego, CA, p. 653-62.
218. Kim K.H., Buyya R., Kim J. Power aware scheduling of bag-of-tasks applications with deadline constraints on DVS-enabled clusters. CCGRID 2007, 85(10):541-548.
219. Lee Y.C., Zomaya A.Y. Minimizing energy consumption for precedence-constrained applications using dynamic voltage scaling. CCGRID 2009, 9:92-99.
220. Cooper BF, Sillberstein A, Tam E, et al. Benchmarking cloud serving systems with YCSB, SoCC'10 2010;10:143-54.
221. Bryhni H., Klovning E., Kurc O. A comparison of load balancing techniques for scalable web server. IEEE Netw 2000, 7/8:58-63.
222. Verma A., Cherkasova L., Campbell R.H. Orchestrating an ensemble of MapReduce jobs for minimizing their makespan. IEEE Trans Dependable Sec Comput 2013, April. [online version].
223. Verma A., Cherkasova L., Campbell R.H. Two sides of a coin: optimizing the schedule of MapReduce jobs to minimize their makespan and improve cluster performance. MASCOTS 2012, p. 11-18, IEEE Computer Society, Washington, DC.
224. Verma A, Cherkasova L, Campbell RH. ARIA: automatic resource inference and allocation for MapReduce environments. In: Proc. of ICAC; 2011.
225. http://sortbenchmark.org/YahooHadoop.pdf.
226. Johnson S. Optimal two-and three-stage production schedules with setup times included. Naval Res Log Quart 1954, 1(1):61-68.
227. WordCount, http://www.cs.cornell.edu/home/llee/data/simple/.
228. Beloglazov A., Abawajy J., Buyya R. Energy-aware resource allocation heuristics for efficient management of data centers for cloud computing. Future Generation Comput Syst 2012, 28(5):755-768.
229. Knauth T, Fetzer C. Energy-aware scheduling for infrastructure clouds. In: Proceedings of CloudCom; 2012.
230. Kolen AWJ, Lenstra JK, Papadimitriou CH, Spieksma FCR. Interval scheduling: a survey. Published online March 16, 2007 in Wiley InterScience, http://www.interscience.wiley.com.
231. Arkin E.M., Silverberg E.B. Scheduling with fixed start and end times. Discrete Appl Math 1987, 18:1-8.
232. Kleinberg J., Tardos E. Algorithm design 2005, Pearson Education Inc, Edinburgh Gate, UK.
233. Kroon L.G., Salomon M., van Wassenhove L. Exact and approximation algorithms for the operational fixed interval scheduling problem. Eur J Oper Res 1995, 82:190-205.
234. Coffman E.G., Grarey M.R., Johnson D.S. Bin-packing with divisible item sizes. J Complexity 1987, 3:406-428.
235. Tian W, Yeo CS, Xue R, Zhong Y. Power-aware scheduling of real-time virtual machines in cloud data centers considering fixed processing intervals. In: Proceedings of IEEE CCIS 2012. October 30-November 1, Hangzhou, China; 2012. p. 337-341.
236. Cormen T.H., Leiserson C.E., Rivest R.L., Stein C. Introduction to algorithms 2001, MIT Press and McGraw-Hill, ISBN 0-262-03293-7. 2nd ed.
237. Dantzig G.B., Fulkerson D.R. Minimizing the number of tankers to meet a fixed schedule. Nav Res Logist Q 1954, 1:217-222.
238. Ford L.R., Fulkerson D.R. Flows in networks 1962, Princeton University Press, Princeton, NJ.
239. Gupta U.I., Lee D.T., Leung J.Y.-T. An optimal solution for the channel-assignment problem. IEEE Trans Comput 1979, C-28:807-810.
240. Bellman R.E. Dynamic programming 1957, Princeton University Press, Princeton, NJ.
241. Bouzina K.I., Emmons H. Interval scheduling on identical machines. J Global Optim 1996, 9:379-393.
242. Orlin JB. A Faster strongly polynomial minimum cost flow algorithm. In: Proceedings of the 20th ACM symposium on the theory of computing; 1988. p. 377-87.
243. Bar-Noy A., Canetti R., Kutten S., Mansour Y., Schieber B. Bandwidth allocation with preemption. SIAM J Comput 2005, 28:1806-1828.
244. Bhowmik B. Dynamic programming-its principles, applications, strengths, and limitations. Int J Eng Sci Technol 2010, 2(9):4822-4826.
245. Armbrust M, Fox A, Griffith R, Joseph A, Katz R, Konwinski A, et al. Above the clouds: a Berkeley view of cloud computing. Technical Report No. UCB/EECS-2009-28. University of California at Berkley, CA; February 10, 2009.
246. Google App Engine, [last accessed 25.03.14]. https://appengine.google.com/.
247. IBM blue cloud, [last accessed 26.03.14]. http://www.ibm.com/grid/.
248. Amazon EC2, [last accessed 25.03.14]. http://aws.amazon.com/ec2/.
249. MicrosoftWindows Azure, [last accessed 26.03.14]. http://www.microsoft.com/windowsazure.
250. Beloglazov A, Abawajy J, Buyya R. Energy-aware resource allocation heuristics for efficient management of data centers for cloud computing accepted by future generation computer systems; 2012.
251. Buyya R, Ranjan R, Calheiros RN. Modeling and simulation of scalable cloud computing environments and the CloudSim toolkit: challenges and opportunities. In: Proceedings of the seventh high performance computing and simulation conference (HPCS 2009, ISBN: 978-1-4244-4907-1, IEEE Press, New York, NY), Leipzig, Germany; June 21-24, 2009.
252. Dumitrescu CL, Foster I. GangSim: a simulator for grid scheduling studies. In: Proceedings of the IEEE international symposium on Cluster Computing and the Grid (CCGrid 2005), Cardiff, UK; 2005.
253. Youseff L, Butrico M, Da Silva D. Toward a unified ontology of cloud computing. In: Proceedings of the grid computing environments workshop, GCE'08; 2008.
254. Buyya R., Murshed M. GridSim: a toolkit for the modeling and simulation of distributed resource management and scheduling for grid computing. J Concurrency Comput Pract Exp 2002, 14(13-15). Wiley Press, Nov.-Dec.
255. Howell F, Mcnab R. SimJava: a discrete event simulation library for java. In: Proceedings of the first international conference on web-based modeling and simulation; 1998.
256. Wickremasinghe B, Calheiros RN, Buyya R. CloudAnalyst: a CloudSim-based tool for modelling and analysis of large scale cloud computing environments. In: Proceedings of the 24th IEEE international conference on advanced information networking and applications (AINA 2010), Perth, Australia; April 20-23, 2010.
257. Wood T, Shenoy P, Venkataramani A, Yousif M. Black-box and gray-box strategies for virtual machine migration. In: Proceedings of the symposium on networked systems design and implementation (NSDI); 2007.
258. Singh A, Korupolu M, Mohapatra D. Server-storage virtualization: integration and load balancing in data centers. In: Proceedings of the 2008 ACM/IEEE conference on supercomputing; 2008, p. 1-12.
259. Zhang W. Research and implementation of elastic network service [PhD dissertation]. National University of Defense Technology, China (in Chinese) 2000102353.
260. Zheng H., Zhou L., Wu J. Design and implementation of load balancing in web server cluster system. J Nanjing University Aeronaut Astronaut 2006, 38(3).
261. Economou D., Rivoire S., Kozyrakis C., Ranganathan P. Full-System power analysis and modeling for server environments. Full-System power analysis and modeling for server environments 2006, Stanford University, [HP Labs Workshop on Modeling, Benchmarking, and Simulation (MoBS) June 18], Stanford University.
262. Hull D., Wolstencroft K., Stevens R., Goble C., Pocock M., Li P., et al. Taverna: a tool for building and running workflows of services. Nucleic Acids Res 2006, 34:729-732. [iss. Web Server issue].
263. Ludäscher B., Altintas I., Berkley C., Higgins D., Jaeger E., Jones M., et al. Scientific workflow management and the Kepler system. Concurr Comput Pract Exp 2006, 18(10):1039-1065. [Special Issue: Workflow in Grid Systems].
264. Freire J, Silva CT, Callahan SP, Santos E, Scheidegger CE, Vo HT. Managing rapidly-evolving scientific workflows, provenance and annotation of data, lecture notes in computer science, vol. 4145/2006, 10-18, 2006. Available from: . doi:10.1007/11890850_2.
265. Deelman E., et al. Pegasus: a framework for mapping complex scientific workflows onto distributed systems. Sci Program 2005, 13(3).
266. Zhao Y, Hategan M, Clifford B, Foster I, Laszewski GV, Raicu I, et al. Swift: fast, reliable, loosely coupled parallel computation. IEEE Workshop on Scientific Workflows; 2007.
267. Lin C, Lu S, Lai Z, Chebotko A, Fei X, Hua J, et al. Service-oriented architecture for VIEW: a visual scientific workflow management system. In: Proceedings of the IEEE 2008 international conference on Services Computing (SCC), Honolulu, HI; July 2008, p. 335-42.
268. Rogers S. Big data is scaling BI and analytics, information management; September 1, 2011.
269. Bell G., Hey T., Szalay A. Beyond the data deluge. Science 2009, 323(5919):1297-1298.
270. Large Hadron Collider,2012. http://lhc.web.cern.ch.
271. 2012. http://www.psc.edu/general/software/packages/genbank/.
272. Wilde M., Foster I., Iskra K., Beckman P., Zhang Z., Espinosa A., et al. Parallel scripting for applications at the petascale and beyond. IEEE Comput 2009, [Nov. 2009 Special Issue on Extreme Scale Computing].
273. Foster I, Zhao Y, Raicu I, Lu S. Cloud computing and grid computing 360-Degree Compared. IEEE Grid Computing Environments (GCE08) 2008, co-located with IEEE/ACM Supercomputing; 2008.
274. Hadoop, 2012. http://hadoop.apache.org/.
275. OpenNebula, 2012. http://www.OpenNebula.org.
276. Nurmi D, Wolski R, Grzegorczyk C, Obertelli G, Soman S, Youseff L, et al. The eucalyptus open-source cloud-computing platform. In: Proceedings of cloud computing and its applications; 2008.
277. Keahey K, Freeman T. Contextualization: providing one-click virtual clusters in eScience. 2008. Indianapolis, IN; 2008.
278. Openstack, 2012. http://www.openstack.org.
279. Zhao Y, Fei X, Raicu I, Lu S. Opportunities and challenges in running scientific workflows on the cloud. IEEE international conference on Cyber-enabled distributed computing and knowledge discovery (CyberC); 2011.
280. Palankar M, Iamnitchi A, Ripeanu M, Garfinkel S. Amazon S3 for science grids: a viable solution? In: Proceedings of the 2008 international workshop on data-aware distributed computing (DADC '08); 2008.
281. Oliveira D, Ocaña K, Ogasawara E, Dias J, Baião F, Mattoso M. A performance evaluation of X-Ray crystallography scientific workflow using SciCumulus. IEEE CLOUD; 2011. p. 708-15.
282. Deelman E, Singh G, Livny M, Berriman B, Good J. The cost of doing science on the cloud: the montage example. In: Proceedings of the 2008 ACM/IEEE conference on Supercomputing, SC '08. Piscataway, NJ; 2008. p. 50:1-50:12.
283. Vecchiola C, Pandey S, Buyya R. High-performance cloud computing: a view of scientific applications. In: International symposium onparallel architectures, algorithms, and networks; 2009.
284. Hoffa C, Mehta G, Freeman T, Deelman E, Keahey K, Berriman B, et al. On the use of cloud computing for scientific workflows. Third International workshop on Scientific Workflows and Business Workflow Standards in e-Science (SWBES). Indianapolis, IN; December 2008.
285. Vöckler J-S, Juve G, Deelman E, Rynge M, Berriman GB. Experiences using cloud computing for a scientific workflow application. Invited Paper, ACM Workshop on Scientific Cloud Computing (ScienceCloud); 2011.
286. Keahey K, Freeman T. Science clouds: early experiences in cloud computing for scientific applications, cloud computing and its applications 2008 (CCA-08), Chicago, IL; October 2008.
287. Ramakrishnan L, Koelbel C, Kee Y-S, Wolski R, Nurmi D, Gannon D, et al. VGrADS: enabling e-Science workflows on grids and clouds with fault tolerance. In: Proceedings of the conference on high performance computing networking, storage and analysis (SC'09); 2009.
288. Juve G, Deelman E. Wrangler: virtual cluster provisioning for the Cloud. In HPDC; 2011.
289. Bresnahan J, Freeman T, LaBissoniere D, Keahey K. Managing appliance launches in infrastructure clouds, Teragrid 2011. Salt Lake City, UT; July 2011.
290. Lin C., Lu S., Fei X., Chebotko A., Pai D., Lai Z., et al. A reference architecture for scientific workflow management systems and the VIEW SOA solution. IEEE Trans Serv Comput (TSC) 2009, 2(1):79-92.
291. Zhao Y., Dobson J., Foster I., Moreau L., Wilde M. A notation and system for expressing and executing cleanly typed workflows on Messy scientific data. SIGMOD Rec 2005, 34(3).
292. Raicu I., Zhao Y., Dumitrescu C., Foster I., Wilde M. Falkon: a Fast and Light-weight tasK executiON framework. Proceedings of the 2007 ACM/IEEE conference on Supercomputing 2007, November, ACM, p. 43.
293. Raicu I, Zhao Y, Foster I, Szalay A. Accelerating large-scale data exploration through data diffusion. International workshop on data-aware distributed computing 2008, co-locate with ACM/IEEE international symposium high performance distributed computing (HPDC); 2008.
294. NASA MODIS dataset, 2012. http://modis.gsfc.nasa.gov/.