Power-aware consolidation of scientific workflows in virtualized environments

2010 ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis, SC 2010

Volumn , Issue , 2010, Pages

  Zhu, Qian ^a   Zhu, Jiedan ^a   Agrawal, Gagan ^a  

^a Ohio State University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DIMENSIONALITY REDUCTION METHOD; DISTANCE METRICS; HIER-ARCHICAL CLUSTERING; POWER CONSUMPTION; POWER-AWARE; REAL-WORLD; RESOURCE COSTS; RESOURCE REQUIREMENTS; SCIENTIFIC RESEARCHES; SCIENTIFIC WORKFLOWS; STORAGE RESOURCES; VIRTUALIZATIONS; VIRTUALIZED ENVIRONMENT; WORK-FLOWS;

LAKES; VIRTUAL REALITY;

MANAGEMENT;

EID: 78650850014     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/SC.2010.43     Document Type: Conference Paper

References (53)

1. Montage: An astronomical image engine. http://montage.ipac.caltech.edu/.
2. Southern california earthquake center, community modeling environment (cme). http://www.scec.org/cme.
3. Sysstat. http://pagesperso-orange.fr/sebastien.godard/.
4. Teragrid. http://www.teragrid.org/.
5. Usc epigenome center. http://epigenome.usc.edu.
6. Xen credit-bsed cpu scheduler. http://wiki.xensource.com/xenwiki/ CreditScheduler.
7. F. R. Bach and M. I. Jordan. Kernel independent component analysis. Journal of Machine Learning Research, 3, 2003.
8. L.A. Barroso and U. Hölzle. The case for engergy-proportional computing. IEEE Computer, 14(12), 2007.
9. S. Bharathi, A. Chervenak, E. Deelman, G. Mehta, M.H. Su, and K. Vahi. Characterization of scientific workflows. In Proceedings of the 3rd Workshop on Workflows in Support of Large-Scale Science (WORKS08), pages 1-10, Nov. 2008.
10. R. Bianchini and R. Rajamony. Power and energy management for server systems. IEEE Computer, 37(11), 2004.
11. L.F. Bittencourt, R. Sakellariou, and E. Madeira. Dag scheduling using a lookahead variant of the heterogeneous earliest finish time algorithm. In Proceedings of the 18th Euromicro International Conference on Parallel, Distributed and Network-Based Computing (PDP 2010), Feb. 2010.
12. D.A. Brown, P.R. Brady, A. Dietz, J. Cao, B. Johnson, and J. McNabb. A case study on the use of workflow technologies for scientific analysis: Gravitational wave data analysis. Workflows for eScience, 2006.
13. E.S. Buneci and D.A. Reed. Analysis of application heartbeats: Learning structural and temporal features in time series data for identification of performance problems. In Proceedings of the 22nd International Conference on High Performance Computing and Networking (SC08), pages 1-12, Nov. 2008.
14. R. Buyya, R. Ranjan, and R.N. Calheiros. Modeling and simulation of scalable cloud computing environments and the cloudsim toolkit: Challenges and opportunities. In Proceedings of the 7th International Conference on High Performance Computing & Simulation (HPCS09), June 2009.
15. L.C. Canon, E. Jeannot, R. Sakellariou, and W. Zheng. Comparative evaluation of the robustness of dag scheduling heuristics. In CoreGRID Technical Report TR-0120, 2007.
16. J. Chase, D. Anderson, P. Thakar, A. Vahdat, and R. Doyle. Managing energy and server resources in hosting centers. In Proceedings of the 18th ACM Symposium on Operating Systems Principles (SOSP01), pages 103-116, Oct. 2001.
17. E. Deelman, G. Singh, M. Livny, B. Berriman, and J. Good. The cost of doing science on the cloud: the montage example. In Proceedings of the 22nd International Conference on High Performance Computing and Networking (SC08), pages 50-61, Nov. 2008.
18. E. Deelman, G. Singh, M.H. Su, J. Blythe, Y. Gil, C. Kesselman, G. Mehta, K. Vahi, G.B. Berriman, J. Good, A. Laity, J.C. Jacob, and D.S. Katz. Pegasus: A framework for mapping complex scientific workflows onto distributed systems. Scientific Programming, 13(3), 2005.
19. R.A Drebin, L.Carpenter, and P.Hanrahan. Volume rendering. In Proceedings of the 15th Annual Conference on Computer Graphics and Interactive Techniques, pages 65-74, 1988.
20. D. Economou, S. Rivoire, C. Kozyrakis, and P. Ranganathan. Full-system power analysis and modeling for server environments. In Proceedings of the Workshop on Modeling Benchmarking and Simulation (MOBS06), June 2006.
21. F.Berman, H.Casanova, A.Chien, K.Cooper, H.Dail, A.Dasgupta, W.Deng, J. Dongarra, L. Johnsson andK.Kennedy, C.Koelbel, B.Liu, X. Liu, A.Mandal, G.Marin, M.Mazina, J.Mellor-Crummey, C.Mendes, A. Olugbile, M.Patel, D.Reed, Z.Shi, O.Sievert, H.Xia, and A. YarKhan. New grid scheduling and rescheduling methods in the grads project. International Journal of Parallel Programming, 33(2), 2005.
22. S. Govindan, J. Choi, B. Urgaonkar, A. Sivasubramaniam, and A. Baldini. Statistical profiling-based techniques for effective power provisioning in data centers. In Proceedings of the 4th ACM European conference on Computer systems (EuroSys09), pages 317-330, April 2009.
23. C. Hoffa, G. Mehta, T. Freeman, E. Deelman, K. Keahey, B. Berriman, and J. Good. On the use of cloud computing for scientific workflows. In Proceedings of the 3rd International Workshop on Scientific Workflows and Business Workflow Standards in e-Science (SWBES08), Dec. 2008.
24. H.Topcuoglu, S.Hariri, and M.Y.Wu. Performance-effective and low-complexity task scheduling for heterogeneous computing. IEEE Transactions on Parallel and Distributed Systems, 13, 2002.
25. S.C. Johnson. Hierarchical clustering schemes. Psychometrika, 32(3), 1966.
26. G. Juve, E. Deelman, K. Vahi, G. Mehta, B. Berriman, B.P. Berman, and P. Maechling. Scientific workflow applications on amazon ec2. In Workshop on Cloud-based Services and Applications in conjunction with 5th IEEE Internation Conference on e-Science (e-Science09), Dec. 2009.
27. L.H. Koopsman. Sampling, aliasing and discrete-time models. The Spectral Analysis of Time Series, 1995.
28. D. Kusic, J.O. Kephart, J.E. Hanson, N. Kandasamy, and G.F. Jiang. Power and performance management of virtualized computing environments via lookahead control. In Proceedings of the 5th International Conference on Autonomic Computing (ICAC08), pages 3-12, June 2008.
29. Y.K. Kwok and I. Ahmad. Static scheduling algorithms for allocating directed task graphs to multiprocessors. ACM Computing Surveys, 31(4), 1999.
30. G.V. Laszewski, L.Z. Wang, A. Younge, and X. He. Power-aware scheduling of virtual machines in dvfs-enabled clusters. In Proceedings of the IEEE International Conference on Cluster Computing (Cluster09), pages 1-10, 2009.
31. B. Ludäscher, I. Altintas, C. Berkley, D. Higgins, E. Jaeger, M. Jones, E.A. Lee, J. Tao, and Y. Zhao. Scientific workflow management and the kepler system. Concurrency and Computation: Practice & Experience, 18(10), 2006.
32. A. Mandal, K. Kennedy, C. Koelbel, G. Marin, J. Mellor-Crummey, B. Liu, and L. Johnsson. Scheduling strategies for mapping application workflows onto the grid. In Proceedings of the 14th IEEE International Symposium on High Performance Distributed Computing(HPDC05), pages 125-134, June 2005.
33. R. Nathuji and K. Schwan. Virtualpower: Coordinated power management in virtualized enterprise systems. In Proceedings of the 21st ACM Symposium on Operating Systems Principles (SOSP07), pages 265-278, Oct. 2007.
34. R. Nathuji and K. Schwan. Vpm tokens: virtual machine-aware power budgeting in datacenters. In Proceedings of the 17th IEEE International Symposium on High Performance Distributed Computing(HPDC08), pages 119-128, June 2008.
35. J.A. Nelder and R. Mead. A simplex method for function minimization. Computer Journal, 1965.
36. T. Oinn, M. Greenwood, M. Addis, M.N. Alpdemir, J. Ferris, K. Glover, C. Goble, A. Goderis, D. Hull, D. Marvin, P. Li, P. Lord, M.R. Pocock, M. Senger, R. Stevens, A. Wipat, and C. Wroe. Taverna: lessons in creating a workflow environment for the life sciences. Concurrency and Computation: Practice and Experience, 18, 2006.
37. E. Parzen. On estimation of a probability density function and mode. The Annals of Mathematical Statistics, 3, 1962.
38. P. Pillai and K.G. Shin. Real-time dynamic voltage scaling for low-power embedded operating systems. In Proceedings of the 18th ACM Symposium on Operating Systems Principles (SOSP01), pages 89-102, Oct. 2001.
39. E. Pinheiro, R. Bianchini, and C. Dubnicki. Exploiting redundancy to conserve energy in storage systems. ACM SIGMETRICS Performance Evaluation Review, 34(1), 2006.
40. C. Poellabauer, T. Zhang, S. Pande, and K. Schwan. An efficient frequency scaling approach for energy-aware embedded real-time systems. In Proceedings of the 18th International Conference on Architecture of Computing Systems (ARCS05), pages 207-221, March 2005.
41. L.R. Rabiner. A tutorial on hidden markov models and selected applications. IEEE, 77(11), 1989.
42. L. Ramakrishnan, C. Koelbel, Y.S. Kee, R. Wolski, D. Nurmi, D. Gannon, G. Obertelli, A. YarKhan, A. Mandal, T.M. Huang, K. Thyagaraja, and D. Zagorodnov. Vgrads: enabling e-science workflows on grids and clouds with fault tolerance. In Proceedings of the 23rd International Conference on High Performance Computing and Networking (SC09), pages 1-12, Nov. 2009.
43. R.Buyya and M.Murshed. Gridsim: A toolkit for the modeling and simulation of distributed resource management and scheduling for grid computing. Concurrency and Computation: Practice and Experience, 14, 2002.
44. S. Srikantaiah, A. Kansal, and F. Zhao. Energy. In Workshop on Power Aware Computing and Systems (HotPower08), Dec. 2008.
45. M. Steinder, I. Whalley, J.E. Hanson, and J.O. Kephart. Coordinated management of power usage and runtime performance. In Proceedings of the IEEE/IFIP Network Operations and Management Symposium (NOMS08), pages 387-394, April 2008.
46. J. Stoess, C. Lang, and F. Bellosa. Energy management for hypervisor-based virtual machines. In Proceedings of the 2007 USENIX Annual Technical Conference (USENIX07), pages 1-14, June 2007.
47. I. Taylor, M. Shields, I. Wang, and A. Harrison. The triana workflow environment: Architecture and applications. Workflows for e-Science, 2007.
48. A. Verma, P. Ahuja, and A. Neogi. pmapper: Power and migration cost aware application placement in virtualized systems. In Proceedings of the 9th ACM/IFIP/USENIX International Conference on Middleware (Middleware08), pages 243-264, Sept. 2008.
49. A. Verma, G. Dasgupta, T.K. Nayak, P. De, and R. Kothari. Server workload analysis for power minimization using consolidation. In Proceedings of the 2009 USENIX Annual Technical Conference (USENIX09), June 2009.
50. F. Wang, Q. Xin, B. Hong, S. Brandt, E. Miller, D. Long, and T. McLarty. File system workload analysis for large scale scientific computing applications. In Proceedings of the 21st IEEE/12th NASA Goddard, 2004.
51. X.R. Wang and M. Chen. Cluster-level feedback power control for performance optimization. In Proceedings of the 14th IEEE International Symposium on High-Performance Computer Architecture (HPCA08), pages 101-110, Feb. 2008.
52. M. Wieczorek, R. Prodan, and T. Fahringer. Scheduling of scientific workflows in the askalon grid environment. ACM SIGMOD Record, 34(3), 2005.
53. Q. Zhu J. Zhu and G. Agrawal. Power-aware consolidation of scientific workflows in virtualized environments. Technical report, OSU-CISRC-6/10- TR14, The Ohio State University, 2010.