Managing power consumption and performance of computing systems using reinforcement learning

Advances in Neural Information Processing Systems 20 - Proceedings of the 2007 Conference

Volumn , Issue , 2008, Pages

  Tesauro, Gerald ^b   Das, Rajarshi ^b   Chan, Hoi ^b   Kephart, Jeffrey O ^b   Lefurgy, Charles ^a   Levine, David W ^b   Rawson, Freeman ^a  

^a IBM T J WATSON RESEARCH CENTER   (United States)

^b Research Laboratories   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTING POWER; FIRMWARE; GREEN COMPUTING; HTTP; MIDDLEWARE; POWER MANAGEMENT; REINFORCEMENT LEARNING; TESTBEDS;

APPLICATION AREA; CO 2 EMISSION; COMPUTING SYSTEM; DATACENTER; ELECTRICAL POWER MANAGEMENTS; IT SYSTEM; LARGE-SCALES; PERFORMANCE; POWER; REINFORCEMENT LEARNINGS;

ELECTRIC POWER UTILIZATION;

EID: 85162032534     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (18)

1. P. Abbeel, A. Coates, M. Quigley, and A. Y. Ng. An application of reinforcement learning to aerobatic helicopter flight. In Proc. of NIPS-06, 2006.
2. P. Abbeel and A. Y. Ng. Exploration and apprenticeship learning in reinforcement learning. In Proc. of ICML-05, 2005.
3. A. Antos, C. Szepesvari, and R. Munos. Learning near-optimal policies with bellman-residual minimization based fitted policy iteration and a single sample path. In Proc. of COLT-06, 2006.
4. L. Baird. Residual algorithms: Reinforcement learning with function approximation. In Proc. of ICML-95, 1995.
5. Y. Chen et al. Managing server energy and operational costs in hosting centers. In Proc. of SIGMETRICS, 2005.
6. M. Femal and V. Freeh. Boosting data center performance through non-uniform power allocation. In Second Intl. Conf. on Autonomic Computing, 2005.
7. Green Grid Consortium. Green grid. http://www.thegreengrid.org, 2006.
8. J. Chen et al. Datacenter power modeling and prediction. UC Berkeley RAD Lab presentation, 2007.
9. J. O. Kephart, H. Chan, R. Das, D. Levine, G. Tesauro, F. Rawson, and C. Lefurgy. Coordinating multiple autonomic managers to achieve specified power-performance tradeoffs. In Proc. of ICAC-07, 2007.
10. M. G. Lagoudakis and R. Parr. Least-squares policy iteration. J. of Machine Learning Research, 4:1107-1149, 2003.
11. C. Lefurgy, X. Wang, and M. Ware. Server-level power control. In Proc. of ICAC-07, 2007.
12. D. Menasce and V. A. F. Almeida. Capacity Planning for Web Performance: Metrics, Models, and Methods. Prentice Hall, 1998.
13. S. Russell and A. L. Zimdars. Q-decomposition for reinforcement learning agents. In Proc. of ICML-03, pages 656-663, 2003.
14. M. S. Squillante, D. D. Yao, and L. Zhang. Internet traffic: Periodicity, tail behavior and performance implications. In System Performance Evaluation: Methodologies and Applications, 1999.
15. G. Tesauro, N. K. Jong, R. Das, and M. N. Bennani. A hybrid reinforcement learning approach to autonomic resource allocation. In Proc. of ICAC-06, pages 65-73, 2006. (Pubitemid 46666907)
16. United States Environmental Protection Agency. Letter to Enterprise Server Manufacturers and Other Stakeholders. http://www.energystar.gov, 2006.
17. M. Wang et al. Adaptive Performance Control of Computing Systems via Distributed Cooperative Control: Application to Power Management in Computer Clusters. In Proc. of ICAC-06, 2006.
18. WebSphere Extended Deployment. http://www.ibm.com/software/webservers/ appserv/extend/, 2007.