Adaptive power management using reinforcement learning

IEEE/ACM International Conference on Computer-Aided Design, Digest of Technical Papers, ICCAD

Volumn , Issue , 2009, Pages 461-467

  Tan, Ying ^a   Liu, Wei ^a   Qiu, Qinru ^a  

^a State University of New York   (United States)

Author keywords

Model free; Power management; Q learning; Reinforcement learning

Indexed keywords

COMPUTER AIDED DESIGN; DECISION MAKING; ECONOMIC AND SOCIAL EFFECTS; ELECTRIC POWER SUPPLIES TO APPARATUS; ENVIRONMENTAL MANAGEMENT; INDUSTRIAL MANAGEMENT; LEARNING ALGORITHMS; MACHINE LEARNING; POWER MANAGEMENT;

ADAPTIVE POWER MANAGEMENT; ENVIRONMENT CHANGE; MODEL FREE; PERFORMANCE CONSTRAINTS; POWER MANAGEMENT TECHNIQUES; Q-LEARNING; SYSTEM-LEVEL POWER MANAGEMENT; UNCERTAINTY AND VARIABILITY;

REINFORCEMENT LEARNING;

EID: 76349083584     PISSN: 10923152     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1687399.1687486     Document Type: Conference Paper

References (16)

1. L. Benini, A. Bogliolo and G. De Micheli, "A survey of design techniques for system-level dynamic power management," IEEE Trans on VLSI, Vol. 8, Issue 3, pp.299-316, 2000.
2. C.H. Hwang, and A.C. Wu, "A predictive system shutdown method for energy saving of event-driven computation," in Proceedings of International Conference on Computer-Aided Design, Nov. 1997.
3. M. Srivastava, A. Chandrakasan, and R. Brodersen, "Predictive system shutdown and other architectural techniques for energy efficient programmable computation," IEEE transactions on Very Large Scale Integration (VLSI) Systems, Vol. 4, pp. 42-55, Mar. 1996.
4. L. Benini, G. Paleologo, A. Bogliolo, and G. De Micheli, "Policy optimization for dynamic power management," IEEE transactions on Computer-Aided Design, Vol. 18, pp. 813-833, Jun. 2001.
5. T. Simunic, L. Benini, and G. De Micheli, "Event-driven power management," IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, Vol. 20, pp. 840-857, Jul. 2001.
6. H. Jung, and M. Pedram, "Dynamic power management under uncertain information," in Proceedings of Design Automation & Test in Europe (DATE'07), Apr. 2007.
7. Q. Qiu, Y. Tan and Q. Wu, "Stochastic Modeling and Optimization for Robust Power Management in a Partially Observable System," in Proceedings of Design Automation & Test in Europe (DATE'07), Apr. 2007.
8. Y. Tan, and Q. Qiu, "A framework of stochastic power management using hidden Markov model," in Proceedings of Design Automation & Test in Europe (DATE'08), Apr. 2008.
9. G. Theocharous, S. Mannor, N. Shah, P. Gandhi, B. Kveton, S. Siddiqi, and C-H. Yu, "Machine Learning for Adaptive Power Management," Intel Technology Journal, Vol. 10, pp. 299-312, November 2006.
10. G. Dhiman, and T. Simunic Rosing, "Dynamic power management using machine learning," in Proceedings of International Conference on Computer-Aided Design (ICCAD'06), Nov. 2006.
11. V.L. Prabha and E. C. Monie, "Hardware Architecture of Reinforcement Learning Scheme for Dynamic Power Management in Embedded Systems," EURASIP Journal on Embedded Systems, Vol. 2007.
12. Dynamic Power Management in Embedded Systems
13. L. Benini, G. Paleologo, A. Bogliolo, and G. De Micheli, "Policy optimization for dynamic power management," IEEE Transactions on Computer-Aided Design, Vol. 18, pp. 813-833, Jun. 1999.
14. G.V. Varatkar and R. Marculescu, "On-chip Traffic Modeling and Synthesis for MPEG-2 Video Applications," IEEE Transactions on Very Large Scale Intergration Systems, Vol. 12, No. 1, January 2004.
15. M. Pendrith, "On reinforcement learning of control actions in noisy and nonMarkovian domains" Technical Report NSW-CSE-TR-9410, School of Computer Science and Engineering, The University of New South Wales, Sydney, Australia, 1994.
16. K. Sikorski and T. Balch, "Model-Based and Model-Free Learning in Markovian and Non-Markovian Environments," in Proceedings of Agents-2001 Workshop on Learning Agents, May 29, 2001.