Stochastic optimal generation command dispatch based on improved hierarchical reinforcement learning approach

IET Generation, Transmission and Distribution

Volumn 5, Issue 8, 2011, Pages 789-797

  Yu, T ^a   Wang, Y M ^b   Ye, W J ^a   Zhou, B ^c   Chan, K W ^c  

^a SOUTH CHINA UNIVERSITY OF TECHNOLOGY   (China)

^b GUANGDONG POWER GRID CORPORATION   (China)

^c HONG KONG POLYTECHNIC UNIVERSITY   (Hong Kong)

Author keywords

[No Author keywords available]

Indexed keywords

AGC SYSTEM; AUTOMATIC GENERATION CONTROL; CONTROL LAYERS; CONTROL PERFORMANCE; CONTROL PERFORMANCE STANDARDS; CONVERGENCE TIME; CORE PROBLEMS; CURSE OF DIMENSIONALITY; ENGINEERING METHODS; HIERARCHICAL REINFORCEMENT LEARNING; HYDRO CAPACITY; LEARNING EFFICIENCY; MARKOV DECISION PROCESSES; OPTIMAL GENERATION; OPTIMISATIONS; PARTICIPATION FACTORS; POWER GRID MODELS; Q-LEARNING; REWARD FUNCTION; SOLUTION ALGORITHMS; SUBTASKS; TIME VARYING;

CONVERGENCE OF NUMERICAL METHODS; DELAY CONTROL SYSTEMS; GROUP DELAY; LEARNING ALGORITHMS; MARKOV PROCESSES; OPTIMIZATION; REINFORCEMENT LEARNING;

HIERARCHICAL SYSTEMS;

EID: 79960776326     PISSN: 17518687     EISSN: None     Source Type: Journal    
DOI: 10.1049/iet-gtd.2010.0600     Document Type: Article

References (23)

1. Jaleeli, N., and VanSlyck, L.S.: 'NERC's new control performance standards', IEEE Trans. Power Syst., 1999, 14, (3), p. 1092-109910.1109/59.780932 0885-8950
2. Venkat, A.N., and Hiskens, I.A.: 'Distributed MPC strategies with application to power system automatic generation control', IEEE Trans. Control Syst. Technol., 2008, 16, (6), p. 1192-120610.1109/TCST.2008.919414 1063-6536
3. Ahamed, T.P.I., Rao, P.S.N., and Sastry, P.S.: 'A reinforcement learning approach to automatic generation control', Electr. Power Syst. Res., 2002, 63, (1), p. 9-260378-7796
4. Chown, G.A., and Hartman, R.C.: 'Design and experience with a fuzzy logic controller for automatic generation control (AGC)', IEEE Trans. Power Syst., 1998, 13, (3), p. 965-97010.1109/59.709084 0885-8950
5. Zeynelgil, H.L., Demiroren, A., and Sengor, N.S.: 'The application of ANN technique to automatic generation control for multi-area power system', Int. J. Electr. Power Energy Syst., 2002, 24, (5), p. 345-35410.1016/S0142-0615(01)00049-7 0142-0615
6. Tao, Y., Chen, L., and Cai, G.L.: 'CPS statistic information self-learning methodology based adaptive automatic generation control', Proc. CSEE, April 2008, 28, (10), p. 82-87 (in Chinese)
7. Xichang, Y., and Quanren, Z.: 'Practical implementation of the SCADA+AGC/EDC system of the Hunan power pool in the central China power network', IEEE Trans. Energy Convers., 1994, 9, (2), p. 250-25510.1109/60.300151 0885-8969
8. Ming, W.Y., Jin, L.Q., and Tao, Y.: 'A reinforcement learning approach to dynamic optimization of load allocation in AGC system', Proc. 2009 IEEE Power & Energy Society General Meeting Conf., p. 1-6
9. Sutton, R.S., and Barto, A.G.: 'Reinforcement learning: an introduction', (MIT Press, Cambridge, MA 1998)
10. Barto, A.G., and Mahadevan, S.: 'Recent advances in hierarchical reinforcement learning', Discrete Event Dyn. Syst., 2003, 13, (4), p. 341-37910.1023/A:1025696116075
11. Schultink, E.G., Cavallo, R., and Parkes, D.C.: 'Economic hierarchical Q-learning', Proc. 2008 23rd AAAI Conf. on Artificial Intelligence, p. 689-695
12. He, G.Z., Liang, T.X., and Qun, T.L.: 'Hierarchical AGC mode and CPS control strategy for interconnected power systems', Autom. Electr. Power Syst., 2004, 28, (1), p. 78-811000-1026
13. Watkins, J.C.H., and Dayan, P.: 'Q-learning', Mach. Learn., 1992, 8, (3-4), p. 279-29210.1007/BF00992698 0885-6125
14. Javadi, M.: 'Dynamic models for steam and hydro turbines in power system studies', IEEE Trans. Power Appar. Syst., 1973, 92, (6), p. 1904-195110.1109/TPAS.1973.293570 0018-9510
15. Takahashi, Y., and Asada, M.: 'Behavior acquisition by multi-layered reinforcement learning', Proc. 1999 IEEE Int. Conf. on Systems, Man, and Cybernetics, 1999, p. 716-721
16. Morimoto, J., and Doya, K.: 'Acquisition of stand-up behavior by a real robot using hierarchical reinforcement learning', Proc. Int. Conf. on Machine Learning, 2000, p. 623-630
17. Sutton, R.S., Precup, D., and Singh, S.: 'Between MDPs and semi-MDPs: a framework for temporal abstraction in reinforcement learning', Artif. Intell., 1999, 112, p. 181-21110.1016/S0004-3702(99)00052-1 0004-3702
18. Parr, R.: 'Hierarchical control and learning for Markov decision processes', 1998, PhD, University of California, Berkeley, CA
19. Parr, R., and Russell, S.: 'Reinforcement learning with hierarchies of machines', Proc. 1997, Conf. on Advances in Neural Information Processing Systems, p. 1043-1049
20. Dietterich, T.G.: 'Hierarchical reinforcement learning with the MAXQ value function decomposition', J. Artif. Intell. Res., 2000, 13, p. 227-3031076-9757
21. Thathachar, M.A.L., and Sastry, P.S.: 'Estimator algorithm for learning automata', Proc. 1986 Platinum Jubilee Systems and Signal Processing Conf., p. 602-606
22. Ernst, D., Glavic, M., and Wehenkel, L.: 'Power systems stability control: reinforcement learning framework', IEEE Trans. Power Syst., 2004, 19, (1), p. 427-43510.1109/TPWRS.2003.821457 0885-8950
23. Manichaikul, Y.: 'Industrial electric load modeling', (MIT Press, Cambridge, MA 1978)