Q-learning approach for hierarchical AGC scheme of interconnected power grids

Energy Procedia

Volumn 12, Issue , 2011, Pages 43-52

  Zhou, B ^a   Chan, K W ^a   Yu, T ^b  

^a HONG KONG POLYTECHNIC UNIVERSITY   (Hong Kong)

^b SOUTH CHINA UNIVERSITY OF TECHNOLOGY   (China)

Author keywords

AGC; CPS; DTMDP; Dynamic generation allocation; Hierarchical control; Q learning; Stochastic optimization

Indexed keywords

ELECTRIC LOAD DISPATCHING; ELECTRIC POWER SYSTEM INTERCONNECTION; ELECTRIC POWER TRANSMISSION NETWORKS; HEURISTIC ALGORITHMS; LEARNING ALGORITHMS; MARKOV PROCESSES; OPTIMIZATION;

DTMDP; DYNAMIC GENERATION ALLOCATIONS; HIERARCHICAL CONTROL; Q-LEARNING; STOCHASTIC OPTIMIZATIONS;

SMART POWER GRIDS;

EID: 84555204759     PISSN: 18766102     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1016/j.egypro.2011.10.008     Document Type: Conference Paper

References (15)

1. N. Jaleeli and L. S. VanSlyck, "NERC's new control performance standards," IEEE Trans. Power Syst., vol. 14, no. 3, pp. 1092-1099, Aug. 1999.
2. L. R. Chang-Chien, O. Chee-Mun, and R. A. Kramer, "Field tests and refinements of an ACE model," IEEE Trans. Power Syst., vol. 18, no. 2, pp. 898-903, May 2003.
3. M. Yao, R. R. Shoults, and R. Kelm, "AGC logic based on NERC's new control performance standard and disturbance control standard," IEEE Trans. Power Syst., vol. 15, no. 2, pp. 852-857, May 2000.
4. Ibraheem, P. Kumar and D. P. Kothari, "Recent philosophies of automatic generation control strategies in power systems," IEEE Trans. Power Syst., vol. 20, no. 1, pp. 346-357, Feb. 2005. (Pubitemid 40259454)
5. Z. H. Gao, X. L. Teng, and L. Q. Tu, "Hierarchical AGC mode and CPS control strategy for interconnected power systems," Automation of Electric Power Systems, vol. 28, no. 1, pp. 78-81, Jan. 2004, in Chinese.
6. R. S. Sutton and A. G. Barto, Reinforcement Learning: An Introduction. Cambridge, MA: MIT Press, 1998.
7. J. C. H. Watkins and P. Dayan, "Q-learning," Machine Learning, vol. 8, no. 3-4, pp. 279-292, May 1992.
8. B. H. Chowdhury and S. Rahman, "A review of recent advances in economic dispatch," IEEE Trans. Power Syst., vol. 5, no. 4, pp. 1248-1259, Nov. 1990.
9. T. Yu, B. Zhou, K. W. Chan, L. Chen and B. Yang. "Stochastic optimal relaxed automatic generation control in non-Markov environment based on multi-step Q(λ) learning", IEEE Trans. Power Syst. Published online, DOI: 10.1109/TPWRS.2010.2102372.
10. S. P. Bhattacharyya, A. Datta and L. H. Keel, Linear Control Theory: Structure, Robustness, and Optimization. Boca Raton: CRC Press, 2009.
11. T. Yu, L. Chen, and G. L. Cai, "CPS statistic information self-learning methodology based adaptive automatic generation control," Proceedings of the CSEE, vol. 28, no. 10, pp. 82-87, Apr. 2008, in Chinese. (Pubitemid 351648457)
12. O. I. Elgerd, Electric Energy Systems Theory: An Introduction. 2nd ed. New York: McGraw-Hill, 1982.
13. G. Mitsuo and R. W. Cheng, Genetic Algorithms and Engineering Design, New York: Wiley, 1997.
14. IEEE committee report, "Dynamic models for steam and hydro turbines in power system studies," IEEE Transactions on Power Apparatus and Systems, vol. PAS-92, no. 6, pp.1904-1915, 1973.
15. D. Ernst, M. Glavic, and L. Wehenkel, "Power systems stability control: reinforcement learning framework," IEEE Trans. Power Syst., vol. 19, no. 1, pp. 427-435, Feb. 2004.