An electricity supplier bidding strategy through Q-learning

Proceedings of the IEEE Power Engineering Society Transmission and Distribution Conference

Volumn 3, Issue SUMMER, 2002, Pages 1516-1521

  Xiong, Gaofeng ^a   Hashiyama, Tomonori ^b   Okuma, Shigeru ^a  

^a NAGOYA UNIVERSITY   (Japan)

^b NAGOYA CITY UNIVERSITY   (Japan)

Author keywords

Day ahead electricity auction market; Deregulation; Q Learning algorithm; Supplier bidding strategy

Indexed keywords

ALGORITHMS; ELECTRIC POWER DISTRIBUTION; INDUSTRIAL ECONOMICS; LEARNING SYSTEMS;

SUPPLIER BIDDING STRATEGY;

ELECTRIC UTILITIES;

EID: 0037662809     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (15)

1. R.W.Ferrero, J.F. Rivera, and S.M.Shahidehpour, "Application of games with incomplete information for pricing electricity in deregualted power pools," IEEE Trans. Power Systems, Vol. 13, No. 1. pp. 184-189, Feb. 1998.
2. F.S.Wen, and A.K.David, "Oligopoly Electricity Market Production under Incomplete Information," IEEE Power Engineer Review, vol. 21, no. 4, pp. 58-61, April 2001.
3. R.K.Seeley, J.Lawarree, and C.C.Liu, "Analysis of Electricity Market Rules and Their Effects on Strategic Behavior in a Non-congestive Grid," IEEE Trans. Power Systems, vol. 15, no. 1, pp. 157-162, Feb. 2000.
4. C. W.Richter, Jr and G.B.Sheble, "Genetic Algorithm Evolution of Utility Bidding Strategies for the Competitive Marketplace," IEEE Trans. Power Systems, vol. 13. no. 1, pp. 256-261, Feb. 1998.
5. H.L.Song. C.C.Liu, J.Lawarree, and R.W.Dahlgren, "Optimal Electricity Supply Bidding by Markov Decision Process," TEEE Trans. Power Systems, vol. 15. no. 2, pp. 618-624, May 2000.
6. F.S.Wen, and A.K.David, "Optimal Bidding Strategies and Modeling of Imperfect Information Among Competitive Generators," IEEE Trans. Power Systems, vol. 16, no. 1, pp. 15-21, Feb. 2001.
7. S.Y.Hao. "A Study of Basic Bidding Strategy in Clearing Pricing Auctions," IEEE Trans. Power Systems, vol. 15, no. 3, pp. 975-980, Aug. 2000.
8. M.Ilic, and P.Skantze, "Electric Power Systems Operation by Decision and Control," IEEE Control Systems Magazine, vol. 20, no. 4. pp. 25-39, Aug. 2000.
9. C.C.Liu, J.H.Jung, G.T.Heydt V.Vittal, and A.G.Phadke, "The Strategic Power Infrastructure Defense (SPID) System," IEEE Control Systems Magazine, vol. 20, no. 4, pp. 40-52. Aug. 2000.
10. S.A.Harp, A.Brignone, B.F.Wollenberg, and T.Samad, "SEPIA: A Simulator for Electric Power Industry Agents," IEEE Control Systems Magazine, vol. 20, no. 4, pp. 53-69, Aug. 2000.
11. Junhong Nie and Simon Haykin. "A Dynamic Channel Assignment Policy Through Q-Learning," IEEE Trans. Neural Networks, vol. 10, no. 6, pp. 1443-1455, Nov. 1999.
12. Arthur R.Bergen, Vijay Vittal, Power Systems Analysis, 2nd ed., Pretice-Hall, 2000.
13. Richard S. Sutton and Andrew G. Barto, Reinforcement Learning: An Introduction, Cambridge, MA:MIT Press, 1998.
14. A. G. Barto, S. J. Bradtke, and S. P. Singh, "Learning to act using real-time dynamic programming,", Artificial Intelligence. vol. 72, pp. 81-138, 1995
15. C. J. C. H. Watkins, Learning from Delayed Rewards, PhD thesis,Cambridge University, Cambridge, England, 1989.