A Q-Learning-Based Supplier Bidding Strategy in Electricity Auction Market

The transactions of the Institute of Electrical Engineers of Japan.B

Volumn 123, Issue 4, 2003, Pages 550-556

  Xiong, Gaofeng ^a   Okuma, Shigeru ^a   Hashiyama, Tomonori ^b  

^a NAGOYA UNIVERSITY   (Japan)

^b NAGOYA CITY UNIVERSITY   (Japan)

Author keywords

day ahead electricity auction market; Deregulation; Q Learning algorithm; supplier bidding strategy

Indexed keywords

EID: 85010179864     PISSN: 03854213     EISSN: 13488147     Source Type: Journal    
DOI: 10.1541/ieejpes.123.550     Document Type: Article

References (17)

1. D. Fudenberg and J. Tirole: Game Theory, The MIT Press, Cambridge, Massachusetts (1991)
2. R.W. Ferrero, J.F. Rivera, and S.M. Shahidehpour: “Application of games with incomplete information for pricing electricity in deregulated power pools,” IEEE Trans. Power Syst., Vol. 13, No. 1, pp. 184–189 (1998–2)
3. F.S. Wen, and A.K. David: “Oligopoly Electricity Market Production under Incomplete Information,” IEEE Power Engineer Rev., pp. 58–61 (2001–4)
4. K. Seeley, J. Lawarree, and C.C. Liu: “Analysis of Electricity Market Rules and Their Effects on Strategic Behavior in a Noncongestive Grid,” IEEE Trans. Power Syst., Vol. 15, No. 1, pp. 157–162 (2000–2)
5. C.W. Richter, Jr and G.B. Sheble: “Genetic Algorithm Evolution of Utility Bidding Strategics for the Competitive Marketplace,” IEEE Trans. Power Syst., Vol. 13, No. 1, pp. 256–261 (1998–2)
6. H.L. Song, C.C. Liu, J. Lawarree, and R.W. Dahlgren: “Optimal Electricity Supply Bidding by Markov Decision Process,” IEEE Trans. Power Syst., Vol. 15, No. 2, pp. 618–624 (2000–5)
7. F.S. Wen and A.K. David: “Optimal Bidding Strategies and Modeling of Imperfect Information Among Competitive Generators,” IEEE Trans. Power Syst., Vol. 16, No. 1, pp. 15–21 (2001–2)
8. D.W. Bunn and F.S. Oliveria: “Agent-Based Simulation—An Application to the New Electricity Trading Arrangements of England and Wales,” IEEE Trans. Evolutionary Computation, Vol. 5, No. 5 (2001–10)
9. J. Bower and D. Bunn: “Experimental analysis of the efficiency of uniform-price versus discriminatory auctions in the England and Wales electricity market,” J. Economic Dynamics & Control, Vol. 25, pp. 561–592 (2001–3)
10. M. Ilic and P. Skantze: “Electric Power Systems Operation by Decision and Control,” IEEE Control Systems Magazine, Vol. 20, No. 4, pp. 25–39 (2000–8)
11. C.C. Liu, J.H. Jung, G.T. Heydt, V. Vittal, and A.G. Phadke: “The Strategic Power Infrastructure Defense (SPID) System,” IEEE Control Systems Magazine, Vol. 20, No. 4, pp. 40–52 (2000–8)
12. S.A. Harp, A. Brignone, B.F. Wollenberg, and T. Samad: “SEPIA: A Simulator for Electric Power Industry Agents,” IEEE Control Systems Magazine, Vol. 20, No-4, pp. 53–69 (2000–8)
13. J. Nie and S. Haykin: “A Dynamic Channel Assignment Policy Through Q-Learning,” IEEE Trans. Neural Networks, Vol. 10, No. 6, pp. 1443–1455 (1999–11)
14. A.R. Bergen and V. Vittal: Power Systems Analysis, 2nd ed., Prentice-Hall (2000)
15. R.S. Sutton and A. G. Barto: Reinforcement Learning: An Introduction, MIT Press, Cambridge, MA (1998)
16. A.G. Barto, S.J. Bradtke, and S.P. Singh: “Learning to act using real-time dynamic programming,” Artificial Intelligence, Vol. 72, pp. 81–138 (1995)
17. C.J.G.H. Watkins: Learning from Delayed Rewards, PhD thesis, Cambridge University, Cambridge, England (1989)