A Supplier Bidding Strategy Through Q-Learning Algorithm in Electricity Auction Markets

IEEJ Transactions on Electronics, Information and Systems

Volumn 123, Issue 6, 2003, Pages 1134-1141

  Xiong, Gaofeng ^a   Okuma, Shigeru ^a   Hashiyama, Tomonori ^b  

^a NAGOYA UNIVERSITY   (Japan)

^b NAGOYA CITY UNIVERSITY   (Japan)

Author keywords

day ahead electricity auction market; Deregulation; Q Learning algorithm; supplier bidding strategy

Indexed keywords

EID: 8644251424     PISSN: 03854221     EISSN: 13488155     Source Type: Journal    
DOI: 10.1541/ieejeiss.123.1134     Document Type: Letter

References (20)

1. Harry Singh: IEEE Tutorial on Game Theory Application in Electric Power Markets, IEEE Power Engineering Society, Winter Meeting, New York (1999).
2. D. Fudenberg and J. Tirole: Game Theory, Cambridge, Massachusetts: The MIT Press (1991).
3. R. W. Ferrero, J. F. Rivera, arid S. M. Shahidehpour: “Application of games with incomplete information for pricing electricity in deregulated power pools”, IEEE Trans, on Power Syst… Vol. 13, No. 1, pp. 184-189, Feb. (1998).
4. F. S. Wen, and A. K. David: “Oligopoly Electricity Market Production under Incomplete Information”, IEEE Power Engineer Review, pp. 58-61, April (2001).
5. K. Seeley, J. Lawarree, and C. C. Liu: “Analysis of Electricity Market Rules and Their Effects on Strategic Behavior in a Noncongestive Grid”, IEEE Trans, on Power Systems, Vol. 15, No. 1, pp. 157-162, Feb. (2000).
6. C. W. Richter, Jr and G. B. Sheble: “Genetic Algorithm Evolution of Utility Bidding Strategies for the Competitive Marketplace”, IEEE Trans. on Power Systems. Vol. 13, No. 1, pp. 256-261, Feb. (1998).
7. H. L. Song, C. C. Lin, J. Lawarree, and R. W. Dahlgren: “Optimal Electricity Supply Bidding by Markov Decision Process”, IEEE Trans. on Power Systems, Vol. 15, No. 2, pp. 618-624, May (2000).
8. F. S. Wen and A. K. David: “Optimal Bidding Strategics and Modeling of Imperfect Information Among Competitive Generators”, IEEE Trans. on Power Systems, Vol. 16, No. 1, pp. 15-21, Feb. (2001).
9. Derek W. Bunn and Fernando S. Olivcria: “Agent-Based Simulation -An Application to the New Electricity Trading Arrangements of England and Wales”, IEEE Trans, on Evolutionary Computation, Vol. 5, No. 5, Oct. (2001).
10. S. Y. Hao: “A Study of Basic Bidding Strategy in Clearing Pricing Auctions”, IEEE Trans, on Power Systems, Vol. 15, No. 3, pp. 975-980, Aug. (2000).
11. SEPIA's web site, http://www.htc.honeywell.com/projects/sepia.
12. J. Bower and D. Bunn: “Experimental analysis of the efficiency of uniform-price versus discriminatory auctions in the England and Wales electricity market”, J. Economic Dynamics and Control, Vol. 25, pp. 561-592, March 2001.
13. M. Ilie, and P. Skantze: “Electric Power Systems Operation by Decision and Control”, IEEE Control Syst. Magazine, Vol. 20, No. 4, pp. 25-39, Aug. (2000).
14. C. C. Liu, J. H. Jung, G. T. Heydt V. Vittal, and A. G. Phadke: “The Strategic Power Infrastructure Defense (SPID) System”, IEEE Control Systems Magazine, Vol. 20, No. 4, pp. 40-52, Aug. (2000).
15. S. A. Harp, A. Brignone, B. F. Wollenberg, and T. Samad: “SEPIA: A Simulator for Electric Power Industry Agents”, IEEE Control Syst. Magazine, Vol. 20, No. 4, pp. 53-69, Aug. (2000).
16. Junhong Nie and Simon Haykin: “A Dynamic Channel Assignment Policy Through Q-Learning”, IEEE Trans. Neural Networks, Vol. 10, No. 6, pp. 1443-1455, Nov. (1999).
17. Arthur R. Bergen, Vijay Vittal: Power Systems Analysis, 2nd ed., Prentice-Hall (2000).
18. Richard S. Sutton and Andrew G. Barto: Reinforcement Learning: An Introduction, Cambridge, MA: MIT Press (1998).
19. A. G. Barto, S. J. Bradtke, and S. P. Singh: “Learning to act. using real-time dynamic programming”, Artificial Intelligence. Vol. 72, pp. 81-138 (1995).
20. C. J. C. H. Watkins, Learning from Delayed Rewards, PhD thesis, Cambridge University, Cambridge, England (1989).