A reinforcement learning algorithm for market participants in FTR auctions

2007 IEEE Lausanne POWERTECH, Proceedings

Volumn , Issue , 2007, Pages 943-948

  Ziogos, Nikolaos P ^b   Tellidou, Athina C ^b   Gountis, Vasileios P ^b   Bakirtzis, Anastasios G ^a,b  

^a IEEE

^b ARISTOTLE UNIVERSITY OF THESSALONIKI   (Greece)

Author keywords

Agent based simulation; Bidding strategy; Financial transmission rights auction; Q learning

Indexed keywords

AGENT-BASED SIMULATION; BIDDING STRATEGY; FINANCIAL TRANSMISSION RIGHTS AUCTION; Q-LEARNING; Q-LEARNING ALGORITHMS;

ADAPTIVE ALGORITHMS; BOOLEAN FUNCTIONS; COMMERCE; COMPUTER NETWORKS; EDUCATION; ELECTRIC UTILITIES; INDUSTRIAL ECONOMICS; LEARNING SYSTEMS; PLANNING; REINFORCEMENT; REINFORCEMENT LEARNING; STRATEGIC PLANNING;

LEARNING ALGORITHMS;

EID: 50849089602     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/PCT.2007.4538442     Document Type: Conference Paper

References (25)

1. O. Alsac, J.M. Bright, S. Brignone, M. Prais, C. Silva, B. Stott, N. Vempati, "The Rights to Fight Price Volatility", IEEE Power & Energy Magazine, july/august 2004, pp. 47-57.
2. PJM Manual for Financial Transmission Rights, PJM Interconnection. Available on-line at: http://pubs.pjm.com/dynaweb/PJMpubp/m06.
3. [Online]. Available: Check http://www.pjm.com for PJM market.
4. [Online]. Available: Check http://www.nyiso.comfor NYISO market.
5. T. Alvey, D. Goodwin, X. Ma, D. Sun, D. Streiffert, "A security-constrained bid-clearing system for New Zealand wholesale electricity market", IEEE PES Summer Meeting, Berlin, Germany, July 1997.
6. H. Chao, S. Peck, S. Oren, R. Wilson, "Flow-based transmission rights and congestion management", Electricity Journal, vol. 13, no. 8, October 2000, pp. 38-58.
7. [Online]. Available: Check http://www.caiso.com for CAISO market.
8. [Online]. Available: Check http://www.ercot.com for ERCOT market.
9. W.W. Hogan, "Financial Transmission Right Formulations", working paper, John F. Kennedy School of Government, Harvard University, 2000. Available on-line at: http://ksghome.harvard.edu/~.whogan.cbg. Ksg/.
10. R.P. O'Neill, U. Helman, B.F. Hobbs, W.R. Steward, Jr., and M.H. Rothkopf, "A joint energy and transmission rights auction: proposal and properties", IEEE Transactions on Power Systems, vol. 17, no. 4, November 2002, pp. 1058-1067.
11. R.P. O'Neill, U. Helman, R. Baldick, W.R. Steward, Jr., and M.H. Rothkopf, "Contingent Transmission Rights in the Standard Market Design", IEEE Transactions on Power Systems, vol. 18, no. 4, November 2003, pp. 1331-1337.
12. T. Li, and M. Shahidehpour, "Risk-Constrained FTR Bidding Strategy in Transmission Markets", IEEE Transactions on Power Systems, vol. 20, no. 2, May 2005, pp. 1014-1021.
13. X. Ma, D. Sun, A. Ott, "Implementation of the PJM financial transmission rights auction market system", IEEE PES Summer Meeting, Chicago, USA, July 2002.
14. M. Liu, G. Gross, "Role of Distribution Factors in Congestion Revenue Rights Applications", IEEE Transactions on Power Systems, vol. 19, no. 2, May 2004, pp. 802-810.
15. R. Mendez, H. Rudnick, "Congestion Management and Transmission Rights in Centralized Electric Markets", IEEE Transactions on Power Systems, vol. 19, no. 2, May 2004, pp. 889-896.
16. W.W. Hogan, "Flowgate Rights and Wrongs", working paper, John F. Kennedy School of Government, Harvard University, 2000. Available on-line at: http://ksghome.harvard.edu/~.whogan.cbg.Ksg
17. L.E. Ruff, "Flowgates, Contingency-Constrained Dispatch, and Transmission Rights", Electricity Journal, vol. 14, no. 1, Jan/Feb. 2001, pp. 34-55.
18. D. W. Bunn, F. S. Oliveira, "Agent-based simulation: An application to the New Electricity Trading Arrangements of England and Wales", IEEE Transactions on Evolutionary Computation, vol. 5, no. 5, October 2001.
19. A. J. Bagnall, G. D. Smith, "Game playing with autonomous adaptive agents in a simplified economic model of the UK market in electricity generation", IEEE Power System Technology, vol. 2, 2000, p 891-896G.
20. D. Koesrindartoto, L. Tesfatsion, "Testing the reliability of FERC's Wholesale Power Market Platform: An agent-based computational economics approach", Proceedings of the 24th USAEE/IAEE North American Conference, Washington, D.C., July 8-10, 2004.
21. T. Krause, G. Andersson, D. Ernst, E. V. Beck, R. Cherkaoui, A. Germond, "A comparison of nash equilibria analysis and agent-based modeling for power markets", Proceedings of the 15th PSCC, Liege, Belgium, August 22-26, 2005.
22. G. Xiong, S. Okuma, H. Fujita, "Multi-agent based experiments on uniform price and pay-as-bid electricity auction markets", in Proc. of the IEEE International Conference on Electric Utility Deregulation, Restructuring and Power Technologies, April 2004.
23. J. Nie, S. Haykin, "A Dynamic Channel Assignment Policy through Q-Learning", IEEE Transactions on Neural Networks, Vol.10, No. 6, pp. 1443-1455, November 1999
24. [Online]. Available: Check http://www.desmie.gr for HTSO market.
25. J. Lally (2002). "Financial Transmission Rights Auction Example." ISO New England, Inc., January. Available on-line at: http://www.iso-ne.com/pubs/pubcomm/forums/2002/ Manual_06_FTR_Auction_Example_Presentation.pdf