Q-learning based supplier-agents for electricity markets

2005 IEEE Power Engineering Society General Meeting

Volumn 1, Issue , 2005, Pages 420-426

  Rahimi Kian, Ashkan ^a,b   Sadeghi, Behrooz ^a,b   Thomas, Robert J ^a,c,d,e  

^a IEEE   (Iran)

^b UNIVERSITY OF TEHRAN   (Iran)

^c Cornell University ^*  (United States)

^d School of Operations Research and Industrial Engineering   (United States)

^e NATIONAL SCIENCE FOUNDATION   (United States)

Author keywords

Electricity markets; Greedy action; Market clearing price (MCP); Q Learning (QL); Reinforcement Learning (RL); Revenue maximizing; Supplier agent (SA); Supply function; Supply function coefficients; Temporal Difference algorithm (TD)

Indexed keywords

ELECTRIC ENERGY; ELECTRICITY MARKETS; GREEDY ACTION; MARKET LEARNING PRICE (MLP); Q-LEARNING (QL); REINFORCEMENT LEARNING; REVENUE MAXIMIZING; SUPPLIER AGENTS; SUPPLIER-AGENT; TEMPORAL DIFFERENCE ALGORITHM;

ALGORITHMS; COMPETITION; ELECTRIC ENERGY STORAGE; ERRORS; LEARNING SYSTEMS; MARKETING; REINFORCEMENT;

ELECTRIC UTILITIES;

EID: 27144437019     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (6)

1. M. North, G. Conzelmann, V. Koritarov, C. Macal, P. Thimmapuram, T. Veselka, "E-Laboralories: Agent-based Modeling of Electricity Markets", Proceedings of the American Power Conference, April 15-17, 2002, Chicago, IL, USA.
2. M. Scheldt, H.-J. Sebastian, "Simulating Day-Ahead Trading in Electricity Markets with Agents", Proceedings of the Second Asia-Pacific Conference of International Agent Technology (IAT-2001), Maebashi City, Japan, 23.-26, October 2001.
3. D. W. Bunn, F. S. Oliveira, "Agent-based Simulation: An Application to the New Electricity Trading Arrangements of England and Wales", IEEE-TEC, special issue: Agent Based Computational Economics, 2002.
4. J. Nicolaisen, V. Petrov, L. Tesfatsion, "Market power and efficiency in a computational electricity market with discriminatory double-auction pricing", IEEE Transactions on Evolutionary Computation, Vol. 5, No. 5, October 2001, pp. 504-523.
5. R.S. Sutton and A. G. Barto, Reinforcement Learning: An Introduction, MIT Press, 1998.
6. T. Basar, G. J. Olsder, Dynamic Non-cooperative Game Theory, second edition, Academic Press, London, 1995.