Modeling of suppliers' learning behaviors in an electricity market environment

2007 International Conference on Intelligent Systems Applications to Power Systems, ISAP

Volumn , Issue , 2007, Pages

  Yu, Nanpeng ^a,b   Liu, Chen Ching ^a,b   Tesfatsion, Leigh ^a,c  

^a IEEE

^b Iowa State University of Science and Technology   (United States)

^c IOWA STATE UNIVERSITY   (United States)

Author keywords

Competitive markov decision process; Electricity market; Q learning; Supplier modeling

Indexed keywords

COMPETITIVE MARKOV DECISION PROCESS; DAY-AHEAD ELECTRICITY MARKET; ELECTRICITY MARKET; ELECTRICITY MARKETS; INTERACTING AGENTS; INTERNATIONAL CONFERENCES; LEARNING BEHAVIORS; LEARNING CAPABILITIES; LOAD-SERVING ENTITIES; MARGINAL COSTS; MARKET CLEARING; MULTI-AGENT SYSTEMS; POWER SYSTEMS; Q-LEARNING; SUPPLIER AGENTS; SUPPLIER MODELING;

EDUCATION; ELECTRIC POWER SYSTEMS; INTELLIGENT SYSTEMS; MARKETING;

AGENTS;

EID: 50249167257     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ISAP.2007.4441590     Document Type: Conference Paper

References (8)

1. S. Borenstein, J. Bushnell, and F. A. Wolak, "Measuring Market Inefficiencies in California's Restructured Wholesale Electricity Market," Center for the Study of Energy Markets. Paper CSEMWP-102, June 2002.
2. J. Sun and L. Tesfatsion, "Dynamic Testing of Wholesale Power Market Designs: An Open-Source Agent-Based Framework," to apperar in Computational Economics, 2008. http://www.econ.iastate.edu/tesfatsi/ DynTestAMES.JSLT.pdf
3. V. Nanduri and T.K. Das, "A Reinforcement Learning Model to Assess Market Power under Auction-Based Energy Pricing," IEEE Transactions on Power Systems, vol. 22(1), pp. 85-95, Feb. 2007.
4. C. W. Richter, G. B. Sheblé, and D. Ashlock, "Comprehensive Bidding Strategies with Genetic Programming/Finite State Automata," IEEE Transactions on Power Systems, vol. 14, pp. 1207-1212, Nov. 1999.
5. J. Hu and M. P. Wellman, "Nash Q-learning for General-Sum Stochastic Games," J. Mach. Learn. Res., vol. 4, pp. 1039-1069, 2003.
6. R. D. Zimmerman and D. Gan, "MATPOWER: A MATLAB Power System Simulation Package (Version 2.0)," Cornell University, New York 1997. http://www.pserc.cornell.edu/.
7. C.J.C.H. Watkins, "Learning from Delayed Rewards," Ph.D. Thesis, University of Cambridge, England, 1989.
8. C.J.C.H. Watkins and P. Dayan, "Q-Learning," Machine Learning, vol. 3, pp. 279-292, 1992.