Smart building real time pricing for offering load-side regulation service reserves

Proceedings of the IEEE Conference on Decision and Control

Volumn , Issue , 2013, Pages 4341-4348

  Bilgin, Enes ^a   Caramanis, Michael C ^a   Paschalidis, Ioannis Ch ^a  

^a Boston University   (United States)

Author keywords

Actor critic algorithms; Approximate policy iteration; Distributed demand management; Regulation service provision

Indexed keywords

COST FUNCTIONS; ITERATIVE METHODS;

ACTOR-CRITIC ALGORITHM; APPROXIMATE POLICY ITERATION (API); COMPUTATIONAL EFFORT; CONVEXITY PROPERTIES; MODIFIED LEAST SQUARES; POLICY ITERATION; POLICY ITERATION ALGORITHMS; REGULATION SERVICES;

COSTS;

EID: 84902313017     PISSN: 07431546     EISSN: 25762370     Source Type: Conference Proceeding    
DOI: 10.1109/CDC.2013.6760557     Document Type: Conference Paper

References (17)

1. Manual 2: Ancillary Services Manual, v.3.26, NYISO, Rensselaer, NY, 2013.
2. Y. V. Makarov, C. Loutan, J. Ma, and P. de Mello, "Operational impacts of wind generation on California power systems", IEEE Trans. Power Syst, vol. 24, no. 2, pp. 10391050, May 2009.
3. G. Gowrisankaran, S. Reynolds, M. Samano, "Intermittency and the Value of Renewable Energy", NBER Working Paper Series, Cambrigde, MA, May 2011.
4. I.C. Paschalidis, B. Li, M. C. Caramanis, "A Market-Based Mechanism for Providing Demand-Side Regulation Service Reserves", in 50th IEEE Conference on Decision and Control, Orlando, FL, Dec. 2011, pp. 21-26.
5. I.C. Paschalidis, B. Li, M. C. Caramanis, "Demand-Side Management for Regulation Service Provisioning through Internal Pricing", IEEE Trans. Power Syst., vol. 27, no. 3, pp. 1531-1539, Aug. 2012.
6. B. Zhang, J. Baillieul, "A Packetized Direct Load Control Mechanism for Demand Side Management", in 51st IEEE Conference on Decision and Control, Maui, HI, Dec. 2012, pp. 3658-3665.
7. M. C. Caramanis, I.C. Paschalidis, C.G. Cassandras, E. Bilgin, E. Ntakou, "Provision of Regulation Service Reserves by Flexible Distributed Loads", in 51st IEEE Conference on Decision and Control, Maui, HI, Dec. 2012, pp. 3694-3700.
8. D.P. Bertsekas, Dynamic Programming and Optimal Control. Belmont, MA: Athena Scientific, 1995, vol. II.
9. V. Konda and J. Tsitsiklis, "On Actor-Critic Algorithms", SIAM Journal on Control and Optimization, vol. 42, no. 4, pp. 1143-1166, Aug. 2003.
10. R. M. Estanjini, K. Li, I. Ch. Paschalidis, "A Least Squares Temporal Difference Actor-Critic Algorithm with Applications to Warehouse Management", Naval Research Logistics, vol. 59, pp. 197-211, Mar. 2012.
11. R. J. Williams, "Simple Statistical Gradient Following Algorithms for Connectionist Reinforcement Learning", Machine Learning, vol. 8, pp. 229-256, May 1992.
12. K. Doya, "Efficient Nonlinear Control with Actor-Tutor Architecture, Advances in Neural Information Processing Systems, vol. 9, pp. 1012-1018, 1997.
13. H. Kimura, T. Yamashita, S. Kobayashi, "Reinforcement Learning of Walking Behavior for a Four-Legged Robot", in 40th IEEE Conference on Decision and Control, Orlando, FL, Dec. 2001, pp. 411-416.
14. R. Sutton and A. Barto, Reinforcement Learning: An Introduction. Cambridge, MA: MIT Press, 1998.
15. E. Porteus, "Conditions for Characterizing the Structure of Optimal Strategies in Infinite-Horizon Dynamic Programs", J. of Optimization Theory and Applications, vol. 36, no. 3, pp. 419-432, Mar. 1982.
16. A.Y. Ha, "Optimal Dynamic Scheduling Policy for a Make-To-Stock Production System", Operations Research, vol. 45, no. 1, pp. 42-53, Jan. 1997.
17. E. Bilgin, M. C. Caramanis, "Decision Support for Offering Load-Side Regulation Service Reserves in Competitive Power Markets", in 52nd IEEE Conference on Decision and Control, Florence, Italy, Dec. 2013.