Adaptive stochastic control for the smart grid

Proceedings of the IEEE

Volumn 99, Issue 6, 2011, Pages 1098-1115

  Anderson, Roger N ^a   Boulanger, Albert ^a   Powell, Warren B ^b   Scott, Warren ^b  

^a Och Spine at New York Presbyterian Hospitals   (United States)

^b Princeton University   (United States)

Author keywords

Adaptive stochastic control (ASC); approximate dynamic programming (ADP); control systems; Smart Grid

Indexed keywords

ADAPTIVE CONTROL SYSTEMS; CONTROL SYSTEMS; DYNAMIC PROGRAMMING; ELECTRIC POWER TRANSMISSION NETWORKS; STOCHASTIC CONTROL SYSTEMS; STOCHASTIC SYSTEMS;

APPROXIMATE DYNAMIC PROGRAMMING; DISTRIBUTED GENERATION AND STORAGE; ELECTRIC GRIDS; SELF-HEALING CAPABILITIES; SMART GRID; SOURCE CONTROL; STOCHASTIC CONTROL;

SMART POWER GRIDS;

EID: 79956350565     PISSN: 00189219     EISSN: None     Source Type: Journal    
DOI: 10.1109/JPROC.2011.2109671     Document Type: Conference Paper

References (47)

1. R. Anderson, A. Boulanger, J. Johnson, and A. Kressner, Computer-Aided Lean Management in the Energy Industry. Tulsa, OK: PennWell Press, 2008.
2. A. Mahmood, M. Aamir, and M. Anis, "Design and implementation of AMR Smart Grid system," in Proc. IEEE Electr. Power Energy Conf., 2008.
3. L. Tsoukalas and R. Gao, "From Smart Grids to an energy internet assumptions, architectures and requirements," in Proc. IEEE DRPT Conf., 2008.
4. J. Katz, "Educating the Smart Grid," in Proc IEEE Energy, 2030, 2008.
5. D. Divan and S. Johal, "Distributed FACTSVA new concept for realizing grid power flow control," IEEE Trans. Power Electron., vol. 26, 2007.
6. D. Divan, "Smart distributed control of power systems," in Proc. Conv. Delivery of Electrical Energy 21st Century, 2008, IEEE.
7. N. Schnurr, T. Weber, W. Wellssow, and T. Wess, "Load-flow control with FACTS devices in competitive markets," in Proc. IEEE Electric Utility Deregulation Restructur. Power Technol., 2000.
8. J. Steinberger, J. Niel Van, and D. Bourg, "Profiting from Negawatts: Reducing absolute consumption and emissions through a performance-based energy economy," in Energy Policy. New York: Elsevier, 2009.
9. A. Boulanger, A. Chu, S. Maxx, and D. Waltz, "Vehicle electrification: Status and issues," Proc. IEEE, Special Issue on the Smart Grid, vol. 99, no. 6, Jun. 2011.
10. M. Dicorato, G. Forte, and M. Trovato, "A procedure for evaluating technical and economic feasibility issues of MicroGrids," in Proc. IEEE Bucharest Power Tech Conf., 2009.
11. A. Pipattanasomporn and A. Rahman, "Multi-agent systems in a distributed Smart Grid: Design and implementation," in Proc. IEEE PES 2009 Power Systems Conf. Expos., 2009.
12. X. Liu and B. Su, "MicrogridsVAn Integration of Renewable Energy Technologies," in Protection, Control, Communication and Automation of Distribution Networks, 2008, S3-25, CT 1800, CICED.
13. Z. Jiang, Power Management of Hybrid PhotovoltaicVFuel Cell Power Systems, 2006, IEEE paper 1-4244-0493-2.
14. A. Chowdhury and D. Koval, Impact of PV Power Sources on a Power System's Capacity Reliability Levels, 2005, IEEE I&CPS-05-4.
15. D. Swider, "Compressed air energy storage in an electricity system, with significant wind power generation," IEEE Trans. Energy Conv., vol. 22, no. 1, pp. 95-102, 2007. (Pubitemid 46487481)
16. R. Anderson, "Texas Wind Energy Plan, Report to the Texas Energy Planning Council," Railroad Commission of Texas, 2004.
17. E. Lerch, Storage of Fluctuating Wind Storage: Case for Compressed Air Energy Storage in Germany, 2008, IEEE.
18. R. Smalley, Our Energy Challenge. [Online]. Available: http://video.google.com/
19. A. Yakobson and R. Smalley, "Fullerene Nanotubes: C1,000,000 and Beyond," Amer. Scientist, vol. 85-4, pp. 324-337, 1997.
20. M. Anantram and T. Govindan, "Transmission through carbon nanotubes with olyhedral caps," M. P. Phys. Rev. B, vol. 61, no. 7, p. 5020, 2000.
21. T. Garrity, "Innovation and trends for future electric power systems," IEEE Power Energy, 2008.
22. J. Momoh, "Optimal methods for power system operation and management," in Proc. PSCE, 2006, pp. 179-186.
23. P. Werbos, "Putting more brain-like intelligence into the electric power grid: What we need and how to do it," in Proc. IEEE 2009 Int. Joint Conf. Neural Netw., IEEE Comput. Intel., 2009.
24. J. Chuang and M. McGranaghan, Functions of a Local Controller to Coordinate Distributed Resources in a Smart Grid Angela Chuang, IEEE, 2008.
25. L. Hannah, D. Blei, and W. Powell, "Dirichlet process mixtures of generalized linear models," J. Mach. Learning Res., (to appear).
26. L. Hannah, D. Blei, and W. B. Powell, "Airichlet Process Mixtures of Generalized Linear Models," in Proc. AISTATS, 2010b.
27. G. Godfrey and W. Powell, "An adaptive, distribution-free algorithm for the newsvendor problem with censored demands, with applications to inventory and distribution," Manag. Sci., vol. 47, no. 8, pp. 1101-1112, 2001. (Pubitemid 34192808)
28. H. Topaloglu and W. Powell, "Dynamic programming approximations for stochastic, time-staged integer multicommodity flow problems," Informs J. Comput., vol. 18, pp. 31-42, 2006. (Pubitemid 43515944)
29. W. Powell, A. George, A. Lamont, and J. Stewart, "SMART: A stochastic multiscale model for the analysis of energy resources, technology, and policy," Inf. J. Comput., (to appear).
30. W. Powell, A. Ruszczynski, and H. Topaloglu, "Learning algorithms for separable approximations of discrete stochastic optimization problems," Math. Oper. Res., vol. 29, no. 4, pp. 814-836, 2004. (Pubitemid 40055836)
31. J. Spall, Introduction to Stochastic Search and Optimization: Estimation, Simulation, and Control. New York: Wiley, 2003.
32. P. Frazier, W. B. Powell, and S. Dayanik, "A knowledge gradient policy for sequential information collection," SIAM J. Contr. Optim., vol. 47, no. 5, pp. 2410-2439, 2008.
33. P. Frazier, W. Powell, and S. Dayanik, "The knowledge-gradient policy for correlated normal beliefs," INFORMS J. Comput., vol. 21, no. 4, pp. 599-613, 2009.
34. W. Scott, P. Frazier, and W. B. Powell, The Correlated Knowledge Gradient for Maximizing Expensive, Continuous Functions With Noisy Observations Using Gaussian Process Regression, Dept. Operations Res. Financial Eng., Princeton, NJ, 2010. [Online]. Available: http://www.castlelab. princeton.edu/
35. D. Bertsekas and J. Tsitsiklis, Neuro-Dynamic Programming, Athena Scientific, 2006.
36. D. Bertsekas, Dynamic Programming and Optimal Control, vol. II. Nashua, NH: Athena Scientific, 2007.
37. W. B. Powell, Approximate Dynamic Programming: Solving the Curses of dimensionality. New York: Wiley, 2007.
38. D. Bertsekas, "Approximate policy iteration: A survey and some new methods," J. Contr. Theory Applicat., 2010.
39. J. Ma and W. B. Powell, Convergence Analysis of On-Policy LSPI for Multi-Dimensional Continuous State and Action Space MDPs and Extension With Orthogonal Polynomial Approximation, Working paper, Dept. Operations Res. Financial Eng., Princeton Univ., Princeton, NJ, 2010.
40. C. Rudin, D. Waltz, R. Anderson, A. Boulanger, A. Salleb-Aouissi, M. Chow, H. Dutta, P. Gross, B. Huang, S. Ierome, D. Isaac, A. Kressner, R. Passonneau, A. Radeva, and L. Wu, "Machine learning for the New York City Power1 Grid," IEEE Trans. Pattern Anal. Machine Intell., 2011, accepted for publication.
41. R. Anderson, A. Boulanger, D. Waltz, P. Long, M. Arias, P. Gross, H. Becker, A. Kressner, M. Mastrocinque, M. Koenig, and J. Johnson, System and Method For Grading Electricity Distribution Network Feeders Susceptible To Impending Failure, 2009, United States Letters Patent. [Online]. Available: http://www. freepatentsonline.com/y2009/0157573.html
42. D. Ormoneit and Ś. Sen, "Kernel-based reinforcement learning," Machine Learning, vol. 49, pp. 161-178, 2002. (Pubitemid 34325684)
43. J. Nascimento and W. Powell, An Optimal Approximate Dynamic Programming Algorithm for the Energy Dispatch Problem with Grid-Level Storage, working paper, Dept. Operations Res. Financial Eng., Princeton Univ., 2010.
44. W. Powell and J. Nascimento, "An optimal approximate dynamic programming algorithm for the lagged asset acquisition problem," Math. Oper. Res., vol. 34, pp. 210-237, 2009.
45. J. McDonald, "Leader or follower: Developing the Smart Grid business case," IEEE Power Energy, pp. 18-24, 2008.
46. A. Schulz, "Agile engineering versus agile systems engineering," Syst. Eng., vol. 3, no. 4, pp. 180-211, 1999.
47. D. Lemoine, Valuing Plug-In Hybrid Electric Vehicles' Battery Capacity Using a Real Options Framework, Working paper 09-022 of the United States Association for Energy Economics, 2009.