Action dependent heuristic dynamic programming for home energy resource scheduling

International Journal of Electrical Power and Energy Systems

Volumn 48, Issue 1, 2013, Pages 148-160

  Fuselli, Danilo ^a   De Angelis, Francesco ^a   Boaro, Matteo ^a   Squartini, Stefano ^a   Wei, Qinglai ^c   Liu, Derong ^b   Piazza, Francesco ^a  

^a UNIVERSITÀ POLITECNICA DELLE MARCHE   (Italy)

^b University of Illinois at Chicago   (United States)

^c INSTITUTE OF AUTOMATION   (China)

Author keywords

Action dependent heuristic dynamic programming; Adaptive dynamic programming; Home energy management; Neural networks; Particle swarm optimization; Smart grid

Indexed keywords

ACTION DEPENDENT HEURISTIC DYNAMIC PROGRAMMING; ADAPTIVE CRITIC DESIGNS; ADAPTIVE DYNAMIC PROGRAMMING; CRITIC NETWORK; ELECTRICITY PRICES; ENERGY COST; ENERGY WASTES; HISTORICAL DATA; HOME ENERGY MANAGEMENTS; OPTIMIZATION TECHNIQUES; PHOTOVOLTAIC ARRAYS; RENEWABLE ENERGIES; RESOURCE-SCHEDULING; SMART GRID; SMART HOMES; SOLAR IRRADIATION; TIME HORIZONS; UTILITY FUNCTIONS;

AUTOMATION; COSTS; ENERGY MANAGEMENT; ENERGY RESOURCES; INTELLIGENT BUILDINGS; NEURAL NETWORKS; PARTICLE SWARM OPTIMIZATION (PSO); PHOTOVOLTAIC CELLS; SCHEDULING; SOLAR RADIATION;

COMPUTER SIMULATION;

EID: 84872940439     PISSN: 01420615     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ijepes.2012.11.023     Document Type: Article

References (51)

1. National Renewable Energy Laboratory (NREL) of U.S. Department of Energy. 2010 Renewable energy data book, energy efficiency and renewable energy (EERE), 2010. < http://www.nrel.gov/analysis/pdfs/51680.pdf >.
2. S.M. Amin, and B.F. Wollenberg Toward a smart grid: power delivery for the 21st century IEEE Power Energy Mag 3 5 2005 34 41
3. T.F. Garrity Getting smart IEEE Power Energy Mag 6 2 2008 38 45 (Pubitemid 351337447)
4. F. Li, W. Qiao, H. Sun, H. Wan, J. Wang, and Y. Xia Smart transmission grid: vision and framework IEEE Trans Smart Grid 1 2 2010 168 177
5. A.P.S. Meliopoulos, G. Cokkinides, R.K. Huang, E. Farantatos, S. Choi, and Y. Lee Smart grid technologies for autonomous operation and control IEEE Trans Smart Grid 2 1 2011 1 10
6. G.B. Sheble Smart grid millionaire IEEE Power Energy 6 1 2008 22 28
7. Venayagamoorthy GK. Potentials and promises of computational intelligence for smart grids. In: IEEE Power & Energy Society general meeting; 2009. p. 1-6.
8. I. Papaioannou, A. Purvins, and E. Tzimas Demand shifting analysis at high penetration of distributed generation in low voltage grids Int J Electr Power Energy Syst 44 1 2013 540 546
9. H. Zayandehroodi, A. Mohamed, H. Shareef, and M. Mohammadjafari A new approach to power system protection in distribution network with dg units by using radial basis function neural network Int J Eng Intel Syst 19 2 2011 1 15
10. Markets and Markets. Smart grid technology market, analysis & global forecast by hardware, software & communication network technologies (2011-2016); 2012. < http://www.marketsandmarkets.com >.
11. M. Castillo-Cagigal, A. Gutiérrez, F. Monasterio-Huelin, E. Caamaño-Martín, D. Masa, and J. Jiménez-Leube A semi-distributed electric demand-side management system with pv generation for self-consumption enhancement Energy Convers Manage 52 7 2011 2659 2666
12. E. Matallanas, M. Castillo-Cagigal, A. Gutiérrez, F. Monasterio-Huelin, E. Caamaño-Martín, and D. Masa Neural network controller for active demand-side management with pv energy in the residential sector Appl Energy 91 1 2012 90 97
13. A. Mohsenian-Rad, and A. Leon-Garcia Optimal residential load control with price prediction in real-time electricity pricing environments IEEE Trans Smart Grid 1 2 2010 120 133
14. Y. Riffonneau, S. Bacha, F. Barruel, and S. Ploix Optimal power flow management for grid connected pv systems with batteries IEEE Trans Sustain Energy 2 3 2011 309 320
15. D.K. Maly, and K.S. Kwan Optimal battery energy storage system (BESS) charge scheduling with dynamic programming IEE Proc Sci Meas Technol 142 6 1995 453 458
16. Changsong C, Shanxu D, Tao C, Bangyin L, Huazhong Y. Energy trading model for optimal microgrid scheduling based on genetic algorithm. In: IEEE 6th international power electronics and motion control conference; 2009. p. 2136-9.
17. Huang T, Liu D. Residential energy system control and management using adaptive dynamic programming. In: The 2011 international joint conference on neural networks (IJCNN). IEEE; 2011. p. 119-24.
18. Welch RL, Venayagamoorthy GK. Optimal control of a photovoltaic solar energy with adaptive critics. In: Proceedings of the international joint conference on neural networks (IJCNN); 2007. p. 985-90.
19. Welch RL, Venayagamoorthy GK. Hdp based optimal control of a grid independent PV system. In: IEEE Power Engineering Society general meeting; 2006. p. 1-6.
20. Welch RL, Venayagamoorthy GK. Comparison of two optimal control strategies for a grid independent PV system. In: IEEE Power Engineering Society general meeting, vol. 3; 2006. p. 1120-7. (Pubitemid 47514753)
21. Gudi N, Wang L, Devabhaktuni V, Depuru S. A demand-side management simulation platform incorporating optimal management of distributed renewable resources. In: Power systems conference and exposition (PSCE), 2011 IEEE/PES. IEEE; 2011. p. 1-7.
22. J.J. Murray, C.J. Cox, G.G. Lendaris, and R. Saeks Adaptive dynamic programming IEEE Trans Syst Man Cybernet 32 2 2002 140 153 (Pubitemid 35289398)
23. P.J. Werbos D. White, D. Sofge, Approximate dynamic programming for real-time control and neural modeling 1992 Van Nostrand New York [chapter 13]
24. Fuselli D, De Angelis F, Boaro M, Liu D, Wei Q, Squartini S, et al. Optimal battery management with ADHDP in smart home environments. In: Advances in neural networks-ISNN 2012, vol. 7367, Part I, LNCS series; 2012.
25. C.H. Lo, and M.D. Anderson Economic dispatch and optimal sizing of battery energy storage systems in utility load-leveling operations IEEE Trans Energy Convers 14 3 1999 824 829 (Pubitemid 30528668)
26. Y. Ru, J. Kleissl, and S. Martinez Storage size determination for grid-connected photovoltaic systems IEEE Trans Sustain Energy 2012 1 14
27. X. Tan, Q. Li, and H. Wang Advances and trends of energy storage technology in microgrid Int J Electr Power Energy Syst 44 1 2013 179 191
28. T. Chen, T. Hsieh, N. Yang, J. Yang, and C. Liao Evaluation of advantages of an energy storage system using recycled EV batteries Int J Electr Power Energy Syst 45 1 2013 264 270
29. Zhang D, Papageorgiou L, Samsatli N, Shah N. Optimal scheduling of smart homes energy consumption with microgrid. In: ENERGY 2011. The first international conference on smart grids, green communications and IT energy-aware technologies; 2011. p. 70-5.
30. M.R. AlRashidi, and M.E. El-Hawary A survey of particle swarm optimization applications in electric power systems IEEE Trans Evolut Comput 13 4 2009 913 918
31. Y. Del Valle, G.K. Venayagamoorthy, S. Mohagheghi, J.C. Hernandez, and R.G. Harley Particle swarm optimization: basic concepts, variants and applications in power systems IEEE Trans Evolut Comput 12 2 2008 171 195 (Pubitemid 351546693)
32. Kennedy J, Eberhart R. Particle swarm optimization. In: Proceedings IEEE international conference on neural networks, ICNN, vol. 4; 1995. p. 1942-8.
33. Eberhart R, Kennedy J. A new optimizer using particle swarm theory. In: Proceedings of the sixth international symposium on micro machine and human science, 1995, MHS'95. IEEE; 1995. p. 39-43.
34. G.K. Venayagamoorthy, R.G. Harley, and D.C. Wunsch Comparison of heuristic dynamic programming and dual heuristic programming adaptive critics for neurocontrol of a turbogenerator IEEE Trans Neural Networks 13 3 2002 764 773 (Pubitemid 34669664)
35. D. Prokhorov, and D.C. Wunsch Adaptive critic designs IEEE Trans Neural Networks 8 5 1997 997 1007 (Pubitemid 127763331)
36. Lendaris GG, Paintz C. Training strategies for critic and action neural networks in dual heuristic programming method. In: Proceedings of international conference on neural network, vol. 2. 1997; p. 712-7.
37. Liu D, Xiong X, Zhang Y. Action-dependent adaptive critic designs. In: Proceedings of the INNS-IEEE international joint conference on neural network, vol. 2; 2001. p. 990-5. (Pubitemid 32805299)
38. Boaro M, Fuselli D, Angelis F, Liu D, Wei Q, Piazza F. Adaptive dynamic programming algorithm for renewable energy scheduling and battery management. Cognitive Computation 1-14, in press, http://dx.doi.org/10.1007/s12559-012-9191- y.
39. J. Si, and Y.T. Wang On-line learning control by association and reinforcement IEEE Trans Neural Networks 3 2000 221 226
40. A.G. Bakirtzis, and P.S. Dokopoulos Short term generation scheduling in a small autonomous system with unconventional energy system IEEE Trans Power Syst 3 3 1988 1230 1236
41. F.A. Chacra, P. Bastard, G. Fleury, and R. Clavreul Impact of energy storage costs on economical performance in a distribution substation IEEE Trans Power Syst 20 2 2005 684 691 (Pubitemid 40699696)
42. Corrigan PM, Heydt GT. Optimized dispatch of a residential solar energy system. In: Proceedings of the North American power symposium; 2007. p. 183-8.
43. B. Lu, and M. Shahidehpour Short-term scheduling of battery in a grid-connected PV/battery system IEEE Trans Power Syst 20 2 2005 1053 1061 (Pubitemid 40699737)
44. T.Y. Lee Operating schedule of battery energy storage system in a time-of-use rate industrial user with wind turbine generators: a multipass iteration particle swarm optimization approach IEEE Trans Energy Convers 22 3 2007 774 782
45. ComEd U. Residential real-time pricing; 2010. < http://www. thewattspot.com >.
46. S. Wilcox, and W. Marion Users manual for TMY3 data sets 2008 National Renewable Energy Laboratory
47. M. Marquez, and C. Coimbra Forecasting of global and direct solar irradiance using stochastic learning methods, ground experiments and the NWS database Solar Energy 85 5 2011 746 756
48. Isa I, Omar S, Saad Z, Noor NM, Osman MK. Weather forecasting using photovoltaic system and neural network. In: Second international conference on computational intelligence; 2010. p. 96-100.
49. C. Unsihuay-Vila, A. Zambroni de Souza, J. Marangon-Lima, and P. Balestrassi Electricity demand and spot price forecasting using evolutionary computation combined with chaotic nonlinear dynamic model Int J Electr Power Energy Syst 32 2 2010 108 116
50. A.J. Conejo, M.A. Plazas, R. Espinola, and A.B. Molina Day-ahead electricity price forecasting using the wavelet transform and ARIMA models IEEE Trans Power Syst 20 2 2005 1035 1042 (Pubitemid 40699735)
51. G. Li, C.-C. Liu, C. Mattson, and J. Lawarree Day-ahead electricity price forecasting in a grid environment IEEE Trans Power Syst 22 1 2007 266 274 (Pubitemid 46437736)