A self-learning scheme for residential energy system control and management

Neural Computing and Applications

Volumn 22, Issue 2, 2013, Pages 259-269

  Huang, Ting ^a   Liu, Derong ^a  

^a 1120 Science and Engineering Offices   (United States)

Author keywords

Adaptive dynamic programming (ADP); Battery storage; Price responsive management; Real time pricing; Residential energy management; Scheduling; Smart grid

Indexed keywords

BATTERY STORAGE; COSTS; ELECTRIC POWER TRANSMISSION NETWORKS; ENERGY MANAGEMENT SYSTEMS; ENERGY UTILIZATION; HOUSING; ITERATIVE METHODS; LEARNING SYSTEMS; MEMORY ARCHITECTURE; NETWORK ARCHITECTURE; OPTIMAL CONTROL SYSTEMS; SCHEDULING; SMART POWER GRIDS;

ADAPTIVE DYNAMIC PROGRAMMING; INTELLIGENT OPTIMIZATION METHOD; OPTIMAL CONTROL STRATEGY; REAL TIME PRICING; RESIDENTIAL ENERGY; RESIDENTIAL ENERGY SYSTEMS; SMART GRID; SYSTEM CONFIGURATIONS;

DYNAMIC PROGRAMMING;

EID: 84872594962     PISSN: 09410643     EISSN: None     Source Type: Journal    
DOI: 10.1007/s00521-011-0711-6     Document Type: Article

References (48)

1. Amin SM, Wollenberg BF (2005) Toward a smart grid: power delivery for the 21st century. IEEE Power Energy Mag 3(5): 34-41.
2. Bakirtzis AG, Dokopoulos PS (1988) Short term gerneation schedulling in a small autonomous system with unconventional energy system. IEEE Trans Power Syst 3(3): 1230-1236.
3. Balakrishnan SN, Biega V (1996) Adaptive-critic-based neural networks for aircraft optimal control. J Guid Control Dyn 19(4): 893-898.
4. Barto AG (1992) Reinforcement learning and adaptive critic methods. In: White DA, Sofge DA (eds) Handbook of intelligent control: neural, fuzzy and adaptive approaches. van Nostrand Reinhold, NY.
5. Bellman RE (1957) Dynamic programming. Princeton University Press, NJ.
6. Belvedere B, Bianchi M, Borghetti A, Paolone M (2009) A microcontroller-based automatic scheduling system for residential microgrids. In: Proceedings of the IEEE Power Technology. pp 1-6.
7. Bertsekas DP, Tsitsiklis JN (1996) Neuro-dynamic programming. Athena Scientific, MA.
8. Cau TDH, Kaye RJ (2001) Multiple distributed energy storage scheduling using constructive evolutionary programming. In: Proceedings of the IEEE international conference on power industry computer applications. pp 402-407.
9. Chacra FA, Bastard P, Fleury G, Clavreul R (2005) Impact of energy storage costs on economical performance in a distribution substation. IEEE Trans Power Syst 20(2): 684-691.
10. Chakraborty S, Weiss MD, Simoes MG (2007) Distributed intelligent energy management system for a single-phase high-frequency AC microgrid. IEEE Trans Ind Electron 54(1): 97-109.
11. Chiang SJ, Chang KT, Yen CY (1998) Residential photovoltaic energy storage system. IEEE Trans Ind Electron 45(3): 385-394.
12. ComEd, USA, http://www. thewattspot. com. Accessed 16 May 2010.
13. Corrigan PM, Heydt GT (2007) Optimized dispatch of a residential solar energy system. In: Proceedings of the North American Power Symposium. pp 4183-4188.
14. Cox C, Stepniewski S, Jorgensen C, Saeks R, Lewis C (1999) On the design of a neural network autolander. Int J Robust Nonlinear Control 9: 1071-1096.
15. Dalton J, Balakrishnan SN (1996) A neighboring optimal adaptive critic for missile guidance. Math Comput Model 23(1-2): 175-188.
16. Fung CC, Ho SCY, Nayar CV (1993) Optimisation of a hybrid energy system using simulated annealing technique. In: Proceedings of IEEE international conference on computer communtion control power engineering. pp 235-238.
17. Garrity TF (2008) Getting smart. IEEE Power Energy Mag 6(2): 38-45.
18. Hagan MT, Menhaj MB (1994) Training feedforward networks with the Marquardt algorithm. IEEE Trans Neural Netw 5(6): 989-993.
19. James M, Jacob B, Scott SG (2006) Dynamic analyses of regenerative fuel cell power for potential use in renewable residential applications. Int J Hydrogen Energy 31(8): 994-1009.
20. Klein KM, Springer PL, Black WZ (2010) Real-time ampacity and ground clearance software for integration into smart grid technology. IEEE Trans Power Deliv 25(3): 1768-1777.
21. Lee TY (2007) Operating schedule of battery energy storage system in a time-of-use rate industrial user with wind turbine generators: a multipass iteration particle swarm optimization approach. IEEE Trans Energy Convers 22(3): 774-782.
22. Lendaris GG, Paintz C (1997) Training strategies for critic and action neural networks in dual heuristic programming method. In: Proceedings of International Conference on Neural Network, pp. 712-717.
23. Li F, Qiao W, Sun H, Wan H, Wang J, Xia Y, Xu Z, Zhang P (2010) Smart transmission grid: vision and framework. IEEE Trans Smart Grid 1(2): 168-177.
24. Liu D, Xiong X, Zhang Y (2001) Action-dependent adaptive critic designs. In: Proceedings of the INNS-IEEE international joint conference on neural network. pp 990-995.
25. Liu D, Zhang Y, Zhang H (2005) A self-learning call admission control scheme for CDMA cellular networks. IEEE Trans Neural Netw 16(5): 1219-1228.
26. Liu D, Javaherian H, Kovalenko O, Huang T (2008) Adaptive critic learning techniques for engine torque and air-fuel ratio control. IEEE Trans Syst Man Cybern 38(4): 988-993.
27. Lo CH, Anderson MD (1999) Economic dispatch and optimal sizing of battery energy storage systems in utility load-leveling operations. IEEE Trans Energy Convers 14(3): 824-829.
28. Lu B, Shahidehpour M (2005) Short-term scheduling of battery in a grid-connected PV/battery system. IEEE Trans Power Syst 20(2): 1053-1061.
29. Lu C, Si J, Xie X (2008) Direct heuristic dynamic programming for damping oscillations in a large power system. IEEE Trans Syst Man Cybern B 38(4): 1008-1013.
30. Maly DK, Kwan KS (1995) Optimal battery energy storage system (BESS) charge scheduling with dynamic programming. IEE Proc Sci Meas Technol 142(6): 454-458.
31. Meliopoulos APS, Cokkinides G, Huang RK, Farantatos E, Choi S, Lee Y, Yu X (2011) Smart grid technologies for autonomous operation and control. IEEE Trans Smart Grid 2(1): 1-10.
32. Mohagheghi S, Valle Y, Venayagamoorthy GK, Harley RG (2007) A proportional-integrator type adaptive critic design-based neurocontroller for a static compensator in a multimachine power system. IEEE Trans Ind Electron 54(1): 86-96.
33. Mohsenian-Rad A, Wong VWS, Jatskevich J, Schober R, Leon-Garcia A (2010) Autonomous demand-side management based on game-theoretic energy consumption scheduling for the future smart grid. IEEE Trans on Smart Grid 1(3): 320-331.
34. Momoh JA, Wang Y, Eddy-Posey F (2004) Optimal power dispatch of photovoltaic system with random load In: Proceedings of IEEE Power Engineering Society. pp 1939-1945.
35. Murray JJ, Cox CJ, Lendaris GG, Saeks R (2002) Adaptive dynamic programming. IEEE Trans Syst Man Cybern Part C Appl Rev 32(2): 140-153.
36. Park JW, Harley RG, Venayagamoorthy GK (2003) Adaptive-critic-based optimal neurocontrol for synchronous generators in a power system using MLP/RBF neural networks. IEEE Trans Ind Electron 39(5): 1529-1540.
37. Prokhorov DV, Wunsch DC (1997) Adaptive critic designs. IEEE Trans Neural Netw 8(2): 997-1007.
38. Qiao W, Harley RG, Venayagamoorthy GK (2009) Coordinated reactive power control of a large wind farm and a STATCOM using heuristic dynamic programming. IEEE Trans Energy Convers 24(2): 493-503.
39. Roncero JR (2008) Integration is key to smart grid management. In: Proceedings of the IET-CIRED seminar smartgrids for distribution. pp 1-4.
40. Rupanagunta P, Baughman ML, Jones JW (1995) Scheduling of cool storage using non-linear programming techniques. IEEE Trans Power Syst 10(3): 1279-1285.
41. Sheble GB (2008) Smart grid millionaire. IEEE Power Energy Mag 6(1): 22-28.
42. Si J, Wang YT (2001) On-line learning control by association and reinforcement. IEEE Trans Neural Netw 12(2): 264-276.
43. Sutton RS, Barto AG (1998) Reinforcement learning: an introduction. The MIT Press, MA.
44. Urbina M, Li Z (2006) A fuzzy optimization approach to PV/battery scheduling with uncertainty in PV generation. In: Proceedings of the North American Power Symposium. pp 561-566.
45. Wakao S, Nakao K (2006) Reduction of fuel consumption in PV/diesel hybrid power generation system by dynamic programming combined with genetic algorithm. In: Proceedings of the 1st IEEE World Conference on PV Energy Conversion. pp 2335-2338.
46. Werbos PJ (1977) Advanced forecasting methods for global crisis warning and models of intelligence. Gen Syst Yearbook 22: 25-38.
47. Werbos PJ (1992) Approximate dynamic programming for real-time control and neural modeling. In: White DA, Sofge DA (eds) Handbook of intelligent control: neural, fuzzy and adaptive approaches. van Nostrand Reinhold, NY.
48. Yau T, Walker LN, Graham HL, Raithel R (1981) Effects of battery storage devices on power system dispatch. IEEE Trans Power Appl Syst PAS-100(1): 375-383.