Multibattery optimal coordination control for home energy management systems via distributed iterative adaptive dynamic programming

IEEE Transactions on Industrial Electronics

Volumn 62, Issue 7, 2015, Pages 4203-4214

  Wei, Qinglai ^a   Liu, Derong ^a   Shi, Guang ^a   Liu, Yu ^a  

^a INSTITUTE OF AUTOMATION   (China)

Author keywords

Adaptive critic designs; adaptive dynamic programming; approximate dynamic programming; distributed optimal control; smart grid; smart home

Indexed keywords

ADAPTIVE CONTROL SYSTEMS; ALGORITHMS; AUTOMATION; DISTRIBUTED COMPUTER SYSTEMS; ENERGY MANAGEMENT; ENERGY MANAGEMENT SYSTEMS; INTELLIGENT BUILDINGS; ITERATIVE METHODS; OPTIMAL CONTROL SYSTEMS; OPTIMIZATION;

ADAPTIVE CRITIC DESIGNS; ADAPTIVE DYNAMIC PROGRAMMING; APPROXIMATE DYNAMIC PROGRAMMING; DISTRIBUTED OPTIMAL CONTROL; SMART GRID; SMART HOMES;

DYNAMIC PROGRAMMING;

EID: 84930506123     PISSN: 02780046     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIE.2014.2388198     Document Type: Article

References (46)

1. N. Liu, J. Chen, L. Zhu, J. Zhang, and Y. He, "A key management scheme for secure communications of advanced metering infrastructure in smart grid," IEEE Trans. Ind. Electron., vol. 60, no. 10, pp. 4746-4756, Oct. 2013.
2. X. Lu, K. Sun, J. M. Guerrero, J. C. Vasquez, and L. Huang, "State-of-charge balance using adaptive droop control for distributed energy storage systems in DC microgrid applications," IEEE Trans. Ind. Electron., vol. 61, no. 6, pp. 2804-2815, Jun. 2014.
3. J. Mei et al., "A new selective loop Bias mapping phase disposition PWM with dynamic voltage balance capability for modular multilevel converter," IEEE Trans. Ind. Electron., vol. 61, no. 2, pp. 798-807, Feb. 2014.
4. T. S. Ustun, A. Zayegh, and C. Ozansoy, "Electric vehicle potential in Australia: Its impact on smartgrids," IEEE Trans. Ind. Electron., vol. 7, no. 4, pp. 15-25, Dec. 2013, vol. 4.
5. S. Vazquez, J. A. Sanchez, M. R. Reyes, J. I. Leon, and J. M. Carrasco, "Adaptive vectorial filter for grid synchronization of power converters under unbalanced and/or distorted grid conditions," IEEE Trans. Ind. Electron., vol. 61, no. 3, pp. 1355-1367, Mar. 2014.
6. B. Zhao, Q. Song, W. Liu, and Y. Xiao, "Next-generation multi-functional modular intelligent UPS system for smart grid," IEEE Trans. Ind. Electron., vol. 60, no. 9, pp. 3602-3618, Sep. 2013.
7. L. Jian et al., "Regulated charging of plug-in hybrid electric vehicles for minimizing load variance in household smart microgrid," IEEE Trans. Ind. Electron., vol. 60, no. 8, pp. 3218-3226, Aug. 2013.
8. C. Molitor et al., "Multiphysics test bed for renewable energy systems in smart homes," IEEE Trans. Ind. Electron., vol. 60, no. 3, pp. 1235-1248, Mar. 2013.
9. F. D. Angelis et al., "Optimal home energy management under dynamic electrical and thermal constraints," IEEE Trans. Ind. Informat., vol. 9, no. 3, pp. 1518-1527, Aug. 2013.
10. H. S. V. S. Kumar Nunna and S. Doolla, "Multiagent-based distributed-energy-resource management for intelligent microgrids," IEEE Trans. Ind. Electron., vol. 60, no. 4, pp. 1678-1687, Apr. 2013.
11. S. N. Motapon, L. A. Dessaint, and K. Al-Haddad, "A comparative study of energy management schemes for a fuel-cell hybrid emergency power system of more-electric aircraft," IEEE Trans. Ind. Electron., vol. 61, no. 3, pp. 1320-1334, Mar. 2014.
12. H. Rahimi-Eichi, F. Baronti, and M. Chow, "Online adaptive parameter identification and state-of-charge coestimation for lithium-polymer battery cells," IEEE Trans. Ind. Electron., vol. 61, no. 4, pp. 2053-2061, Apr. 2014.
13. H. Babazadeh, B. Asghari, and R. Sharma, "A new control scheme in a multi-battery management system for expanding microgrids," in Proc. IEEE PES ISGT, Washington, DC, USA, Feb. 2014, pp. 1-5.
14. H. Rahimi-Eichi, U. Ojha, F. Baronti, and M. Chow, "Battery management system: An overview of its application in the smart grid and electric vehicles," IEEE Ind. Electron. Mag., vol. 7, no. 2, pp. 4-16, Jun. 2013.
15. P. J. Werbos, "Advanced forecasting methods for global crisis warning and models of intelligence," Gen. Syst. Yearbook, vol. 22, pp. 25-38, 1977.
16. P. J. Werbos, "A menu of designs for reinforcement learning over time," in Neural Networks for Control, W. T. Miller, R. S. Sutton, and P. J. Werbos, Eds. Cambridge, MA, USA: MIT Press, 1991, pp. 67-95.
17. A. Heydari and S. N. Balakrishnan, "Finite-horizon control-constrained nonlinear optimal control using single network adaptive critics," IEEE Trans. Neural Netw. Learn. Syst., vol. 24, no. 1, pp. 145-157, Jan. 2013.
18. D. Liu and Q. Wei, "Finite-approximation-error-based optimal control approach for discrete-time nonlinear systems," IEEE Trans. Cybern., vol. 43, no. 2, pp. 779-789, Apr. 2013.
19. D. Liu and Q. Wei, "Policy iteration adaptive dynamic programming algorithm for discrete-time nonlinear systems," IEEE Trans. Neural Netw. Learn. Syst., vol. 25, no. 3, pp. 621-634, Mar. 2014.
20. Q. Wei and D. Liu, "Data-driven neuro-optimal temperature control of water gas shift reaction using stable iterative adaptive dynamic programming," IEEE Trans. Ind. Electron., vol. 61, no. 11, pp. 6399-6408, Nov. 2014.
21. Q. Wei and D. Liu, "Numerically adaptive learning control scheme for discrete-time nonlinear systems," IET Control Theory Appl., vol. 7, no. 11, pp. 1472-1486, Jul. 2013.
22. Q. Wei and D. Liu, "Stable iterative adaptive dynamic programming algorithm with approximation errors for discrete-time nonlinear systems," Neural Comput. Appl., vol. 24, no. 6, pp. 1355-1367, May 2014.
23. Q. Wei and D. Liu, "A novel iterative θ-adaptive dynamic programming for discrete-time nonlinear systems," IEEE Trans. Autom. Sci. Eng., vol. 11, no. 4, pp. 1176-1190, Oct. 2014.
24. Q. Wei and D. Liu, "An iterative ∈-optimal control scheme for a class of discrete-time nonlinear systems with unfixed initial state," Neural Netw., vol. 32, pp. 236-244, Aug. 2012.
25. Q. Wei, D. Wang, and D. Zhang, "Dual iterative adaptive dynamic programming for a class of discrete-time nonlinear systems with time-delays," Neural Comput. Appl., vol. 23, no. 7/8, pp. 1851-1863, Dec. 2013.
26. Q. Wei, D. Liu, and G. Shi, "A novel dual iterative Q-learning method for optimal battery management in smart residential environments," IEEE Trans. Ind. Electron., vol. 62, no. 4, pp. 2509-2518, Apr. 2015.
27. Q. Wei and D. Liu, "Neural-network-based adaptive optimal tracking control scheme for discrete-time nonlinear systems with approximation errors," Neurocomputing, vol. 149, pp. 106-115, Feb. 2015.
28. Q. Wei, F. Wang, D. Liu, and X. Yang, "Finite-approximation-error based discrete-time iterative adaptive dynamic programming," IEEE Trans. Cybern., vol. 44, no. 12, pp. 2820-2833, Dec. 2014.
29. Q.Wei and D. Liu, "Adaptive dynamic programming for optimal tracking control of unknown nonlinear systems with application to coal gasification," IEEE Trans. Autom. Sci. Eng., vol. 11, no. 4, pp. 1020-1036, Oct. 2014.
30. Q. Wei, D. Liu, and Y. Xu, "Neuro-optimal tracking control for a class of discrete-time nonlinear systems via generalized value iteration adaptive dynamic programming approach," Soft Comput., DOI: 10.1007/s00500-014-1533-0, to be published.
31. D. Liu and Q. Wei, "Multi-person zero-sum differential games for a class of uncertain nonlinear systems," Int. J. Adapt. Control Signal Process., vol. 28, no. 3-5, pp. 205-231, Mar.-May 2014.
32. H. Zhang, F. L. Lewis, and Z. Qu, "Lyapunov, adaptive, optimal design techniques for cooperative systems on directed communication graphs," IEEE Trans. Ind. Electron., vol. 59, no. 7, pp. 3026-3041, Jul. 2012.
33. D. Molina, G. K. Venayagamoorthy, J. Liang, and R. G. Harley, "Intelligent local area signals based damping of power system oscillations using virtual generators and approximate dynamic programming," IEEE Trans. Smart Grid, vol. 4, no. 1, pp. 498-508, Mar. 2013.
34. T. Huang and D. Liu, "A self-learning scheme for residential energy system control and management," Neural Comput. Appl., vol. 22, no. 2, pp. 259-269, Feb. 2013.
35. M. Boaro et al., "Adaptive dynamic programming algorithm for renewable energy scheduling and battery management," Cogn. Comput., vol. 5, no. 2, pp. 264-277, Jun. 2013.
36. D. Fuselli et al., "Action dependent heuristic dynamic programming for home energy resource scheduling," Int. J. Elect. Power Energy Syst., vol. 48, pp. 148-160, Jun. 2013.
37. P. Ouyang, S. Yin, L. Liu, and S. Wei, "Battery aware tasks allocating algorithm for multi-battery operated system," in Proc. IEEE APCCAS, Kuala Lumpur, Malaysia, Dec. 2010, pp. 875-878.
38. T. Yau, L. N. Walker, H. L. Graham, and R. Raithel, "Effects of battery storage devices on power system dispatch," IEEE Trans. Power App. Syst., vol. PAS-100, no. 1, pp. 375-383, Jan. 1981.
39. T. Y. Lee, "Operating schedule of battery energy storage system in a time-of-use rate industrial user with wind turbine generators: A multi-pass iteration particle swarm optimization approach," IEEE Trans. Energy Convers., vol. 22, no. 3, pp. 774-782, Sep. 2007.
40. R. E. Bellman, Dynamic Programming. Princeton, NJ, USA: Princeton Univ. Press, 1957.
41. A. Al-Tamimi, F. L. Lewis, and M. Abu-Khalaf, "Discrete-time nonlinear HJB solution using approximate dynamic programming: Convergence proof," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 38, no. 4, pp. 943-949, Aug. 2008.
42. B. Lincoln and A. Rantzer, "Relaxing dynamic programming," IEEE Trans. Autom. Control, vol. 51, no. 8, pp. 1249-1260, Aug. 2006.
43. T. M. Apostol, Mathematical Analysis., 2nd ed. Boston, MA, USA: Addison-Wesley, 1974.
44. Data of electricity rate from ComEd Company, USA . [Online]. Available: https://rrtp.comed.com/live-prices/?.
45. NAHB Research Center, Inc., Review of residential electrical energy use data, Upper Marlboro, MD, USA, Jul. 16, 2001. [Online]. Available: http://www.toolbase.org/PDF/CaseStudies/Res-Electrical-EnergyUseData.pdf
46. J. Si and Y.-T. Wang, "On-line learning control by association and reinforcement," IEEE Trans. Neural Netw., vol. 12, no. 2, pp. 264-276, Mar. 2001.