메뉴 건너뛰기




Volumn 87, Issue 3, 2014, Pages 553-566

Erratum: Reinforcement learning for adaptive optimal control of unknown continuous-time nonlinear systems with input constraints (International Journal of Control,(2013), 10.1080/00207179.2013.848292);Reinforcement learning for adaptive optimal control of unknown continuous-time nonlinear systems with input constraints

Author keywords

adaptive control; input constraints; neural networks; optimal control; reinforcement learning

Indexed keywords

CLOSED LOOP SYSTEMS; CONTINUOUS TIME SYSTEMS; CONTROL NONLINEARITIES; DYNAMIC PROGRAMMING; DYNAMICAL SYSTEMS; NEURAL NETWORKS; NONLINEAR SYSTEMS; OPTIMAL CONTROL SYSTEMS; REINFORCEMENT LEARNING;

EID: 84893949931     PISSN: 00207179     EISSN: 13665820     Source Type: Journal    
DOI: 10.1080/00207179.2013.862419     Document Type: Erratum
Times cited : (182)

References (45)
  • 1
    • 14844340822 scopus 로고    scopus 로고
    • Nearly optimal control laws for nonlinear systems with saturating actuators using a neural network HJB approach
    • Abu-Khalaf, M., & Lewis, F.L. (2005). Nearly optimal control laws for nonlinear systems with saturating actuators using a neural network HJB approach. Automatica, 41, 779-791.
    • (2005) Automatica , vol.41 , pp. 779-791
    • Abu-Khalaf, M.1    Lewis, F.L.2
  • 2
    • 0004147916 scopus 로고
    • (2nd ed.). Massachusetts: Addison-Wesley
    • Apostol, T.M. (1974). Mathematical analysis (2nd ed.). Massachusetts: Addison-Wesley.
    • (1974) Mathematical Analysis
    • Apostol, T.M.1
  • 3
    • 0031332446 scopus 로고    scopus 로고
    • Galerkin approximations of the generalized Hamilton-Jacobi-Bellman equation
    • Beard, R., Saridis, G., & Wen, J. (1997). Galerkin approximations of the generalized Hamilton-Jacobi-Bellman equation. Automatica, 33, 2159-2177.
    • (1997) Automatica , vol.33 , pp. 2159-2177
    • Beard, R.1    Saridis, G.2    Wen, J.3
  • 4
    • 0003787146 scopus 로고
    • New Jersey: Princeton University Press
    • Bellman, R.E. (1957). Dynamic programming. New Jersey: Princeton University Press.
    • (1957) Dynamic Programming.
    • Bellman, R.E.1
  • 6
    • 84871319455 scopus 로고    scopus 로고
    • A novel actor-criticidentifier architecture for approximate optimal control of uncertain nonlinear systems
    • Bhasin, S., Kamalapurkar, R., Johnson, M., Vamvoudakis, K.G., Lewis, F.L., & Dixon, W.E. (2013). A novel actor-criticidentifier architecture for approximate optimal control of uncertain nonlinear systems. Automatica, 49, 82-92.
    • (2013) Automatica , vol.49 , pp. 82-92
    • Bhasin, S.1    Kamalapurkar, R.2    Johnson, M.3    Vamvoudakis, K.G.4    Lewis, F.L.5    Dixon, W.E.6
  • 7
    • 68149180889 scopus 로고    scopus 로고
    • Optimal control of unknown affine nonlinear discrete-time systems using offline-trained neural networks with proof of convergence
    • Dierks, T., Thumati, B.T., & Jagannathan, S. (2009). Optimal control of unknown affine nonlinear discrete-time systems using offline-trained neural networks with proof of convergence. Neural Networks, 22, 851-860.
    • (2009) Neural Networks , vol.22 , pp. 851-860
    • Dierks, T.1    Thumati, B.T.2    Jagannathan, S.3
  • 8
    • 39549084132 scopus 로고    scopus 로고
    • Neural network adaptive control for nonlinear uncertain dynamical systems with asymptotic stability guarantees
    • Hayakawa, T., Haddad, W.M., & Hovakimyan, N. (2008). Neural network adaptive control for nonlinear uncertain dynamical systems with asymptotic stability guarantees. IEEE Transactions on Neural Networks, 19, 80-89.
    • (2008) IEEE Transactions on Neural Networks , vol.19 , pp. 80-89
    • Hayakawa, T.1    Haddad, W.M.2    Hovakimyan, N.3
  • 9
    • 0024880831 scopus 로고
    • Multilayer feedforward neural networks are universal approximators
    • Hornic, K., & Stinchombe, M. (1989). Multilayer feedforward neural networks are universal approximators. Neural Networks, 2, 359-366.
    • (1989) Neural Networks , vol.2 , pp. 359-366
    • Hornic, K.1    Stinchombe, M.2
  • 11
    • 78650326265 scopus 로고    scopus 로고
    • An integrated optimal control algorithm for discrete-time nonlinear stochastic system
    • Kek, S.L., Teo, K.L., & Ismail, A.A. (2010). An integrated optimal control algorithm for discrete-time nonlinear stochastic system. International Journal of Control, 83, 2536-2545.
    • (2010) International Journal of Control , vol.83 , pp. 2536-2545
    • Kek, S.L.1    Teo, K.L.2    Ismail, A.A.3
  • 12
    • 84856363414 scopus 로고    scopus 로고
    • An almost optimal control design method for nonlinear time-delay systems
    • Koshkouei, A.J., Farahi, M.H., & Burnham, K.J. (2012). An almost optimal control design method for nonlinear time-delay systems. International Journal of Control, 85, 147-158.
    • (2012) International Journal of Control , vol.85 , pp. 147-158
    • Koshkouei, A.J.1    Farahi, M.H.2    Burnham, K.J.3
  • 16
    • 70349116541 scopus 로고    scopus 로고
    • Reinforcement learning and adaptive dynamic programming for feedback control
    • Lewis, F.L., & Vrabie, D. (2009). Reinforcement learning and adaptive dynamic programming for feedback control. IEEE Circuits and Systems Magazine, 9, 32-50.
    • (2009) IEEE Circuits and Systems Magazine , vol.9 , pp. 32-50
    • Lewis, F.L.1    Vrabie, D.2
  • 17
    • 79954867546 scopus 로고    scopus 로고
    • Optimality and convergence of adaptive optimal control by reinforcement synthesis
    • Lin, W. (2011). Optimality and convergence of adaptive optimal control by reinforcement synthesis. Automatica, 47, 1047-1052.
    • (2011) Automatica , vol.47 , pp. 1047-1052
    • Lin, W.1
  • 18
    • 84865457158 scopus 로고    scopus 로고
    • Constrained adaptive optimal control using a reinforcement learning agent
    • Lin,W.,&Zheng, C. (2012). Constrained adaptive optimal control using a reinforcement learning agent. Automatica, 48, 2614-2619.
    • (2012) Automatica , vol.48 , pp. 2614-2619
    • Lin, W.1    Zheng, C.2
  • 19
    • 84876066909 scopus 로고    scopus 로고
    • Neural-network-based zerosum game for discrete-time nonlinear systems via iterative adaptive dynamic programming algorithm
    • Liu, D., Li, H., & Wang, D. (2013). Neural-network-based zerosum game for discrete-time nonlinear systems via iterative adaptive dynamic programming algorithm. Neurocomputing, 110, 92-100.
    • (2013) Neurocomputing , vol.110 , pp. 92-100
    • Liu, D.1    Li, H.2    Wang, D.3
  • 20
    • 84887472008 scopus 로고    scopus 로고
    • Adaptive optimal control for a class of continuous-time affine nonlinear systems with unknown internal dynamics
    • doi: 10.1007/s00521-012-1249-y
    • Liu, D., Yang, X., & Li, H. (2012). Adaptive optimal control for a class of continuous-time affine nonlinear systems with unknown internal dynamics. Neural Computing and Applications, doi: 10.1007/s00521-012-1249-y.
    • (2012) Neural Computing and Applications
    • Liu, D.1    Yang, X.2    Li, H.3
  • 21
    • 84868467610 scopus 로고    scopus 로고
    • An iterative adaptive dynamic programming algorithm for optimal control of unknown discrete-time nonlinear systems with constrained inputs
    • Liu, D., Wang, D., & Yang, X. (2013). An iterative adaptive dynamic programming algorithm for optimal control of unknown discrete-time nonlinear systems with constrained inputs. Information Sciences, 220, 331-342.
    • (2013) Information Sciences , vol.220 , pp. 331-342
    • Liu, D.1    Wang, D.2    Yang, X.3
  • 22
    • 84881555023 scopus 로고    scopus 로고
    • Finite-approximation-error-based optimal control approach for discrete-time nonlinear systems
    • Liu, D., & Wei, Q. (2013). Finite-approximation-error-based optimal control approach for discrete-time nonlinear systems. IEEE Transactions on Cybernetics, 43, 779-789.
    • (2013) IEEE Transactions on Cybernetics , vol.43 , pp. 779-789
    • Liu, D.1    Wei, Q.2
  • 23
    • 84881324637 scopus 로고    scopus 로고
    • Optimal control of nonlinear continuoustime systems: Design of bounded controllers via generalized nonquadratic functionals
    • Philadelphia, PA
    • Lyshevski, S.E. (1998). Optimal control of nonlinear continuoustime systems: Design of bounded controllers via generalized nonquadratic functionals. In Proceedings of American Control Conference (pp. 205-209). Philadelphia, PA.
    • (1998) Proceedings of American Control Conference , pp. 205-209
    • Lyshevski, S.E.1
  • 24
    • 84899093084 scopus 로고    scopus 로고
    • Online solution of nonquadratic two-player zero-sum games arising in the H8 control of constrained input systems
    • doi: 10.1002/acs.2348
    • Modares, H., Lewis, F.L., & Sistani, M. (2012). Online solution of nonquadratic two-player zero-sum games arising in the H8 control of constrained input systems. International Journal of Adaptive Control and Signal Processing, doi: 10.1002/acs.2348.
    • (2012) International Journal of Adaptive Control and Signal Processing
    • Modares, H.1    Lewis, F.L.2    Sistani, M.3
  • 26
    • 33751238181 scopus 로고    scopus 로고
    • A single network adaptive critic (SNAC) architecture for optimal control synthesis for a class of nonlinear systems
    • Padhi, R., Unnikrishnan, N., Wang, X., & Balakrishnan, S.N. (2006). A single network adaptive critic (SNAC) architecture for optimal control synthesis for a class of nonlinear systems. Neural Networks, 19, 1648-1660.
    • (2006) Neural Networks , vol.19 , pp. 1648-1660
    • Padhi, R.1    Unnikrishnan, N.2    Wang, X.3    Balakrishnan, S.N.4
  • 29
    • 84856320183 scopus 로고    scopus 로고
    • Nonlinear and locally optimal controllers design for input affine locally controllable systems
    • Sahnoun, M., Andrieu, V., & Nadri, M. (2012). Nonlinear and locally optimal controllers design for input affine locally controllable systems. International Journal of Control, 85, 159-170.
    • (2012) International Journal of Control , vol.85 , pp. 159-170
    • Sahnoun, M.1    Andrieu, V.2    Nadri, M.3
  • 30
    • 0035273403 scopus 로고    scopus 로고
    • On-line learning control by association and reinforcement
    • Si, J.,& Wang,Y.T. (2001).On-line learning control by association and reinforcement. IEEE Transactions on Neural Networks, 12, 264-276.
    • (2001) IEEE Transactions on Neural Networks , vol.12 , pp. 264-276
    • Si, J.1    Wang, Y.T.2
  • 31
    • 84893968025 scopus 로고    scopus 로고
    • Reinforcement learning-an introduction. Massachusetts: MIT Press. Vamvoudakis, K.G., & Lewis, F.L. (2010). Online actor-critic algorithm to solve the continuous-time infinite horizon optimal control problem
    • Sutton, R.S., & Barto, A.G. (1998). Reinforcement learning-an introduction. Massachusetts: MIT Press. Vamvoudakis, K.G., & Lewis, F.L. (2010). Online actor-critic algorithm to solve the continuous-time infinite horizon optimal control problem. Automatica, 46, 878-888.
    • (1998) Automatica , vol.46 , pp. 878-888
    • Sutton, R.S.1    Barto, A.G.2
  • 32
    • 78651311269 scopus 로고    scopus 로고
    • Adaptive dynamic programming for finite horizon optimal control of discretetime nonlinear systems with ?-error bound
    • Wang, F.Y., Jin, N., Liu, D., & Wei, Q. (2011). Adaptive dynamic programming for finite horizon optimal control of discretetime nonlinear systems with ?-error bound. IEEE Transactions on Neural Networks, 22, 24-36.
    • (2011) IEEE Transactions on Neural Networks , vol.22 , pp. 24-36
    • Wang, F.Y.1    Jin, N.2    Liu, D.3    Wei, Q.4
  • 33
    • 84864489666 scopus 로고    scopus 로고
    • Optimal control of unknown nonaffine nonlinear discrete-time systems based on adaptive dynamic programming
    • Wang, D., Liu, D., Wei, Q., Zhao, D., & Jin, N. (2012). Optimal control of unknown nonaffine nonlinear discrete-time systems based on adaptive dynamic programming. Automatica, 48, 1825-1832.
    • (2012) Automatica , vol.48 , pp. 1825-1832
    • Wang, D.1    Liu, D.2    Wei, Q.3    Zhao, D.4    Jin, N.5
  • 35
    • 84862811062 scopus 로고    scopus 로고
    • An iterative ?-optimal control scheme for a class of discrete-time nonlinear systems with unfixed initial state
    • Wei, Q., & Liu, D. (2012). An iterative ?-optimal control scheme for a class of discrete-time nonlinear systems with unfixed initial state. Neural Networks, 32, 236-244.
    • (2012) Neural Networks , vol.32 , pp. 236-244
    • Wei, Q.1    Liu, D.2
  • 37
    • 0002557583 scopus 로고
    • Advanced forecasting methods for global crisis warning and models of intelligence
    • Werbos, P.J. (1977). Advanced forecasting methods for global crisis warning and models of intelligence. General Systems Yearbook, 22, 25-38.
    • (1977) General Systems Yearbook , vol.22 , pp. 25-38
    • Werbos, P.J.1
  • 38
    • 0002031779 scopus 로고
    • Approximate dynamic programming for realtime control and neural modeling
    • In D.A. White & D.A. Sofge (Eds.), New York: Van Nostrand Reinhold
    • Werbos, P.J. (1992). Approximate dynamic programming for realtime control and neural modeling. In D.A. White & D.A. Sofge (Eds.), Handbook of intelligent control: Neural, fuzzy, and adaptive approaches. New York: Van Nostrand Reinhold.
    • (1992) Handbook of Intelligent Control: Neural, Fuzzy, and Adaptive Approaches
    • Werbos, P.J.1
  • 39
    • 0029346234 scopus 로고
    • Reinforcement learning control using interconnected learning automata
    • Wu, Q.H. (1995). Reinforcement learning control using interconnected learning automata. International Journal of Control, 62, 1-16.
    • (1995) International Journal of Control , vol.62 , pp. 1-16
    • Wu, Q.H.1
  • 40
    • 76249131616 scopus 로고    scopus 로고
    • Integrated nonlinear optimal control of spacecraft in proximity operations
    • Xin, M., & Pan, H. (2010). Integrated nonlinear optimal control of spacecraft in proximity operations. International Journal of Control, 83, 347-363.
    • (2010) International Journal of Control , vol.83 , pp. 347-363
    • Xin, M.1    Pan, H.2
  • 42
    • 0035273045 scopus 로고    scopus 로고
    • Some newresults on system identification with dynamic neural network
    • Yu,W., & Li, X. (2001). Some newresults on system identification with dynamic neural network. IEEE Transactions on Neural Networks, 2, 412-417.
    • (2001) IEEE Transactions on Neural Networks , vol.2 , pp. 412-417
    • Yu, W.1    Li, X.2
  • 43
    • 83655163786 scopus 로고    scopus 로고
    • Data-driven robust approximate optimal tracking control for unknown general nonlinear systems using adaptive dynamic programming method
    • Zhang, H., Cui, L., Zhang, X., & Luo, Y. (2011). Data-driven robust approximate optimal tracking control for unknown general nonlinear systems using adaptive dynamic programming method. IEEE Transactions on Neural Networks, 22, 2226-2236.
    • (2011) IEEE Transactions on Neural Networks , vol.22 , pp. 2226-2236
    • Zhang, H.1    Cui, L.2    Zhang, X.3    Luo, Y.4
  • 45
    • 78650805234 scopus 로고    scopus 로고
    • An iterative adaptive dynamic programming method for solving a class of nonlinear zero-sum differential games
    • Zhang, H., Wei, Q., & Liu, D. (2011). An iterative adaptive dynamic programming method for solving a class of nonlinear zero-sum differential games. Automatica, 47, 207-214.
    • (2011) Automatica , vol.47 , pp. 207-214
    • Zhang, H.1    Wei, Q.2    Liu, D.3


* 이 정보는 Elsevier사의 SCOPUS DB에서 KISTI가 분석하여 추출한 것입니다.