Approximate optimal control design for nonlinear one-dimensional parabolic PDE systems using empirical eigenfunctions and neural network

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 42, Issue 6, 2012, Pages 1538-1549

  Luo, Biao ^a   Wu, Huai Ning ^a  

^a BEIHANG UNIVERSITY   (China)

Author keywords

Hamilton Jacobi Bellman (HJB) equation; Karhunen Lo ve decomposition (KLD); neural network (NN); nonlinear parabolic partial differential equation (PDE) systems; optimal control; singular perturbation (SP)

Indexed keywords

ALGEBRAIC RICCATI EQUATIONS; CLOSED-LOOP; DIFFUSION-REACTION PROCESS; EMPIRICAL EIGENFUNCTIONS; HAMILTON-JACOBI-BELLMAN; HAMILTON-JACOBI-BELLMAN EQUATIONS; HIGH-ORDER; NONLINEAR PARABOLIC PARTIAL DIFFERENTIAL EQUATIONS; OPTIMAL CONTROL DESIGN; OPTIMAL CONTROL LAW; OPTIMAL CONTROL METHODS; OPTIMAL CONTROL PROBLEM; OPTIMAL CONTROLLER; OPTIMAL CONTROLS; PARABOLIC PARTIAL DIFFERENTIAL EQUATIONS; PARABOLIC PDES; REDUCED ORDER MODELS; SINGULAR PERTURBATIONS; SPATIAL DIFFERENTIAL OPERATORS; SUCCESSIVE APPROXIMATIONS;

APPROXIMATION THEORY; ASYMPTOTIC STABILITY; CONTROL; EIGENVALUES AND EIGENFUNCTIONS; NEURAL NETWORKS; OPTIMAL CONTROL SYSTEMS; ORDINARY DIFFERENTIAL EQUATIONS; PARTIAL DIFFERENTIAL EQUATIONS; RICCATI EQUATIONS;

NONLINEAR EQUATIONS;

EID: 84869489097     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2012.2194781     Document Type: Article

References (49)

1. F. L. Lewis and V. L. Syrmos, Optimal Control. New York:Wiley, 1995.
2. D. P. Bertsekas, Dynamic Programming and Optimal Control, 3rd ed. Nashua, NH: Athena Scientific, 2005.
3. A. G. Butkovskiy, Distributed Control Systems. New York: American Elsevier, 1969.
4. P. K. C. Wang and F. Tung, "Optimum control of distributed parameter systems," J. Basic Eng., vol. 86, no. 1, pp. 67-79, Mar. 1964.
5. J. L. Lions, Optimal Control of Systems Governed by Partial Differential Equations. New York: Springer-Verlag, 1971.
6. H. O. Fattorini, Infinite Dimensional Optimization Theory and Optimal Control. Cambridge, U.K.: Cambridge Univ. Press, 1999.
7. X. Li and J. Yong, Optimal Control Theory for Infinite Dimensional Systems. Boston, MA: Birkhäuser, 1995.
8. R. F. Curtain and H. J. Zwart, An Introduction to Infinite-Dimensional Linear Systems Theory. New York: Springer-Verlag, 1995.
9. I. Aksikas, A. Fuxman, J. F. Forbes, and J. J. Winkin, "LQ control design of a class of hyperbolic PDE systems: Application to fixed-bed reactor," Automatica, vol. 45, no. 6, pp. 1542-1548, Jun. 2009.
10. I. Aksikas, J. J. Winkin, and D. Dochain, "Optimal LQ-feedback regulation of a nonisothermal plug flow reactor model by spectral factorization," IEEE Trans. Autom. Control, vol. 52, no. 7, pp. 1179-1193, Jul. 2007. (Pubitemid 47098931)
11. W. H. Ray, Advanced Process Control. New York: McGraw-Hill, 1981.
12. M. Li and P. D. Christofides, "An input/output approach to the optimal transition control of a class of distributed chemical reactors," Chem. Eng. Sci., vol. 62, no. 11, pp. 2979-2988, 2007. (Pubitemid 46653861)
13. M. Li and P. D. Christofides, "Optimal control of diffusion-convection- reaction processes using reduced-order models," Comput. Chem. Eng., vol. 32, no. 9, pp. 2123-2135, Sep. 2008.
14. C. Xu, Y. Ou, and E. Schuster, "Sequential linear quadratic control of bilinear parabolic PDEs based on POD model reduction," Automatica, vol. 47, no. 2, pp. 418-426, Feb. 2011.
15. I. S. Sadek and M. A. Bokhari, "Optimal control of a parabolic distributed parameter system via orthogonal polynomials," Optim. Control Appl. Methods, vol. 19, no. 3, pp. 205-213, May/Jun. 1998. (Pubitemid 128467243)
16. S. S. Ravindran, "A reduced-order approach for optimal control of fluids using proper orthogonal decomposition," Int. J. Numer. Method Fluid, vol. 34, no. 5, pp. 425-448, Nov. 2000.
17. V. Yadav, R. Padhi, and S. N. Balakrishnan, "Robust/optimal temperature profile control of a high-speed aerospace vehicle using neural networks," IEEE Trans. Neural Netw., vol. 18, no. 4, pp. 1115-1128, Jul. 2007. (Pubitemid 47098885)
18. R. Padhi, S. N. Balakrishnan, and T. Randolph, "Adaptive-critic based optimal neuro control synthesis for distributed parameter systems," Automatica, vol. 37, no. 8, pp. 1223-1234, 2001. (Pubitemid 32610253)
19. R. Padhi and S. N. Balakrishnan, "Proper orthogonal decomposition based optimal neurocontrol synthesis of a chemical reactor process using approximate dynamic programming," J. Neural Netw., vol. 16, no. 5/6, pp. 719-728, Jun. 2003. (Pubitemid 36794346)
20. J. Baker and P. D. Christofides, "Finite-dimensional approximation and control of nonlinear parabolic PDE systems," Int. J. Control, vol. 73, no. 5, pp. 439-456, 2000. (Pubitemid 35395437)
21. J. Baker and P. D. Christofides, "Output feedback control of parabolic PDE systems with nonlinear spatial differential operators," Ind. Eng. Chem. Res., vol. 38, no. 11, pp. 4372-4380, Nov. 1999.
22. A. Armaou and P. D. Christofides, "Dynamic optimization of dissipative PDE systems using nonlinear order reduction," Chem. Eng. Sci., vol. 57, no. 24, pp. 5083-5114, Dec. 2002. (Pubitemid 35436890)
23. H.-X. Li and C. K. Qi, Spatio-Temporal Modeling of Nonlinear Distributed Parameter Systems: A Time/Space Separation Based Approach. New York: Springer-Verlag, 2011.
24. P. Holmes, J. L. Lumley, and G. Berkooz, Turbulence, Coherent Structures, Dynamical Systems and Symmetry. Cambridge, U.K.: Cambridge Univ. Press, 1996.
25. L. G. Bleris and M. V. Kothare, "Low-order empirical modeling of distributed parameter systems using temporal and spatial eigenfunctions," Comput. Chem. Eng., vol. 29, no. 4, pp. 817-827, Mar. 2005. (Pubitemid 40432107)
26. D. H. Gay and W. H. Ray, "Identification and control of distributed parameter systems by means of the singular value decomposition," Chem. Eng. Sci., vol. 50, no. 10, pp. 1519-1539, May 1995.
27. D. G. Zheng, "System identification and model-based control for a class of distributed parameter systems," Ph.D. dissertation, Texas Tech Univ., Lubbock, TX, 2003.
28. B. Widrow, N. K. Gupta, and S. Maitra, "Punish/reward: Learning with a critic in adaptive threshold systems," IEEE Trans. Syst., Man, Cybern., vol. SMC-3, no. 5, pp. 455-465, Sep. 1973.
29. J. Seiffertt, S. Sanyal, and D. C. Wunsch, "Hamilton-Jacobi-Bellman equations and approximate dynamic programming on time scales," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 38, no. 4, pp. 918-923, Aug. 2008.
30. H. Zhang, Q. Wei, and Y. Luo, "A novel infinite-time optimal tracking control scheme for a class of discrete-time nonlinear systems via the greedy HDP iteration algorithm," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 38, no. 4, pp. 937-942, Aug. 2008.
31. A. Al-Tamimi, M. Abu-Khalaf, and F. L. Lewis, "Adaptive critic designs for discrete-time zero-sum games with application to H∞ control," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 37, no. 1, pp. 240-247, Feb. 2007. (Pubitemid 46358495)
32. A. Al-Tamimi, F. L. Lewis, and M. Abu-Khalaf, "Discrete-time nonlinear HJB solution using approximate dynamic programming convergence proof," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 38, no. 4, pp. 943-949, Aug. 2008.
33. F. L. Lewis and K. G. Vamvoudakis, "Reinforcement learning for partially observable dynamic processes: Adaptive dynamic programming using measured output data," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 41, no. 1, pp. 14-25, Feb. 2011.
34. H. Zhang and Y. Luo, "Neural-network-based near-optimal control for a class of discrete-time affine nonlinear systems with control constraints," IEEE Trans. Neural Netw., vol. 20, no. 9, pp. 1490-1503, Sep. 2009.
35. D. V. Prokhorov and D. C. Wunsch, II, "Adaptive critic designs," IEEE Trans. Neural Netw., vol. 8, no. 5, pp. 997-1007, Sep. 1997. (Pubitemid 127763331)
36. F. L. Lewis, D. Liu, and G. G. Lendaris, "Special issue on adaptive dynamic programming and reinforcement learning in feedback control," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 38, no. 4, pp. 896-897, Aug. 2008.
37. G. Saridis and C. S. Lee, "An approximation theory of optimal control for trainable manipulators," IEEE Trans. Syst., Man, Cybern., vol. 9, no. 3, pp. 152-159, Mar. 1979. (Pubitemid 9438017)
38. R. W. Beard, G. N. Saridis, and J. Wen, "Galerkin approximations of the generalized Hamilton-Jacobi-Bellman equation," Automatica, vol. 33, no. 12, pp. 2159-2177, Dec. 1997.
39. R. W. Beard, G. N. Saridis, and J. Wen, "Approximate solutions to the time-invariant Hamilton-Jacobi-Bellman equation," J. Optimiz. Theory Appl., vol. 96, no. 3, pp. 589-626, Mar. 1998.
40. M. Abu-Khalaf and F. L. Lewis, "Nearly optimal state feedback control of constrained nonlinear systems using a neural network HJB approach," IFAC Annu. Rev. Control, vol. 28, no. 2, pp. 239-251, 2004.
41. M. Abu-Khalaf and F. L. Lewis, "Nearly optimal control laws for nonlinear systems with saturating actuators using a neural network HJB approach," Automatica, vol. 41, no. 5, pp. 779-791, May 2005. (Pubitemid 40352391)
42. T. Cheng, F. L. Lewis, and M. Abu-Khalaf, "A neural network solution for fixed-final time optimal control of nonlinear systems," Automatica, vol. 43, no. 3, pp. 482-490, Mar. 2007. (Pubitemid 46209051)
43. T. Cheng, F. L. Lewis, and M. Abu-Khalaf, "Fixed-final time constrained optimal control of nonlinear systems using neural network HJB approach," IEEE Trans. Neural Netw., vol. 18, no. 6, pp. 1725-1737, Nov. 2007. (Pubitemid 350148423)
44. M. Renardy and R. C. Rogers, An Introduction to Partial Differential Equations. New York: Springer-Verlag, 1993.
45. A. J. Newman, "Model reduction via the Karhunen-Loève expansion Part II: Some elementary examples," Inst. Syst. Res., College Park, MD, TR 96-33, 1996.
46. J. Mercer, "Functions of positive and negative type and their connection with the theory of integral equations," Philos. Trans. Roy. Soc. London A, Math. Phys. Sci., vol. 209, no. 1909, pp. 415-446, 1909.
47. H. K. Khalil, Nonlinear Systems, 3rd ed. Upper Saddle River, NJ: Prentice-Hall, 2002.
48. P. D. Christofides and P. Daoutidis, "Finite-dimensional control of parabolic PDE systems using approximate inertial manifolds," J. Math. Anal. Appl., vol. 216, no. 2, pp. 398-420, Dec. 1997. (Pubitemid 127170520)
49. B. A. Finlayson, The Method of Weighted Residuals and Variational Principles. New York: Academic, 1972.