Heuristic dynamic programming algorithm for optimal control design of linear continuous-time hyperbolic PDE systems

Industrial and Engineering Chemistry Research

Volumn 51, Issue 27, 2012, Pages 9310-9319

  Wu, Huai Ning ^a   Luo, Biao ^a  

^a BEIHANG UNIVERSITY   (China)

Author keywords

[No Author keywords available]

Indexed keywords

CONTROL APPROACH; HEURISTIC DYNAMIC PROGRAMMING; HYPERBOLIC PARTIAL DIFFERENTIAL EQUATION; HYPERBOLIC PDES; INTERNAL SYSTEMS; LINEAR CONTINUOUS-TIME; METHOD OF WEIGHTED RESIDUAL; OPTIMAL CONTROL DESIGN; OPTIMAL CONTROL PROBLEM; OPTIMAL CONTROLS; RICCATI DIFFERENTIAL EQUATION; SYSTEM DYNAMICS; SYSTEM MODELS; SYSTEM TRAJECTORY; TUBULAR HEAT EXCHANGERS;

CONTINUOUS TIME SYSTEMS; CONTROL; DYNAMIC PROGRAMMING; OPTIMAL CONTROL SYSTEMS; PARTIAL DIFFERENTIAL EQUATIONS; SYSTEM THEORY;

ALGORITHMS;

EID: 84863856475     PISSN: 08885885     EISSN: 15205045     Source Type: Journal    
DOI: 10.1021/ie300897m     Document Type: Article

References (52)

1. Lax, P. D. Hyperbolic Partial Differential Equations; American Mathematical Society: New York, 2006.
2. Christofides, P. D. Nonlinear and Robust Control of PDE Systems: Methods and Applications to Transport-Reaction Processes; Birkhäuser: Boston, MA, 2001.
3. Wang, J.-W.; Wu, H.-N.; Li, H.-X. Distributed fuzzy control design of nonlinear hyperbolic PDE systems with application to nonisothermal plug-flow reactor IEEE Trans. Fuzzy Syst. 2011, 19, 514-526
4. Aksikas, I.; Winkin, J. J.; Dochain, D. Optimal LQ-feedback regulation of a nonisothermal plug flow reactor model by spectral factorization IEEE Trans. Automat. Contr. 2007, 52, 1179-1193
5. Smets, I. Y.; Dochain, D.; Van Impe, J. F. Optimal temperature control of a steady-state exothermic plug-flow reactor AIChE J. 2002, 48, 279-286
6. Choi, J.; Lee, K. S. Model predictive control of cocurrent first-order hyperbolic PDE systems Ind. Eng. Chem. Res. 2005, 44, 1812-1822
7. Shang, H.; Forbes, J. F.; Guay, M. Model predictive control for quasilinear hyperbolic distributed parameter systems Ind. Eng. Chem. Res. 2004, 43, 2140-2149
8. Aksikas, I.; Fuxman, A.; Forbes, J. F.; Winkin, J. J. LQ control design of a class of hyperbolic PDE systems: Application to fixed-bed reactor Automatica 2009, 45, 1542-1548
9. Christofides, P. D.; Daoutidis, P. Robust control of hyperbolic PDE systems Chem. Eng. Sci. 1998, 53, 85-105
10. Ray, W. H. Advanced Process Control; McGraw-Hill: New York, 1981.
11. Sano, H. Exponential stability of amono-tubular heat exchanger equation with output feedback Syst. Control Lett. 2003, 50, 363-369
12. Bayen, A. M.; Raffard, R. L.; Tomlin, C. J. Adjoint-based control of a new Eulerian network model of air traffic flow IEEE Trans. Contr. Syst. Tech. 2006, 14, 804-818
13. Litrico, X.; Fromion, V. Boundary control of hyperbolic conservation laws using a frequency domain approach Automatica 2009, 45, 647-656
14. Litrico, X.; Fromion, V. H ∞ control of an irrigation canal pool with a mixed control politics IEEE Trans. Contr. Syst. Tech. 2006, 14, 99-111
15. Smyshlyaev, A.; Krstic, M. Boundary control of an anti-stable wave equation with anti-damping on the uncontrolled boundary Syst. Control Lett. 2009, 58, 617-623
16. Guo, B. Z.; Xu, C. Z. The stabilization of a one-dimensional wave equation by boundary feedback with noncollocated observation IEEE Trans. Automat. Contr. 2007, 52, 371-377
17. Christofides, P. D.; Baker, J. Robust output feedback control of quasi-linear parabolic PDE systems Syst. Control Lett. 1999, 36, 307-316
18. Wu, H.-N.; Li, H. X. A Galerkin/neural-network based design of guaranteed cost control for nonlinear distributed parameter systems IEEE Trans. Neural Netw. 2008, 19, 795-807
19. Dubljevic, S.; Christofides, P. D. Predictive output feedback control of parabolic partial differential equations (PDEs) Ind. Eng. Chem. Res. 2006, 45, 8421-8429
20. Baker, J.; Christofides, P. D. Output feedback control of parabolic PDE systems with nonlinear spatial differential operators Ind. Eng. Chem. Res. 1999, 38, 4372-4380
21. Baker, J.; Christofides, P. D. Finite-dimensional approximation and control of non-linear parabolic PDE systems Int. J. Control 2000, 73, 439-456
22. Luo, B.; Wu, H.-N. Approximate optimal control design for nonlinear one-dimensional parabolic PDE systems using empirical eigenfunctions and neural network. IEEE Trans. Syst. Man Cybern. Part B 2012, DOI: 10.1109/TSMCB.2012. 2194781, in press.
23. Ravindran, S. S. A reduced-order approach for optimal control of fluids using proper orthogonal decomposition Int. J. Numer. Meth. Fluids 2000, 34, 425-448
24. Holmes, P.; Lumley, J. L.; Berkooz, G. Turbulence, Coherent Structures, Dynamical Systems and Symmetry; Cambridge University Press: Cambridge, UK, 1996.
25. Curtain, R. F.; Zwart, H. J. An Introduction to Infinite-Dimensional Linear Systems Theory; Springer Verlag: New York, 1995.
26. Bensoussan, A.; Da Prato, G.; Delfour, M. C.; Mitter, S. K. Representation and Control of Infinite Dimensional Systems, Second ed.; Birkhäuser: Boston, 2007.
27. Coron, J. M.; D'Andrea-Novel, B.; Bastin, G. A strict Lyapunov function for boundary control of hyperbolic systems of conservation laws IEEE Trans. Automat. Contr. 2007, 52, 2-11
28. Krstic, M.; Smyshlyaev, A. Backstepping boundary control for first-order hyperbolic PDEs and application to systems with actuator and sensor delays Syst. Control Lett. 2008, 57, 750-758
29. Sira-Ramirez, H. Distributed sliding mode control in systems described by quasilinear partial differential equations Syst. Control Lett. 1989, 13, 177-181
30. Christofides, P. D.; Daoutidis, P. Feedback control of hyperbolic PDE systems AIChE J. 1996, 42, 3063-3086
31. Qi, C.-K.; Zhang, H.-T.; Li, H.-X. A multi-channel spatio-temporal Hammerstein modeling approach for nonlinear distributed parameter processes J. Process Contr. 2009, 19, 85-99
32. Zhang, H.-T.; Qi, C.-K.; Zhou, T.; Li, H.-X. Greatly enhancing the modeling accuracy for distributed parameter systems by nonlinear time/space separation Physica A 2007, 376, 215-222
33. Li, H.-X.; Qi, C.-K. Incremental modeling of nonlinear distributed parameter processes via spatiotemporal kernel series expansion Ind. Eng. Chem. Res. 2009, 48, 3052-3058
34. Qi, C.-K.; Li, H.-X.; Zhang, X.; Zhao, X.; Li, S.; Gao, F. Time/space-separation-based SVM modeling for nonlinear distributed parameter processes Ind. Eng. Chem. Res. 2011, 50, 332-341
35. Lewis, F. L.; Syrmos, V. L. Optimal Control; John Wiley: New York, 1995.
36. Li, X.; Yong, J. Optimal Control Theory for Infinite Dimensional Systems; Birkhäuser: Boston, 1995; p 338.
37. Al-Tamimi, A.; Lewis, F. L.; Abu-Khalaf, M. Discrete-time nonlinear HJB solution using approximate dynamic programming: Convergence proof IEEE Trans. Syst. Man Cybern. Part B 2008, 38, 943-949
38. Lewis, F. L.; Vrabie, D. Reinforcement learning and adaptive dynamic programming for feedback control IEEE Circ. Syst. Mag. 2009, 9, 32-50
39. Hafner, R.; Riedmiller, M. Reinforcement learning in feedback control Mach. Learn. 2011, 84, 137-169
40. Zhang, H.; Wei, Q.; Luo, Y. A novel infinite-time optimal tracking control scheme for a class of discrete-time nonlinear systems via the greedy HDP iteration algorithm IEEE Trans. Syst. Man Cybern. Part B 2008, 38, 937-942
41. Barto, A. G.; Bradtke, S. J.; Singh, S. P. Learning to act using real-time dynamic programming Artif. Intell. 1995, 72, 81-138
42. Kaelbling, L. P.; Littman, M. L.; Moore, A. W. Reinforcement learning: A survey J. Artif. Intell. Res. 1996, 4, 237-285
43. Sutton, R. S.; Barto, A. G. Reinforcement Learning: An Introduction; MIT Press: Cambridge, Mass., 1998.
44. Yang, Q.; Jagannathan, S. Reinforcement learning controller design for affine nonlinear discrete-time systems using online approximators IEEE Trans. Syst. Man Cybern. Part B 2012, 42, 377-390
45. Padhi, R.; Balakrishnan, S. N. Proper orthogonal decomposition based optimal neurocontrol synthesis of a chemical reactor process using approximate dynamic programming Neural Netw. 2003, 16, 719-728
46. Yadav, V.; Padhi, R.; Balakrishnan, S. N. Robust/optimal temperature profile control of a high-speed aerospace vehicle using neural networks IEEE Trans. Neural Netw. 2007, 18, 1115-1128
47. Zhang, H.-T.; Chen, M. Z. Q.; Chen, Z. Nonlinear Laguerre-Volterra observer-controller and its application to process control Int. J. Robust Nonlinear 2010, 20, 412-423
48. Karafyllis, I.; Daoutidis, P. Control of hot spots in plug flow reactors Comput. Chem. Eng. 2002, 26, 1087-1094
49. Winkin, J. J.; Dochain, D.; Ligarius, P. Dynamical analysis of distributed parameter tubular reactors Automatica 2000, 36, 349-361
50. Amin, S.; Hante, F. M.; Bayen, A. M. Exponential stability of switched linear hyperbolic initial-boundary value problems IEEE Trans. Automat. Contr. 2012, 57, 291-301
51. Courant, R.; Hilbert, D. Methods of Mathematical Physics; Wiley-VCH: New York, 1989; Vol. 1.
52. Finlayson, B. A. The Method of Weighted Residuals and Variational Principles; Academic Press: New York, 1972.