Nonlinear Bayesian state estimation: A review of recent developments

Control Engineering Practice

Volumn 20, Issue 10, 2012, Pages 933-953

  Patwardhan, Sachin C ^a   Narasimhan, Shankar ^b   Jagadeesan, Prakash ^c   Gopaluni, Bhushan ^d   L Shah, Sirish ^e  

^a INDIAN INSTITUTE OF TECHNOLOGY BOMBAY   (India)

^b INDIAN INSTITUTE OF TECHNOLOGY MADRAS   (India)

^c ANNA UNIVERSITY   (India)

^d UNIVERSITY OF BRITISH COLUMBIA   (Canada)

^e UNIVERSITY OF ALBERTA   (Canada)

Author keywords

Constrained state estimation; Multi rate sampling; Observer stability; Sequential Bayesian state estimation; State and parameter estimation

Indexed keywords

ACTIVE AREA; BAYESIAN PERSPECTIVE; BAYESIAN STATE ESTIMATION; CONSTRAINED STATE ESTIMATION; COST-EFFECTIVE APPROACH; DELAYED MEASUREMENTS; DIFFERENTIAL ALGEBRAIC EQUATIONS; ENGINEERING PROCESS; ESTIMATION ERRORS; ESTIMATION TECHNIQUES; INTERNAL STATE; MODEL PARAMETER ESTIMATION; MULTI RATE; NONLINEAR STATE ESTIMATORS; ON-LINE ESTIMATION; REAL TIME; STABILITY ANALYSIS;

ESTIMATION; PARAMETER ESTIMATION;

STATE ESTIMATION;

EID: 84865398763     PISSN: 09670661     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.conengprac.2012.04.003     Document Type: Review

References (99)

1. Albuquerque J.S., Biegler L.T. Decomposition algorithms for on-line estimation with nonlinear DAE models. Computers and Chemical Engineering 1997, 21:283-299.
2. Alspach D.L., Sorenson H.W. Nonlinear Bayesian estimation using Gaussian sum approximations. IEEE Transactions on Automatic Control 1972, 4:439-448.
3. Andrieu C., Doucet A., Singh S.S., Tadic V.B. Particle methods for change detection, system identification, and control. Proceedings of the IEEE 2004, 92:423-438.
4. Arasarathnam I., Haykin S., Elliott R.J. Discrete-time nonlinear filtering algorithms using Gauss-Hermite quadrature. Proceedings of the IEEE 2007, 95(5):953-977.
5. Arulampalam M.S., Maskell S., Gordon N., Clapp T. A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking. IEEE Transactions on Signal Processing 2002, 50(2):174-188.
6. Aström K.J., Wittenmark B. Computer controlled systems 1997, Prentice-Hall Inc., Upper Saddle River, NJ.
7. Baras J.S., Bensoussan A., James M.R. Dynamic observers as asymptotic limits of recursive filters: Special cases. SIAM Journal of Applied Mathematics 1988, 48:1147-1158.
8. Bavdekar V.A., Deshpande A.P., Patwardhan S.C. Identification of process and measurement noise covariances for state and parameter estimation using extended Kalman filter. Journal of Process Control 2011, 21:585-601.
9. Bavdekar, V. A., Prakash, J., Patwardhan, S. C., & Shah, S. L. (2011). Moving window ensemble Kalman filter for delayed and multi-rate measurements. In Proceedings of 18th IFAC world congress, Milano, Italy, August 28-September 2.
10. Becerra V.M., Roberts P.D., Griffiths G.W. Applying the extended Kalman filter to systems described by nonlinear differential algebraic equations. Control Engineering Practice 2001, 9:267-281.
11. Bouteyab M., Aubry D. A strong tracking extended Kalman observer for nonlinear discrete-time systems. IEEE Transactions on Automatic Control 1999, 44(8):1550-1556.
12. Bouteyab M., Rafalahy H., Darouach M. Convergence analysis of the extended Kalman filter used as an observer for nonlinear deterministic discrete-time systems. IEEE Transactions on Automatic Control 1997, 42(4):581-585.
13. Burgers G., Leeuwen P.J.V., Evensen G. Analysis scheme in the ensemble Kalman filter. Monthly Weather Review 1998, 126:1719-1724.
14. Cappe O., Godsil S.J., Moulines E. An overview of existing methods and recent advances in sequential monte carlo. Proceedings of the IEEE 2007, 95(5):899-924.
15. Casella G., Berger R.L. Statistical inference 1990, Brooks/Cole Publishing Company, Pacific Grove, CA.
16. Chen, Z. (2003). Bayesian filtering: From Kalman filters to particle filters, and beyond. Technical report. Hamilton, ON, Canada: Adaptive Syst. Lab., McMaster University.
17. Chia T., Chow P., Chizeck H.J. Recursive parameter identification of constrained systems. IEEE Transactions on Biomedical Engineering 1991, 38(5):429-442.
18. Ching J., Beck J.L., Porter K.A. Bayesian state and parameter estimation of uncertain dynamical systems. Probabilistic Engineering Mechanics 2006, 21:81-96.
19. Chitralekha S.B., Prakash J., Raghavan H., Gopaluni R.B., Shah S.L. A comparison of simultaneous state and parameter estimation schemes for a continuous fermentor reactor. Journal of Process Control 2010, 20(8):934-943.
20. Daum F. Nonlinear filters: Beyond the Kalman filter. IEEE A&E Systems Magazine 2005, 20(8):57-69.
21. Deshpande A., Patwardhan S.C., Narasimhan S. Intelligent state estimation for fault tolerant nonlinear predictive control. Journal of Process Control 2009, 19(2):187-204.
22. Dochain D. State and parameter estimation in chemical and biochemical processes: A tutorial. Journal of Process Control 2003, 13:801-818.
23. Evenson G. The ensemble Kalman filter: Theoretical formulation and practical implementation. Ocean Dynamics 2003, 53:343-367.
24. Gelb A. Applied optimal estimation 1974, The MIT Press.
25. Goodwin, G. C., & Agüero, J. C. (2005). Approximate EM algorithms for parameter and state estimation in nonlinear stochastic models. In Proceedings of 44th IEEE conference on decision and control (pp. 368-373).
26. Gopalakrishnan A., Kaisare N.S., Narasimhan S. Incorporating delayed and infrequent measurements in extended Kalman filter based nonlinear state estimation. Journal of Process Control 2010, 21:119-129.
27. Gopaluni R.B. A particle filter approach to identification of nonlinear processes under missing observations. Canadian Journal of Chemical Engineering 2008, 86(6):1081-1092.
28. Gopaluni R.B. Nonlinear system identification under missing observations: The case of unknown model structure. Journal of Process Control 2010, 20(3):314-324.
29. Gordon N.J., Salmond D.J., Smith A.F.M. Novel approach to nonlinear non-Gaussian Bayesian state estimation. IEE Proceedings F 1993, 140:107-113.
30. Gudi R.D., Shah S.L., Gray M.R. Adaptive multirate state and parameter estimation strategies with application to a bioreactor. AIChE Journal 1995, 41:2451-2464.
31. Higuchi T. Self organizing time series model. Sequential Monte Carlo methods 2001, 429-444. Springer-Verlag, New York. A. Practice, J.F.G. Doucet, de Freitas, N.J. Gordon (Eds.).
32. Huang, R., Patwardhan, S. C., & Biegler, L. T. (2009). Robust extended Kalman filter based nonlinear model predictive control formulation. In Proceedings of 48th IEEE conference on decision and control (CDC-2009), Shanghai, China, December 16-18.
33. Huang R., Patwardhan S.C., Biegler L.T. Stability of a class of discrete-time nonlinear recursive observers. Journal of Process Control 2010, 20:1150-1160.
34. Huang, R., Patwardhan, S. C., & Biegler, L. T. (2012). Robust stability of nonlinear model predictive control with extended Kalman filter and target setting. International Journal of Robust and Nonlinear Control, doi:10.1002/rnc.2817. Published online in Wiley Online Library (). http://wileyonlinelibrary.com.
35. Ito K., Xiong K. Gaussian filters for nonlinear filtering problems. IEEE Transactions on Automatic Control 2000, 45(5):910-927.
36. Jazwinski, A. H. (1970). Stochastic processes and filtering theory. Dover, NY.
37. Julier S.J., Uhlmann J.K. Unscented filtering and nonlinear estimation. Proceedings of the IEEE 2004, 92(3):401-422.
38. Julier S.J., Viola J.J. On Kalman filtering with nonlinear equality constraints. IEEE Transactions of Signal Processing 2007, 55(6):2774-2784.
39. Jumpana P., Shah S.L., Kadali R. Computer vision based interface level control in separation cells. Control Engineering Practice 2010, 18:349-357.
40. Kadu S.C., Mani Bhushan, Gudi R.D., Roy K. Modified unscented recursive nonlinear dynamic data reconciliation for constrained state estimation. Computers and Chemical Engineering 2009, 27:1335-1340.
41. Kalman R.E. A new approach to linear filtering and prediction problems. Transactions of the ASME: Journal of Basic Engineering 1960, 82:34-45.
42. Kitagawa G. A self-organizing state-space model. Journal of the American Statistical Association 1998, 93:1203-1215.
43. Ko S., Bitmead R.R. State estimation for linear systems with state equality constraints. Automatica 2007, 43:1363-1368.
44. Linear optimal control systems 1972, John Wiley & Sons, New York.
45. Lang W., Chen, Bakshi B.R., Goel P.K., Ungarala S. Bayesian estimation via sequential Monte Carlo sampling-Constrained dynamic systems. Automatica 2007, 43:1615-1622.
46. Lima F.V., Rawlings J.B. Nonlinear stochastic modeling to improve state estimation in process monitoring and control. AIChE Journal 2011, 57(4):996-1007.
47. Liu J., West M. Combined parameter and state estimation in simulation-based filtering. Sequential Monte Carlo methods 2001, 197-223. Springer-Verlag, New York. A. Practice, J.F.G. Doucet, deFreitas, N.J. Gordon (Eds.).
48. Ljung L. Asymptotic behavior of extended Kalman filter as a parameter estimator for linear systems. IEEE Transactions on Automatic Control 1979, 24(1):36-50.
49. López-Negrete, R. (2012). Nonlinear programming sensitivity based methods for constrained state estimation. Ph.D. dissertation. Carnegie Mellon University.
50. López-Negrete R., Patwardhan S.C., Biegler L.T. Constrained particle filter approach to approximate the arrival cost in Moving Horizon Estimation. Journal of Process Control 2011, 21:909-919.
51. Luenberger D. Observers for multivariable systems. IEEE Transactions on Automatic Control 1966, 11(2):190-197.
52. Mandela R.K., Rengaswamy R., Narasimhan S., Sridhar L.N. Recursive state estimation techniques for nonlinear differential algebraic systems. Chemical Engineering Science 2010, 65:4548-4556.
53. Mandela R.K., Vidyashankar K., Rengaswamy R., Narasimhan S. Constrained unscented recursive estimator for nonlinear dynamical systems. Journal of Process Control 2012, 22(4):718-728.
54. Maybeck P.S. Stochastic models, estimation, and control 1979, Academic Press, New York.
55. Misawa E., Hedrick J. Nonlinear observers, a state of the art survey. Journal of Dynamic Systems, Measurement, and Control 1989, 111:344-351.
56. Muske K.R., Edgar T.F. Nonlinear state estimation. Nonlinear process control 1997, Prentice-Hall. M.A. Henson, D.E. Seborg (Eds.).
57. Mutha R.K., Cluett W.R., Penlidis A. Online nonlinear model-based estimation and control of a polymer reactor. AIChE Journal 1997, 43:3042-3058.
58. Nikoukhah R., Willsky A.S., Levy B.C. Kalman filtering and riccati equations for descriptor systems. IEEE Transactions on Automatic Control 1992, 37:1325-1342.
59. Nørgaard M., Poulsen N.K., Ravn O. New developments in state estimation for nonlinear systems. Automatica 2000, 36:1627-1638.
60. Odelson B.J., Rajamani M.R., Rawlings J.B. A new autocovariance least-squares method for estimating noise covariances. Automatica 2006, 42:303-308.
61. Olanrewaju M., Huang B., Afacan A. Development of a simultaneous continuum and noncontinuum states estimator with application on a distillation process. AIChE Journal 2012, 58:480-492.
62. Poyiadjis, G., Doucet, A., Singh, S.S. (2005). Maximum likelihood parameter estimation in general state-space models using particle methods. In Proceedings of the joint statistical meeting, minneapolis, 7-11 August, 2005.
63. Prakash J., Patwardhan S.C., Narasimhan S. A supervisory approach to fault tolerant control of linear multivariable systems. Industrial and Engineering Chemistry Research 2002, 41:2270-2281.
64. Prakash J., Patwardhan S.C., Shah S.L. Constrained state estimation using ensemble Kalman filter. Industrial and Engineering Chemistry Research 2010, 49(5):2242-2253.
65. Prakash J., Patwardhan S.C., Shah S.L. On the choice of importance distributions for unconstrained and constrained state estimation using particle filter. Journal of Process Control 2011, 21:119-129.
66. Qi, S., Jiang, Z., & Han, J. (2007). Noise covariance identification based adaptive UKF with application to mobile robot systems. In IEEE conference on robotics and automation (pp. 4164-4169).
67. Qu C.C., Hahn J. Computation of arrival cost for moving horizon estimation via unscented Kalman filtering. Journal of Process Control 2009, 19:358-363.
68. Quine B. A derivative-free implementation of the extended Kalman filter. Automatica 2006, 42:1927-1934.
69. Raghavan H., Tangirala A.K., Gopaluni R.B., Shah S.L. Identification of chemical processes with irregular output sampling. Control Engineering Practice 2006, 14(5):467-480.
70. Rao C.V., Rawlings J.B. Constrained process monitoring: Moving-horizon approach. AIChE Journal 2002, 48(1):97-109.
71. Rao C.V., Rawlings J.B., Lee J.H. Constrained linear state estimation-A moving horizon approach. Automatica 2001, 37:1619-1628.
72. Rao C.V., Rawlings J.B., Mayne D.Q. Constrained state estimation for nonlinear discrete-time systems: Stability and moving horizon approximations. IEEE Transactions on Automatic Control 2003, 48(2):246-258.
73. Rawlings J.B., Bakshi B.R. Computers and Chemical Engineering 2006, 30(10-12):1529-1541.
74. Reif K., Unbehauen R. The extended Kalman filter as an exponential observer for nonlinear systems. IEEE Transactions on Signal Processing 1999, 47:2324-2328.
75. Reif K., Gunther S., Yaz E., Unbehauen R. Stochastoc stability of the discrete-time extended Kalman filter. IEEE Transactions on Automatic Control 1999, 44(4):714-728.
76. Reif K., Sonnemann F., Unbehauen R. An EKF based nonlinear observer with a prescribed degree of stability. Automatica 1998, 14(9):1119-1123.
77. Rengaswamy R., Narasimhan S., Kuppuraj V. Receding nonlinear Kalman filter for nonlinear constrained state estimation. Proceedings of ESCAPE 21 2011, 844-848. Elsevier. E.N. Pistikopoulos, M.C. Georgiakis, A. Kokossis (Eds.).
78. Ristic, B., Arulampalam, S., & Gordon, N. (2004). Beyond the Kalman filter-Particle filters for tracking applications. Boston, USA: Artech House.
79. Robertson D.G., Lee J.H., Rawlings J.B. A moving horizon-based approach for leastsquares state estimation. AIChE Journal 1996, 42(8):2209-2224.
80. Schön T.B., Wills A., Ninness B. System identification of nonlinear state-space models. Automatica 2011, 47:39-49.
81. Shao X., Huang B., Lee J.M. Constrained Bayesian state estimation-A comparative study and a new particle filter based approach. Journal of Process Control 2010, 20(2):143-157.
82. Shao X., Huang B., Lee J., Xu F., Espejo A. Bayesian methods for multirate data synthesis and model calibration. AIChE Journal 2011, 57:1514-1525.
83. Shumway R.H., Stoffer D.S. Time series analysis and its applications 2000, Springer.
84. ∞ and nonlinear approaches 2006, John Wiley & Sons Inc., Hoboken, NJ, USA.
85. Simon D. Kalman filtering with state equality constraints-A survey of linear and nonlinear algorithms. IET Control Theory and Applications 2010, 4(8):1303-1318.
86. Simon D., Chia T.L. Kalman filtering with state equality constraints. IEEE Transactions of Aerospace and Electronic Systems 2002, 38(1):128-136.
87. Soderstrom T. Discrete-time stochastic systems, advanced textbooks in control and signal processing 2003, Springer.
88. Sorenson H. Least square estimation from Gauss to Kalman. IEEE Spectrum 1970, (July):63-68.
89. Sorenson H. Kalman filtering: Theory and applications 1985, IEEE Press, New York.
90. Soroush M. State and parameter estimations and their applications in process control. Computers and Chemical Engineering 1998, 23(2):229-245.
91. Tatiraju S., Soroush M., Ogunnaike B.A. Multirate nonlinear state estimation with application to a polymerization reactor. AIChE Journal 1999, 45(4):769-780.
92. Teixeira, B. O. S., Chandrasekhar, J., Torres, L. A. B., Aguirre, L. A., & Bernstein, D. S. (2007). State estimation for equality constrained linear systems. In Proceedings of the 46th IEEE conference on decision and control (pp. 6220-6225), New Orleans, USA, December 12-14.
93. Ungarala S. Computing arrival cost parameters in moving horizon estimation using sampling based filters. Journal of Process Control 2009, 19:1576-1588.
94. Vachhani P., Narasimhan S., Rengaswamy R. Robust and reliable estimation via unscented recursive nonlinear dynamic data reconciliation. Journal of Process Control 2006, 16:1075-1086.
95. Vachhani P., Rengaswamy R., Gangwal V., Narasimhan S. Recursive estimation in constrained nonlinear dynamical systems. AIChE Journal 2004, 946-959.
96. Valappil J., Georgakis C. Systematic estimation of state noise statistics for extended Kalman filters. AIChE Journal 2000, 46(2):292-308.
97. Van der Merwe, R. (2004). Sigma-point Kalman filters for probabilistic inference in dynamic state-space models. Ph.D. dissertation. Oregon Health & Science University.
98. Xiong K., Zhang H.Y., Chan C.W. Performance evaluation of UKF-based nonlinear filtering. Automatica 2006, 42:261-270.
99. Zavala V.M., Laird C.D., Biegler L.T. A fast moving horizon estimation algorithm based on nonlinear programming sensitivity. Journal of Process Control 2008, 18:876-884.