Online state-space modeling using recurrent multilayer perceptrons with unscented kalman filter

Neural Processing Letters

Volumn 22, Issue 1, 2005, Pages 69-84

  Choi, Jongsoo ^a   Yeap, Tet Hin ^a   Bouchard, Martin ^a  

^a UNIVERSITY OF OTTAWA   (Canada)

Author keywords

Extended Kalman filter; Recurrent neural networks; Systems modeling; Unscented Kalman filter

Indexed keywords

ADAPTIVE CONTROL SYSTEMS; ALGORITHMS; COMPUTATIONAL COMPLEXITY; COMPUTER SIMULATION; FEEDBACK; KALMAN FILTERING; MULTILAYERS; NONLINEAR SYSTEMS; PARAMETER ESTIMATION; RECURRENT NEURAL NETWORKS; SPEECH SYNTHESIS;

EXTENDED KALMAN FILTER; RECURRENT NEURAL NETWORK; SYSTEMS MODELING; UNSCENTED KALMAN FILTER;

STATE SPACE METHODS;

EID: 23844536275     PISSN: 13704621     EISSN: None     Source Type: Journal    
DOI: 10.1007/s11063-005-2157-2     Document Type: Review

References (18)

1. Narendra, K. S. and Parthasarathy, K.: Identification and control of dynamical systems using neural networks, IEEE Transactions on Neural Networks, 1 (1990), 4-27.
2. Rivals, I. and Personnaz, L.: Black-box modeling with state-space neural networks, In: R. Zbikowski and K. J. Hunt (ed.), Neural Adaptive Control Technology, pp. 237-264, World Scientific, 1996.
3. Haykin, S.: Neural networks: a Comprehensive Foundation, 2nd edn., Prentice Hall:Upper Saddle River, NJ, 1999.
4. Atiya, A. F. and Parlos, A. G.: New results on recurrent network training: unifying the algorithms and accelerating convergence, IEEE Transactions on Neural Networks, 11 (2000), 697-709.
5. Hammer, B. and Steil, J. J.: Tutorial: Perspective on learning with RNNs, In: Proceedings of the European Symposium on Artificial Neural Networks (ESANN), pp. 357-369, 2002.
6. Puskorius G. V. and Feldkamp, L. A.: Neurocontrol of nonlinear dynamical systems with Kalman filter trained recurrent networks, IEEE Transactions on Neural Networks, 5 (1994), 279-297.
7. Sitz, A., Schwarz, U., Kurths, J., and Voss, H. U.: Estimation of parameters and unobserved components for nonlinear systems from noisy time series, Physical Review E, 66 (2002), 016210.
8. Julier, S. J. and Uhlmann, J. K.: A new extension of the Kalman filter to nonlinear systems. In Proceedings of AeroSence: The 11th International Symposium on Aerospace/Defence Sensing, Simulation and Controls, 1997.
9. Julier, S., Uhlmann, J., and Durrant-Whyte, H. F.: A new method for the nonlinear transformation of means and covariances in filters and estimators, IEEE Transactions on Automatic Control, 45 (2000), 477-482.
10. Wan, E. A. and van der Merwe, R.: The unscented Kalman filter for nonlinear estimation, in Proceedings of the IEEE 2000 Adaptive Systems for Signal Processing, Communications and Control Symposium (AS-SPCC), pp. 153-158, 2000.
11. Wan, E. A. and van der Merwe, R.: The unscented Kalman filter. In: S. Haykin (ed.), Kalman Filtering and Neural Networks, pp. 221-280, John Wiley and Sons, 2001.
12. Choi, J., Lima, A. and Haykin, S.: Unscented Kalman filter-trained recurrent neural equalizer for time-varying channels. In Proceedings of IEEE International Conference on Communications, pp. 3241-3245, Anchorage, USA, May 2003.
13. Choi, J., Bouchard, M., Yeap, T. H. and Kwon, O.: A derivative-free Kalman filter for parameter estimation of recurrent neural networks and its applications to nonlinear channel equalization. In Proceedings of the 4th International ICSC Symposium on Engineering of Intelligent Systems, Funchal Island, Portugal, February 2004.
14. Sjoberg, J., Zhang, Q., Ljung, L., Benveniste, A., Delyon, B., Glorennec, P.-Y., Hjalmarsson, H. and Juditsky, A.: Nonlinear black-box modeling in system identification: A unified overview, Automatica, 31 (1995), 1691-1724.
15. Box, G. E. P. and Jenkins, G. M.: Time Series Analysis: Forecasting and Control, 2nd edn., Holden Day: San Francisco, CA, 1976.
16. Sastry, P. S., Santharam, G. and Unnikrishnan, K. P.: Memory neuron networks for identification and control of dynamical systems, IEEE Transactions on Neural Networks, 5 (1994), 306-319.
17. Cowan, C. and Semnani, S.: Time-variant equalization using a novel nonlinear adaptive structure, International Journal of Adaptive Control and Signal Processing, 12 (1998), 195-206.
18. Ong, S., You, C., Choi, S. and Hong, D.: A decision feedback recurrent neural equalizer as an infinite impulse response filter, IEEE Transactions on Signal Processing, 45 (1997), 2851-2858.