Estimation of adaptive neuro-fuzzy inference system parameters with the expectation maximization algorithm and extended Kalman smoother

Neural Computing and Applications

Volumn 20, Issue 3, 2011, Pages 403-415

  Cetisli, Bayram ^a   Edizkan, Rifat ^b  

^a SULEYMAN DEMIREL UNIVERSITY   (Turkey)

^b ESKISEHIR OSMANGAZI UNIVERSITY   (Turkey)

Author keywords

Adaptive neuro fuzzy inference system (ANFIS); Dynamic model; Estimation; Expectation maximization (EM) algorithm; Extended Kalman smoother (EKS)

Indexed keywords

ADAPTIVE NEURO-FUZZY INFERENCE SYSTEM; BENCHMARK FUNCTIONS; COMPUTING TIME; EM ALGORITHMS; EXPECTATION MAXIMIZATION (EM) ALGORITHM; EXPECTATION-MAXIMIZATION ALGORITHMS; EXTENDED KALMAN SMOOTHER (EKS); FUNCTION APPROXIMATION; INITIAL VALUES; KALMAN SMOOTHER; OPTIMAL PERFORMANCE; PREDICTION PROBLEM; SUPERVISED LEARNING METHODS; TRAINING METHODS;

DYNAMIC MODELS; FUZZY INFERENCE; FUZZY SYSTEMS; MAXIMUM PRINCIPLE; OPTIMIZATION; PARAMETER ESTIMATION;

ALGORITHMS;

EID: 79952817756     PISSN: 09410643     EISSN: None     Source Type: Journal    
DOI: 10.1007/s00521-010-0406-4     Document Type: Article

References (41)

1. Jang JSR (1993) ANFIS: adaptive network based fuzzy inference systems. IEEE Trans Syst Man Cybern 23: 665-685.
2. Ghaffari A, Mehrabian AR, Mohammad-Zaheri M (2007) Identification and control of power plant de-superheater using soft computing techniques. Eng Appl Artif Intell 20(2): 273-287.
3. Jang JSR, Sun CT, Mizutani E (1997) Neuro-fuzzy and soft computing. Prentice Hall, Upper Saddle River.
4. Tseng HC, Almogahed B (2009) Modular neural networks with applications to pattern profiling problems. Neurocomputing 72(10-12): 2093-2100.
5. Jang JSR (1991) Fuzzy modeling using generalized neural networks and Kalman filter algorithm. In: Proceedings of the ninth national conference on artificial intelligence, pp 762-767.
6. Shoorehdeli MA, Teshnehlab M, Sedigh AK (2009) Training ANFIS as an identifier with intelligent hybrid stable learning algorithm based on particle swarm optimization and extended Kalman filter. Fuzzy Sets Syst 160(7): 922-948.
7. Nakamura E, Kehtarnavez N (1995) Optimization of fuzzy membership function parameters. IEEE international conference on systems, man and cybernetics. Vancouver, Canada, pp 1-6.
8. Li C, Cheng K-H (2007) Recurrent neuro-fuzzy hybrid-learning approach to accurate system modelling. Fuzzy Sets Syst 158(2): 194-212.
9. Wu R, Chen S (1999) A new method for constructing membership functions and fuzzy rules from training examples. IEEE Trans Syst Man Cybern B 29: 25-40.
10. Cetişli B, Barkana A (2010) Speeding up the scaled conjugate gradient algorithm and its application in neuro-fuzzy classifier training. Soft Comput 14(4): 365-378.
11. Jang JSR, Mizutani E (1996) Levenberg-Marquardt method for ANFIS learning. In: Proceedings of the international joint conference of the North American fuzzy information processing society biannual conference. Berkeley, California, pp 87-91.
12. Alcalá-Fdez J, Alcalá R, Gacto MJ, Herrera F (2009) Learning the membership function contexts for mining fuzzy association rules by using genetic algorithms. Fuzzy Sets Syst 160(7): 905-921.
13. de Oliveira JV (1999) Towards neuro-linguistic modeling: constraints for optimization of membership functions. Fuzzy Sets Syst 106(3): 357-380.
14. Hongsheng S, Feng Z (2007) A novel learning method for ANFIS using EM algorithm and emotional learning. International conference on computer intelligence and security, pp 23-27.
15. Simon D (2002) Training fuzzy systems with the extended Kalman filter. Fuzzy Sets Syst 132: 189-199.
16. Simon D (2002) Training radial basis neural networks with the extended Kalman filter. Neurocomputing 48: 455-475.
17. Ciocoiu IB (2002) RBF networks training using a dual extended Kalman filter. Neurocomputing 48: 609-622.
18. Leung C-S, Chan L-W (2003) Dual extended Kalman filtering in recurrent neural networks. Neural Netw 16(2): 223-239.
19. Young S, Park NJB, Joo YH (2006) Kalman filtering for TS fuzzy state estimation. International joint conference SICE-ICASE. Busan, Korea, pp 3800-3803.
20. Harris CJ, Gan Q (2001) State estimation and multi-sensor data fusion using data-based neuro-fuzzy local linearization process models. Inf Fusion 2(1): 17-29.
21. Layne JR, Passino K (2001) A fuzzy model based state estimator. Fuzzy Sets Syst 122(1): 45-72.
22. Tiano A, Zirilli A, Pizzocchero F (2001) Application of interval and fuzzy techniques to integrated navigation systems. IFSA world congress and 20th NAFIPS international conference, Canada, pp 13-18.
23. Matía F, Jiménez A, Al-Hadithi BM, Rodríguez-Losada D, Galán R (2006) The fuzzy Kalman filter: state estimation using possibilistic techniques. Fuzzy Sets Syst 157(16): 2145-2170.
24. Najjaran H, Goldenberg A (2007) Real-time motion planning of an autonomous mobile manipulator using a fuzzy adaptive Kalman filter. Rob Auton Syst 55(2): 96-106.
25. de Rubio J, Pacheco J (2009) A generalized Takagi-Sugeno-Kang recurrent fuzzy-neural filter for adaptive noise cancellation. Neural Comput Appl 18: 633-641.
26. Roweis S, Ghahramani Z (2001) Learning nonlinear dynamical systems using the expectation-maximization algorithm. In: Haykin S (ed) Kalman filtering and neural networks, Chap. 6. Wiley, New York, pp 175-220.
27. de Freitas JFG, Niranjan M, Gee AH (2000) Dynamical learning with the EM algorithm for neural networks. J VLSI Signal Process Syst Signal Image Video Technol 26(1-2): 119-131.
28. de Freitas N, Niranjan M, Gee A (1998) Nonlinear state space learning with EM and neural networks. In: Constantinides T, Kung SY, Niranjan M, Wilson E (ed) IEEE workshop on neural networks for signal processing. (NNSP98). Cambridge, England, pp 254-263.
29. Kalman RE (1960) A new approach to linear filtering and prediction problems. Trans ASME J Basic Eng 82(D): 35-45.
30. de Freitas JFG, Niranjan M, Gee AH (1998) Hierarchical Bayesian-Kalman models for regularization and in sequential learning. Technical report CUED/F_INFENG/TR 307, Cambridge University.
31. Rauch HE, Tung F, Striebel CT (1965) Maximum likelihood estimates of linear dynamic systems. AIAA J 3(8): 445-1450.
32. Haykin S (2001) Kalman filtering and neural networks. Wiley, New York.
33. Maybeck PS (1979) Stochastic models, estimation, and control. Academic Press, New York.
34. Yang M-S, Yu N-Y (2005) Estimation of parameters in latent class models using fuzzy clustering algorithms. Eur J Oper Res 160(2): 515-531.
35. Yang X, Liu J (2002) Mixture density estimation with group membership functions. Pattern Recognit Lett 23(5): 501-512.
36. Leng G, Zeng X-J, Keane JA (2009) A hybrid learning algorithm with a similarity-based pruning strategy for self-adaptive neuro-fuzzy systems. Applied Soft Computing 9(4): 1354-1366.
37. Larsen RJ, Marx ML (2000) Introduction to mathematical statistics and its applications, 3rd edn. Prentice Hall, Englewood Cliffs.
38. UCI Machine Learning Group, www. ics. uci. edu/~mlearn.
39. Abonyi J, Babuska R, Szeifert F (2002) Modified Gath-Geva fuzzy clustering for identification of Takagi-Sugeno fuzzy models. IEEE Trans Syst Man Cybern B Cybern 32(5): 612-621.
40. Jang JSR (1996) Input selection for ANFIS learning. In: Proceedings of IEEE international conference on fuzzy systems, New Orleans, pp 1493-1499.
41. Zhao L, Yang Y, Zeng Y (2009) Eliciting compact T-S fuzzy models using subtractive clustering and coevolutionary particle swarm optimization. Neurocomputing 72(10-12): 2569-2575.