Training ANFIS as an identifier with intelligent hybrid stable learning algorithm based on particle swarm optimization and extended Kalman filter

Fuzzy Sets and Systems

Volumn 160, Issue 7, 2009, Pages 922-948

  Shoorehdeli, Mahdi Aliyari ^a   Teshnehlab, Mohammad ^a   Sedigh, Ali Khaki ^a  

^a K N TOOSI UNIVERSITY OF TECHNOLOGY   (Iran)

Author keywords

ANFIS; Extended Kalman filter; Hybrid learning algorithm; Identification; Particle swarm optimization; Stability analysis

Indexed keywords

ADAPTIVE ALGORITHMS; ALGORITHMS; CELLULAR RADIO SYSTEMS; CONTROL THEORY; CURVE FITTING; EDUCATION; EXTENDED KALMAN FILTERS; FUZZY INFERENCE; FUZZY SYSTEMS; INFERENCE ENGINES; KALMAN FILTERS; LEARNING ALGORITHMS; LEARNING SYSTEMS; MEMBERSHIP FUNCTIONS; OPTIMIZATION; POSITION CONTROL; PROGRAMMING THEORY; STABILITY; SYSTEM STABILITY;

ANFIS; EXTENDED KALMAN FILTER; HYBRID LEARNING ALGORITHM; IDENTIFICATION; PARTICLE SWARM OPTIMIZATION; STABILITY ANALYSIS;

PARTICLE SWARM OPTIMIZATION (PSO);

EID: 59649125893     PISSN: 01650114     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.fss.2008.09.011     Document Type: Article

References (100)

1. S. Akbar, R. Parra-Loera, Optimal self-tuning fuzzy controller, in: SPIE Conf. on Machine Tool In-Line, and Robot Sensors and Controls, 1995.
2. M.Sh. Aliyari, M. Teshnehlab, A.K. Sedigh, A novel training algorithm in ANFIS structure, in: American Control Conf., 2006.
3. M.Sh. Aliyari, M. Teshnehlab, A.K. Sedigh, A novel hybrid learning algorithm for tuning ANFIS parameters using adaptive weighted PSO, in: IEEE Internat. Fuzzy System Conf., 2007.
4. M.Sh. Aliyari, M. Teshnehlab, A.K. Sedigh, Identification using ANFIS with intelligent hybrid stable learning algorithm approaches, Neural Comput. Appl., accepted for publication, doi:10.1007/s00521-007-0168-9.
5. Anderson B., and Moore J. Optimal Filtering (1979), Prentice-Hall, Englewood Cliffs, NJ
6. P.J. Angeline, Using selection to improve particle swami optimization, in: Proc. IEEE Congr. on Evolutionary Computation, 1998.
7. Atkinson K. An Introduction to Numerical Analysis (1989), Wiley, New York
8. Bastian A. Identifying fuzzy models utilizing genetic programming. Fuzzy Sets and Systems 113 (2000) 335-350
9. Chaabene M., and Ammar M.B. Neuro-fuzzy dynamic model with Kalman filter to forecast irradiance and temperature for solar energy systems. Renewable Energy 33 7 (2008) 1435-1443
10. Chatterjee A., and Watanabe K. An optimized Takagi-Sugeno type neuro-fuzzy system for modeling robot manipulators. Neural Comput. Appl. 15 1 (2006) 55-61
11. Chen G., Xie Q., and Shieh L.S. Fuzzy Kalman filtering. J. Inform. Sci. (1998) 197-209
12. M.S. Chen, A comparative study of learning methods in tuning parameters of fuzzy membership functions, in: IEEE Conf. on System Man and Cybernetics, 1999.
13. Chen Y., Yang B., Abraham A., and Peng L. Automatic design of hierarchical Takagi-Sugeno type fuzzy systems using evolutionary algorithms. IEEE Trans. Fuzzy Systems 15 3 (2007)
14. Ciuprina G., Ioan D., and Munteanu I. Use of intelligent-particle swarm optimization in electromagnetic. IEEE Trans. Magn. 38 2 (2002) 1037-1040
15. M. Clerc, The Swarm and the Queen: towards a deterministic and adaptive particle swarm optimization, in: Proc. IEEE Internat. Conf. on Evolutionary Computation, 1999.
16. Coello C.A.C., Pulido G., and Lechuga M. Handling multiple objectives with particle swarm optimization. IEEE Trans. Evol. Comput. 8 3 (2004) 256-279
17. B. Demaya, R. Palm, S. Boverie, A. Titli, Multilevel qualitative and numerical optimization of fuzzy controller, in: IEEE Internat. Conf. on Fuzzy Systems, 1995.
18. J. Deskur, R. Muszynski, D. Sarnowski, Tuning and investigation of combined fuzzy controller, in: Internat. Conf. on Power Electronics and Variable Speed Drives, 1998.
19. R.C. Eberhart, X. Hu, Human tremor analysis using particle swarm optimization, in: Proceedings of the IEEE Congr. Evol. Comput., 1999.
20. R.C. Eberhart, X. Hu, Multiobjective optimization using dynamic neighborhood particle swarm optimization, in: Proc. IEEE Congr. on Evolutionary Computation, 2002.
21. R.C. Eberhart, J. Kennedy, A new optimizer using particle swarm theory, in: Proc. Sixth Internat. Symp. on Micromachine Human Science, 1995.
22. R.C. Eberhart, Y. Shi, Comparing inertia weights and constriction factors in particle swarm optimization, in: Proc. Congr. on Evolutionary Computation, 2000.
23. W. Eradus, H. Scholten, A. Udink ten Cate, Optimized fuzzy inference system for oestrus detection in dairy cattle, in: Internat. Symp. on Neuro-Fuzzy Systems, 1996.
24. Feldkamp L.A., Prokhorov D.V., and Feldkamp T.M. Simple and conditioned adaptive behavior from Kalman filter trained recurrent networks. Neural Networks 16 (2003) 683-689
25. Goldberg D.E. Genetic Algorithm in Search Optimization and Machine Learning (1989), Addison-Wesley, Reading, MA
26. Heo J.S., Lee K.Y., and Garduno-Ramirez R. Multiobjective control of power plants using particle swarm optimization techniques. IEEE Trans. Energy Convers. 21 2 (2006) 552-561
27. Ho S.L., Yang S., Ni G., Lo E.W.C., and Wong H.C. A particle swarm optimization-based method for multiobjective design optimizations. IEEE Trans. Magn. 41 5 (2005) 1756-1759
28. Hoehn L., and Niven I. Averages on the move. Math. Mag. 58 (1985) 151-156
29. X. Hu, R.C. Eberhart, Y. Shi, Particle swarm with extended memory for multiobjective optimization, in: Proc. IEEE Swarm Intelligence Symp., 2003.
30. Iiguni Y., Sakai H., and Tokumaru H. A real-time learning algorithm for a multilayered neural network based on the extended Kalman filter. IEEE Trans. Signal Process. 40 (1992) 959-966
31. Jacomet M., Stahel A., and Walti R. On-line optimization of fuzzy systems. Inform. Sci. 98 (1997) 301-313
32. Jang J.S.R. ANFIS: adaptive-network-based fuzzy inference system. IEEE Trans. Systems Man and Cybernet. 23 3 (1993)
33. J.S.R. Jang, ANFIS: Adaptive-Network-based Fuzzy Inference System, Research reported, 1993.
34. J.S.R. Jang, Input selection for ANFIS learning, in: IEEE Internat. Conf. on Fuzzy Systems, 1996.
35. J.S.R. Jang, E. Mizutani, Levenberg-Marquardt method for ANFIS learning, in: Proc. Biennial Conf. of the North American Fuzzy Information Processing Society, 1996.
36. Jang J.SR., Sun C.-T., and Mlizutani E. Neurofuzzy and Soft Computing: A Computational Approach to Learning and Machine Intelligence (1996), Prentice-Hall, Englewood Cliffs, NJ
37. Juang C.F. A TSK-type recurrent fuzzy network for dynamic systems processing by neural network and genetic algorithms. IEEE Trans. Fuzzy Systems 10 (2002) 155-170
38. Juang C.-F., and Chung I.-F. Recurrent fuzzy network design using hybrid evolutionary learning algorithms. Neurocomputing 70 (2007) 3001-3010
39. Juang C.F., and Lin C.T. A recurrent self-organizing neural fuzzy inference network. IEEE Trans. Neural Networks 10 (1999) 828-845
40. Kadirkamanathan V., Selvarajah K., and Fleming P.J. Stability analysis of the particle dynamics in particle swarm optimizer. IEEE Trans. Evol. Comput. 10 3 (2006) 245-255
41. Karakuzu C. Fuzzy controller training using particle swarm optimization for nonlinear system control. ISA Trans. 47 (2008) 229-239
42. J. Kennedy, The behavior of particle, in: Proc. Seventh Annual Conf. on Evolutionary Program, 1998.
43. Kim W.C., Ahn S.C., and Kwon W.H. Stability analysis and stabilization of fuzzy state space models. Fuzzy Sets and Systems 71 1 (1995) 131-142
44. Kollias S., and Anastassiou D. An adaptive least squares algorithm for the efficient training of artificial neural networks. IEEE Trans. Circuits Systems 36 (1989) 1092-1101
45. Kovacevic R., and Zhang Y. Neurofuzzy model-based weld fusion state estimation. IEEE Control Systems Mag. 17 2 (1997) 30-42
46. M. Kumar, D.P. Garg, Intelligent learning of fuzzy logic controllers via neural network and genetic algorithm, in: Proc. Japan-USA Symp. on Flexible Automation, 2004.
47. Lee C.H., and Teng C.C. Identification and control of dynamic systems using recurrent fuzzy neural networks. IEEE Trans. Fuzzy Systems 8 4 (2000) 349-366
48. Leng G., McGinnity T.M., and Prasad G. Design for self-organizing fuzzy neural networks based on genetic algorithms. IEEE Trans. Fuzzy Systems 14 (2006) 755-766
49. Leu G., and Baratti R. An extended Kalman filtering approach with a criterion to set its tuning parameters; application to a catalytic reactor. Comput. Chem. Eng. (2000) 1839-1849
50. Lin C.J., and Chin C.C. Prediction and identification using wavelet-based recurrent fuzzy neural network. IEEE Trans. Systems Man Cybernet. Part B Cybernet. 10 (2004) 2144-2154
51. Lu C.H., and Tsai C.C. Generalized predictive control using recurrent fuzzy neural networks for industrial processes. J. Process Control 17 (2007) 83-92
52. Mackey M.C., and Glass L. Oscillation and chaos in physical control system. Science 197 (1977) 287-289
53. Magdalena L., and Monasterio-Huelin F. Fuzzy logic controller with learning through the evolution of its knowledge base. Internat. J. Approx. Reason. 16 (1997) 335-358
54. M. Mahfouf, M.-Y. Chen, D.A. Linkens, Adaptive weighted particle swarm optimization for multi-objective optimal design of alloy steels, in: Proc. of Parallel Problem Solving from Nature, 2004.
55. Mandic D.P., and Chambers J.A. Recurrent Neural Networks for Prediction: Learning Algorithms, Architectures, and Stability (2001), Wiley, New York
56. F.M. Mascioli, G.M. Varazi, G. Martinelli, Constructive algorithm for neuro-fuzzy networks, in: Proc. Sixth IEEE Internat. Conf. on Fuzzy Systems, 1997.
57. Mastorocostas P.A., and Theocharis J.B. A recurrent fuzzy-neural model for dynamic system identification. IEEE Trans. Systems Man Cybern. Part B Cybernet. 32 (2002) 176-190
58. Matía F., Jiménez A., Al-Hadithi B.M., Rodríguez-Losada D., and Galán R. The fuzzy Kalman filter: state estimation using possibilistic techniques. Fuzzy Sets and Systems 157 16 (2006) 2145-2170
59. Mendes R., Kennedy J., and Neves J. The fully informed particle swarm: simpler, maybe better. IEEE Trans. Evol. Comput. 8 3 (2004) 204-210
60. Messerschmidt L., and Engelbrecht A. Learning to play games using a PSO-based competitive learning approach. IEEE Trans. Evol. Comput. 8 3 (2004) 280-288
61. V. Miranda, N. Fonseca, EPSO-evolutionary particle swarm optimization, a new algorithm with applications in power systems, in: Proc. IEEE Trans. Distribution Conf. on Exhibition, 2002.
62. V. Miranda, N. Fonseca, EPSO-best-of-two-worlds meta-heuristic applied to power system problems, in: Proc. Congr. on Evolutionary Computation, 2002.
63. S. Naka, T. Genji, T. Yura, Y. Fukuyama, Hybrid particle swarm optimization based distribution state estimation using constriction factor approach, in: Proc. Internat. Conf. on SCIS & ISIS, 2002.
64. Narendra K.S., and Parthasarathy K. Identification and control of dynamical system using neural networks. IEEE Trans. Neural Networks 1 1 (1990) 4-27
65. Nounou H.N., and Nounou M.N. Multiscale fuzzy Kalman filtering. Eng. Appl. Artif. Intell. 19 5 (2006) 439-450
66. E. Ozcan, C.K. Mohan, Particle swami optimization: surfing the waves, in: Proc. IEEE Congr. on Evolutionary Computation, 1999.
67. K.E. Parsopouls, M.N. Vrahatis, Particle swarm optimization method in multiobjective problems, in: Proc. ACM Symp. on Applied Computing and Evolutionary Computation, 2002.
68. Pearlmutter B.A. Gradient calculations for dynamic recurrent neural networks: a survey. IEEE Trans. Neural Networks 6 (1995) 1212-12228
69. Polycarpou M.M., and Ioannou P.A. Learning and convergence analysis of neural-type structured networks. IEEE Trans. Neural Networks 3 1 (1992) 39-50
70. Puskorius G., and Feldkamp L. Neurocontrol of nonlinear dynamical systems with Kalman filter trained recurrent networks. IEEE Trans. Neural Networks 5 (1994) 279-297
71. P. Ramaswamy, M. Riese, R. Edwards, K. Lee, Two approaches for automating the tuning process of fuzzy logic controllers, in: IEEE Conf. on Decision and Control, 1993.
72. Ratnaweera A., Halgamuge S., and Watson H. Self-organizing hierarchical particle swarm optimizer with time-varying acceleration coefficients. IEEE Trans. Evol. Comput. 8 3 (2004) 240-255
73. Rong H.-J., Sundararajan N., Huang G.-B., and Saratchandran P. Sequential adaptive fuzzy inference system (SAFIS) for nonlinear system identification and prediction. Fuzzy Sets and Systems 57 (2006) 1260-1275
74. Satini S., Bimbo A.D., and Jain R. Block-structured recurrent neural networks. Neural Networks 8 (1995) 135-147
75. Shah S., Palmeieri F., and Datum M. Optimal filtering algorithms for fast learning in feedforward neural networks. Neural Networks 5 (1992) 779-787
76. Shi Y., Eberhart R., and Chen Y. Implementation of evolutionary fuzzy systems. IEEE Trans. Fuzzy Systems 7 2 (1999)
77. Simon D. Training fuzzy systems with the extended Kalman filter. Fuzzy Sets and Systems 132 (2002) 189-199
78. Simon D., and El-Sherief H. Fuzzy logic for digital phase-locked loop filter design. IEEE Trans. Fuzzy Systems 3 (1995) 211-218
79. Singhal S., and Wu L. Training multilayer perceptrons with the extended Kalman algorithm. Adv. Neural Inform. Process. System 1 (1989) 133-140
80. Sonbol A.H., and Sami Fadali M. Stability analysis of discrete TSK Type II/III systems. IEEE Trans. Fuzzy Systems 14 5 (2006) 640-653
81. Sonbol A.H., and Sami Fadali M. TSK fuzzy systems types II and III stability analysis: continuous case. IEEE Trans. Systems Man and Cybernet. Part B 36 1 (2006) 2-12
82. P.N. Suganthan, Particle swarm optimizer with neighborhood operator, in: Proc. IEEE Congr. on Evolutionary Computation, 1999.
83. Sugeno M., and Tanaka K. Successive identification of a fuzzy model and its applications to prediction of a complex system. Fuzzy Sets and Systems 42 (1991) 315-334
84. Surmann H. Genetic optimization of a fuzzy system for charging batteries. IEEE Trans. Ind. Electron. 43 (1996) 541-548
85. Takagi H., and Hayashi I. NN-driven fuzzy reasoning. Internat. J. Approx. Reason. 5 3 (1991) 191-212
86. Wachowiak M., Smolikova R., Zheng Y., Zurada J., and Elmaghraby A. An approach to multimodal biomedical image registration utilizing particle swarm optimization. IEEE Trans. Evol. Comput. 8 3 (2004) 289-301
87. E.A. Wan, A.T. Nelson, Dual Kalman filtering methods for nonlinear prediction, smoothing, and estimation, NIPS, 1996.
88. Wang L. Adaptive Fuzzy Systems and Control: Design and Stability Analysis (1994), Prentice-Hall, Englewood Cliffs, NJ
89. Wang L., and Frayman Y. A dynamically generated fuzzy neural network and its application to torsional vibration control of tandem cold rolling mill spindles. Eng. Appl. Artif. Intell. 15 (2003) 541-550
90. L. Wang, J. Mendel, Back-propagation of fuzzy systems as nonlinear dynamic system identifiers, in: IEEE Internat. Conf. on Fuzzy Systems, 1992.
91. Wang L., and Yen J. Extracting fuzzy rules for system modeling using a hybrid of genetic algorithms and Kalman filter. Fuzzy Sets and Systems 101 3 (1999) 353-362
92. Williams R.J., and Zipser D. A learning algorithm for continually running recurrent neural networks. Neural Comput. 1 (1989) 270-280
93. Wu T.P., and Chen S.M. A new method for constructing membership functions and fuzzy rules from training examples. IEEE Trans. Systems Man Cybernet. Part B Cybernet. 29 1 (1999)
94. Yager R.R., and Zadeh L.A. Fuzzy Sets Neural Networks, and Soft Computing (1994), Thomson Learning
95. Yang Z.P., and Feng X.X. A note on the trace inequality for products of Hermitian matrix power. J. Inequalities Pure Appl. Math. 3 5 (2002)
96. Yoshida H., Kawata K., Fukuyama Y., Takayama S., and Naknishi Y. A particle swarm optimization for reactive power and voltage control considering voltage security assessment. IEEE Trans. Power System 15 4 (2000) 1232-1239
97. W. Yu, X. Li, Fuzzy neural modeling using stable learning algorithm, in: Proc. American Control Conf., 2003.
98. Yu W., and Li X. Fuzzy identification using fuzzy neural networks with stable learning algorithms. IEEE Trans. Fuzzy Systems 12 3 (2004) 411-420
99. Zhang J., and Morris A.J. Recurrent neuro-fuzzy networks for nonlinear process modeling. IEEE Trans. Neural Networks 10 (1999) 313-326
100. Zhou Y., Li S., and Jin R. A new fuzzy neural network with fast learning algorithm and guaranteed stability for manufacturing process control. Fuzzy Sets and Systems 132 2 (2002) 201-216