Identification of nonlinear systems with outliers using wavelet neural networks based on annealing dynamical learning algorithm

Engineering Applications of Artificial Intelligence

Volumn 25, Issue 3, 2012, Pages 533-543

  Ko, Chia Nan ^a  

^a NAN KAI UNIVERSITY OF TECHNOLOGY   (Taiwan)

Author keywords

Annealing dynamical learning algorithm; Outliers; Particle swarm optimization; Wavelet neural networks; Wavelet support vector regression

Indexed keywords

COMPUTATIONALLY EFFICIENT; LEARNING RATES; OPTIMIZATION METHOD; OUTLIERS; SIMULATED RESULTS; SPEED OF CONVERGENCE; SUPPORT VECTOR REGRESSIONS; SYSTEM IDENTIFICATIONS; TIME VARYING; TRAINING PROCEDURES; TRANSLATION AND DILATION; WAVELET KERNEL; WAVELET NEURAL NETWORKS; WAVELET SUPPORT VECTORS;

ANNEALING; LEARNING ALGORITHMS; NONLINEAR SYSTEMS; PARTICLE SWARM OPTIMIZATION (PSO);

STATISTICS;

EID: 84857446921     PISSN: 09521976     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.engappai.2011.09.019     Document Type: Article

References (68)

1. R.H. Abiyev, and O. Kaynak Fuzzy wavelet neural networks for identification and control of dynamic plantsA novel structure and a comparative study IEEE Transactions on Industrial Electronics 55 8 2008 3133 3140
2. L. Ait Gougam, M. Tribeche, and F. Mekideche-Chafa A systematic investigation of a neural network for function approximation Neural Networks 21 9 2008 1311 1317
3. A. Azadeh, S.F. Ghaderi, M. Anvari, M. Saberi, and H. Izadbakhsh An integrated artificial neural network and fuzzy clustering algorithm for performance assessment of decision making units Applied Mathematics and Computation 187 2 2007 584 599 (Pubitemid 46656281)
4. S.A. Billings, and H.L. Wei A new class of wavelet networks for nonlinear system identification IEEE Transactions on Neural Networks 16 4 2005 862 874 (Pubitemid 41064318)
5. G.E.P. Box, G.M. Jenkins, and G.C. Reinsel Time Series Analysis, Forecasting and Control 2008 Wiley New York
6. G.R. Chen, Y. Chen, and H. Ogmen Identifying chaotic systems via a Wiener-type cascade model IEEE Transactions on Control Systems Magazine 17 5 1997 29 36 (Pubitemid 127595774)
7. Y.M. Chen, and C.T. Lin Dynamic parameter optimization of evolutionary computation for on-line prediction of time series with changing dynamics Applied Soft Computing 7 2007 1170 1176 (Pubitemid 46810391)
8. C.C. Chuang, J.T. Jeng, and P.T. Lin Annealing robust radial basis function networks for function approximation with outliers Neurocomputing 56 2004 123 139
9. C.C. Chuang, S.F. Su, and C.C. Hsiao The annealing robust backpropagation (BP) learning algorithm IEEE Transactions on Neural Networks 11 5 2000 1067 1077
10. C.C. Chuang, S.F. Su, J.T. Jeng, and C.C. Hsiao Robust support vector regression networks for function approximation with outliers IEEE Transactions on Neural Networks 13 6 2002 1322 1330
11. C.K. Chui An Introduction to Wavelets 1992 Academic Press New York
12. I. Daubechies Ten Lectures on Wavelets 1992 SIAM Pennsylvania
13. H. Du, and N. Zhang Application of evolving TakagiSugeno fuzzy model to nonlinear system identification Applied Soft Computing 8 2008 676 686 (Pubitemid 47374598)
14. E. Elbeltagi, T. Hegazy, and D. Grierson Comparison among five evolutionary-based optimization algorithms Advanced Engineering Informatics 19 1 2005 43 53 (Pubitemid 41000265)
15. E. Elfelly, J.Y. Dieulot, M. Benrejeb, and P. Borne A new approach for multimodel identification of complex systems based on both neural and fuzzy clustering algorithms Engineering Applications of Artificial Intelligence 23 2010 1064 1071
16. V. Fernandez Wavelet-and SVM-based forecasts: an analysis of the U.S. metal and materials manufacturing industry Resources Policy 32 2007 80 89 (Pubitemid 47181172)
17. Y.Y. Fu, C.J. Wu, J.T. Jeng, and C.N. Ko Identification of MIMO systems using radial basis function networks with hybrid learning algorithm Applied Mathematics and Computation 213 2009 184 196
18. Y.Y. Fu, C.J. Wu, J.T. Jeng, and C.N. Ko Annealing robust radial basis function networks with support vector regression for nonlinear inverse system identification with outliers Journal of Vibration and Control 16 13 2010 1915 1940
19. D.M. Hawkins Identification of Outliers 1980 Chapman and Hall London
20. S.T. Hsieh, T.Y. Sun, C.L. Lin, and C.C. Liu Effective learning rate adjustment of blind source separation based on an improved particle swarm optimizer IEEE Transactions on Evolutionary Computation 12 2 2008 242 251
21. J.T. Jeng, C.C. Chuang, and C.W. Tao Hybrid SVMR-GPR for modeling of chaotic time series systems with noise and outliers Neurocomputing 73 2010 1686 1693
22. C. Johnson, G.K. Venayagamoorthy, and P. Mitra Comparison of a spiking neural network and an MLP for robust identification of generator dynamics in a multimachine power system Neural Network 22 56 2009 833 841
23. C.F. Juang A TSK-type recurrent fuzzy network for dynamic systems processing by neural network and genetic algorithms IEEE Transactions on Fuzzy Systems 10 2 2002 155 170
24. C.F. Juang, and C.T. Lin A recurrent self-organizing neural fuzzy inference network IEEE Transactions on Neural Networks 10 4 1999 828 845
25. Kennedy, J.; Eberhart, R.; 1995. Particle swarm optimization. In: Proceedings of the IEEE International Conference on Neural Networks, pp. 19421948.
26. B. Kosko Neural Networks and Fuzzy Systems: A Dynamical Systems Approach to Machine Intelligence 1992 Englewood Cliffs New Jersey
27. C.C. Lee, P.C. Chung, J.R. Tsai, and C.I. Chang Robust radial basis function neural networks IEEE Transactions on Systems, Man, and CyberneticsPart B: Cybernetics 29 6 1999 674 685
28. G.G. Lendaris Adaptive dynamic programming approach to experience-based systems identification and control Neural Networks 22 5-6 2009 822 832
29. K. Liano Robust error measure for supervised neural network learning with outliers IEEE Transactions on Neural Networks 7 1996 246 250 (Pubitemid 126811747)
30. C.J. Lin Wavelet neural networks with a hybrid learning approach Journal of Information Science and Engineering 22 2006 1367 1387
31. C.J. Lin, and C.H. Chen A compensation-based recurrent fuzzy neural network for dynamic system identification European Journal of Operational Research 172 2006 696 715
32. F.J. Lin, C.H. Lin, and P.H. Shen Self-constructing fuzzy neural network speed controller for permanent-magnet synchronous motor drive IEEE Transactions on Fuzzy Systems 9 2001 751 759
33. F.J. Lin, and R.J. Wai Hybrid control using recurrent fuzzy neural network for linear-induction motor servo drive IEEE Transactions on Fuzzy Systems 9 1 2001 102 115
34. B. Luitel, and G.K. Venayagamoorthy Particle swarm optimization with quantum infusion for system identification Engineering Applications of Artificial Intelligence 23 2010 635 649
35. S.G. Mallat A theory for multiresolution signal representation: the wavelet representation IEEE Transactions on Pattern Analysis and Machine Intelligence 11 7 1989 674 693
36. M.R. Manel, R.A. Jose Luis, C.V. Gustavo, M.M. Jordi, N.V. Angel, S.O. Emilio, and R.F.V. Anibal Support vector machines for nonlinear kernel ARMA system identification IEEE Transactions on Neural Networks 17 6 2006 1617 1622
37. R. Mendes, J. Kennedy, and J. Neves The fully informed particle swarm: simpler, maybe better IEEE Transactions on Evolutionary Computation 8 3 2004 204 210
38. R. Min, and H.D. Cheng Effective image retrieval using dominant color descriptor and fuzzy support vector machine Pattern Recognition 42 2009 147 157
39. H. Muzhou, and H. Xuli The multidimensional function approximation based on constructive wavelet RBF neural network Applied Soft Computing Journal 11 2 2011 2173 2177
40. K.S. Narendra Identification and control of dynamical systems using neural network IEEE Transactions on Neural Networks 1 1 1990 4 27
41. S. Ozer, and H. Zorlu Identification of bilinear systems using differential evolution algorithm Indian Academy of Sciences 36 3 2011 281 292
42. A. Ratnaweera, S.K. Halgamuge, and C. Watson Self-organizing hierarchical particle swarm optimizer with time-varying acceleration coefficients IEEE Transactions on Evolutionary Computation 8 3 2004 240 255
43. V. Rouss, and W. Charon Multi-input and multi-output neural model of the mechanical nonlinear behaviour of a PEM fuel cell system Journal of Power Sources 175 2008 1 17 (Pubitemid 350161821)
44. B. Schölkopf, A.J. Smola, R. Willianson, and P. Bartlett New support vector algorithms Neural Computation 12 5 2000 1207 1245
45. Shi, Y.; Eberhart, R.C.; 1999. Empirical study of particle swarm optimization. In: Proceedings of the Congress on Evolutionary Computation, pp. 19451950.
46. Song, G.J.; Zhang, J.L.; Sun, Z.L.; 2008. The research of dynamic change learning rate strategy in BP neural network and application in network intrusion detection. In: Proceedings of the Third International Conference on Innovative Computing Information and Control, pp. 513513.
47. A. Subasi, A. Alkan, E. Koklukaya, and M.K. Kiymik Wavelet neural network classification of EEG signals by using AR model with MLE preprocessing Neural Networks 18 2005 985 997 (Pubitemid 41253513)
48. A.V.D. Swanchez Special Issue on the RBF Networks: Part I and Part II Neurocomputing 1998 19 and 20.
49. T.B. Trafalis, and R.C. Gilbert Robust classification and regression using support vector machines European Journal of Operational Research 173 3 2006 893 909 (Pubitemid 43866334)
50. S.T. Tzeng Design of fuzzy wavelet neural networks using the GA approach for function approximation and system identification Fuzzy Sets and Systems 161 19 2010 2585 2596
51. V. Vapnik The Nature of Statistical Learning Theory 1995 Springer Berlin
52. V.N. Vapnik Statistical Learning Theory 1998 Wiley New York
53. V.N. Vapnik, S. Golowich, and A. Smola Support vector method for function approximation, regression estimation, and signal processing Advances in Neural Information Processing Systems 9 1996 281 287
54. W.G. Vieira, V.M.L. Santos, F.R. Carvalho, J.A.F.R. Pereira, and A.M.F. Fileti Identification and predictive control of a FCC unit using an MIMO neural model Chemical Engineering and Processing 44 2005 855 868
55. X.Y. Wang, and Z.K. Fu A wavelet-based image denoising using least squares support Engineering Applications of Artificial Intelligence 23 2010 862 871
56. H.L. Wei, S.A. Billings, Y.F. Zhao, and L.Z. Guo An adaptive wavelet neural network for spatio-temporal system identification Neural Networks 23 10 2010 1286 1299
57. J.D. Wu, and J.J. Chan Faulted gear identification of a rotating machinery based on wavelet transform and artificial neural network Expert Systems with Applications 36 5 2009 8862 8875
58. J. Xu, and D.W.C. Ho A basis selection algorithm for wavelet neural networks Neurocomputing 48 2002 681 689 (Pubitemid 36221521)
59. S. Yang, M. Wang, and L. Jiao Approximation of functions with spatial inhomogeneity based on true ortho-ridgelet neural network Applied Soft Computing Journal 11 2 2011 2444 2451
60. S. Yilmaz, and Y. Oysal Fuzzy wavelet neural network models for prediction and identification of dynamical systems IEEE Transactions on Neural Networks 21 10 2010 1599 1609
61. S.J. Yoo, J.B. Park, and Y.H. Choi Indirect adaptive control of nonlinear dynamic systems using self-recurrent wavelet neural networks via adaptive learning rates Information Sciences 177 2007 3074 3098 (Pubitemid 46719181)
62. W. Yu Nonlinear system identification using discrete-time recurrent neural networks with stable learning algorithms Information Sciences 158 2004 131 147
63. Q. Zhang Using wavelet networks in nonparametric estimation IEEE Transactions on Neural Networks 8 2 1997 227 236 (Pubitemid 127765118)
64. Q. Zhang, and A. Benveniste Wavelet networks IEEE Transactions on Neural Networks 3 6 1992 889 898 (Pubitemid 23580843)
65. X.G. Zhang, D. Gao, X.G. Zhang, and S.J. Ren Robust wavelet support vector machine for regression estimation International Journal of Information Technology 11 9 2005 35 45
66. J. Zhang, G.G. Walter, Y. Miao, and W.N.W. Lee Wavelet neural networks for function learning IEEE Transactions on Signal Processing 43 6 1995 1485 1497
67. M.M. Zhang, H. Yang, Z.D. Jin, J.G. Yu, Z.Y. Cai, and Z.S. Li Differential diagnosis of pancreatic cancer from normal tissue with digital imaging processing and pattern recognition based on a support vector machine of EUS images Gastrointestinal Endoscopy 72 5 2010 978 985
68. L. Zhang, W. Zhou, and L. Jiao Wavelet support vector machine IEEE Transactions on Systems, Man, and Cybernetics - Part B: Cybernetics 34 1 2004 34 38