An adaptive wavelet neural network for spatio-temporal system identification

Neural Networks

Volumn 23, Issue 10, 2010, Pages 1286-1299

  Wei, H L ^a   Billings, S A ^a   Zhao, Y F ^a   Guo, L Z ^a  

^a UNIVERSITY OF SHEFFIELD   (United Kingdom)

Author keywords

Coupled map lattices; Neural networks; Particle swarm optimization; Spatio temporal systems; Wavelets

Indexed keywords

ADAPTIVE WAVELET NEURAL NETWORK; ADJUSTABLE PARAMETERS; BASIC CONCEPTS; COUPLED MAP LATTICES; HYBRID TRAINING; MODELLING FRAMEWORK; NETWORK MODELS; ORTHOGONAL LEAST SQUARES ALGORITHM; ORTHOGONAL PROJECTION; PARTICLE SWARM; PARTICLE SWARM OPTIMIZATION ALGORITHM; PARTICLE SWARM OPTIMIZERS; SPATIO-TEMPORAL SYSTEM; SYSTEM OUTPUT; TOTAL VARIANCE; TWO STAGE; WAVELET REPRESENTATION; WAVELETS;

ALGORITHMS; CRYSTAL LATTICES; NEURAL NETWORKS; POWER TRANSFORMERS;

PARTICLE SWARM OPTIMIZATION (PSO);

ANALYTICAL ERROR; ARTICLE; ARTIFICIAL NEURAL NETWORK; CONTROLLED STUDY; CRYSTAL STRUCTURE; LEARNING ALGORITHM; NERVE CELL NETWORK; ORTHOGONAL ROTATION; PRIORITY JOURNAL; PROCESS OPTIMIZATION; SIGNAL NOISE RATIO;

ALGORITHMS; COMPUTER SIMULATION; MODELS, BIOLOGICAL; NEURAL NETWORKS (COMPUTER);

EID: 78149498272     PISSN: 08936080     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neunet.2010.07.006     Document Type: Article

References (98)

1. Adamatzky A. Identification of cellular automata 1994, Taylor & Francis, London.
2. Adamatzky A. Computing in nonlinear media and automata collectives 2001, IOP Publishing, Bristol.
3. Adamatzky A. Collision-based computing in Belousov-Zhabotinsky medium. Chaos, Solitons and Fractals 2004, 21:1259-1264.
4. Adamatzky A., Bronnikov V. Identification of additive cellular automata. Journal of Computer and System Sciences 1990, 28:47-51.
5. Aguirre L.A., Billings S.A. Validating identified nonlinear models with chaotic dynamics. International Journal of Bifurcation and Chaos 1994, 4:109-125.
6. Aguirre L.A., Billings S.A. Dynamical effects of overparameterisation in nonlinear models. Physica D 1995, 80:26-40.
7. Astic L., Pellier-Monnin V., Godinot F. Spatio-temporal patterns of ensheathing cell differentiation in the rat olfactory system during development. Neuroscience 1998, 84(1):295-307.
8. Aydogan D., Elmas A., Albora A.M., Ucan O.N. A new approach to the structural features of the Aegean sea: Cellular neural network. Marine Geophysical Researches 2005, 26(1):1-15.
9. Bakshi B., Stephanopoulos G. Wave-net: a multiresolution, hierarchial neural network with localized learning. AIChE Journal 1993, 39(1):57-81.
10. Bascompte J., Sole R.V. Modelling spatio temporal dynamics in ecology 1998, Springer, Berlin.
11. Billings S.A., Chen S., Korenberg M.J. Identification of MIMO nonlinear systems suing a forward regression orthogonal estimator. International Journal of Control 1989, 49(6):2157-2189.
12. Billings S.A., Coca D. Discrete wavelet models for identification and qualitative analysis of chaotic systems. International Journal of Bifurcation and Chaos 1999, 9(7):263-1284.
13. Billings S.A., Coca D. Identification of coupled map lattice models of deterministic distributed parameter systems. International Journal of Systems Science 2002, 33:623-634.
14. Billings S.A., Guo L.Z., Wei H.L. Identification of coupled map lattice models for spatio-temporal patterns using wavelets. International Journal of Control 2005, 14(14):1021-1038.
15. Billings S.A., Wei H.L. The wavelet-NARMAX representation: a hybrid model structure combining polynomial models with multiresolution wavelet decompositions. International Journal of Systems Science 2005, 36(3):137-152.
16. Billings S.A., Wei H.L. A new class of wavelet networks for nonlinear system identification. IEEE Transactions on Neural Networks 2005, 16(4):862-874.
17. Billings S.A., Wei H.L. Sparse model identification using a forward orthogonal regression algorithm aided by mutual information. IEEE Transactions on Neural Networks 2007, 18(1):306-310.
18. Billings S.A., Wei H.L. An adaptive orthogonal search algorithm for model subset selection and nonlinear system identification. International Journal of Control 2008, 81(5):714-724.
19. Billings S.A., Yang Y.Y. Identification of the neighbourhood and CA rules from spatio-temporal CA patterns. IEEE Transactions on Systems, Man, and Cybernetics, Part B 2003, 33:32-339.
20. Billings S.A., Zhu Q.M. Model validation tests for multivariable nonlinear models including neural networks. International Journal of Control 1995, 62:749-766.
21. Chen S., Billings S.A. Modelling and analysis of nonlinear time series. International Journal of Control 1989, 50:2151-2171.
22. Chen S., Billings S.A., Luo W. Orthogonal least squares methods and their application to nonlinear system identification. International Journal of Control 1989, 50(5):1873-1896.
23. Chen S., Billings S.A. Neural networks for nonlinear dynamic system modelling and identification. International Journal of Control 1992, 56(2):319-346.
24. Chen S., Cowan C.F.N., Grant P.M. Orthogonal least-squares learning algorithm for radial basis function networks. IEEE Transactions on Neural Networks 1991, 2(2):302-309.
25. Chen S., Hong X., Harris C.J. Sparse kernel regression modeling using combined locally regularized orthogonal least squares and D-optimality experimental design. IEEE Transactions on Automatic Control 2003, 48(6):1029-1036.
26. Chen S., Hong X., Harris C.J., Sharkey P.M. Sparse modeling using orthogonal forward regression with press statistic and regularization. IEEE Transactions on Systems, Man and Cybernetics, Part B (Cybernetics) 2004, 34(2):898-911.
27. Chen Z.S., Ji C.Y. Spatial-temporal modeling of malware propagation in networks. IEEE Transactions on Neural Networks 2005, 16(5):1291-1303.
28. Chen Y.H., Yang B., Dong J.W. Time-series prediction using a local linear wavelet neural network. Neurocomputing 2006, 69:449-465.
29. Chua L.O., Roska T. Cellular neural networks: foundations and applications 2001, Cambridge University Press, Cambridge.
30. Chua L.O., Yang L. Cellular neural networks: theory. IEEE Transactions on Circuits and Systems I: Fundamental Theory and Applications 1988, 35(12):1257-1272.
31. Chua L.O., Yang L. Cellular neural networks: applications. IEEE Transactions on Circuits and Systems I: Fundamental Theory and Applications 1988, 35(12):1273-1290.
32. Chui C.K. An introduction to wavelets 1992, Academic Press, Boston.
33. Clerc M., Kennedy J. The particle swarm-explosion, stability, and convergence in a multidimensional complex space. IEEE Transactions on Evolutionary Computation 2002, 6(1):58-73.
34. Coca D., Billings S.A. Continuous-time system identification for linear and nonlinear system identification using wavelet decompositions. International Journal of Bifurcation and Chaos 1997, 7(1):87-96.
35. Coca D., Billings S.A. Identification of coupled map lattice models of complex spatio-temporal pattern. Physics Letters A 2001, 287:65-73.
36. Czaran T. Spatiotemporal models of population and community dynamics 1998, Chapman & Hall, London.
37. Daubechies I. Ten lectures on wavelets 1992, Society for Industrial and Applied Mathematics, Philaelphia, Pennsylvania.
38. Delyon B., Juditsky A., Beneveniste A. Accuracy analysis for wavelet approximations. IEEE Transactions on Neural Networks 1995, 6(2):332-348.
39. Eberhart, R. C., & Kennedy, J. (1995). A new optimizer using particle swarm theory. In Proc. 6 th symp. micro mach. human sci. (pp. 39-43).
40. Fahlman S.E., Lebiere C. The cascade-correlation learning architecture. Advances in neural information processing systems 1990, Vol. 2:524-532. Morgan Kaufmann, San Mateo, CA.
41. Friedman J.H., Stuetzle W. Projection pursuit regression. Journal of the American Statistical Association 1981, 76(376):817-823.
42. Guo L.Z., Billings S.A. Identification of coupled map lattice models of stochastic spatio-temporal dynamics using wavelets. Dynamical Systems 2004, 19:265-278.
43. Harris C.J., Hong X., Gan Q. Adaptive modelling, estimation and fusion from data: a neurofuzzy approach 2002, Springer-Verlag, Berlin, London.
44. Haykin S. Neural networks: a comprehensive foundation 1999, Macmillan, Maxwell Macmillan International, New York. 2nd ed.
45. Ho D.W.C., Li J.M., Niu Y.G. Adaptive neural control for a class of nonlinearly parametric time-delay systems. IEEE Transactions on Neural Networks 2005, 16(3):625-635.
46. Hsu C.F., Lin C.M., Lee T.T. Wavelet adaptive backstepping control for a class of nonlinear systems. IEEE Transactions on Neural Networks 2006, 17(5):1175-1183.
47. Huang G.B., Chen L., Siew C.K. Universal approximation using incremental constructive feedforward networks with random hidden nodes. IEEE Transactions on Neural Networks 2006, 17(4):879-892.
48. Huang C.S., Su W.C. Identification of modal parameters of a time invariant linear system by continuous wavelet transformation. Mechanical Systems and Signal Processing 2007, 21(4):1642-1664.
49. Hwang J.N., Lay S.R., Maechler M., Martin R.D., Schimert J. Regression modeling in back-propagation and projection pursuit learning. IEEE Transactions on Neural Networks 1994, 5(3):342-353.
50. Jahne B. Spatio-temporal image processing: theory and scientific applications 1993, Springer-Verlag, Berlin.
51. Jones L.K. A simple lemma on greedy approximation in Hilbert space and convergence rates for projection pursuit regression and neural network training. Annals of Statistics 1992, 20(1):608-613.
52. Juditsky A., Hjalmarsson H., Benveniste A., Delyon B., Ljung L., Sjoberg J., et al. Nonlinear black-box models in system identification: mathematical foundations. Automatica 1995, 31(12):725-1750.
53. Kaneko K. Spatio-temporal chaos in one- and two-dimensional coupled map lattices. Physica D 1989, 37:60-82.
54. Kaneko K. Theory and application of coupled map lattices 1993, Wiley, New York.
55. Kennedy, J., & Eberhart, R. C. (1995). Particle swarm optimization. In Proc. IEEE int. conf. neural networks. vol. IV. (pp. 1942-1948).
56. Kennedy J., Eberhart R.C., Shi Y. Swarm intelligence 2001, Morgan Kaufmann Publishers, San Francisco.
57. Kwok T.Y., Yeung D.Y. Constructive algorithms for structure learning in feedforward neural networks for regression problems. IEEE Transactions on Neural Networks 1997, 8(3):630-645.
58. Kwok T.Y., Yeung D.Y. Objective functions for training new hidden units in constructive neural networks. IEEE Transactions on Neural Networks 1997, 8(5):1131-1148.
59. Leontaritis I.J., Billings S.A. Experimental design and identifiability for nonlinear systems. International Journal of Systems Science 1987, 18:189-202.
60. Leung H., Hennessey G., Drosopoulos A. Signal detection using the radial basis function coupled map lattice. IEEE Transactions on Neural Networks 2000, 11(5):1133-1151.
61. Lin C.J., Chin C.C. Prediction and identification using wavelet-based recurrent fuzzy neural networks. IEEE Transactions on Systems, Man, and Cybernetics, Part B 2004, 34(5):2144-2154.
62. Lin F.J., Shieh H.J., Huang P.K. Adaptive wavelet neural network control with hysteresis estimation for piezo-positioning mechanism. IEEE Transactions on Neural Networks 2006, 17(2):432-444.
63. Liu G.P. Nonlinear identification and control: a neural network approach 2001, Springer-Verlag, Berlin.
64. Mallat S.G. A theory for multiresolution signal decomposition: the wavelet representation. IEEE Transactions on Pattern Analysis and Machine Intelligence 1989, 11:674-693.
65. Mallat S., Zhang Z. Matching pursuit with time-frequency dictionaries. IEEE Transactions on Signal Processing 1993, 41(12):3397-3415.
66. Mandelj S., Grabec I., Govekar E. Statistical approach to modeling of spatiotemporal dynamics. International Journal of Bifurcation and Chaos 2001, 11:2731-2738.
67. Marcos-Nikolaus P., Martin-Gonzalez J.M., Sole R.V. Spatial forecasting: detecting determinism from single snapshots. International Journal of Bifurcation and Chaos 2002, 12:369-376.
68. More J.J. The Levenberg-Marquardt algorithm: implementation and theory. Lecture notes in mathematics 1977, Vol. 630:105-116. Springer-Verlag. G.A. Watson (Ed.).
69. Ohtaki M., Honjo H., Sakaguchi H. A coupled map lattice model for dendrite in diffusion field. Journal of Crystal Growth 2002, 237:159-163.
70. Oussar Y., Rivals I., Personnaz L., Dreyfus G. Training wavelet networks for nonlinear dynamic input-output modelling. Neurocomputing 1998, 20:173-188.
71. Parlitz U., Merkwirth C. Prediction of spatiotemporal time series based on reconstructed local states. Physical Review Letters 2000, 84:2820-2823.
72. Parsopoulos K.E., Vrahatis M.N. On the computation of all global minimizes through particle swarm optimization. IEEE Transactions on Evolutionary Computation 2004, 8(3):211-224.
73. Pati Y.C., Krishnaprasad P.S. Analysis and synthesis of feedforward neural networks using discrete affine wavelet transforms. IEEE Transactions on Neural Networks 1993, 4(1):73-85.
74. Pearson R.K. Discrete-time dynamic models 1999, Oxford Univ. Press, Oxford, UK.
75. Raabe D. Cellular automata in materials science with particular reference to recrystallization simulation. Annual Review of Materials Research 2002, 32:53-76.
76. Reed R.D., Marks R.J. Neural smithing: supervised learning in feedforward artificial neural networks 1999, The MIT Press, Cambridge, MA.
77. Rying E.A., Bilbro J.L., Lu J.C. Focused local learning with wavelet neural networks. IEEE Transactions on Neural Networks 2002, 13:304-319.
78. Sanner R.M., Slotine J.J.E. Structurally dynamic wavelet networks for adaptive control of robotic systems. International Journal of Control 1998, 70(3):405-421.
79. Silva F.L., Principe J.C., Almeida L.B. Spatiotemporal models in biological and artificial systems 1997, IOS Press, Washington.
80. Sitz A., Kurths J., Voss H.U. Identification of nonlinear spatio-temporal systems via partitioned filtering. Physical Review E 2003, 68:016202.
81. Unser M. Approximation power of biorthogonal wavelet expansions. IEEE Transactions on Signal Processing 1996, 44:519-527.
82. Unser M., Aldroubi A., Eden M. A family of polynomial spline wavelet transforms. Signal Processing 1993, 30(2):141-162.
83. van den Bergh F., Engelbrecht A.P. A cooperative approach to particle swarm optimization. IEEE Transactions on Evolutionary Computation 2004, 8(3):225-239.
84. Wai R.J., Chang H.H. Backstepping wavelet neural network control for indirect field-oriented induction motor drive. IEEE Transactions on Neural Networks 2003, 15(2):367-382.
85. Wei H.L., Billings S.A., Liu J. Term and variable selection for nonlinear system identification. International Journal of Control 2004, 77(1):86-110.
86. Wei H.L., Billings S.A. A unified wavelet-based modelling framework for nonlinear system identification: the WANARX model structure. International Journal of Control 2004, 77(4):351-366.
87. Wei H.L., Billings S.A. Identification and reconstruction of chaotic systems using multiresolution wavelet decompositions. International Journal of Systems Science 2004, 35(9):511-526.
88. Wei H.L., Billings S.A. Long term prediction of nonlinear time series using multiresolution wavelet models. International Journal of Control 2006, 79(76):569-580.
89. Wei H.L., Billings S.A. Genearlised cellular neural networks (GCNNs) constructed using particle swarm optimisation for spatio-temporal evolutionary pattern identification. International Journal of Bifurcation and Chaos 2008, 18(12):3611-3624.
90. Wei H.L., Billings S.A., Balikhin M.A. Wavelet based nonparametric NARX models for nonlinear input-output system identification. International Journal of Systems Science 2006, 37(5):1089-1096.
91. Wolfram S. Cellular automata and complexity 1994, Addison-Wesley, New York.
92. Xia Y.S., Leung H. Nonlinear spatial-temporal prediction based on optimal fusion. IEEE Transactions on Neural Networks 2006, 17(4):975-988.
93. Xu J.H., Ho D.W.C. A basis selection algorithm for wavelet neural networks. Neurocomputing 2002, 48:681-689.
94. Xu J.X., Tan Y. Nonlinear adaptive wavelet control using constructive wavelet networks. IEEE Transactions on Neural Networks 2007, 18(1):115-127.
95. Zhang, Z. (1993). Matching pursuit. Ph.D. dissertation. New York University.
96. Zhang Q. Using wavelet network in nonparametric estimation. IEEE Transactions on Neural Networks 1997, 8(2):227-236.
97. Zhang Q., Benveniste A. Wavelet networks. IEEE Transactions on Neural Networks 1992, 3(6):889-898.
98. Zhang J., Walter G.G., Miao Y.B., Lee W.N.W. Wavelet neural networks for function learning. IEEE Transactions on Signal Processing 1995, 43(6):1485-1497.