Generalized cellular neural networks (GCNNs) constructed using particle swarm optimization for spatio-temporal evolutionary pattern identification

International Journal of Bifurcation and Chaos

Volumn 18, Issue 12, 2008, Pages 3611-3624

  Wei, H L ^a   Billings, S A ^a  

^a UNIVERSITY OF SHEFFIELD   (United Kingdom)

Author keywords

Cellular neural networks; Coupled map lattices; Evolutionary algorithms; Mutual information; Neural networks; Orthogonal least squares; Parameter estimation; Particle swarm optimization; Spatio temporal evolutionary systems

Indexed keywords

CELLULAR NEURAL NETWORKS; LEARNING ALGORITHMS; NEURAL NETWORKS; OPTIMIZATION; PARAMETER ESTIMATION; PARTICLE SWARM OPTIMIZATION (PSO);

CONSTRUCTIVE LEARNING ALGORITHM; COUPLED MAP LATTICES; EVOLUTIONARY SYSTEM; GENERALIZED CELLULAR NEURAL NETWORKS; MUTUAL INFORMATION ESTIMATIONS; MUTUAL INFORMATIONS; ORTHOGONAL LEAST SQUARES; PATTERN IDENTIFICATION;

EVOLUTIONARY ALGORITHMS;

EID: 60749125519     PISSN: 02181274     EISSN: None     Source Type: Journal    
DOI: 10.1142/S0218127408022585     Document Type: Article

References (61)

1. Adamatzky, A. [1994] Identification of Cellular Automata (Taylor & Francis, London).
2. Aguirrc, L. A. & Billings, S. A. [1995] "Retrieving dynamical invariants from chaotic data using NAR-MAX models," Int. J. Bifurcation and Chaos 5, 449-474.
3. Billings, S. A., Chen, S. & Korenberg, M. J. [1989] "Identification of MIMO nonlinear systems using a forward regression orthogonal estimator," Int. J. Gontr. 49, 2157-2189.
4. Billings, S. A. & Zhu, Q. M. [1994] "A structure detection algorithm for nonlinear dynamical rational models," Int. J. Gontr. 59, 1439-1463.
5. Billings, S. A. & Yang, X. X. [2003] "Identification of the neighborhood and CA rules from spatio-temporal CA patterns," IEEE Trams. Syst. Man Cybern. B 33, 332-339.
6. Billings, S. A. & Wei, H. L. [2005] "The wavelet-NARMAX representation: A hybrid model structure combining the polynomial models and multiresolution wavelet decompositions," Int. J. Syst. Sci, 36, 137-152.
7. Billings, S. A. & Wei, H. L. [2007] "Sparse model identification using a forward orthogonal regression algorithm aided by mutual information," IEEE Trans. Neural Networks 18, 306-310.
8. Billings, S. A. & Wei. H. L. [2008] "An adaptive orthogonal search algorithm for model subset selection and nonlinear system identification," Int. J. Control 81, 714-724.
9. Cai, H. & Min, L. Q. [2005] "A kind of two-input CNN with application," Int. J. Bifurcation, and Chaos 15, 4007-4011.
10. Chen, S., Billings, S. A. & Luo, W. [1989] "Orthogonal least squares methods and their application to nonlinear system identification," Int. J. Contr. 50, 1873-1896.
11. Chen, S., Hong, X. & Harris, C. J. [2003] "Sparse kernel regression modeling using combined locally regularized orthogonal least squares and D-optimality experimental design," IEEE Trans. Autom. Contr. 48, 1029-1036.
12. Chen, S., Hong, X., Harris, C. J. & Sharkey, P. M. [2004] "Sparse modeling using orthogonal forward regression with press statistic and regularization," IEEE Trans. Syst. Man Cybern. B 34, 898-911.
13. Chen, F. J., Chen, F. Y. & He, G. L. [2005] "Image processing via CNN genes with Von Neumann neighborhoods," Int. J. Bifurcation and Chaos 15, 3999-4006.
14. Chua, L. O. & Yang, Y. [1988a] "Cellular neural networks: Theory," IEEE Trans. Circuits Syst.-I: Fund. Th. Appl. 35, 1257-1272.
15. Chua, L. O. & Yang, Y. [1988b] "Cellular neural networks: Applications," IEEE Trans. Circuits Syst.-I: Fund. Th. Appl. 35, 1273-1290.
16. Chua, L. O. & Roska, T. [1993] "The CNN paradigm," IEEE Trans. Circuits Syst.-I: Fund. Th. Appl. 40, 147-156.
17. Chua, L. O., Hasler, M., Moschytz, G. S. & Neirynck, J. [1995] "Autonomous cellular neural networks - A unified paradigm for pattern-formation and active wave-propagation," IEEE Trans. Circuits Syst.-I: Fund. Th. Appl. 42, 559-577.
18. Chua, L. O. & Roska, T. [2002] Cellular Neural Networks and Visual Computing (Cambridge University Press, Cambridge).
19. Clerc, M. & Kennedy, J. [2002] "The particle swarmexplosion, stability, and convergence in a multidimensional complex space," IEEE Trans. Evol. Comput. 6, 58-73.
20. Cover, T. M. & Thomas, J. A. [1991] Elements of Information Theory (John Wiley & Sons, NY).
21. Crounse, K. R., Roska, T. & Chua, L. O. [1993] "Image half-toning with cellular neural networks," IEEE Trans. Circuits Syst-II: Anal. Dig. Sign. Process. 40, 267-283.
22. Crounse, K. R. & Chua, L. O. [1995] "Methods for imageprocessing and pattern-formation in cellular neural networks-A tutorial," IEEE Trans. Circuits Syst.-I. Fund. Th. Appl. 42, 583-601.
23. Crounse, K. R., Chua, L. O., Thiran, P. & Setti, G. [1996] "Characterization and dynamics of pattern formation in cellular neural networks," Int. J. Bifurcation and Chaos 6, 1703-1724.
24. Darbellay, G. A. & Vajda, I. [1999] "Estimation of the information by an adaptive partitioning of the observation space." IEEE Trans. Inform. Th. 45, 1315-1321.
25. Eberhart, R. C. & Kennedy, J. [1995] "A new optimizer using particle swarm theory," in Proc. 6th Symp. Micro Mach. Human Set., Nagoya, Japan, Oct. 4-6, 1995, pp. 39-43.
26. Friedman, J. H. & Stuetzle, W. [1981] "Projection pursuit regression," J. Amer. Statist. Assoc. 76, 817-823.
27. Gilli, M.; Roska, T., Chua, L. O. & Civalleri, P. P. [2002] "CNN dynamics represent a broader class than PDEs," Int. J. Bifurcation and Chaos 12, 2051-2068.
28. Harrer, H. & Nossek, J. A. [1992] "Discrete 0 time cellular networks," Int. J. Circuit Th. Appl. 20, 453-467.
29. He, Q. B. & Chen, F. Y. [2006] "Designing CNN genes for binary image edge smoothing and noise removing," Int. J. Bifurcation and Chaos 16, 3007-3013.
30. Huang, G. B., Chen, L. & Siew, C. K. [2006] "Universal approximation using incremental constructive feedforward networks with random hidden nodes," IEEE Trans. Neural Networks 17, 879-892.
31. Hwang, J. N., Lay, S. It., Maechler, M., Martin, It. D. &: Schlmert, J. [1994] "Regression modeling in backpropagation and projection pursuit learning," IEEE Trans. Neural Networks 5, 342-353.
32. Itoh, M. & Chua, L. O. [2003] "Equivalent CNN cell models and patterns," Int. J. Bifurcation and Chaos 13, 1055-1161.
33. Itoh, M. & Chua, L. O. [2005] "Image processing and self-organizing CNN," Int. J. Bifurcation and Chaos 15, 2939-2958.
34. Jones, L. K. [1992] "A simple lemma on greedy approximation in Hilbert space and convergence rates for projection pursuit regression and neural network training," Ann. Statist. 20, 608-613.
35. Kanakov, O. I., Shalfeev, V. D. & Forti, G. L. [2006] "Stationary patterns in CNN-like ensembles with modified cell output functions," Int. J. Bifurcation and Chaos 16, 2207-2220.
36. Kaneko, K. [1993] Theory and Application of Coupled Map Lattices (Wiley, NY).
37. Kennedy, J. & Eberhart, It. C. [1995] "Particle swarm optimization," in Proc. IEEE Int. Conf. Neural Networks, Vol. IV, Perth, Australia, 1995, pp. 1942-1948.
38. Kennedy, J., Eberhart, R. C. & Shi, Y. [2001] Swarm Intelligence (Morgan Kaufmann Publishers, San Francisco).
39. Kwok, T. Y. & Yeung, D. Y. [1997a] "Constructive algorithms for structure learning in feedforward neural networks for regression problems," IEEE Trans. Neural Networks 8, 630-645.
40. Kwok, T. Y. & Yeung, D. Y. [1997b] "Objective functions for training new hidden units in constructive neural networks," IEEE Trans. Neural Networks 8, 1131-1148.
41. Lin, S. S. & Yang, T. S. [2002] "On the spatial entropy and patterns of two-dimensional cellular neural networks," Int. J. Bifurcation and Chaos 12, 115-128.
42. Mallat, S. & Zhang, Z. [1993] "Matching pursuit with time-frequency dictionaries," IEEE Trans. Sign. Process. 41, 3397-3415.
43. Miller, J. & Huse, D. A. [1993] "Macroscopic equilibrium from microscopic irreversibility in a chaotic coupled map lattice," Phys. Rev. E 48, 2528-2535.
44. Moddemeljer, R. [1989] "On estimation of entropy and mutual information of continuous distributions," Sign. Process. 16, 233-246.
45. Moddemeijer, It. [1999] "A statistic to estimate the variance of the histogram-based mutual information estimator based on dependent pairs of observations," Sign. Process. 75, 51-63.
46. Morfu, S. & Cornte, J. C. [2004] "A nonlinear oscillators network devoted to image processing," Int. J. Bifurcation and Chaos 14, 1385-1394.
47. Paninski, L. [2003] "Estimation of entropy and mutual information," Neural Comput. 15, 1191-1253.
48. Roska, T. & Chua, L. O. [1992] "Cellular neural networks with nonlinear and delay-type template elements and nonuniform grids," Int. J. Circuit Th. Appl. 20, 469-481.
49. Roska, T. & Chua, L. O. [1993] "The CNN universal machine-an analogic array computer," IEEE Trans. Circuits Syst. II: Anal. Dig. Sign. Proc. 40, 163-173.
50. Sbitnev, V. I. & Chua, L. O. [2002] "Local activity criteria for discrete-MAP CNN," Int. J. Bifurcation and Chaos 2 1227-1272.
51. Shi, Y. & Eberhart, It. C. [1998a] "Parameter selection in particle swarm optimization," in Lecture Notes In Computer Science, eds. Porto, V. W., Saravanan, N., Waagen, I). & Eiben, A. E., 1447, pp. 591-600.
52. Shi, Y. & Eberhart, R. C. [1998b] "A modified particle swarm optimizer," in Proc. IEEE Conf. Evolutionary Computation, Anchorage, AK, USA, 4th-9th May, 1998, pp. 69-73.
53. Shi, B. E. [2004] "Oriented spatio patter formation in a four layer CMOS cellular network," Int. J. Bifurcation and Chaos 14, 1209-1221.
54. Stoffels, A., Roska, T. & Chua, L. O. [1996] "On object-oriented video coding using the CNN universal machine," IEEE Trans. Circuits Syst.-I: Fund. Th. Appl. 43, 948-952.
55. Thiran, P., Crounse, K. R., Chua, L. O. & Hasler, M. [1995] "Pattern-formation properties of autonomous cellular neural networks," IEEE Trans, Circuits Syst.-I: Fund. Th. Appl. 42. 757-774.
56. van den Rergh, F. &: Engelbrecht, A. P. [2004] "A cooperative approach to particle swarm optimization," IEEE Trans, Evolut, Comput. 8, 225-239.
57. Venetianer, P. L., Werblin, F., Roska, T. & Chua, L. O. [1995] "Analogic CNN algorithms for some image compression and restoration tasks," IEEE Trans. Circuits Syst.-I: Fund. Th. Appl. 42, 278-284.
58. Wei, H. L. & Billings, S. A. [2004] "Identification and reconstruction of chaotic systems using multiresolution wavelet decompositions." Int. J. Syst. Sci. 35. 511-526.
59. Wei, H. L., Billings, S. A. & Liu, J. [2004] "Term and variable selection for nonlinear system identification," Int. J. Contr. 77, 86-110.
60. Wei, H. L. & Billings, S. A. [2008] "Model structure selection using an integrated forward orthogonal search algorithm assisted by squared correlation and mutual information," Int. J. Modelling, Identification and Control 3, 341-356.
61. Wolfram, S. [2002] A New Kind of Science (Wolfman Media, Champaign, IL).