Classification capacity of a modular neural network implementing neurally inspired architecture and training rules

IEEE Transactions on Neural Networks

Volumn 15, Issue 3, 2004, Pages 597-612

  Poirazi, Panayiota ^a   Neocleous, Costas ^b   Pattichis, Costantinos S ^c   Schizas, Christos N ^c  

^a INSTITUTE OF COMPUTER SCIENCE   (Greece)

^b HIGHER TECHNICAL INSTITUTE   (Cyprus)

^c UNIVERSITY OF CYPRUS   (Cyprus)

Author keywords

Dissimilar neuron models; Enhanced guided annealing learning rule; Medical data; Neural networks (NNs)

Indexed keywords

BRAIN; DATA STRUCTURES; LEARNING SYSTEMS; MEDICAL COMPUTING; PHYSIOLOGY; TISSUE;

DISSIMILAR NEURON MODELS; ENHANCED GUIDED-ANNEALING LEARNING RULE; MEDICAL DATA; MODULAR NEURAL NETWORK;

NEURAL NETWORKS;

ANIMAL; ARTICLE; ARTIFICIAL NEURAL NETWORK; BIOLOGICAL MODEL; BRAIN CORTEX; HISTOLOGY; HUMAN;

ANIMALS; CEREBRAL CORTEX; HUMANS; MODELS, NEUROLOGICAL; NEURAL NETWORKS (COMPUTER);

EID: 2542529216     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2004.826225     Document Type: Article

References (52)

1. C. T. Chen and W. D. Chang, "A feedforward neural network with function shape autotuning," Neural Networks, vol. 9, no. 4, pp. 627-641, 1996.
2. O. D. Creutzfeldt, "Generality of the functional structure of the neo-cortex," Naturwissenschaften, vol. 64, pp. 507-517, 1977.
3. C. Daqing, C. G. Gregory, and R. D. Freeman, "Spatiotemporal receptive field organization in the lateral geniculate nucleus of cats and kittens," J. Neurophysiol., vol. 78, pp. 1045-1064, 1997.
4. J. G. Daugman, "Complete discrete 2-D Gabor transforms by neural networks for image analysis and compression," IEEE Trans. Acoust., Speech, Signal Processing, vol. 36, pp. 1169-1179, 1988.
5. L. E. Dobrunz and C. F. Stevens, "Heterogeneity of release probability, facilitation and depletion at central synapses," Neuron, vol. 18, pp. 995-1008, 1997.
6. D. Dong, "Associative decorrelation dynamics: A theory of self-organization and optimization in feedback networks," in Advances in Neural Information Processing Systems, G. Tesauro, D. S. Touretzsky, and D. K. Leen, Eds. Cambridge, MA: MIT Press, 1995, p. 925.
7. ____, "Associative decorrelation dynamics in visual cortex," in Lateral Interactions in the Cortex: Structure and Function, J. Sirosh, R. Miikkulainen, and Y. Choe, Eds. Austin, TX: The UTCS Neural Networks Res. Group, 1996.
8. J. C. Eccles, Neurosci., vol. 6, pp. 1839-1855, 1981.
9. S. Edelman, "Why have lateral connections in the visual cortex?," in Lateral Interactions in the Cortex: Structure and Function, J. Sirosh, R. Miikkulainen, and Y. Choe, Eds. Austin, TX: UTCS Neural Networks Res. Group, 1996.
10. O. V. Favorov and D. G. Kelly, "Minicolumnar organization within somatosensory cortical segregates, II: Emergent functional properties," Cerebral Cortex, vol. 4, pp. 428-442, 1994.
11. ____, "Minicolumnar organization within somatosensory cortical segregates, I: Development of afferent connections," Cerebral Cortex, vol. 4, pp. 408-427, 1994.
12. P. Gallinary, "Training if modular neural net systems," in The Handbook of Brain Theory and Neural Networks, M. Arbib, Ed. London, U.K.: MIT Press, 1995, pp. 582-585.
13. C. D. Gilbert and T. N. Wiesel, "Columnar specificity of intrinsic horizontal and corticocortical connections in cat visual cortex," J. Neurosci., vol. 9, pp. 2432-2442, 1989.
14. C. D. Gilbert, J. A. Hirsch, and T. N. Wiesel, "Lateral interactions in visual cortex," in Proc. Cold Spring Harbor Symp. Quantitative Biology, vol. LV, 1990, pp. 663-677.
15. S. R. Gunn, "Support Vector Machines for Classification and Regression," Image Speech and Intelligent Systems Research Group, Univ. Southampton, 1997.
16. L. Bart, M. Happel, and M. J. Murre, "The design and evolution of modular neural network architectures," Neural Networks, vol. 7, pp. 985-1004, 1994.
17. S. Haykin, Neural Networks: A Comprehensive Foundation. Englewood Cliffs, NJ: Prentice-Hall, 1995.
18. D. O. Hebb, The Organization of Behavior: A Neurophysiological Theory. New York: Wiley, 1949.
19. S. Haykin, Neural Networks, 2nd ed. Englewood Cliffs, NJ: Prentice-Hall, 1999.
20. R. Horst and H. Tuy, Global Optimization. New York: Springer-Verlag, 1990.
21. R. Horst and P. M. Pardalos, Eds., Handbook of Global Optimization. Dordrecht: Kluwer, 1995.
22. Z. Hu and H. Shao, "The study of neural network adaptive control systems," Contr. Decision, vol. 7, pp. 361-366, 1992.
23. D. H. Hubel and T. N. Wiesel, "Receptive fields, binocular interaction and functional architecture in the cat's visual cortex," J. Physiol., vol. 160, pp. 106-154, 1962.
24. ____, "Functional architecture of the macaque monkey visual cortex," in Proc. Royal Society, vol. 198, London [B], U.K., 1977, pp. 1-59.
25. G. Indiveri, L. Raffo, S. P. Sabatini, and G. M. Bisio, "A neuromorphic architecture for cortical multi-layer integration of early visual tasks," Mach. Vis. Appl., vol. 10, pp. 305-314, 1995.
26. ____, "A recurrent neural architecture mimicking cortical preattentive vision systems," Neurocomputing, vol. 11, pp. 155-170, 1996.
27. M. W. Jung, Y. Qin, D. Lee, and I. Mook-Jung, "Relationship among discharges of neighboring neurons in the rat prefrontal cortex during spatial working memory tasks," J. Neurosci., vol. 20, no. 16, pp. 6166-6172, 2000.
28. A. H. Kan and G. T. Timmer, "Stochastic global optimization methods part I: Clustering methods," Mathemat. Program., vol. 39, pp. 27-78, 1987.
29. S. Löwel and W. Singer, "Selection of intrinsic horizontal connections in the visual cortex by correlated neuronal activity," Science, vol. 255, pp. 209-212, 1992.
30. D. Marr and E. Hildreth, "Theory of edge detection," in Proc. Royal Society, vol. B207, London, U.K., 1980, pp. 187-217.
31. V. B. Mountcastle, "An organizing principle for cerebral function: The unit module and the distributed system," in The Mindful Brain, G. M. Edelman and V. B. Mountcastle, Eds. Cambridge, MA: MIT Press, 1975.
32. M. C. Nechyba and Y. Xu, "Improved ANN performance when using different activation functions in problems of system identification and control. Neural network approach to control system identification with variable activation functions," in Proc. IEEE Int. Symp. Intelligent Control, vol. 1, 1994, pp. 358-63.
33. C. Neocleous, "A neural network architecture composed of adaptively defined dissimilar single-neurons: applications in engineering and design," Ph.D. dissertation, Brunel Univ. 1997, U.K.
34. C. Neocleous, I. Esat, and C. Schizas, "A neural network architecture composed of adaptively defined dissimilar single-neuron units," in Proc. 2nd Int. Conf. Computational Intelligence and Neuroscience, Druham, NC, 1997.
35. J. D. Pinter, Global Optimization in Action. Dordrecht: Kluwer, 1996.
36. P. Poirazi, "Contributions of active dendrites and structural plasticity to the neural substrate for learning and memory," Ph.D. dissertation, Univ. Southern California, Los Angeles, CA, 2000.
37. P. Poirazi and B. W. Mel, "Impact of active dendrites and structural plasticity on the memory capacity of neural tissue," Neuron, vol. 29, pp. 779-796, 2001.
38. P. Poirazi, C. Neocleous, C. Pattichis, and C. Schizas, "A biologically inspired neural network composed of dissimilar single neuron models," in Proc. 23rd Ann. Int. Conf. IEEE Eng. Med. Biol. Soc., Oct. 2001.
39. S. J. Pyott and C. Rosenmund, "The effects of temperature on vesicular supply and release in autaptic cultures of hippocampal neurons," J. Physiol., vol. 539.2, pp. 523-535, 2002.
40. C. Rosenmund, A. Sigler, I. Augustin, K. Reim, N. Brose, and J. S. Rhee, "Differential control of vesicle priming and short-term plasticity by Munc13 isoforms," Neuron, vol. 33, pp. 411-424, 2002.
41. S. P. Sabatini, "Recurrent inhibition and clustered connectivity as a basis for gabor-like receptive fields in the visual cortex," in Lateral Interactions in the Cortex: Structure and Function, J. Sirosh, R. Miikkulainen, and Y. Choe, Eds. Austin, TX: UTCS Neural Networks Research Group, 1996.
42. J. Sirosh, R. Miikkulainen, and J. A. Bednar, "Self-organization of orientation maps, lateral connections, and dynamic receptive fields in the primary visual cortex," in Lateral Interactions in the Cortex: Structure and Function, J. Sirosh, R. Miikkulainen, and Y. Choe, Eds. Austin, TX: UTCS Neural Networks Res. Group, 1996.
43. D. Somers, L. J. Toth, E. Todorov, S. C. Rao, D.-S. Kim, S. B. Nelson, A. G. Siapas, and M. Sur, "Variable gain control in local cortical circuitry supports context-dependent modulation by long-range connections," in Lateral Interactions in the Cortex: Structure and Function, J. Sirosh, R. Miikkulainen, and Y. Choe, Eds. Austin, TX: UTCS Neural Networks Research Group, 1996.
44. N. Spruston, Y. Schiller, G. Stuart, and B. Sakmann, "Activity-dependent action potential invasion and calcium influx into hippocampal CA1 dendrites," Sci., vol. 286, pp. 297-300, 1995.
45. G. Stuart and B. Sakmann, "Active propagation of somatic action potentials into neocortical pyramidal cell dendrites," Nature, vol. 367, pp. 69-72, 1994.
46. G. Stuart and N. Spruston, "Determinants of voltage attenuation in neocortical pyramidal neuron dendrites," J. Neurosci., vol. 18, pp. 3501-3510, 1998.
47. J. Szentágothai, "The neuron network of the cerebral cortex: A functional interpretation," in Proc. Royal Society, vol. 201, London, U.K., 1997, pp. 219-248.
48. J. G. Taylor and F. N. Alavi, "A basis for long-range inhibition across cortex," in Lateral Interactions in the Cortex: Structure and Function, J. Sirosh, R. Miikkulainen, and Y. Choe, Eds. Austin, TX: UTCS Neural Networks Research Group, 1996.
49. E. Trentin, "Networks with trainable amplitude of activation functions," Neural Networks, vol. 14, pp. 471-493, 2001.
50. M. Usher, M. Stemmler, and E. Neibur, "The role of lateral connections in visual cortex: Dynamics and information processing," in Lateral Interactions in the Cortex: Structure and Function, J. Sirosh, R. MIikkulainen, and Y. Choe, Eds. Austin, TX: UTCS Neural Networks Research Group, 1996.
51. R. Vogels and G. A. Orban, "How well do the response changes of striate neurons signal differences in orientation: A study in the discriminating monkey," J. Neurosci., vol. 10, pp. 3543-3558, 1990.
52. Y. Yamada and Y. Yabuta, "Neural network controller using autotuning method for nonlinear functions," IEEE Trans. Neural Networks, vol. 3, pp. 595-601, 1992.