Programming in the brain: A neural network theoretical framework

Connection Science

Volumn 24, Issue 2-3, 2012, Pages 71-90

  Donnarumma, Francesco ^a   Prevete, Roberto ^a   Trautteur, Giuseppe ^a  

^a UNIVERSITY OF NAPLES FEDERICO II   (Italy)

Author keywords

biologically plausible neural architecture; CTRNN; fixed weight network; programmability; programmable neural networks

Indexed keywords

COGNITIVE DOMAIN; CONSTRUCTION SCHEME; CTRNN; EXTENSIVE TESTING; NEURAL ARCHITECTURES; PROGRAMMABILITY; RECENT RESEARCHES; THEORETICAL FRAMEWORK;

BRAIN; NETWORK ARCHITECTURE;

NEURAL NETWORKS;

EID: 84871869326     PISSN: 09540091     EISSN: 13600494     Source Type: Journal    
DOI: 10.1080/09540091.2012.684670     Document Type: Article

References (46)

1. Abbott, L. F. and Kepler, T. B. Model Neurons: From Hodgkin-Huxley to Hopfield. XI Sitges Conference. Statistical Mechanics of Neural Networks, Edited by: Garrido, L. pp.5-18. Berlin: Springer-Verlag.
2. Andersen, R., Snyder, L., Bradley, D. and Xing, J. 1997. Multimodal Representation of Space in the Posterior Parietal Cortex and Its Use in Planning Movements. Annual Review of Neuroscience, 20: 303-330. (doi:10.1146/annurev.neuro.20.1.303)
3. Anderson, M. L. 2010. Neural Re-use as a Fundamental Organizational Principle of the Brain. Behavioral and Brain Sciences, 33(4): 245-266. (doi:10.1017/S0140525X10000853)
4. Beer, R. D. 1995. On the Dynamics of Small Continuous-Time Recurrent Neural Networks. Adaptive Behavior, 3(4): 469-509. (doi:10.1177/105971239500300405)
5. De Falco, I., Della Cioppa, A., Donnarumma, F., Maisto, D., Prevete, R. and Tarantino, E. CTRNN Parameter Learning Using Differential Evolution. ECAI 2008, 18th European Conference on Artificial Intelligence. Edited by: Ghallab, M., Spyropoulos, C. D., Fakotakis, N. and Avouris, N. pp.783-784. Amsterdam, The Netherlands: IOS Press.
6. Dehaene, S. 8. Evolution of Human Cortical Circuits for Reading an Arithmetic: The 'Neuronal Recycling' Hypothesis, from Monkey Brain to Human Brain. A Fyssen Foundation Symposium. Edited by: Dehaene, S., Duhamel, J.-R., Hauser, M. D. and Rizzolatti, G. pp.133-157. Bradford: MIT Press.
7. Donnarumma, F., Prevete, R. and Trautteur, G. 2010. How and Over What Timescales Does Neural Reuse Actually Occur? Commentary on "Neural re-use as a Fundamental Organizational Principle of the Brain" by Michael L. Anderson. Behavioral and Brain Sciences, 33(4): 272-273. (doi:10.1017/S0140525X10001184)
8. Dunn, N. A., Lockery, S. R., Pierce-Shimomura, J. T. and Conery, J. S. 2004. A Neural Network Model of Chemotaxis Predicts Functions of Synaptic Connections in the Nematode Caenorhabditis elegans. Journal of Computational Neuroscience, 17(2): 137-147. (doi:10.1023/B:JCNS.0000037679.42570.d5)
9. Eliasmith, C. 2005. A Unified Approach to Building and Controlling Spiking Attractor Networks. Neural Computation, 17(6): 1276-1314. (doi:10.1162/0899766053630332)
10. Eliasmith, C. and Anderson, C. H. 2003. Neural Engineering: Computation, Representation, and Dynamics in Neurobiological Systems, Cambridge, MA: MIT Press.
11. Funahashi, K. I. and Nakamura, Y. 1993. Approximation of Dynamical Systems by Continuous Time Recurrent Neural Networks. Neural Networks, 6(6): 801-806. (doi:10.1016/S0893-6080(05)80125-X)
12. Fyhn, M., Hafting, T., Treves, A., Moser, M. B. and Moser, E. I. 2007. Hippocampal Remapping and Grid Realignment in Entorhinal Cortex. Nature, 446(7132): 190-194. (doi:10.1038/nature05601)
13. Garzillo, C. and Trautteur, G. 2009. Computational Virtuality in Biological Systems. Theoretical Computer Science, 410(4-5): 323-331. (doi:10.1016/j.tcs.2008.09.044)
14. Gers, F. A., Schraudolph, N. N. and Schmidhuber, J. 2002. Learning Precise Timing with LSTM Recurrent Networks. Journal of Machine Learning Research, 3: 115-143.
15. Giles, C. L., Miller, C. B., Chen, D., Chen, H. H., Sun, G. Z. and Lee, Y. C. 1992. Learning and Extracting Finite State Automata with Second-Order Recurrent Neural Networks. Neural Computation, 4: 393-405. (doi:10.1162/neco.1992.4.3.393)
16. Gupta, M. M., Homma, N. and Jin, L. 2003. Static and Dynamic Neural Networks: From Fundamentals to Advanced Theory, New York: John Wiley & Sons, Inc.
17. Hochreiter, S., Younger, S. A. and Conwell, P. R. Learning to Learn Using Gradient Descent. ICANN '01: Proceedings of the International Conference on Artificial Neural Networks. pp.87-94. London: Springer-Verlag.
18. Hopfield, J. J. and Tank, D. W. 1985. Neural Computation of Decisions in Optimization Problems. Biological Cybernetics, 52(3): 141-152.
19. Hopfield, J. J. and Tank, D. W. 1986. Computing with Neural Circuits: A Model. Science, 233: 625-633. (doi:10.1126/science.3755256)
20. Hurley, S. 2008. The Shared Circuits Model (SCM): How Control, Mirroring, and Simulation Can Enable Imitation, Deliberation, and Mindreading. Behavioral and Brain Sciences, 31(1): 1-22. (doi:10.1017/S0140525X07003123)
21. Ito, M. and Tani, J. Generalization in Learning Multiple Temporal Patterns Using RNNPB. ICONIP: International Conference on Neural Information Processing. pp.592-598.
22. Izhikevich, E. M. 2004. Which Model to Use for Cortical Spiking Neurons?. IEEE Transactions on Neural Networks, 15(5): 1063-1070. (doi:10.1109/TNN.2004.832719)
23. Jordan, M. I. Attractor Dynamics and Parallelism in a Connectionist Sequential Machine. Proceedings of the Eighth Annual Conference of the Cognitive Science Society. pp.531-546. Hillsdale, NJ: Erlbaum.
24. Kiebel, S. J., Daunizeau, J. and Friston, K. J. 2008. A Hierarchy of Time-Scales and the Brain. PLoS Computational Biology, 4(11): e1000209 (doi:10.1371/journal.pcbi.1000209)
25. Kier, R. J., Ames, J. C., Beer, R. D. and Harrison, R. R. 2006. Design and Implementation of Multipattern Generators in Analog VLSI. IEEE Transactions on Neural Networks, 17(4): 1025-1038. (doi:10.1109/TNN.2006.875983)
26. La Camera, G., Rauch, A., Thurbon, D., Luscher, H. R., Senn, W. and Fusi, S. 2006. Multiple Time Scales of Temporal Response in Pyramidal and Fast Spiking Cortical Neurons. Journal of Neurophysiology, 96(6): 3448-3464. (doi:10.1152/jn.00453.2006)
27. Mel, B. W. 1999. "Why Have Dendrites? A Computational Perspective". In Dendrites, Edited by: Stuart, G., Spruston, N. and Häusser, M. 271-289. Oxford: Oxford University Press.
28. Nishimoto, R., Namikawa, J. and Tani, J. 2008. Learning Multiple Goal-Directed Actions Through Self-organization of a Dynamic Neural Network Model: A Humanoid Robot Experiment. Adaptive Behavior, 16(2-3): 166-181. (doi:10.1177/1059712308089185)
29. Noelle, D. C. and Cottrell, G. W. 1995. "Towards Instructable Connectionist Systems". In Computational Architectures Integrating Neural and Symbolic Processes, Edited by: Sun, R. and Bookman, L. 187-221. Needham, MA: Kluwer Academic Publishers.
30. O'Reilly, R. C., Herd, S. A. and Pauli, W. M. 2010. Computational Models of Cognitive Control. Current Opinion in Neurobiology, 20(2): 257-261. (doi:10.1016/j.conb.2010.01.008)
31. Oztop, E. and Arbib, M. 2002. Schema Design and Implementation of the Grasp-Related Mirror Neuron System. Biological Cybernetics, 87(2): 116-140. (doi:10.1007/s00422-002-0318-1)
32. Paine, R. W. and Tani, J. 2004. Motor Primitive and Sequence Self-organization in a Hierarchical Recurrent Neural Network. Neural Networks, 17(8-9): 1291-1309. (doi:10.1016/j.neunet.2004.08.005)
33. Pena, J. and Konishi, M. 2004. Robustness of Multiplicative Processes in Auditory Spatial Tuning. The Journal of Neuroscience, 24(40): 8907-8910. (doi:10.1523/JNEUROSCI.2924-04.2004)
34. Perdikis, D., Huys, R. and Jirsa, V. K. 2011. Time Scale Hierarchies in the Functional Organization of Complex Behaviors. PLoS Computational Biology, 7(9): e1002198 (doi:10.1371/journal.pcbi.1002198)
35. Price, K. V., Storn, R. M. and Lampinen, J. A. 2005. Differential Evolution: A Practical Approach to Global Optimization, Berlin: Springer-Verlag. Natural Computing Series
36. Prokhorov, D., Feldkarnp, L. and Tyukin, I. Adaptive Behavior with Fixed Weights in RNN: An Overview. IJCNN '02. Proceedings of the 2002 International Joint Conference on Neural Networks, 2002. Vol. 3, pp.2018-2022.
37. Roy, A. 2008. Connectionism, Controllers, and a Brain Theory. IEEE Transactions on Systems, Man and Cybernetics, Part A: Systems and Humans, 38(6): 1434-1441. (doi:10.1109/TSMCA.2008.2003484)
38. Rumelhart, D., Hinton, G. and McClelland, J. 1986. Parallel Distributed Processing: Explorations in the Microstructure of Cognition, Vol. 1, 605-636. Cambridge, MA: MIT Press.
39. Salinas, E. and Abbott, L. 1996. A Model of Multiplicative Neural Responses in Parietal Cortex. PNAS, 93: 11956-11961. (doi:10.1073/pnas.93.21.11956)
40. Sauser, E. and Billard, A. 2006. Parallel and Distributed Neural Models of the Ideomotor Principle: An Investigation of Imitative Cortical Pathways. Neural Networks, 19(3): 285-298. (doi:10.1016/j.neunet.2006.02.003)
41. Schmidhuber, J. 1992. Learning to Control Fast-Weight Memories: An Alternative to Dynamic Recurrent Networks. Neural Computation, 4(1): 131-139. (doi:10.1162/neco.1992.4.1.131)
42. Schneider, W. and Oliver, W. L. An Instructable Connectionist/Control Architecture: Using Rule-Based Instructions to Accomplish Connectionist Learning in a Human Time Scale. Architectures for Intelligence: The 22nd Carnegie Mellon Symposium on Cognition. Edited by: Lehn, K. V. pp.113-145. Hillsdale, NJ: Erlbaum.
43. Siegelmann, H. T. 1999. Neural Networks and Analog Computation Beyond the Turing Limit, Boston, MA: Birkhäuser.
44. Siegelmann, H. T., Ben-Hur, A. and Fishman, S. 2001. Comments on Attractor Computation. International Journal of Computing Anticipatory Systems, 6: 161-170.
45. Touretzky, D. S. 1990. BoltzCONS: Dynamic Symbol Structures in a Connectionist Network. Artificial Intelligence, 46(1-2): 5-46. (doi:10.1016/0004-3702(90)90003-I)
46. Yamashita, Y. and Tani, J. 2008. Emergence of Functional Hierarchy in a Multiple Timescale Neural Network Model: A Humanoid Robot Experiment. PLoS Computational Biology, 4(11): e1000220 (doi:10.1371/journal.pcbi.1000220)