Tackling learning intractability through topological organization and regulation of cortical networks

IEEE Transactions on Neural Networks and Learning Systems

Volumn 23, Issue 4, 2012, Pages 552-564

  Thangavelautham, Jekanthan ^a   D'Eleuterio, Gabriele M T ^b  

^a Massachusetts Institute of Technology Cambridge   (United States)

^b UNIVERSITY OF TORONTO   (Canada)

Author keywords

Coarse coding; evolutionary algorithms; robotics; task decomposition

Indexed keywords

CHEMICAL DIFFUSION; COARSE CODING; CORTICAL NETWORK; DOMAIN KNOWLEDGE; PARTICULAR SOLUTION; SYNAPTIC CONNECTIONS; TASK DECOMPOSITION; VARIABLE TOPOLOGIES;

EVOLUTIONARY ALGORITHMS; NETWORK ARCHITECTURE; NEURONS; PERSONNEL TRAINING; ROBOTICS; TISSUE; TOPOLOGY;

NEURAL NETWORKS;

ANATOMY AND HISTOLOGY; ANIMAL; ARTIFICIAL INTELLIGENCE; ARTIFICIAL NEURAL NETWORK; BIOLOGICAL MODEL; BIOMIMETICS; BRAIN CORTEX; COMPUTER SIMULATION; HUMAN; LEARNING; NERVE CELL NETWORK; PHYSIOLOGY; PROCEDURES; ROBOTICS;

ANIMALS; ARTIFICIAL INTELLIGENCE; BIOMIMETICS; CEREBRAL CORTEX; COMPUTER SIMULATION; HUMANS; LEARNING; MODELS, NEUROLOGICAL; NERVE NET; NEURAL NETWORKS (COMPUTER); ROBOTICS;

EID: 84876947700     PISSN: 2162237X     EISSN: 21622388     Source Type: Journal    
DOI: 10.1109/TNNLS.2011.2178311     Document Type: Article

References (39)

1. G. Cybenko, "Approximation by superposition of a sigmoidal function," Math. Control Signal Syst., vol. 2, no. 4, pp. 303-314, 1989.
2. S. Nolfi and D. Floreano, Evolutionary Robotics. Cambridge, MA: MIT Press, 2000.
3. M. Dorigo and M. Colombetti, "Robot shaping: Developing autonomous agents through learning," Artif. Intell., vol. 71, no. 2, pp. 321-370, Dec. 1994.
4. P. Stone and M. Veloso, "Layered learning," in Proc. 11th Eur. Conf. Mach. Learn., 2000, pp. 369-381.
5. R. Jacobs, M. Jordan, and A. Barto, "Task decomposition through competition in a modular connectionist architecture," Cognit. Sci., vol. 15, no. 2, pp. 219-250, Apr.-Jun. 1991.
6. J. Thangavelautham and G. M. T. D'Eleuterio, "A coarse-coding framework for a gene-regulatory-based artificial neural tissue," in Proc. 8th Eur. Conf. Artif. Life, 2005, pp. 67-77.
7. J. Thangavelautham, "A regulatory theory of cortical organization and its applications to robotics," Ph.D. thesis, Inst. Aerospace Studies, Univ. Toronto, Toronto, ON, Canada, 2008.
8. J. S. Albus, "A theory of cerebellar function," Math. Biosci., vol. 10, nos. 1-2, pp. 25-61, 1971.
9. G. Hinton, "Shape representation in parallel systems," in Proc. 7th Int. Joint Conf. Artif. Intell., 1981, pp. 1088-1096.
10. J. Garthwaite, S. Charles, and R. Chess-Williams, "Endothelium- derived relaxing factor release on activation of NMDA receptors suggests role as intercellular messenger in the brain," Nature, vol. 336, pp. 385-388, Nov. 1988.
11. C. Hölscher, "Nitric oxide, the enigmatic neuronal messenger," Trends Neurosci., vol. 20, no. 7, pp. 298-303, Jul. 1997.
12. G. Hinton, "Product of experts," in Proc. 9th Int. Conf. Artif. Neural Netw. vol. 1. 1999, pp. 1-6.
13. Y. Liu, X. Yao, and T. Higuchi, "Evolutionary ensembles with negative correlation learning," IEEE Trans. Evol. Comput., vol. 4, no. 4, pp. 380-387, Nov. 2000.
14. T. Kohonen, Self-Organizing Maps. Berlin, Germany: Springer-Verlag, 1997.
15. K. Tasdemir, P. Milenov, and B. Tapsall, "Topology-based hierarchical clustering of self-organizing maps," IEEE Trans. Neural Netw., vol. 22, no. 3, pp. 474-485, Mar. 2011.
16. E. L. Rubio and E. J. Palomo, "Growing hierarchical probabilistic selforganizing graphs," IEEE Trans. Neural Netw., vol. 22, no. 7, pp. 997-1008, Jul. 2011.
17. J. Walter and H. Ritter, "Rapid learning with parametrized selforganizing maps," Neurocomputing, vol. 12, nos. 2-3, pp. 131-153, Jul. 1995.
18. W. Maass, T. Natschlaeger, and H. Markram. "Real-time computing without stable states," Neural Comput., vol. 14, no. 11, pp. 2531-2560, 2002.
19. H. Jaeger. "The echo state approach to analysing and training recurrent neural networks," German National Research Center Information Technology, St. Augustin, Germany, Tech. Rep. GMD 148, 2001.
20. D. Verstraeten, B. Schrauwen, M. Dhaene, and D. Stroobandt, "An experimental unification of reservoir computing methods," Neural Netw., vol. 20, no. 3, pp. 391-403, Apr. 2007.
21. E. Goodman and D. Ventura, "Effectively using recurrently connected spiking neural networks," in Proc. IEEE Int. Joint Conf. Neural Netw., vol. 3, Jul.-Aug. 2005, pp. 1542-1547.
22. D. Norton and D. Ventura, "Preparing more effective liquid state machines using Hebbian learning," in Proc. IEEE Int. Joint Conf. Neural Netw., Vancouver, BC, Canada, Oct. 2006, pp. 8359-8364.
23. B. J. Grzyb, E. Chinellato, G. M. Wojcik, and A.W. Kaminsi, "Facial expression recognition based on liquid state machines built of alternative neuron models," in Proc. Int. Conf. Neural Netw., 2009, pp. 1011-1017.
24. T. Yamazaki and S. Tanaka, "The cerebellum as liquid state machine," Neural Netw., vol. 20, no. 3, pp. 290-297, Apr. 2007.
25. K. Stanley and R. Miikkulainen, "Continual coevolution through complexification," in Proc. Genetic Evol. Comput. Conf., 2002, pp. 63-100.
26. F. Gomez and J. Schmidhuber, "Coevolving recurrent neurons learn deep memory POMDPs," in Proc. Genetic Evol. Comput. Conf., 2005, pp. 491-498.
27. P. Eggenberger, G. Gomez, and R. Pfeifer, "Evolving the morphology of a neural net for controlling a foveating retina," in Proc. 8th Int. Conf. Artif. Life, vol. 8. 2002, pp. 243-251.
28. J. Astor and C. Adami, "A developmental model for the evolution of artificial neural networks," Artif. Life, vol. 6, no. 3, pp. 189-218, 2000.
29. J. Hawkins and S. Blakeslee, On Intelligent. New York: Times Books, 2004.
30. S. Ohno, Evolution by Gene Duplication. Berlin, Germany: Springer-Verlag, 1970.
31. K. Stanley and R. Miikkulainen, "A taxonomy for artificial embryogeny," Artif. Life, vol. 9, no. 2, pp. 93-130, 2003.
32. F. Gruau, D. Whitley, and L. Pyeatt, "A comparison between cellular encoding and direct encoding for genetic neural networks," in Proc. 1st Conf. Genetic Prog., 1996, pp. 81-89.
33. H. Kitano, "Designing neural networks using genetic algorithms with graph generation systems," Complex Syst., vol. 4, no. 4, pp. 461-476, 1990.
34. K. Sims, "Evolving 3-D morphology and behavior by competition," Artif. Life, vol. 1, no. 4, pp. 28-39, 1994.
35. G. Hornby and J. Pollack, "Creating high-level components with a generative representation for body-brain evolution," Artif. Life, vol. 8, no. 3, pp. 223-246, 2002.
36. F. Dellaert and R. Beer, "Toward an evolvable model of development for autonomous agent synthesis," in Proc. Artificial Life 4, 1994, pp. 246-257.
37. D. Federici and K. Downing, "Evolution and development of a multicellular organism," Artif. Life, vol. 12, no. 3, pp. 381-409, 2006.
38. J. Zhang, "Evolution by gene duplication: An update," Trends Ecol. Evol., vol. 18, no. 6, pp. 192-198, 2003.
39. K. Stanley and R. Miikkulainen, "Evolving neural networks through augmenting topologies," Evol. Comput., vol. 10, no. 2, pp. 99-127, 2002.