A hormone-based controller for evaluation-minimal evolution in decentrally controlled systems

Artificial Life

Volumn 18, Issue 2, 2012, Pages 165-198

  Hamann, Heiko ^a   Schmickl, Thomas ^a   Crailsheim, Karl ^a  

^a UNIVERSITY OF GRAZ   (Austria)

Author keywords

Controller synthesis; decentral control; evolutionary robotics; hormone endocrine system; inspiration by signaling networks of unicellular organisms

Indexed keywords

BENCHMARKING; COMPLEX NETWORKS; CONTROL SYSTEM SYNTHESIS; MICROORGANISMS; ROBOTICS; SIGNALING;

CONTROLLER SYNTHESIS; DECENTRAL CONTROL; ENDOCRINE SYSTEMS; EVOLUTIONARY ROBOTICS; INSPIRATION BY SIGNALING NETWORKS OF UNICELLULAR ORGANISMS;

CONTROLLERS;

HORMONE;

ARTICLE; EVOLUTION; HOMEOSTASIS; PHYSIOLOGY; SIGNAL TRANSDUCTION;

BIOLOGICAL EVOLUTION; HOMEOSTASIS; HORMONES; SIGNAL TRANSDUCTION;

EID: 84859560155     PISSN: 10645462     EISSN: 15309185     Source Type: Journal    
DOI: 10.1162/artl_a_00058     Document Type: Article

References (78)

1. Alberts, B. (1989). Molecular biology of the cell. New York: Garland Publications.
2. Armus, H., Montgomery, A., & Jellison, J. (2006). Discrimination learning in Paramecia (P. caudatum). The Psychological Record, 56, 489-498.
3. Bongard, J. C. (2002). Evolving modular genetic regulatory networks. In Proceedings of the 2002 Congress on Evolutionary Computation (CEC'02) (pp. 17-21
4. Bray, D. (1990). Intracellular signalling as a parallel distributed process. Journal of Theoretical Biology, 143(2), 215-231. (Pubitemid 20141562)
5. Bray, D. (1995). Protein molecules as computational elements in living cells. Nature, 376, 307-312.
6. Bray, D. (2009). Wetware: A computer in every living cell. New Haven, CT: Yale University Press.
7. Brooks, R. (1986). A robust layered control system for a mobile robot. IEEE Journal of Robotics and Automation, 2(1), 14-23. (Pubitemid 16576274)
8. Brooks, R. (1997). From earwigs to humans. Robotics and Autonomous Systems, 20(2-4), 291-304. (Pubitemid 127399449)
9. Camazine, S., Deneubourg, J.-L., Franks, N. R., Sneyd, J., Theraulaz, G., & Bonabeau, E. (2001). Self-organization in biological systems. Princeton, NJ: Princeton University Press.
10. Chatterjee, D., Patra, A., & Joglekar, H. K. (2002). Swing-up and stabilization of a cart-pendulum system under restricted cart track length. Systems & Control Letters, 47(4), 355-364. (Pubitemid 35152364)
11. Chouard, T. (2010). Revenge of the hopeful monster. Nature, 463, 864-867.
12. Cliff, D., Harvey, I., & Husbands, P. (1993). Explorations in evolutionary robotics. Adaptive Behavior, 2(1), 71-108.
13. Dale, K., & Husbands, P. (2010). The evolution of reaction-diffusion controllers for minimally cognitive agents. Artificial Life, 16(1), 1-19.
14. Dorigo, M., Trianni, V., Şahin, E., Groß, R., Labella, T. H., Baldassarre, G., Nolfi, S., Deneubourg, J.-L., Mondada, F., Floreano, D., & Gambardella, L. M. (2004). Evolving self-organizing behaviors for a swarm-bot. Autonomous Robots, 17(2-3), 223-245.
15. Egorov, A. V., Hamam, B. N., Hasselmo, E. F. M. E., & Alonso, A. A. (2002). Graded persistent activity in entorhinal cortex neurons. Nature, 420, 173-178. (Pubitemid 35340120)
16. Endler, J. A. (1993). Some general comments on the evolution and design of animal communication systems. Philosophical Transactions of the Royal Society B, 340, 215-225.
17. Floreano, D., Mitri, S., Magnenat, S., & Keller, L. (2007). Evolutionary conditions for the emergence of communication in robots. Current Biology, 17, 514-519. (Pubitemid 46401376)
18. Floreano, D., Dürr, P., & Mattiussi, C. (2008). Neuroevolution: From architectures to learning. Evolutionary Intelligence, 1, 47-62.
19. Floreano, D., Husbands, P., & Nolfi, S. (2008). Evolutionary robotics. In B. Siciliano & K. Oussama (Eds.), Handbook of robotics (pp. 1423-1452). Berlin: Springer-Verlag.
20. Fujimoto, K., & Kaneko, K. (2003). How fast elements can affect slow dynamics. Physica D: Nonlinear Phenomena, 180(1-2), 1-16.
21. Grey Walter, W. (1950). An imitation of life. Scientific American, 182(5), 42-45.
22. Grey Walter, W. (1951). A machine that learns. Scientific American, 185(2), 60-63.
23. Hamann, H., Stradner, J., Schmickl, T., & Crailsheim, K. (2010). A hormone-based controller for evolutionary multi-modular robotics: From single modules to gait learning. In Proceedings of the IEEE Congress on Evolutionary Computation (CEC'10) (pp. 244-251
24. Hamann, H., Stradner, J., Schmickl, T., & Crailsheim, K. (2010). Artificial hormone reaction networks: Towards higher evolvability in evolutionary multimodular robotics. In H. Fellermann, M. Dörr, M. M. Hanczyc, L. L. Laursen, S. Maurer, D. Merkle, P.-A. Monnard, K. Støy, & S. Rasmussen (Eds.), Proceedings of the ALife XII Conference (pp. 773-780). Cambridge, MA: MIT Press.
25. Hamann, H., Schmickl, T., & Crailsheim, K. (2011). Coupled inverted pendulums: A benchmark for evolving decentral controllers in modular robotics. In N. Krasnogor & P. L. Lanzi (Eds.), Proceedings of the 13th Annual Genetic and Evolutionary Computation Conference, GECCO 2011 (pp. 195-202). ACM. http://doi.acm.org/10.1145/2001576.2001604.
26. Hand, W., & Haupt, W. (1971). Flagellar activity of the colony members of Volvox aureus Ehrbg. during light stimulation. Journal of Eukaryotic Microbiology, 18(3), 361-364.
27. Harvey, I., Husbands, P., Cliff, D., Thompson, A., & Jakobi, N. (1997). Evolutionary robotics: The Sussex approach. Robotics and Autonomous Systems, 20(2-4), 205-224. (Pubitemid 127399445)
28. Hauser, M. D. (1996). The evolution of communication. Cambridge, MA: MIT Press.
29. Holland, J. H. (1975). Adaptation in natural and artificial systems. Ann Arbor, MI: University of Michigan Press.
30. Holmes, S. (1903). Phototaxis in Volvox. Biological Bulletin, 4(6), 319-326.
31. Husbands, P. (1998). Evolving robot behaviours with diffusing gas networks. In Evolutionary Robotics (pp. 71-86). Berlin: Springer. (Pubitemid 128122276)
32. Jang, J.-S. R. (2002). Self-learning fuzzy controllers based on temporal backpropagation. IEEE Transactions on Neural Networks, 3(5), 714-723.
33. Kauffman, S. A., & Levin, S. (1987). Towards a general theory of adaptive walks on rugged landscapes. Journal of Theoretical Biology, 128(1), 11-45.
34. Koza, J. (1992). Genetic programming: On the programming of computers by means of natural selection. Cambridge, MA: MIT Press.
35. Koza, J. R.,&Keane,M.A. (1990).Genetic breeding of non-linear optimal control strategies forbroombalancing. In A. Bensoussan & J. Lions (Eds.), Analysis and optimization of systems (pp. 47-56). Berlin: Springer-Verlag.
36. Kremling, A., Fischer, S., Sauter, T., Bettenbrock, K., & Gilles, E. (2004). Time hierarchies in the Escherichia coli carbohydrate uptake and metabolism. BioSystems, 73(1), 57-71. (Pubitemid 38077255)
37. Meng, Y., Zhang, Y., & Jin, Y. (2011). Autonomous self-reconfiguration of modular robots by evolving a hierarchical mechanochemical model. IEEE Computational Intelligence Magazine, 6(1), 43-54.
38. Moioli, R., Vargas, P. A., & Husbands, P. (2010). Exploring the Kuramoto model of coupled oscillators in minimally cognitive evolutionary robotics tasks. In WCCI 2010 IEEE World Congress on Computational Intelligence-CEC IEEE (pp. 2483-2490
39. Murata, S., Kakomura, K., & Kurokawa, H. (2008). Toward a scalable modular robotic system-Navigation, docking, and integration of M-TRAN. IEEE Robotics & Automation Magazine, 14(4), 56-63.
40. Nakamura, H., Ishiguro, A., & Uchilkawa, Y. (2000). Evolutionary construction of behavior arbitration mechanisms based on dynamically-rearranging neural networks. In Proceedings of the 2000 Congress on Evolutionary Computation, Vol. 1 (pp. 158-165). Piscataway, NJ: IEEE.
41. Neal, M., & Timmis, J. (2003). Timidity: A useful mechanism for robot control? Informatica, 4(27), 197-204.
42. Nelson, A. L., Barlow, G. J., & Doitsidis, L. (2009). Fitness functions in evolutionary robotics: A survey and analysis. Robotics and Autonomous Systems, 57, 345-370.
43. Nolfi, S., & Floreano, D. (1999). Learning and evolution. Autonomous Robots, 7, 89-113.
44. Nolfi, S., & Floreano, D. (2004). Evolutionary robotics: The biology, intelligence, and technology of self-organizing machines. Cambridge, MA: MIT Press.
45. Østman, B., Hintze, A., & Adami, C. (2010). Critical properties of complex fitness landscapes. In H. Fellermann, M. Dörr, M. M. Hanczyc, L. L. Laursen, S. Maurer, D. Merkle, P.-A. Monnard, K. Støy, & S. Rasmussen (Eds.), Proceedings of the ALife XII Conference (pp. 126-132). Cambridge, MA: MIT Press.
46. Pasemann, F. (1998). Evolving neurocontrollers for balancing an inverted pendulum. Network: Computation in Neural Systems, 9(4), 495-511. (Pubitemid 128692543)
47. Payton, D., Daily, M., Estowski, R., Howard, M., & Lee, C. (2001). Pheromone robotics. Autonomous Robots, 11(3), 319-324. (Pubitemid 33109981)
48. Peak, D., West, J. D., Messinger, S. M., & Mott, K. A. (2004). Evidence for complex, collective dynamics and emergent, distributed computation in plants. Proceedings of the National Academy of Science, 101(4), 918-922. (Pubitemid 38160559)
49. Press, W. H., Teukolsky, S. A., Vetterling, W. T., & Flannery, B. P. (2002). Numerical recipes in C++. Cambridge, UK: Cambridge University Press.
50. Rechenberg, I. (1994). Evolutionsstrategie '94. Frommann Holzboog.
51. REPLICATOR. (2011). Project Web site. http://www.replicators.eu.
52. Rojdestvenski, I., Cottam, M., Park, Y.-I., & Öquist, G. (1999). Robustness and time-scale hierarchy in biological systems. BioSystems, 50(1), 71-82. (Pubitemid 29099761)
53. Rubenstein, M., & Shen, W.-M. (2009). Scalable self-assembly and self-repair in a collective of robots. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), St. Louis, Missouri, USA.
54. Schmickl, T., & Crailsheim, K. (2009). Modelling a hormone-based robot controller. In MATHMOD 2009-6th Vienna International Conference on Mathematical Modelling.
55. Schmickl, T., Hamann, H., Stradner, J., & Crailsheim, K. (2010). Hormone-based control for multi-modular robotics. In P. Levi & S. Kernbach (Eds.), Symbiotic multi-robot organisms: Reliability, adaptability, evolution. Berlin: Springer-Verlag.
56. Schmickl, T., Hamann, H., Stradner, J., Mayet, R., & Crailsheim, K. (2010). Complex taxis-behaviour in a novel bio-inspired robot controller. In H. Fellermann, M. Dörr, M. M. Hanczyc, L. L. Laursen, S. Maurer, D. Merkle, P.-A. Monnard, K. Støy, & S. Rasmussen (Eds.), Proceedings of the ALife XII Conference (pp. 648-655). Cambridge, MA: MIT Press.
57. Schmickl, T., Hamann, H., & Crailsheim, K. (2011). Modelling a hormone-inspired controller for individual- and multi-modular robotic systems. Mathematical and Computer Modelling of Dynamical Systems, 17(3), 221-242.
58. Schwefel, H.-P. (1995). Evolution and optimum seeking. New York: Wiley.
59. Shen, W.-M., Salemi, B., & Will, P. (2002). Hormone-inspired adaptive communication and distributed control for CONRO self-reconfigurable robots. IEEE Transactions on Robotics and Automation, 18(5), 700-712.
60. Shen, W.-M., Will, P., Galstyan, A., & Chuong, C.-M. (2004). Hormone-inspired self-organization and distributed control of robotic swarms. Autonomous Robots, 17, 93-105.
61. Shen, W.-M., Krivokon, M., Chiu, H., Everist, J., Rubenstein, M., & Venkatesh, J. (2006). Multimode locomotion via SuperBot reconfigurable robots. Autonomous Robots, 20(2), 165-177.
62. Stanley, K. O., & Miikkulainen, R. (2002). Evolving neural networks through augmenting topologies (Technical Report AI2001-290). Department of Computer Sciences, The University of Texas at Austin, 2002. http://nn.cs.utexas. edu/?stanley:ec02.
63. Stanley, K. O., & Miikkulainen, R. (2004). Competitive coevolution through evolutionary complexification. Journal of Artificial Intelligence Research, 21(1), 63-100. (Pubitemid 41525898)
64. Stanley, K. O., D'Ambrosio, D. B., & Gauci, J. (2009). A hypercube-based encoding for evolving large-scale neural networks. Artificial Life, 15(2), 185-212.
65. Stradner, J., Hamann, H., Schmickl, T., & Crailsheim, K. (2009). Analysis and implementation of an artificial homeostatic hormone system: A first case study in robotic hardware. In The 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS'09) (pp. 595-600). Piscataway, NJ: IEEE Press.
66. Stradner, J., Hamann, H., Schmickl, T., Thenius, R., & Crailsheim, K. (2011). Evolving a novel bio-inspired controller in reconfigurable robots. In G. Kampis, I. Karsai, & E. Szathmáry (Eds.), Advances in Artificial Life, 10th European Conference, ECAL 2009 (pp. 132-139). Berlin: Springer-Verlag.
67. SYMBRION. (2011). Project Web site. http://www.symbrion.eu.
68. Takahashi, K., Arjunan, S. N. V., & Tomita, M. (2005). Space in systems biology of signaling pathways towards intracellular molecular crowding in silico. FEBS Letters, 579, 1783-1788. (Pubitemid 40342654)
69. Trianni, V. (2008). Evolutionary swarm robotics-Evolving self-organising behaviours in groups of autonomous robots. Berlin: Springer-Verlag.
70. Vargas, P. A., Moioli, R. C., de Castro, L. N., Timmis, J., Neal, M., & von Zuben, F. J. (2005). Artificial homeostatic system: A novel approach. In M. S. Capcarrère, A. A. Freitas, P. J. Bentley, C. G. Johnson, & J. Timmis (Eds.), 8th European Conference on Artificial Life (ECAL'05) (pp. 754-764). Berlin: Springer-Verlag.
71. Vargas, P. A., Moioli, R. C., von Zuben, F. J., & Husbands, P. (2009). Homeostasis and evolution together dealing with novelties and managing disruptions. International Journal of Intelligent Computing and Cybernetics, 2(3), 435-454.
72. Whiteson, S., & Stone, P. (2006). Evolutionary function approximation for reinforcement learning. Journal of Machine Learning Research, 7, 877-917. (Pubitemid 43736560)
73. Widrow, B., & Smith, F. W. (1964). Pattern recognizing control systems. In J. T. Tou & R. H. Wilcox (Eds.), Computer and information sciences (pp. 288-317). Washington, DC: Clever Hume Press.
74. Wiener, N. (1948). Cybernetics: Or control and communication in the animal and the machine. Cambridge, MA: MIT Press.
75. Winkler, L., & Wörn, H. (2009). Symbricator3D-A distributed simulation environment for modular robots. In M. Xie, Y. Xiong, C. Xiong, H. Liu, & Z. Hu (Eds.), ICIRA (pp. 1266-1277). Berlin: Springer-Verlag.
76. Wolpert, D. H., & Macready, W. G. (1997). No free lunch theorems for optimization. IEEE Transactions on Evolutionary Computation, 1(1), 67-82. (Pubitemid 127771019)
77. Xin, X., & Kaneda, M. (2005). Analysis of the energy based control for swinging up two pendulums. IEEE Transactions on Automatic Control, 50(5), 679-684. (Pubitemid 40784442)
78. Yim, M., Shen, W., Salemi, B., Rus, D., Moll, M., Lipson, H., Klavins, E., & Chirikjian, G. (2007). Modular self-reconfigurable robot systems. IEEE Robotics and Automation Magazine, 14(1), 43-52.