Towards unconventional computing through simulated evolution: Control of nonlinear media by a learning classifier system

Artificial Life

Volumn 14, Issue 2, 2008, Pages 203-222

  Bull, Larry ^a   Budd, Adam ^a   Stone, Christopher ^a   Uroukov, Ivan ^a   Costello, Ben de Lacy ^a   Adamatzky, Andrew ^a  

^a UNIVERSITY OF THE WEST OF ENGLAND   (United Kingdom)

Author keywords

Chemical computing; Genetic algorithm; Neuronal computing; Reinforcement learning

Indexed keywords

COMPUTER SIMULATION; NEURAL NETWORKS; NONLINEAR CONTROL SYSTEMS; REINFORCEMENT LEARNING;

CHEMICAL COMPUTING; LEARNING CLASSIFIER SYSTEM; NEURONAL COMPUTING; NONLINEAR MEDIA; UNCONVENTIONAL COMPUTING;

GENETIC ALGORITHMS;

ANIMAL; ARTICLE; ARTIFICIAL NEURAL NETWORK; CELL CULTURE; CHICK EMBRYO; LEARNING; NERVE CELL NETWORK;

ANIMALS; CELLS, CULTURED; CHICK EMBRYO; LEARNING; NERVE NET; NEURAL NETWORKS (COMPUTER);

EID: 41149156883     PISSN: 10645462     EISSN: 15309185     Source Type: Journal    
DOI: 10.1162/artl.2008.14.2.203     Document Type: Article

References (54)

1. Adamatzky, A. (2001). Computing in nonlinear media and automata collectives. Bristol, UK: IoP Publishing.
2. Agladze, K, Aliey, R. R., Yamaguhi, T., & Yoshikawa, K. (1996). Chemical diode. Journal of Physical Chemistry, 100, 13895-13897.
3. Bar-Eli, K., & Reuveni, S. (1985). Stable stationary-states of coupled chemical oscillators: Experimental evidence. Journal of Physical Chemistry, 89, 1329-1330.
4. Bar-Eli, K. (1985). On the stability of coupled oscillators. Physica D, 14, 242-252.
5. Booker, L. (1989). Triggered rule discovery in classifier systems. In R. Schaffer (Ed.), Proceedings of the International Conference on Genetic Algorithms (pp. 265-274). San Mateo, CA: Morgan Kaufmann.
6. Bull, L. (Ed.) (2004). Applications of learning classifier systems. Berlin: Springer.
7. Bull, L., & Kovacs, T. (Eds.) (2005). Foundations of learning classifier systems. Berlin: Springer.
8. Butz, M., & Wilson, S. W. (2002). An algorithmic description of XCS. Soft Computing, 6(3-4), 144-153.
9. Crowley, M. F., & Field, R. J. (1986). Electrically coupled Belousov-Zhabotinskii oscillators Experiments and simulations. Journal of Physical Chemistry, 90, 1907-1915.
10. Crowley, M. F., & Epstein, I. R. (1989). Experimental and theoretical studies of a coupled chemical oscillator: Phase death, multistability and in-phase and out of phase entrainment. Journal of Physical Chemistry, 93, 2496-2502.
11. DeLong, G. R. (1970). Histogenesis of fetal mouse isocortex and hipppcampus in reaggregating cell cultures. Developmental Biology, 22, 563-583.
12. DeMarse, T. B., Wagenaar, D. A., Blau, A. W., & Potter, S. M. (2001). The neutally controlled animat: Biological brains acting with simulated bodies. Autonomous Robotics, 11, 305-310.
13. Dolnik, M., & Epstein, I. R. (1996). Coupled chaotic oscillators. Physical Review E, 54, 3361-3368.
14. Dorigo, M., & Colombetti, M. (1998). Robot shaping. Cambridge, MA: MIT Press.
15. Field, R. J., & Noyes, R, M. (1974). Oscillations in chemical systems. IV. Limit cycle behavior in a model of a real chemical reaction. Journal of Physical Chemistry, 60, 1877-1884.
16. Gorecki, J., Yoshikawa, K., & Igarashi, Y. (2003). On chemical reactors that can count. Journal of Physical Chemistry A, 107, 1664-1669.
17. Hjelmfelt, A., & Ross, J. (1993). Mass-coupled chemical systems with computational properties. Journal of Physical Chemistry, 97, 7988-7992.
18. Hjelmfelt, A., Weinberger, E. D., & ROss, J. (1991). Chemical implementation of neural networks and Turing machines. Proceedings of the National Academy of Sciences of the U.S.A., 88, 10983-10987.
19. Hjelmfelt, A., Weinberger, E. D., & Ross, J. (1992). Chemical implementation of finite-state machines. Proceedings of the National Academy of Sciences of the U.S.A., 89, 383-387.
20. Hjelmfelt, A., Schneider, F. W., & Ross, J. (1993). Pattern-recognition in coupled chemical kinetic systems. Science, 260, 335-337.
21. Holland, J. H. (1975). Adaptation in natural and artificial systems. Ann Arbor: University of Michigan Press.
22. Holland, J. H. (1986). Escaping brittleness: The possibilities of general-purpose learning algorithms applied to parallel rule-based systems. In R. S. Michalski, J. G. Carbonell & T. M. Mitchell (Eds.), Machine learning, an artificial intelligence approach (pp. 48-78). San Mateo, CA: Morgan Kaufmann.
23. Holz, R., & Schneider, F. W. (1993). Control of dynamic states with time-delay between 2 mutually flow-rate coupled reactors. Journal of Physical Chemistry, 97, 12239.
24. Hull, C. (1943). Principles of behavior. New York: Appleton-Century-Crofts.
25. Jimbo, Y., Tateno, T., & Robinson, H. (1999). Simultaneous induction of pathway-specific potentiation and depression in networks of cortical neurons. Biophysics Journal, 76(2), 670-678.
26. Jimbo, Y., Kawana, A., Parodi P., & Torre, V. (2000). The dynamics of a neuronal culture of dissociated cortical neurons of neonatal rats. Biological Cybernetics, 83, 1-20.
27. Jung, P., Cornell-Bell, A., Madden, K. S., & Moss, F. J. (1998). Noise-induced spiral waves in astrocyte syncytia show evidence of self-organized criticality. Neurophysiology, 79, 1098-1101.
28. Kawato, M., & Suzuki, R. (1980). Two coupled neural oscillators as a model of the circadian pacemaker. Journal of Theoretical Biology, 86, 547-575.
29. Krug, H.-J., Pohlmann, L., & Kuhnert, L. (1990). Analysis of the modified complete Oregonator accounting for oxygen sensitivity and photosensitivity of Belousov-Zhabotinsky systems. Journal of Physical Chemistry, 94, 4862-4866.
30. Kuhnert, L., Agladze, K. I., & Krinsky, V. I. (1989). Image processing using light sensitive chemical waves. Nature, 337, 244-247.
31. Laplante, J. P., Pemberton, M., Hjelmfelt, A., & Ross, J. (1995). Experiments on pattern recognition by chemical kinetics. Journal of Physical Chemistry, 99, 10063-10065.
32. Lebender, D., & Schneider, F. W. (1994). Logical gates using a nonlinear chemical reaction. Journal of Physical Chemistry, 98, 7533-7537.
33. Michalewicz, Z., & Fogel, D. (1999). How to solve it. Berlin: Springer-Verlag.
34. Moscona, A. (1961). Rotation mediated histogenic aggregation of dissociated cells. Experimental Cell Research, 22, 455-475.
35. Motoike, I. N., Yoshikawa, K., Iguchi, Y., & Nakata, S. (2001). Real time memory on an excitable field. Physical Review E, 63(036220), 1-4.
36. Rossler, O. E. (1974). Chemical automata in homogeneous and reaction-diffusion kinetics. In M. Conrad, W. Guttinger, & M. Dal Cin (Eds.), Physics and mathematics of the nervous system (pp. 399-418, 546-582). Berlin: Springer.
37. Ruaro, M. E., Bonifazi, P., & Torre, V. (2005). Toward the neurocomputer: Image processing and pattern recognition with neuronal cultures. IEEE Transactions on Biomedical Engineering, 52(3), 371-383.
38. Seeds, N. W. (1971). Biochemical differentiation in reaggregating brain cell culture. Proceedings of the National Academy of Sciences of the U.S.A., 68(8), 1858-1861.
39. Shahaf, G., & Marom, S. (2001). Learning in networks of cortical neurons. Journal of Neuroscience, 21(22), 8782-8788.
40. Sielewiesiuk, J., & Gorecki, J. (2002). Passive barrier as a transformer of chemical frequency. Journal of Physical Chemistry A, 106, 4068-4076.
41. Steinbock, O., Toth, A., & Showalter, K. (1995). Navigating complex labyrinths: Optimal paths from chemical waves. Science, 267, 868-871.
42. Steinbock, O., Kettunen, P., & Showalter, K. (1996). Chemical wave logic gates. Journal of Physical Chemistry, 100, 18970-18975.
43. Stone, C., & Bull, L. (2003). For reall XCS with continuous valued inputs. Evolutionary Computation, 11(3), 299-336.
44. Stuchl, I. & Marck, M. (1982). Dissipative structures in coupled cells: Experiments. Journal of Physical Chemistry, 77, 2956-2963.
45. Sutton, R., & Barto, A. (1998). Reinforcement learning. Cambridge, MA: MIT Press.
46. Takayama, Y., & Jimbo, Y. (2006). Modification of evoked responses induced by correlated stimuli in cultured cortical networks. Proceedings of the 5th International Meeting on Substrate-Integrated Micro Electrode Arrays (pp. 22-25).
47. Trapp, B. D., Honneger, P., Richelson, E., & Webster, H. deF. (1979). Morphological differentiation of mechanically dissociated fetal rat brain in aggregating cell cultures. Brain Research, 160, 117-180.
48. Toth, A., Gaspar, V., & Showlater, K. (1994). Signal transmission in chemical systems: Propagation of chemical waves through capillary tubes. Journal of Physical Chemistry, 98, 522-531.
49. Uroukov, I., Ma, M., Bull, L., & Purcell, W. (2006). Electrophysiological measurements in 3-dimensional in vivo-mimetic organotypic cell cultures: Preliminary studies with hen embryo brain spheroids. Neuroscience Letters, 404, 33-38.
50. Wagenaar, D., Madhavan, R., Pine, J., & Potter, S. M. (2005). Controlling bursting in cortical cultures with closed-loop multi-electrode stimulation. Journal of Neuroscience, 25(3), 680-688.
51. Wang, J., Kadar, S., Jung, P., & Showalter, K. (1999). Noise driven avalanche behavior in subexcitable media. Physical Review Letters, 82, 855-858.
52. Watkins, C. J. (1989). Learning from delayed rewards. Ph.D. Thesis. Cambridge University, Cambridge, UK.
53. Wilson, S. W. (1995). Classifier fitness based on accuracy. Evolutionapy Computing, 3, 149-175.
54. Zaikin, A. N., & Zhabotinsky, A. M. (1970). Concentration wave propagation in two-dimensional liquid-phase self-oscillating system. Nature, 225, 535-537.