Optimization in "self-modeling" complex adaptive systems

Complexity

Volumn 16, Issue 5, 2011, Pages 17-26

  Watson, Richard A ^a   Buckley, C L ^b   Mills, Rob ^a  

^a UNIVERSITY OF SOUTHAMPTON   (United Kingdom)

^b UNIVERSITY OF SUSSEX   (United Kingdom)

Author keywords

Associative memory; Complex adaptive systems; Hopfield networks; Optimization; Self organization

Indexed keywords

EID: 79955960452     PISSN: 10762787     EISSN: 10990526     Source Type: Journal    
DOI: 10.1002/cplx.20346     Document Type: Article

References (48)

1. Strogatz, S.H. Nonlinear Dynamics and Chaos; Addison-Wesley: Reading, MA, 1994.
2. Hopfield, J.J. Neural networks and physical systems with emergent collective computational abilities. Proc Natl Acad Sci USA 1982, 79, 2554-2558.
3. Hopfield, J.J.;Tank, D.W. Neural computation of decisions in optimization problems. Biol Cybern 1985, 52, 141-152.
4. Hopfield, J.J.;Tank, D.W. Computing with neural circuits: A model. Science 1986, 233, 625-633.
5. Hebb, D.O. The Organization of Behavior; Wiley: New York, 1949.
6. Hinton, G.E.;Sejnowski, T.J. Analyzing cooperative computation. In: Proceedings of the 5th Annual Congress of the Cognitive Science Society, Rochester, NY, May 1983.
7. Hinton, G.E.;Sejnowski, T.J. Learning in Boltzmann Machines. In: Proceedings of the Cognitiva, 85, Paris, France, 1985.
8. Ackley, D.H.;Hinton, G.E.;Sejnowski, T.J. A Learning algorithm for Boltzmann machines. Cognit Sci 1985, 9, 147-169.
9. Tsirukis, A.G.;Reklaitis, G.V.;Tenorio, M.F. Nonlinear optimization using generalized Hopfield networks. Neural Comput 1989, 1, 511-521.
10. Watson, R.A.;Buckley, C.L.;Mills, R. The Effect of Hebbian Learning on Optimization in Hopfield Networks. Technical Report, ECS, University of Southampton: Southampton, UK, 2009.
11. Ito, J.;Kaneko, K. Spontaneous structure formation in a network of chaotic units with variable connection strengths. Phys Rev Lett 2002, 88, 028701.
12. Gross, T.; Sayama, H. (eds). Adaptive Networks; Springer: Berlin, 2009.
13. Hopfield, J.J.;Feinstein, D.;Palmer, R. Unlearning has a stabilizing effect in collective memories. Nature 1983, 304, 158-159.
14. Gardner, E. The space of interactions in neural network models. J Phys A: Math Gen 1988, 21, 257.
15. Coolen, A.C.C. On the relation between stability parameters and sizes of domains of attraction in attractor neural networks. Europhys Lett 1991, 16, 73.
16. Kryzhanovsky, B.;Kryzhanovsky, V. Binary optimization: On the probability of a local minimum detection in random search. In: Proceedings of the ICAISC, Zakopane, Poland, 2008; Springer: Berlin, pp 89-100.
17. Kryzhanovsky, B.;Magomedov, B.M.;Fonarev, A.B. On the probability of finding local minima in optimization problems. In: Proceedings of the IJCNN, Vancouver, BC, IEEE Press, 2006; pp 3243-3248.
18. Kryzhanovsky, B.;Kryzhanovsky, V.;Mikaelian, A.L. Binary optimization: A relation between the depth of a local minimum and the probability of its detection. In: Proceedings of the ICINCO-ICSO, Angers, France, INSTICC Press, 2007; pp 5-10.
19. Garey, M.R.;Johnson, D.S.;Stockmeyer, L. Some simplified NP-complete graph problems. Theor Comp Sci 1976, 1, 237-267.
20. Lim, H.C.; Babu, S.; Chase, J.S.; Parekh, S.S. Automated control in cloud computing: Challenges and opportunities. In: Proceedings of the 1st Workshop on Automated Control for Datacenters and Clouds, Barcelona, Spain, 2009; pp 13-18, ACM Press, New York, NY.
21. Simon, H.A. The Sciences of the Artificial; MIT Press: Cambridge, Mass, 1969.
22. Watson, R.A.;Pollack, J.B. Modular interdependency in complex dynamical systems. Artificial Life 2005, 11, 445-457.
23. Bar-Yam, Y. Dynamics of Complex Systems; Addison-Wesley: Reading, MA, 1997.
24. Mills, R. How Micro-Evolution Can Guide Macro-Evolution: Multi-Scale Search via Evolved Modular Variation. Ph.D. Thesis, ECS, University of Southampton, Southampton, UK, 2010.
25. Pacheco, J.M.;Traulsen, A.;Nowak, M.A. Coevolution of strategy and structure in complex networks with dynamical linking. Phys Rev Lett 2006, 97, 258103.
26. Heylighen, F.;Gershenson, C.;Staab, S.;Flake, G.W.;Pennock, D.M.;Fain, D.C.;De Roure, D.;Aberer, K.;Shen, W.-M.;Dousse, O.;Thiran, P. Neurons, viscose fluids, freshwater polyp hydra-and self-organizing information systems. IEEE Intell Syst 2005, 18, 72-86.
27. Nettleton, R.W.;Schloemer, G.R. Self-organizing channel assignment for wireless systems. IEEE Commun Mag 1997, 35, 46-51.
28. Gascuel, J.-D.;Moobed, B.;Weinfeld, M. An internal mechanism for detecting parasite attractors in a Hopfield network. Neural Comput 1994, 6, 902-915.
29. Jang, J.-S.;Kim, M.W.;Lee, Y. A conceptual interpretation of spurious memories in the Hopfield-type neural network. In: Proceedings of the Neural Networks, IJCNN, International Joint Conference on Baltimore, MD, IEEE Press, Vol. 1, 1992; pp 21-26.
30. O'Reilly, R.C.;Munakata, Y. Computational Explorations in Cognitive Neuroscience: Understanding the Mind by Simulating the Brain; MIT Press: Cambridge, MA, 2000.
31. Mills, R.;Watson, R.A. Symbiosis enables the evolution of rare complexes in structured environments. In: Proceedings of European Conference on Artificial Life, Budapest, Hungary, Springer, Berlin, in press.
32. Iclanzan, D.;Dumitrescu, D. Overcoming hierarchical difficulty by hillclimbing the building block structure. In: Proceedings of the GECCO, London, UK, 2007; pp 1256-1263. ACM Press, New York, NY.
33. Wolpert, D.H.;Macready, W.G. No free lunch theorems for optimization. IEEE Trans Evol Comput 1997, 1, 67-82.
34. Newman, M.E.J.;Barabasi, A.L.;Watts, D.J., Eds. The Structure and Dynamics of Networks; Princeton University Press: Princeton, NJ, 2006.
35. Davies, A.P.;Watson, R.A.;Mills, R.;Buckley, C.L.;Noble, J. If you can't be with the one you love, love the one you're with: How individual habituation of agent interactions improves global utility. In: Proceedings of ALIFE XII, Odense, Denmark, in press.
36. Lewis, M. An Investigation into the Evolution of Relationships Between Species in an Ecosystem. MSc Dissertation, ECS, University of Southampton, Southampton, UK, 2009.
37. Poderoso, F.C.;Fontanari, J.F. Model ecosystem with variable interspecies interactions. J Phys A: Math Theor 2007, 40, 8723-8738.
38. Watson, R.A.;Palmius, N.;Mills, R.;Powers, S.T.;Penn, A.S. Can selfish symbioses effect higher-level selection? In: Proceedings of the European Conference on Artificial Life, Budapest, Hungary, in press, Springer, Berlin.
39. Odling-Smee, F.J.;Laland, K.N.;Feldman, M.W. Niche Construction. The Neglected Process in Evolution. Monographs in Population Biology. 37; Princeton University Press, Princeton, NJ, 2003.
40. Penn, A.S. Ecosystem Selection: Simulation, Experiment and Theory. Ph.D. Thesis, University of Sussex, Brighton, UK: 2006.
41. Powers, S.T.;Mills, R.;Penn, A.S.;Watson, R.A. Social niche construction provides an adaptive explanation for new levels of individuality (ABSTRACT). In: Proceedings of Workshop on Levels of Selection and Individuality in Evolution, European Conference on Artificial Life, Budapest, Hungary, 2009.
42. Powers, S.T.;Penn, A.S.;Watson, R.A. Individual selection for cooperative group formation. In: Proceedings of European Conference on Artificial Life, Lisbon, Portugal, Springer, Berlin, 2007; pp 585-594.
43. Parter, M.;Kashtan, N.;Alon, U. Facilitated variation: How evolution learns from past environments to generalize to new environments. PLoS Comput Biol 2008, 4, e1000206.
44. Watson, R.A.;Buckley, C.L.;Mills, R.;Davies, A.P. Associative memory in gene regulation networks. In: Proceedings of ALIFE XII, Odense, Denmark, in press.
45. Wagner, G.P.;Pavlicev, M.;Cheverud, J.M. The road to modularity. Nat Rev Genet 2007, 8, 921-931.
46. Pavlicev, M.;Kenney-Hunt, J.P.;Norgard, E.A.;Roseman, C.C.;Wolf, J.B.;Cheverud, J.M. Genetic variation in pleiotropy: Differential epistasis as a source of variation in the allometric relationship between long bone lengths and body weight. Evolution 2008, 62, 199-213.
47. Fontanari, J.F. Generalization in a Hopfield network. J Phys 1990, 51, 2421-2430.
48. Watson, R.A.;Buckley, C.L.;Mills, R. Global Adaptation in Networks of Selfish Components: Emergent Associative Memory at the System Scale. Technical Report, ECS, University of Southampton: Southampton, UK, 2009.