Complexity and information: Measuring emergence, self-organization, and homeostasis at multiple scales

Complexity

Volumn 18, Issue 2, 2012, Pages 29-44

  Gershenson, Carlos ^a,b   Fernández, Nelson ^c,d  

^a IIMAS UNAM   (Mexico)

^b UNIVERSIDAD NACIONAL AUTÓNOMA DE MÉXICO   (Mexico)

^c UNIVERSIDAD DE PAMPLONA   (Colombia)

^d UNIVERSIDAD DE LOS ANDES   (Venezuela)

Author keywords

Complexity; Emergence; Homeostasis; Information; Self organization

Indexed keywords

EID: 84868498060     PISSN: 10762787     EISSN: 10990526     Source Type: Journal    
DOI: 10.1002/cplx.21424     Document Type: Article

References (101)

1. Bar-Yam, Y. Dynamics of Complex Systems, Studies in Nonlinearity; Westview Press: Boulder, CO, USA, 1997.
2. Mitchell, M. Complexity: A Guided Tour; Oxford University Press: Oxford, UK, 2009.
3. Nicolis, G.;Prigogine, I. Self-Organization in Non-Equilibrium Systems: From Dissipative Structures to Order Through Fluctuations; Wiley: Chichester, 1977.
4. Haken, H. Information and Self-organization: A Macroscopic Approach to Complex Systems; Springer-Verlag: Berlin, 1988.
5. Holland, J.H. Hidden Order: How Adaptation Builds Complexity; Helix books: Addison-Wesley, 1995.
6. Schweitzer, F. Self-Organization of Complex Structures: From Individual to Collective Dynamics; Gordon and Breach: London, 1997.
7. Wolfram, S.A New Kind of Science; Wolfram Media: Champaign, IL, USA, 2002.
8. Newman, M.E.J. The structure and function of complex networks. SIAM Rev 2003, 45, 167-256.
9. Schweitzer, F. Brownian Agents and Active Particles. Collective Dynamics in the Natural and Social Sciences, Springer Series in Synergetics Springer: Berlin, 2003.
10. Chaitin, G.J. Irreducible complexity in pure mathematics, Arxiv preprint math/0411091, 2004.
11. Batty, M. Cities and complexity; MIT Press: Cambridge, MA, USA, 2005.
12. Morin, E. Restricted complexity, general complexity. In: Philosophy and Complexity; Gershenson, C.;Aerts, D.;Edmonds, B., Eds.; Worldviews, Science and Us, World Scientific, 2007; pp. 5-29, Translated from French by Carlos Gershenson.
13. Prokopenko, M.;Boschetti, F.;Ryan, A.J. An information-theoretic primer on complexity, self-organisation and emergence. Complexity 2009, 15, 11-28.
14. Edmonds, B. Syntactic Measures of Complexity, PhD Thesis, University of Manchester, Manchester, UK, 1999.
15. Shannon, C.E. A mathematical theory of communication. Bell Syst Tech J July and October 1948, 27, 379-423 and623-656.
16. Gleick, J. The Information: A History, A Theory, A Flood; Pantheon: New York, 2011.
17. Lloyd, S. Measures of complexity: A non-exhaustive list, Department of Mechanical Engineering, Massachusetts Institute of Technology, Cambridge, MA, USA, 2001.
18. Gershenson, C. The implications of interactions for science and philosophy. Found Sci, in press.
19. Bar-Yam, Y. Multiscale variety in complex systems. Complexity 2004, 9, 37-45.
20. Gell-Mann, M.;Lloyd, S. Information measures, effective complexity, and total information. Complexity 1996, 2, 44-52.
21. Langton, C. Computation at the edge of chaos: Phase transitions and emergent computation. Phys D 1990, 42, 12-37.
22. Wuensche, A. Classifying cellular automata automatically: Finding gliders, filtering, and relating space-time patterns, attractor basins, and the Z parameter. Complexity 1999, 4, 47-66.
23. Lopez-Ruiz, R.;Mancini, H.L.;Calbet, X. A statistical measure of complexity. Phys Lett A 1995, 209, 321-326.
24. Anderson, P.W. More is different. Science 1972, 177, 393-396.
25. Heylighen, F. Modelling emergence. World Futures J Gen Evol 1991, 31, 89-104.
26. Bedau, M.A. Weak emergence. In:Philosophical Perspectives: Mind, Causation, and World, Vol. 11; Tomberlin, J., Ed.; Blackwell: Malden, MA, USA, 1997; pp. 375-399.
27. Bar-Yam, Y. A mathematical theory of strong emergence using multiscale variety. Complexity 2004, 9, 15-24.
28. Shalizi, C.R. Causal Architecture, Complexity and Self-Organization in Time Series and Cellular Automata, PhD Thesis, University of Wisconsin at Madison, 2001.
29. Holzer, R.;De Meer, H. Methods for approximations of quantitative measures in self-organizing systems. In:Self-Organizing Systems, Vol. 6557 of Lecture Notes in Computer Science; Bettstetter, C.;Gershenson, C., Eds.; Springer: Berlin/Heidelberg, 2011; pp. 1-15.
30. Gershenson, C. Design and Control of Self-organizing Systems; CopIt Arxives: Mexico. Available at:http://tinyurl.com/DCSOS2007, 2007.
31. Camazine, S.;Deneubourg, J.-L.;Franks, N.R.;Sneyd, J.;Theraulaz, G.;Bonabeau, E. Self-Organization in Biological Systems; Princeton University Press: Princeton, NJ, USA, 2003.
32. Ashby, W.R. Principles of the self-organizing dynamic system. J Gen Psychol 1947, 37, 125-128.
33. Gershenson, C.;Heylighen, F. When can we call a system self-organizing? In: Advances in Artificial Life, 7th European Conference, ECAL 2003 LNAI 2801; Banzhaf, W.;Christaller, T.;Dittrich, P.;Kim, J.T.;Ziegler, J., Eds.; Springer: Berlin, 2003; pp. 606-614.
34. Cannon, W.B. The Wisdom of the Body; WW Norton & Co: New York, 1932.
35. Ashby, W.R. The nervous system as physical machine: With special reference to the origin of adaptive behavior. Mind 1947, 56, 44-59.
36. Ashby, W.R. Design for a Brain: The Origin of Adaptive Behaviour, 2nd ed.; Chapman & Hall: London, 1960.
37. Wagner, A. Robustness and Evolvability in Living Systems; Princeton University Press: Princeton, NJ, 2005.
38. Jen, E. Robust Design: A Repertoire of Biological, Ecological, and Engineering Case Studies; Santa Fe Institute Studies on the Sciences of Complexity; Oxford University Press: Oxford, UK, 2005.
39. Fernández, N.;Aguilar, J.;Terán, O. Conceptual modeling of emergent processes in dynamics complex systems, In: 9th WSEAS international conference on computational intelligence, man-machine systems and cybernetics (CIMMACS ′10), 2010, pp. 75-82.
40. Fernández, N.;Aguilar, J.;Gershenson, C.;Terán, O. Sistemas dinámicos como redes computacionales de agentes para la evaluación de sus propiedades emergentes, In: II Simposio Científico y Tecnológico en Computación SCTC 2012, Universidad Central de Venezuela, 2012.
41. Cohen, I.R. Tending Adam's Garden: Evolving the Cognitive Immune Self; Academic Press: London, 2000.
42. Cohen, I.R. Informational landscapes in art, science, and evolution. Bull Math Biol 2006, 68, 1213-1229.
43. Gershenson, C. The world as evolving information. Proceedings of International Conference on Complex Systems ICCS2007, In: Y. Bar-Yam; Ed., 2007.
44. Gershenson, C. Introduction to random Boolean networks. In: Workshop and Tutorial Proceedings, Ninth International Conference on the Simulation and Synthesis of Living Systems (ALife IX); Bedau, M.;Husbands, P.;Hutton, T.;Kumar, S.;Suzuki, H., Eds.: Boston, MA, 2004; pp. 160-173.
45. Salthe, S. Hierarchical structures. Axiomathes 2012, 22, 355-383.
46. Kauffman, S.A. Metabolic stability and epigenesis in randomly constructed genetic nets. J Theor Biol 1969, 22, 437-467.
47. Kauffman, S.A. The Origins of Order; Oxford University Press: Oxford, UK, 1993.
48. Wuensche, A. Discrete dynamical networks and their attractor basins. In: Complex Systems ′98; Standish, R.;Henry, B.;Watt, S.;Marks, R.;Stocker, R.;Green, D.;Keen, S.;Bossomaier, T., Eds.; University of New South Wales: Sydney, Australia, 1998; pp. 3-21.
49. Gershenson, C. Classification of random Boolean networks. In: Artificial Life VIII: Proceedings of the Eight International Conference on Artificial Life; Standish, R.K.;Bedau, M.A.;Abbass, H.A., Eds.; MIT Press: Cambridge, MA, USA, 2002; pp. 1-8.
50. Aldana-González, M.;Coppersmith, S.;Kadanoff, L.P. Boolean dynamics with random couplings. Perspectives and Problems in Nonlinear Science. A Celebratory Volume in Honor of Lawrence Sirovich; Kaplan, E.;Marsden, J.E.;Sreenivasan, K.R., Eds.; Springer Applied Mathematical Sciences Series: Berlin, 2003.
51. Drossel, B. Random Boolean networks. In: Reviews of Nonlinear Dynamics and Complexity; Schuster, H.G., Ed.; Wiley-VCH Verlag GmbH & Co. KGaA, 2009; pp. 69-110.
52. Gershenson, C. Guiding the self-organization of random Boolean networks. Theory Biosci 2012, 131, 181-191.
53. Gershenson, C. Updating schemes in random Boolean networks: Do they really matter? In: Artificial Life IX Proceedings of the Ninth International Conference on the Simulation and Synthesis of Living Systems; Pollack, J.;Bedau, M.;Husbands, P.;Ikegami, T.;Watson, R.A., Eds.; MIT Press, 2004; pp. 238-243.
54. Wolfram, S. Universality and complexity in cellular automata. Phys D 1984, 10, 1-35.
55. Wuensche, A.;Lesser, M.J. The Global Dynamics of Cellular Automata; An Atlas of Basin of Attraction Fields of One-Dimensional Cellular Automata; Santa Fe Institute Studies in the Sciences of Complexity; Addison-Wesley: Reading, MA, 1992.
56. Li, W.;Packard, N. The structure of the elementary cellular automata rule space. Complex Syst 1990, 4, 281-297.
57. Cook, M. Universality in elementary cellular automata. Complex Syst 2004, 15, 1-40.
58. Derrida, B.;Pomeau, Y. Random networks of automata: A simple annealed approximation. Eur Lett 1986, 1, 45-49.
59. Luque, B.;Solé, R.V. Lyapunov exponents in random Boolean networks. Physica A 2000, 284, 33-45.
60. Wang, X.R.;Lizier, J.T.;Prokopenko, M. Fisher information at the edge of chaos in random Boolean networks. Artif Life 2011, 17, 315-329, Special Issue on Complex Networks.
61. Zenil, H. Compression-based investigation of the dynamical properties of cellular automata and other systems. Complex Syst 2010, 19, 1-28.
62. Gong, X.;Socolar, J.E.S. Quantifying the complexity of random Boolean networks. Phys. Rev. E 2012, 85, 066107.
63. Martínez, G.;Adamatzky, A.;Alonso-Sanz, R. Complex dynamics of elementary cellular automata emerging in chaotic rules. Int J Bifurcation Chaos 2012, 22, 1250023.
64. Martĺnez, G.;Adamatzky, A.;Alonso-Sanz, R. Complex dynamics of elementary cellular automata emerging in chaotic rules. Int J Bifurcation Chaos 2012, 22, 1250023.
65. Müssel, C.;Hopfensitz, M.;Kestler, H.A. BoolNet - an R package for generation, reconstruction and analysis of Boolean networks. Bioinformatics 2010, 26, 1378-1380.
66. Hugues, J. R package 'CellularAutomaton', v. 1.1, http://cran.r-project.org/web/packages/CellularAutomaton/, 2012.
67. Hausser, J.;Strimmer, K. R package 'entropy', v. 1.1.7, http://cran.r-project.org/web/packages/entropy/, 2012.
68. Shalizi, C.R.;Shalizi, K.L.;Haslinger, R. Quantifying self-organization with optimal predictors. Phys Rev Lett 2004, 93, 118701.
69. Bak, P.;Tang, C.;Wiesenfeld, K. Self-organized criticality: An explanation of the 1/f noise. Phys Rev Lett 1987, 59, 381-384.
70. Kauffman, S.A. Investigations; Oxford University Press: Oxford, UK, 2000.
71. Escalona-Morán, M.;Paredes, G.;Cosenza, M.G. Complexity, information transfer and collective behavior in chaotic dynamical networks. Int J Appl Math Stat 2012, 26, 58-66.
72. Crutchfield, J.P.;Young, K. Inferring statistical complexity. Phys Rev Lett 1989, 63, 105-108.
73. Gershenson, C. The sigma profile: A formal tool to study organization and its evolution at multiple scales. Complexity 2011, 16, 37-44.
74. Luque, B.;Solé, R.V. Controlling chaos in Kauffman networks. Eur Lett 1997, 37, 597-602.
75. Luque, B.;Solé, R.V. Stable core and chaos control in random Boolean networks. J Phys A Math Gen 1998, 31, 1533-1537.
76. Wolpert, D.H.;Macready, W.G. Self-dissimilarity: An empirically observable complexity measure. In: Unifying Themes in Complex Systems: Proceedings of the First International Conference on Complex Systems; Bar-Yam, Y., Ed.; Westview Press: Boulder, CO, USA, 1999; pp. 626-643.
77. Polani, D. Defining emergent descriptions by information preservation. InterJ Complex Syst 2004, 1102.
78. Weeks, A. Neutral Emergence and Coarse Graining Cellular Automata, PhD Thesis, University of York, 2010.
79. Rhodes, J. Applications of Automata Theory and Algebra via the Mathematical Theory of Complexity to Finite-State Physics, Biology, Philosophy, and Games; World Scientific: Singapore, 2009.
80. Egri-Nagy, A.;Nehaniv, C.L. Hierarchical coordinate systems for understanding complexity and its evolution with applications to genetic regulatory networks. Artif Life 2008, 14, 299-312, Special Issue on Evolution of Complexity.
81. Northrop, L.;Feiler, P.;Gabriel, R.P.;Goodenough, J.;Linger, R.;Kazman, R.;Schmidt, D.;Sullivan, K.;Wallnau, K. Ultra-large-scale systems-the software challenge of the future, Technical report, Software Engineering Institute 2006, Carnegie Mellon University.
82. Prokopenko, M.;Lizier, J.T.;Obst, O.;Wang, X.R. Relating fisher information to order parameters. Phys Rev E 2011, 84, 041116.
83. Bennett, C.H. Logical depth and physical complexity. In:The Universal Turing Machine a Half-Century Survey, Vol. 2 of Computerkultu; Herken, R., Ed.; Springer: Vienna, 1995; pp. 207-235.
84. Zenil, H.;Delahaye, J.-P.;Gaucherel, C. Image characterization and classification by physical complexity. Complexity 2012, 17, 26-42.
85. Delahaye, J.-P.;Zenil, H. On the Kolmogorov-Chaitin complexity for short sequences. In: Randomness and Complexity: From Leibniz to Chaitin; Calude, C.S., Ed.; World Scientific: Singapore, 2007; pp. 123.
86. Delahaye, J.-P.;Zenil, H. Numerical evaluation of algorithmic complexity for short strings: A glance into the innermost structure of randomness. Appl Math Comput 2012, 219, 63-77.
87. Shalizi, C.;Crutchfield, J. Computational mechanics: Pattern and prediction, structure and simplicity. J Stat Phys 2001, 104, 816-879.
88. Görnerup, O.;Crutchfield, J.P. Hierarchical self-organization in the finitary process soup. Artif Life 2008, 14, 245-254, Special Issue on the Evolution of Complexity.
89. Batty, M.;Morphet, R.;Massuci, P.;Stanilov, K. Entropy, complexity and spatial information, CASA Working Paper 185, 2012.
90. Neuman, Y. Reviving the Living: Meaning Making in Living Systems, Vol. 6 of Studies in Multidisciplinarity; Elsevier: Amsterdam, 2008.
91. Edmonds, B. What if all truth is context-dependent? Technical Report 01-77 2001, CPM.
92. Gershenson, C. Contextuality: A philosophical paradigm, with applications to philosophy of cognitive science, POCS Essay, COGS, University of Sussex, 2002.
93. Edmonds, B.;Gershenson, C. Learning, social intelligence and the Turing test - why an "out-of-the-box" Turing machine will not pass the Turing test. In:How the world computes: Turing Centenary Conference and 8th Conference on Computability in Europe, CiE 2012, Cambridge, UK, June 18-23, 2012. Proceedings, Vol. 7318/2012 of Lecture Notes in Computer Science; Barry Cooper, S.;Dawar, A.;Löwe, B., Eds.; Springer-Verlag:Berlin Heidelberg, 2012; pp. 182-192.
94. Varela, F.J.;Maturana, H.R.;Uribe, R. Autopoiesis: The organization of living systems, its characterization and a model. BioSystems 1974, 5, 187-196.
95. Maturana, H.;Varela, F. Autopoiesis and Cognition: the Realization of the Living, 2nd ed.; D. Reidel Publishing Co.: Dordecht, 1980.
96. McMullin, B. 30 years of computational autopoiesis: A review. Artif Life 2004, 10, 277-295.
97. Gershenson, C. Computing networks: A general framework to contrast neural and swarm cognitions. Paladyn J Behav Robot 2010, 1, 147-153.
98. Barabási, A.-L. Linked: The New Science of Networks; Perseus: Cambridge, MA, USA, 2002.
99. Newman, M.;Barabási, A.-L.;Watts, D. J., Ed.; The Structure and Dynamics of Networks, Princeton Studies in Complexity; Princeton University Press: Princeton, NJ, USA, 2006.
100. Caldarelli, G. Scale-Free Networks; Oxford University Press: Oxford, UK, 2007.
101. Newman, M. Networks: An Introduction; Oxford University Press: Oxford, UK, 2010.