The organization of intrinsic computation: Complexity-entropy diagrams and the diversity of natural information processing

Chaos

Volumn 18, Issue 4, 2008, Pages

  Feldman, David P ^a,b,c   McTague, Carl S ^b,d   Crutchfield, James P ^b,c  

^a Policy and Design   (United States)

^b SANTA FE INSTITUTE   (United States)

^c UNIVERSITY OF CALIFORNIA   (United States)

^d UNIVERSITY OF CAMBRIDGE   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHM; COMPUTER SIMULATION; ENTROPY; INFORMATION RETRIEVAL; NONLINEAR SYSTEM; PROCEDURES; STATISTICAL MODEL;

ALGORITHMS; COMPUTER SIMULATION; ENTROPY; INFORMATION STORAGE AND RETRIEVAL; MODELS, STATISTICAL; NONLINEAR DYNAMICS;

EID: 58149359375     PISSN: 10541500     EISSN: None     Source Type: Journal    
DOI: 10.1063/1.2991106     Document Type: Article

References (106)

1. J. P. Crutchfield and N. H. Packard, Physica D 7, 201 (1983).
2. R. Shaw, The Dripping Faucet as a Model Chaotic System (Aerial, Santa Cruz, 1984).
3. S. Wolfram, Physica D 10, 1 (1984).
4. C. H. Bennett, Found. Phys. 16, 585 (1986).
5. B. A. Huberman and T. Hogg, Physica D 22, 376 (1986).
6. P. Grassberger, Int. J. Theor. Phys. 25, 907 (1986).
7. P. Sźpfalusy and G. Györgyi, Phys. Rev. A 33, 2852 (1986).
8. K. E. Eriksson and K. Lindgren, Phys. Scr. 35, 388 (1987).
9. M. Koppel, Complex Syst. 1, 1087 (1987).
10. R. Landauer, Nature (London) 336, 306 (1988).
11. S. Lloyd and H. Pagels, Ann. Phys. 188, 186 (1988).
12. K. Lindgren and M. G. Norhdal, Complex Syst. 2, 409 (1988).
13. P. Szepfalusy, Phys. Scr., T T25, 226 (1989).
14. J. P. Crutchfield and K. Young, Phys. Rev. Lett. 63, 105 (1989).
15. C. H. Bennett, " How to Define Complexity in Physics, and Why.," in Santa Fe Institute Studies in the Sciences of Complexity, edited by, W. H. Zurek, (Addison-Wesley, Reading, 1990), Vol. VIII, pp. 137-148.
16. J. P. Crutchfield and K. Young, " Computation at the Onset of Chaos.," in Santa Fe Institute Studies in the Sciences of Complexity, edited by, W. H. Zurek, (Addison-Wesley, Reading, 1990), Vol. VIII, pp. 223-269.
17. R. Badii, Phys. Lett. A 160, 372 (1991).
18. W. Li, Complex Syst. 5, 381 (1991).
19. J. P. Crutchfield, Physica D 75, 11 (1994).
20. J. E. Bates and H. K. Shepard, Phys. Lett. A 172, 416 (1993).
21. B. Wackerbauer, A. Witt, H. Atmanspacher, J. Kurths, and A. Schein, Chaos, Solitons Fractals 4, 133 (1994).
22. W. Ebeling, Physica D 109, 42 (1997).
23. R. Badii and A. Politi, Complexity: Hierarchical Structures and Scaling in Physics (Cambridge University Press, Cambridge, 1997).
24. D. P. Feldman and J. P. Crutchfield, Phys. Lett. A 238, 244 (1998).
25. D. P. Feldman and J. P. Crutchfield, " Discovering non-critical organization: Statistical mechanical, information theoretic, and computational views of patterns in simple one-dimensional spin systems.," Santa Fe Institute Working Paper No. 98-04-026, http://hornacek.coa.edu/dave/ Publications/ DNCO.html.
26. I. Nemenman and N. Tishby, Physica A 302, 89 (2001).
27. J. P. Crutchfield and D. P. Feldman, Chaos 15, 25 (2003).
28. C. R. Shalizi and J. P. Crutchfield, J. Stat. Phys. 104, 817 (2001).
29. N. H. Packard, J. P. Crutchfield, J. D. Farmer, and R. S. Shaw, Phys. Rev. Lett. 45, 712 (1980).
30. M. R. Muldoon, R. S. Mackay, D. S. Broomhead, and J. Huke, Physica D 65, 1 (1993).
31. J. P. Crutchfield and B. S. McNamara, Complex Syst. 1, 417 (1987).
32. D. Auerbach, P. Cvitanović, J.-P. Eckmann, G. Gunaratne, and I. Procaccia, Phys. Rev. Lett. 58, 2387 (1987).
33. A. Fraser, " Chaotic data and model building.," in Information Dynamics, Vol. 256 of NATO ASI Series, edited by, H. Atmanspacher, and, H. Scheingraber, (Plenum, New York, 1991), pp. 125-130.
34. G. Tononi, O. Sporns, and G. M. Edelman, Proc. Natl. Acad. Sci. U.S.A. 91, 5033 (1994).
35. T. Wennekers and N. Ay, Neural Comput. 17, 2258 (2005).
36. P. I. Saparin, W. Gowin, J. Kurths, and D. Felsenberg, Phys. Rev. E 58, 6449 (1998).
37. N. Marwan, N. Wessel, U. Meyerfeldt, A. Schirdewan, and J. Kurths, Phys. Rev. E 66, 026702 (2002).
38. K. Young, U. Chen, J. Kornak, G. B. Matson, and N. Schuff, Phys. Rev. Lett. 94, 098701 (2005).
39. W. Bialek, I. Nemenman, and N. Tishby, Neural Comput. 13, 2409 (2001).
40. I. Nemenman, " Information theory and learning: A physical approach.," Ph.D. thesis, Princeton University (2000).
41. J. P. Crutchfield and D. P. Feldman, Adv. Complex Syst. 4, 251 (2001).
42. L. Debowski, " Entropic subextensitivity in language and learning.," in Nonextensive Entropy: Interdisciplinary Applications, edited by, C. Tsallis, and, M. Gell-Mann, (Oxford University Press, Oxford, 2004), pp. 335-345.
43. D. P. Feldman and J. P. Crutchfield, Adv. Complex Syst. 7, 329 (2004).
44. T. M. Cover and J. A. Thomas, Elements of Information Theory (Wiley, New York, 1991).
45. J. P. Crutchfield and N. H. Packard, Int. J. Theor. Phys. 21, 433 (1982).
46. M. Gell-Mann and S. Lloyd, Complexity 2, 44 (1996).
47. H. Atlan, " Natural Complexity and the Self-Creation of Meaning.," in The Science and Praxis of Complexity, edited by, S. Aida, (United Nations University, Tokyo, 1985), pp. 173-192.
48. M. Gell-Mann, The Quark and the Jaguar: Adventures in the Simple and the Complex (Freeman, New York, 1994).
49. G. W. Flake, The Computational Beauty of Nature: Computer Explorations of Fractals, Chaos, Complex Systems, and Adaptation (MIT, Cambridge, 1999).
50. J. S. Shiner, M. Davison, and P. T. Landsberg, Phys. Rev. E 59, 1459 (1999).
51. R. Lopez-Ruiz, H. L. Mancini, and X. Calbet, Phys. Lett. A 209, 321 (1995).
52. C. Anteneodo and A. R. Plastino, Phys. Lett. A 223, 348 (1996).
53. X. Calbet and R. Lopez-Ruiz, Phys. Rev. E 63, 066116 (2001).
54. R. López-Ruiz, Int. J. Bifurcation Chaos Appl. Sci. Eng. 11, 2669 (2001).
55. J. P. Crutchfield, D. P. Feldman, and C. R. Shalizi, Phys. Rev. E 62, 2996 (2000).
56. P. M. Binder, Phys. Rev. E 62, 2998 (2000).
57. K. Young and N. Schuff, Neuroimage 39, 1721 (2008).
58. O. A. Rosso, H. A. Larrondo, M. T. Martin, A. Plastino, and M. A. Fuentes, Phys. Rev. Lett. 99, 154102 (2007).
59. M. T. Martin, A. Plastino, and O. A. Rosso, Physica A 369, 439 (2006).
60. N. H. Packard, " Adaptation toward the edge of chaos.," in Dynamic Patterns in Complex Systems, edited by, A. Mandell, and, M. F. Shlesinger, (World Scientific, Singapore, 1988).
61. S. Kauffman, Origins of Order: Self-Organization and Selection in Evolution (Oxford University Press, New York, 1993).
62. C. G. Langton, Physica D 42, 12 (1990).
63. M. M. Waldrop, Complexity: The Emerging Science at the Edge of Order and Chaos (Simon and Schuster, New York, 1992).
64. T. S. Ray and N. Jan, Phys. Rev. Lett. 72, 4045 (1994).
65. P. Melby, J. Kaidel, N. Weber, and A. Hübler, Phys. Rev. Lett. 84, 5991 (2000).
66. M. Bertram, C. Beta, M. Pollmann, A. S. Mikhailov, H. H. Rotermund, and G. Ertl, Phys. Rev. E 67, 036208 (2003).
67. N. Bertschinger and T. Natschläger, Neural Comput. 16, 1413 (2004).
68. M. Mitchell and J. P. Crutchfield, Complex Syst. 7, 89 (1993).
69. K. Rateitschak, J. Freund, and W. Ebeling, " Entropy of sequences generated by nonlinear processes: The logistic map.," in Entropy and Entropy Generation: Fundamentals and Applications, edited by, J. S. Shiner, (Kluwer, Dordrecht, 1996).
70. J. Freund, W. Ebeling, and K. Rateitschak, Phys. Rev. E 54, 5561 (1996).
71. T. Schürmann, J. Phys. A 35, 1589 (2002).
72. H. E. Stanley, Rev. Mod. Phys. 71, S358 (1999).
73. J. M. Yeomans, Statistical Mechanics of Phase Transitions (Clarendon, Oxford, 1992).
74. J. P. Crutchfield and D. P. Feldman, Phys. Rev. E 55, 1239R (1997).
75. D. Arnold, Complex Syst. 10, 143 (1996).
76. K. Lindgren, " Cellular automata and modeling of complex physical systems.," in Springer Proceedings in Physics, edited by, P. Manneville, N. Boccara, G. Y. Vichniac, and, R. Bidaux, (Springer-Verlag, Berlin, 1989), Vol. 46, pp. 27-40.
77. W. Ebeling, L. Molgedey, J. Kurths, and U. Schwarz, " Entropy, complexity, predictability and data analysis of time series and letter sequences.," in The Science of Disaster: Climate Disruptions, Heart Attacks, and Market Crashes (Springer, Berlin/Heidelberg, 2002).
78. A. Csordás and P. Sźpfalusy, Phys. Rev. A 39, 4767 (1989).
79. Z. Kaufmann, Physica D 54, 75 (1991).
80. P. Grassberger, Phys. Lett. A 128, 369 (1988).
81. P. Grassberger, IEEE Trans. Inf. Theory 35, 669 (1989).
82. H. Herzel, A. O. Schmitt, and W. Ebeling, Chaos, Solitons Fractals 4, 97 (1994).
83. T. Schürmann and P. Grassberger, Chaos 6, 414 (1996).
84. Dudok T. de Wit, Eur. Phys. J. B 11, 513 (1999).
85. I. Nemenman, " Inference of entropies of discrete random variables with unknown cardinalities.," NSF-ITP-02-52, KITP, UCSB (2002).
86. H. B. Lin, Elementary Symbolic Dynamics and Chaos in Dissipative Systems (World Scientific, Singapore, 1989).
87. H. O. Peitgen, H. Jürgens, and D. Saupe, Chaos and Fractals: New Frontiers of Science (Springer-Verlag, Berlin, 1992).
88. E. Ott, Chaos in Dynamical Systems (Cambridge University Press, Cambridge, 1993).
89. K. Christensen and N. R. Moloney, Complexity and Criticality (Imperial College Press Advanced Physics Texts) (Imperial College Press, London, 2005).
90. J. P. Sethna, Statistical Mechanics: Entropy, Order Parameters and Complexity (Oxford Master Series in Physics) (Oxford University Press, New York, 2006).
91. D. P. Feldman, " Computational mechanics of classical spin systems.," Ph.D. thesis, University of California, Davis (1998).
92. D. P. Feldman and J. P. Crutchfield, Phys. Rev. E 67, 051103 (2003).
93. V. Spirin, P. L. Krapivsky, and S. Redner, Phys. Rev. E 63, 036118 (2001).
94. V. Spirin, P. L. Krapivsky, and S. Redner, Phys. Rev. E 65, 016119 (2001).
95. F. Vazquez, P. L. Krapivsky, and S. Redner, J. Phys. A 36, L61 (2003).
96. E. Erb and N. Ay, J. Stat. Phys. 115, 949 (2004).
97. S. Wolfram, Rev. Mod. Phys. 55, 601 (1983).
98. B. Chopard and M. Droz, Cellular Automata Modeling of Physical Systems (Collection Alea-Saclay: Monographs and Texts in Statistical Physics) (Cambridge University Press, Cambridge, 1999).
99. A. Ilachinski, Cellular Automata (World Scientific, Singapore, 2001).
100. W. Li, N. H. Packard, and C. G. Langton, Physica D 45, 77 (1990).
101. W. K. Wooters and C. G. Langton, Physica D 45, 95 (1990).
102. C. G. Langton, " Computation at the edge of chaos: Phase-transitions and emergent computation.," Ph.D. thesis, The University of Michigan (1991).
103. D. P. Feldman and J. P. Crutchfield, " Complexity-entropy surveys of cellular automata.," Physica D (to be submitted).
104. D. Lind and B. Marcus, An Introduction to Symbolic Dynamics and Coding (Cambridge University Press, New York, 1995).
105. C. McTague, C. J. Ellison, and J. P. Crutchfield, " Enumerating process languages.," Phys. Rev. E (to be submitted).
106. K. Young and J. P. Crutchfield, Chaos, Solitons Fractals 4, 5 (1993).