Self-organized complexity and coherent infomax from the viewpoint of Jaynes's probability theory

Information (Switzerland)

Volumn 3, Issue 1, 2012, Pages 1-15

  Phillips, William A ^a,b  

^a UNIVERSITY OF STIRLING   (United Kingdom)

^b FRANKFURT INSTITUTE FOR ADVANCED STUDIES   (Germany)

Author keywords

Coherent infomax; Complexity; Context sensitivity; Coordination; Information; Jaynes; Neural computation; Probabilistic inference; Probability theory; Self organization

Indexed keywords

COMPLEXITY; CONTEXT SENSITIVITY; COORDINATION; INFOMAX; INFORMATION; JAYNES; NEURAL COMPUTATIONS; PROBABILISTIC INFERENCE; PROBABILITY THEORY; SELF-ORGANIZATION;

MAXIMUM ENTROPY METHODS; PROBABILITY;

PROBABILISTIC LOGICS;

EID: 84860318576     PISSN: None     EISSN: 20782489     Source Type: Journal    
DOI: 10.3390/info3010001     Document Type: Article

References (46)

1. Jaynes, E.T. Probability Theory: The Logic of Science; Bretthorst, G.L., Ed.; Cambridge University Press: Cambridge, UK, 2003.
2. Engel, C.; Singer, W. Better than Conscious? MIT Press: Cambridge, MA, USA, 2008.
3. Phillips, W.A.; Kay, J.; Smyth, D. The discovery of structure by multi-stream networks of local processors with contextual guidance. Netw. Comput. Neural Syst. 1995, 6, 225-246.
4. Kay, J.; Floreano, D.; Phillips, W.A. Contextually guided unsupervised learning using local multivariate binary processors. Neural Network. 1998, 11, 117-140.
5. Kay, J.; Phillips, W.A. Activation functions, computational goals and learning rules for local processors with contextual guidance. Neural Comput. 1997, 9, 895-910.
6. Kay, J.; Phillips, W.A. Coherent Infomax as a computational goal for neural systems. Bull. Math. Biol. 2011, 73, 344-372.
7. Sporns, O. Complexity. Scholarpedia 2007, 2, 1623.
8. von der Malsburg, C.; Singer, W. Principles of Cortical Network Organization. In Neurobiology of Neocortex; Rakic, P., Singer, W., Eds.; John Wiley & Sons: Chichester, UK, 1988.
9. Rolston, H., III. Three Big Bangs: Matter-Energy, Life, Mind; Columbia University Press: New York, NY, USA, 2010.
10. Phillips, W.A.; von der Malsburg, C.; Singer, W. Dynamic Coordination in Brain and Mind. In Dynamic Coordination in the Brain: From Neurons to Mind; von der Malsburg, C., Phillips, W.A., Singer, W., Eds.; MIT Press: Cambridge, MA, USA, 2010; Chapter 1, pp. 1-24.
11. Friston, K.J. The free-energy principle: A unified brain theory? Nat. Rev. Neurosci. 2010, 11, 127-138.
12. Finger, S. Origins of Neuroscience; Oxford University Press: New York, NY, USA, 1994.
13. Phillips, W.A.; Singer, W. In search of common foundations for cortical computation. Behav. Brain Sci. 1997, 20, 657-722.
14. Dynamic Coordination in the Brain: From Neurons to Mind; von der Malsburg, C., Phillips, W.A., Singer, W., Eds.; MIT Press: Cambridge, MA, USA, 2010.
15. Phillips, W.A.; Silverstein, S.M. Convergence of biological and psychological perspectives on cognitive coordination in schizophrenia. Behav. Brain Sci. 2003, 26, 65-138.
16. Becker, S.; Hinton, G.E. A self-organizing neural network that discovers surfaces in random-dot stereograms. Nature 1992, 335, 161-163.
17. Creutzig, F.; Globerson, A.; Tishby, N. Past-future information bottleneck in dynamical systems. Phys. Rev. 2009, 79, 041925.
18. Kelso, J.A.S. Dynamic Patterns: The Self-Organization of Brain and Behavior; MIT Press: Cambridge, MA, USA, 1995.
19. Körding, K.P.; König, P. Learning with two sites of synaptic integration. Netw. Comput. Neural Syst. 2000, 11, 1-15.
20. Salinas, E.; Sejnowski, T.J. Gain modulation in the central nervous system: Where behavior, neurophysiology, and computation meet. Neuroscientist 2001, 7, 430-440.
21. Spratling, M.W. Predictive-coding as a model of biased competition in visual attention. Vis. Res. 2008, 48, 1391-1408.
22. Spratling, M.W.; Johnson, M.H. A feedback model of perceptual learning and categorisation. Vis. Cogn. 2006, 13, 129-165.
23. Tononi, G.; Sporns, O.; Edelman, G.M. Complexity and coherency: Integrating information in the brain. Trends Cogn. Sci. 1998, 2, 474-484.
24. Fiorillo, C.D. Towards a general theory of neural computation based on prediction by single neurons. PLoS One 2008, 3, e3298.
25. Fiorillo, C.D. A neurocentric approach to Bayesian inference. Nat. Rev. Neurosci. 2010, 11, 605.
26. Jaynes, E.T. Probability Theory as Logic. In Maximum Entropy and Bayesian Methods; Fougere, P.H., Ed.; Kluwer Academic Publishers: Dordrecht, The Netherlands, 1990.
27. Jaynes, E.T. Where do We Stand on Maximum Entropy? In The Maximum Entropy Formalism; Levine, R.D., Tribus, M., Eds.; MIT Press: Cambridge, MA, USA, 1979.
28. Jaynes, E.T. Information theory and statistical mechanics. Phys. Rev. 1957, 106, 120-130.
29. Jaynes, E.T. Information theory and statistical mechanics. II. Phys. Rev. 1957, 108, 171-191.
30. Friston, K.J.; Stephan, K.E. Free-energy and the brain. Synthese 2007, 159, 417-458.
31. Bellman, R.E. Adaptive Control Processes; Princeton University Press: Princeton, NJ, USA, 1961.
32. Barlow, H.B. Possible Principles Underlying the Transformation of Sensory Messages. In Sensory Communication; Rosenblith, W.A., Ed.; MIT Press: Cambridge, MA, USA, 1961.
33. Linsker, R. Self-organization in a perceptual network. Computer 1988, 21, 105-107.
34. Dechter, R. From local to global consistency. Artif. Intell. 1992, 55, 87-107.
35. Silver, R.A. Neuronal arithmetic. Nat. Rev. Neurosci. 2010, 11, 474-489.
36. Berger, A.L.; Della Pietra, S.A.; Della Pietra, V.J. A maximum entropy approach to natural language processing. Comput. Linguist. 1996, 22, 39-71.
37. Myers, C.L.; Troyanskaya, O.G. Context-sensitive data integration and prediction of biological networks. Bioinformatics 2007, 23, 2322-2330.
38. Ginter, F.; Boberg, J.; Jarvinen, J.; Salakoski, T. New techniques for disambiguation in natural language and their application to biological text. J. Mach. Learn. Res. 2004, 5, 605-621.
39. Oaksford, M.; Chater, N. Bayesian rationality: The probabilistic approach to human reasoning. Behav. Brain Sci. 2009, 32, 69-120.
40. Knill, D.C.; Pouget, A. The Bayesian Brain: The role of uncertainty in neural coding and computation. Trends Neurosci. 2004, 27, 712-719.
41. Jones, M.; Love, B.C. Bayesian fundamentalism or enlightenment? On the explanatory status and theoretical contributions of Bayesian models to cognition. Behav. Brain Sci. 2011, 34, 169-188.
42. Szmatháry, E.; Smith, J.M. The major evolutionary transitions. Nature 1995, 374, 227-232.
43. Phillips, W.A. How do Neural Systems Use Probabilistic Inference that is Context-Sensitive to Create and Preserve Organized Complexity? In Integral Biomathics: Tracing the Road to Reality; Simeonov, P.L., Smith, L.S., Ehresmann, A.C., Eds.; Springer: Berlin, Germany, 2011.
44. Berhendt, R.-P.; Young, C. Hallucinations in schizophrenia, sensory impairment, and brain disease: A unifying model. Behav. Brain Sci. 2004, 27, 771-830.
45. Phillips, W.A. Belief in the primacy of fantasy is misleading and unnecessary. Behav. Brain Sci. 2004, 27, 802-803.
46. Fiorillo, C.D. Beyond Bayes: On the need for a unified and Jaynesian definition of probability and information within neuroscience. Information, submitted for publication, 2012.