Statistical mechanics of complex neural systems and high dimensional data

Journal of Statistical Mechanics: Theory and Experiment

Volumn 2013, Issue 3, 2013, Pages

  Advani, Madhu ^a   Lahiri, Subhaneil ^a   Ganguli, Surya ^a  

^a STANFORD UNIVERSITY   (United States)

Author keywords

cavity and replica method; computational neuroscience; message passing Algorithms; spin glasses (theory)

Indexed keywords

EID: 84875289428     PISSN: None     EISSN: 17425468     Source Type: Journal    
DOI: 10.1088/1742-5468/2013/03/P03014     Document Type: Article

References (170)

1. Kandel E R, Schwartz J H and Jessell T M 1991 Principles of Neural Science (Norwalk, CT: Appleton and Lange)
2. Dayan P and Abbott L F 2001 Theoretical Neuroscience. Computational and Mathematical Modelling of Neural Systems (Cambridge, MA: MIT Press)
3. Reike F, Warland D, van Steveninck R and Bialek W 1996 Spikes: Exploring the Neural Code (Cambridge, MA: MIT Press)
4. Lau K Y, Ganguli S and Tang C 2007 Function constrains network architecture and dynamics: a case study on the yeast cell cycle boolean network Phys. Rev. E 75 051907 (Pubitemid 47013679)
5. Mezard M and Montanari A 2009 Information, Physics, and Computation (Oxford: Oxford University Press)
6. Sherrington D and Kirkpatrick S 1975 Solvable model of a spin-glass Phys. Rev. Lett. 35 1792
7. Mezard M, Parisi G and Virasoro M A 1987 Spin Glass Theory and Beyond (Singapore: World Scientific)
8. Fischer K H and Hertz J A 1993 Spin Glasses vol 1 (Cambridge: Cambridge University Press)
9. Nishimori H 2001 Statistical Physics of Spin Glasses and Information Processing: an Introduction vol 111 (Oxford: Oxford University Press)
10. Koller D and Friedman N 2009 Probabilistic Graphical Models: Principles and Techniques (Cambridge, MA: MIT Press)
11. Pearl J 1988 Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference (San Mateo, CA: Morgan Kaufmann)
12. Engel A and den Broeck C V 2001 Statistical Mechanics of Learning (Cambridge, MA: Cambridge University Press)
13. Rosenblatt F 1958 The perceptron: a probabilistic model for information storage and organization in the brain Psychol. Rev. 65 386
14. Block H D 1962 The perceptron: a model for brain functioning. i Rev. Mod. Phys. 34 123
15. Blum A L and Rivest R L 1992 Training a 3-node neural network is np-complete Neural Netw. 5 117
16. Amaldi E 1991 On the complexity of training perceptrons Artif. Neural Netw. 1 55
17. Braunstein A and Zecchina R 2006 Learning by message passing in networks of discrete synapses Phys. Rev. Lett. 96 30201 (Pubitemid 43248077)
18. Baldassi C, Braunstein A, Brunel N and Zecchina R 2007 Efficient supervised learning in networks with binary synapses BMC Neurosci. 8 S13
19. Mehta M L 2004 Random Matrices vol 142 (New York: Academic)
20. Akemann G, Baik J and Di Francesco P 2011 The Oxford Handbook of Random Matrix Theory (Oxford Handbooks in Mathematics) (Oxford: Oxford University Press)
21. Sompolinsky H, Crisanti A and Sommers H J 1988 Chaos in random neural networks Phys. Rev. Lett. 61 259
22. Wishart J 1928 The generalised product moment distribution in samples from a normal multivariate population Biometrika 20 32
23. Marchenko V A and Pastur L A 1967 Distribution of eigenvalues for some sets of random matrices Matematicheskii Sbornik 114 507
24. Tracy C A and Widom H 1994 Level-spacing distributions and the Airy kernel Commun. Math. Phys. 159 151 (Pubitemid 24759200)
25. Tracy C A and Widom H 2002 Distribution functions for largest eigenvalues and their applications arXiv:math-ph/0210034
26. Vivo P, Majumdar S N and Bohigas O 2007 Large deviations of the maximum eigenvalue in Wishart random matrices J. Phys. A: Math. Theor. 40 4317
27. Majumdar S N and Vergassola M 2009 Large deviations of the maximum eigenvalue for Wishart and Gaussian random matrices Phys. Rev. Lett. 102 60601
28. Bruckstein A M, Donoho D L and Elad M 2009 From sparse solutions of systems of equations to sparse modeling of signals and images SIAM Rev. 51 34
29. Candes E and Wakin M 2008 An introduction to compressive sampling IEEE Sig. Proc. Mag. 25 21 (Pubitemid 351513062)
30. Ganguli S and Sompolinsky H 2012 Compressed sensing, sparsity, and dimensionality in neuronal information processing and data analysis Annu. Rev. Neurosci. 35 485
31. Lustig M, Donoho D L, Santos J M and Pauly J M 2008 Compressed sensing mri IEEE Signal Process. Mag. 25 72 (Pubitemid 351513068)
32. Lustig M, Donoho D and Pauly J M 2007 Sparse mri: the application of compressed sensing for rapid mr imaging Magnet. Reson. Med. 58 1182 (Pubitemid 350234205)
33. Parrish T and Hu X 1995 Continuous update with random encoding (cure): a new strategy for dynamic imaging Magn. Reson. Med. 33 326
34. Dai W, Sheikh M A, Milenkovic O and Baraniuk R G 2009 Compressive sensing DNA microarrays EURASIP J. Bioinform. Syst. Biol. 2009 162824
35. Hu T and Chklovskii D B 2009 Reconstruction of sparse circuits using multi-neuronal excitation (rescume) Advances in Neural Information Processing Systems 22
36. Mishchenko Y 2011 Reconstruction of complete connectivity matrix for connectomics by sampling neural connectivity with fluorescent synaptic markers J. Neurosci. Methods 196 289
37. Wilt B A, Burns L D, Ho E T W, Ghosh K K, Mukamel E A and Schnitzer M J 2009 Advances in light microscopy for neuroscience Ann. Rev. Neurosci. 32 435
38. Taraska J W and Zagotta W N 2010 Fluorescence applications in molecular neurobiology Neuron 66 170
39. Coskun A F, Sencan I, Su T W and Ozcan A 2010 Lensless wide-field fluorescent imaging on a chip using compressive decoding of sparse objects Opt. Express 18 10510
40. Takhar D, Laska J N, Wakin M, Duarte M F, Baron D, Sarvotham S, Kelly K F and Baraniuk R G 2006 A new compressive imaging camera architecture using optical-domain compression IS&T/SPIE Comput. Imaging 4 6065
41. Duarte M F, Davenport M A, Takhar D, Laska J N, Sun T, Kelly K F and Baraniuk R G 2008 Single-pixel imaging via compressive sampling IEEE Signal Process. Mag. 25 83 (Pubitemid 351513069)
42. Rogers T T and McClelland J L 2004 Semantic Cognition: A Parallel Distributed Processing Approach (Cambridge, MA: MIT Press)
43. Kiani R, Esteky H, Mirpour K and Tanaka K 2007 Object category structure in response patterns of neuronal population in monkey inferior temporal cortex J. Neurophysiol. 97 4296 (Pubitemid 47080657)
44. Kriegeskorte N, Mur M, Ruff D A, Kiani R, Bodurka J, Esteky H, Tanaka K and Bandettini P A 2008 Matching categorical object representations in inferior temporal cortex of man and monkey Neuron 60 1126
45. Ganguli S, Huh D and Sompolinsky H 2008 Memory traces in dynamical systems Proc. Nat. Acad. Sci. 105 18970
46. Ganguli S and Sompolinsky H 2010 Short-term memory in neuronal networks through dynamical compressed sensing Neural Information Processing Systems (NIPS)
47. Rozell C J, Johnson D H, Baraniuk R G and Olshausen B A 2008 Sparse coding via thresholding and local competition in neural circuits Neural Comput. 20 2526
48. Olshausen B A et al 1996 Emergence of simple-cell receptive field properties by learning a sparse code for natural images Nature 381 607 (Pubitemid 26177476)
49. Perrinet L U 2010 Role of homeostasis in learning sparse representations Neural Comput. 22 1812
50. Lage-Castellanos A, Pagnani A and Weigt M 2009 Statistical mechanics of sparse generalization and graphical model selection J. Stat. Mech. P10009
51. Coulter W K, Hillar C J, Isley G and Sommer F T 2010 Adaptive compressed sensing - a new class of self-organizing coding models for neuroscience ICASSP: IEEE Int. Conf. Acoustics Speech and Signal Processing (Piscataway, NJ: IEEE) pp 5494-7
52. Isely G, Hillar C J and Sommer F T 2010 Deciphering subsampled data: adaptive compressive sampling as a principle of brain communication Advances in Neural Information Processing Systems
53. Hillar C J and Sommer F T 2011 Ramsey theory reveals the conditions when sparse coding on subsampled data is unique arXiv:org/abs/1106.3616
54. Kim S M, Ganguli S and Frank L M 2012 Spatial information outflow from the hippocampal circuit: distributed spatial coding and phase precession in the subiculum J. Neurosci. 32 11539
55. Donoho D L, Maleki A and Montanari A 2009 Message-passing algorithms for compressed sensing Proc. Nat. Acad. Sci. 106 18914
56. Hu T, Druckmann S and Chklovskii D B 2011 Early sensory processing as predictive coding: subtracting sparse approximations by circuit dynamics Front. Neurosci. Conf. Abs: COSYNE
57. Koulakov A A and Rinberg D 2011 Sparse incomplete representations: a novel role for olfactory granule cells Neuron 72 124
58. Amit D J, Gutfreund H and Sompolinsky H 1985 Spin-glass models of neural networks Phys. Rev. A 32 1007
59. Schneidman E, Berry M J, Segev R and Bialek W 2006 Weak pairwise correlations imply strongly correlated network states in a neural population Nature 440 1007
60. Shlens J, Field G D, Gauthier J L, Grivich M I, Petrusca D, Sher A, Litke A M and Chichilnisky E J 2006 The structure of multi-neuron firing patterns in primate retina J. Neurosci. 26 8254 (Pubitemid 44309839)
61. Krzakała F, Montanari A, Ricci-Tersenghi F, Semerjian G and Zdeborová L 2007 Gibbs states and the set of solutions of random constraint satisfaction problems Proc. Nat. Acad. Sci. 104 10318 (Pubitemid 47185663)
62. Kirkpatrick S and Sherrington D 1978 Infinite-ranged models of spin-glasses Phys. Rev. B 17 4384
63. De Almeida J R L and Thouless D J 2001 Stability of the Sherrington-Kirkpatrick solution of a spin glass model J. Phys. A: Math. Gen. 11 983
64. Rammal R, Toulouse G and Virasoro M A 1986 Ultrametricity for physicists Rev. Mod. Phys. 58 765
65. Huse D A and Fisher D S 1999 Pure states in spin glasses J. Phys. A: Math. Gen. 20 L997
66. Bray A J and Moore M A 1987 Chaotic nature of the spin-glass phase Phys. Rev. Lett. 58 57
67. Chatterjee S 2009 Disorder chaos and multiple valleys in spin glasses arXiv:0907.3381
68. Hopfield J J 1982 Neural networks and physical systems with emergent collective computational abilities Proc. Nat. Acad. Sci. 79 2554
69. Hebb D O 1949 The Organization of Behavior (New York: Wiley)
70. Amit D J, Gutfreund H and Sompolinsky H 1985 Storing infinite numbers of patterns in a spin glass model of neural networks Phys. Rev. Lett 55 1530
71. Amit D J, Gutfreund H and Sompolinsky H 1987 Statistical mechanics of neural networks near saturation Ann. Phys. 173 30
72. Shamir M and Sompolinsky H 2000 Thouless-Anderson-Palmer equations for neural networks Phys. Rev. E 61 1839
73. Bethe H A 1935 Proc. R. Soc. A 151 552
74. Yedidia J S, Freeman W T and Weiss Y 2005 Constructing free-energy approximations and generalized belief propagation algorithms IEEE Trans. Inform. Theory 51 2282 (Pubitemid 41136394)
75. Wainwright M J and Jordan M I 2008 Graphical models, exponential families, and variational inference Found. Trends Mach. Learn. 1 1
76. Mézard M and Parisi G 2001 The bethe lattice spin glass revisited Eur. Phys. J. B 20 217
77. Mézard M, Parisi G and Zecchina R 2002 Analytic and algorithmic solution of random satisfiability problems Science 297 812 (Pubitemid 34839626)
78. Braunstein A, Mézard M and Zecchina R 2005 Survey propagation: an algorithm for satisfiability Random Struct. Algorithms 27 201 (Pubitemid 41482546)
79. Gardner E 1988 The space of interactions in neural network models J. Phys. A: Math. Gen. 21 257
80. Gardner E and Derrida B 1999 Optimal storage properties of neural network models J. Phys. A: Math. Gen. 21 271
81. Brunel N, Hakim V, Isope P, Nadal J P and Barbour B 2004 Optimal information storage and the distribution of synaptic weights: perceptron versus Purkinje cell Neuron 43 745
82. Marr D 1969 A theory of cerebellar cortex J. Physiol. 202 437
83. Albus J S 1971 A theory of cerebellar function Math. Biosci. 10 26
84. Isope P and Barbour B 2002 Properties of unitary granule cell Purkinje cell synapses in adult rat cerebellar slices J. Neurosci. 22 9668
85. Mézard M 1999 The space of interactions in neural networks: Gardner's computation with the cavity method J. Phys. A: Math. Gen. 22 2181
86. Griniasty M 1993 Cavity-approach analysis of the neural-network learning problem Phys. Rev. E 47 4496
87. Lootens E and van den Broeck C 2007 Analysing cluster formation by replica method Europhys. Lett. 30 381
88. Petersen C C H, Malenka R C, Nicoll R A and Hopfield J J 1998 All-or-none potentiation at ca3-ca1 synapses Proc. Nat. Acad. Sci. 95 4732 (Pubitemid 28207982)
89. O'Connor D H, Wittenberg G M and Wang S S H 2005 Graded bidirectional synaptic plasticity is composed of switch-like unitary events Proc. Nat. Acad. Sci. 102 9679 (Pubitemid 40981740)
90. Krauth W and Opper M 1989 Critical storage capacity of the j =± 1 neural network J. Phys. A: Math. Gen. 22 L519
91. Krauth W and Mézard M 1989 Storage capacity of memory networks with binary couplings J. Phys. 50 3057
92. Montgomery J M and Madison D V 2004 Discrete synaptic states define a major mechanism of synapse plasticity Trends Neurosci. 27 744 (Pubitemid 39488078)
93. Dhesi G S and Jones R C 1999 Asymptotic corrections to the wigner semicircular eigenvalue spectrum of a large real symmetric random matrix using the replica method J. Phys. A: Math. Gen. 23 5577
94. Sommers H J, Crisanti A, Sompolinsky H and Stein Y 1988 Spectrum of large random asymmetric matrices Phys. Rev. Lett. 60 1895
95. Rajan K and Abbott L F 2006 Eigenvalue spectra of random matrices for neural networks Phys. Rev. Lett. 97 188104 (Pubitemid 44684346)
96. Sengupta A M and Mitra P P 1999 Distributions of singular values for some random matrices Phys. Rev. E 60 3389
97. Hoyle D C and Rattray M 2004 Principal-component-analysis eigenvalue spectra from data with symmetry-breaking structure Phys. Rev. E 69 026124
98. Wigner E P 1958 On the distribution of the roots of certain symmetric matrices Ann. Math. 67 325
99. Dhesi G S and Jones R C 1990 Asymptotic corrections to the wigner semicircular eigenvalue spectrum of a large real symmetric random matrix using the replica method J. Phys. A: Math. Gen. 23 5577
100. Edelman A and Rao N R 2005 Random matrix theory Acta Numerica 14 233 (Pubitemid 40763884)
101. Johnson W B and Lindenstrauss J 1984 Extensions of Lipschitz mappings into a Hilbert space Contemp. Math. 26 1
102. Indyk P and Motwani R 1998 Approximate nearest neighbors: towards removing the curse of dimensionality Proc. 13th Annual ACM Symp. on Theory of Computing ACM, pp 604-613
103. Dasgupta S and Gupta A 2003 An elementary proof of a theorem of Johnson and Lindenstrauss Random Struct. Algorithms 22 60
104. Baraniuk R G and Wakin M B 2009 Random projections of smooth manifolds Found. Comput. Math. 9 51
105. Baraniuk R G, Cevher V and Wakin M B 2010 Low-dimensional models for dimensionality reduction and signal recovery: a geometric perspective Proc. IEEE 98 959
106. Yap H L, Wakin M B and Rozell C J 2011 Stable manifold embeddings with operators satisfying the restricted isometry property CISS: 45th Annual Conf. on Information Sciences and Systems, 2011 (Piscataway, NJ: IEEE) pp 1-6
107. Baraniuk R, Davenport M, DeVore R and Wakin M 2008 A simple proof of the restricted isometry property for random matrices Construct. Approx. 28 253
108. Candes E and Tao T 2005 Decoding by linear programming IEEE Trans. Inf. Theory 51 4203 (Pubitemid 41800353)
109. Zhou S, Lafferty J and Wasserman L 2009 Compressed and privacy-sensitive sparse regression IEEE Trans. Inf. Theory 55 846
110. Duarte M F, Davenport M A, Wakin M B and Baraniuk R G 2006 Sparse signal detection from incoherent projections ICASSP Proc. Acoustics, Speech and Signal Processing (Piscataway, NJ: IEEE) p III
111. Davenport M, Duarte M, Wakin M, Laska J, Takhar D, Kelly K and Baraniuk R 2007 The smashed filter for compressive classification and target recognition Proc. Computational Imaging V SPIE Electronic Imaging
112. Duarte M F, Davenport M A, Wakin M B, Laska J N, Takhar D, Kelly K F and Baraniuk R G 2007 Multiscale random projections for compressive classification (ICIP 2007): IEEE Int. Conf. on Image Processing (Piscataway, NJ: IEEE) pp VI-161
113. Haupt J, Castro R, Nowak R, Fudge G and Yeh A 2006 Compressive sampling for signal classification (ACSSC'06): 40th Asilomar Conf. on Signals, Systems and Computers, 2006 (Piscataway, NJ: IEEE) pp 1430-4
114. Blum A 2006 Random projection, margins, kernels, and feature-selection Subspace, Latent Structure and Feature Selection (Lecture Notes in Computer Science vol 3940) (Berlin: Springer) pp 52-68 (Pubitemid 44029879)
115. Hegde C, Wakin M B and Baraniuk R G 2007 Random projections for manifold learning Neural Information Processing Systems
116. Coles S 2001 An Introduction to Statistical Modeling of Extreme Values (Berlin: Springer)
117. Donoho D L and Elad M 2003 Optimally sparse representation in general (non-orthogonal) dictionaries via l1 minimization Proc. Nat. Acad. Sci. 100 2197 (Pubitemid 36297476)
118. Candes E, Romberg J and Tao T 2006 Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information IEEE Trans. Inf. Theory 52 489 (Pubitemid 43174093)
119. Kabashima Y, Wadayama T and Tanaka T 2009 A typical reconstruction limit for compressed sensing based on l p-norm minimization J. Stat. Mech. L09003
120. Rangan S, Fletcher A K and Goyal V K 2009 Asymptotic analysis of map estimation via the replica method and applications to compressed sensing arXiv:0906.3234
121. Ganguli S and Sompolinsky H 2010 Statistical mechanics of compressed sensing Phys. Rev. Lett. 104 188701
122. Donoho D L and Tanner J 2005 Neighborliness of randomly projected simplices in high dimensions Proc. Nat. Acad. Sci. 102 9452 (Pubitemid 40981702)
123. Donoho D L and Tanner J 2005 Sparse nonnegative solution of underdetermined linear equations by linear programming Proc. Nat. Acad. Sci. 102 9446 (Pubitemid 40981701)
124. Montanari A 2010 Graphical models concepts in compressed sensing Compressed Sensing: Theory and Applications (Cambridge: Cambridge University Press) pp 394-438
125. Martin P C, Siggia E D and Rose H A 1973 Statistical dynamics of classical systems Phys. Rev. A 8 423
126. De Dominicis C 1978 Dynamics as a substitute for replicas in systems with quenched random impurities Phys. Rev. B 18 4913
127. Crisanti A and Sompolinsky H 1987 Dynamics of spin systems with randomly asymmetric bonds: Langevin dynamics and a spherical model Phys. Rev. A 36 4922
128. Crisanti A and Sompolinsky H 1988 Dynamics of spin systems with randomly asymmetric bonds: Ising spins and glauber dynamics Phys. Rev. A 37 4865
129. Derrida B, Gardner E and Zippelius A 2007 An exactly solvable asymmetric neural network model Europhys. Lett. 4 167
130. van Vreeswijk C and Sompolinsky H 1996 Chaos in neuronal networks with balanced excitatory and inhibitory activity Science 274 1724 (Pubitemid 26414907)
131. Vreeswijk C and Sompolinsky H 1998 Chaotic balanced state in a model of cortical circuits Neural Comput. 10 1321
132. Molgedey L, Schuchhardt J and Schuster H G 1992 Suppressing chaos in neural networks by noise Phys. Rev. Lett. 69 3717
133. Rajan K, Abbott L F and Sompolinsky H 2010 Stimulus-dependent suppression of chaos in recurrent neural networks Phys. Rev. E 82 011903
134. Brunel N 2000 Dynamics of sparsely connected networks of excitatory and inhibitory spiking neurons J. Comput. Neurosci. 8 183 (Pubitemid 30219050)
135. Renart A, Brunel N and Wang X J 2004 Mean-Field Theory of Irregularly Spiking Neuronal Populations and Working Memory in Recurrent Cortical Networks (Boca Raton, FL: CRC Press)
136. Hertz J, Lerchner A and Ahmadi M 2004 Mean field methods for cortical network dynamics Computational Neuroscience: Cortical Dynamics (Lecture Notes in Computer Science vol 3146) (Berlin: Springer) p 71
137. Monteforte M and Wolf F 2010 Dynamical entropy production in spiking neuron networks in the balanced state Phys. Rev. Lett. 105 268104
138. Monteforte M and Wolf F 2012 Dynamic flux tubes form reservoirs of stability in neuronal circuits Phys. Rev. X 2 041007
139. London M, Roth A, Beeren L, Häusser M and Latham P E 2010 Sensitivity to perturbations in vivo implies high noise and suggests rate coding in cortex Nature 466 123
140. Vogels T P, Rajan K and Abbott L F 2005 Neural network dynamics Annu. Rev. Neurosci. 28 357 (Pubitemid 41102238)
141. Rabinovich M I, Varona P, Selverston A I and Abarbanel H D I 2006 Dynamical principles in neuroscience Rev. Mod. Phys. 78 1213 (Pubitemid 44800115)
142. Seung H S, Sompolinsky H and Tishby N 1992 Statistical mechanics of learning from examples Phys. Rev. A 45 6056
143. Sompolinsky H, Tishby N and Seung H S 1990 Learning from examples in large neural networks Phys. Rev. Lett. 65 1683
144. Barkai E, Hansel D and Kanter I 1990 Statistical mechanics of a multilayered neural network Phys. Rev. Lett. 65 2312
145. Barkai E, Hansel D and Sompolinsky H 1992 Broken symmetries in multilayered perceptrons Phys. Rev. A 45 4146
146. Engel A, Köhler H M, Tschepke F, Vollmayr H and Zippelius A 1992 Storage capacity and learning algorithms for two-layer neural networks Phys. Rev. A 45 7590
147. Opper M 1994 Learning and generalization in a two-layer neural network: the role of the Vapnik-Chervonvenkis dimension Phys. Rev. Lett. 72 2113
148. Monasson R and Zecchina R 1995 Weight space structure and internal representations: a direct approach to learning and generalization in multilayer neural networks Phys. Rev. Lett. 75 2432
149. Schwarze H 1999 Learning a rule in a multilayer neural network J. Phys. A: Math. Gen. 26 5781
150. Dietrich R, Opper M and Sompolinsky H 1999 Statistical mechanics of support vector networks Phys. Rev. Lett. 82 2975
151. Opper M and Urbanczik R 2001 Universal learning curves of support vector machines Phys. Rev. Lett. 86 4410 (Pubitemid 32469566)
152. Malzahn D and Opper M 2005 A statistical physics approach for the analysis of machine learning algorithms on real data J. Stat. Mech. P11001
153. Urry M and Sollich P 2012 Replica theory for learning curves for Gaussian processes on random graphs arXiv:1202.5918
154. Gütig R and Sompolinsky H 2006 The tempotron: a neuron that learns spike timing - based decisions Nature Neurosci. 9 420 (Pubitemid 43290972)
155. Rubin R, Monasson R and Sompolinsky H 2010 Theory of spike timing-based neural classifiers Phys. Rev. Lett. 105 218102
156. Lichtman J W and Sanes J R 2008 Ome sweet ome: what can the genome tell us about the connectome? Curr. Opin. Neurobiol. 18 346
157. Watkin T L H, Rau A and Biehl M 1993 The statistical mechanics of learning a rule Rev. Mod. Phys. 65 499
158. Hoyle D C 2010 Statistical mechanics of learning orthogonal signals for general covariance models J. Stat. Mech. P04009
159. Biehl M and Mietzner A 1999 Statistical mechanics of unsupervised structure recognition J. Phys. A: Math. Gen. 27 1885
160. Biehl M 1994 An exactly solvable model of unsupervised learning Europhys. Lett. 25 391 (Pubitemid 24763899)
161. Marangi C, Biehl M and Solla S A 2007 Supervised learning from clustered input examples Europhys. Lett. 30 117
162. Rose K, Gurewitz E and Fox G C 1990 Statistical mechanics and phase transitions in clustering Phys. Rev. Lett. 65 945
163. Barkai N, Seung H S and Sompolinsky H 1993 Scaling laws in learning of classification tasks Phys. Rev. Lett. 70 3167
164. Barkai N and Sompolinsky H 1994 Statistical mechanics of the maximum-likelihood density estimation Phys. Rev. E 50 1766
165. Blatt M, Wiseman S and Domany E 1996 Superparamagnetic clustering of data Phys. Rev. Lett. 76 3251
166. Wiseman S, Blatt M and Domany E 1998 Superparamagnetic clustering of data Phys. Rev. E 57 3767
167. Łuksza M, Lässig M and Berg J 2010 Significance analysis and statistical mechanics: an application to clustering Phys. Rev. Lett. 105 220601
168. Dyson F J 1962 A brownian-motion model for the eigenvalues of a random matrix J. Math. Phys. 3 1191
169. Schehr G, Majumdar S N, Comtet A and Randon-Furling J 2008 Exact distribution of the maximal height of p vicious walkers Phys. Rev. Lett. 101 150601
170. Tracy C A and Widom H 2007 Nonintersecting brownian excursions Ann. Appl. Probab. 17 953