Synaptic sampling: A Bayesian approach to neural network plasticity and rewiring

Advances in Neural Information Processing Systems

Volumn 2015-January, Issue , 2015, Pages 370-378

  Kappel, David ^a   Habenschuss, Stefan ^a   Legenstein, Robert ^a   Maass, Wolfgang ^a  

^a GRAZ UNIVERSITY OF TECHNOLOGY   (Austria)

Author keywords

[No Author keywords available]

Indexed keywords

BAYESIAN NETWORKS; INFORMATION SCIENCE; MAXIMUM LIKELIHOOD; NEURAL NETWORKS;

BAYESIAN APPROACHES; CONNECTION PROBABILITY; MATHEMATICAL FRAMEWORKS; POSTERIOR DISTRIBUTIONS; PROBABILISTIC INFERENCE; SPIKING NEURAL NETWORKS; SYNAPTIC PLASTICITY; WEIGHT DISTRIBUTIONS;

PROBABILITY DISTRIBUTIONS;

EID: 84965179942     PISSN: 10495258     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (29)

1. Hatfield G. Perception as Unconscious Inference. In: Perception and the Physical World: Psychological and Philosophical Issues in Perception. Wiley; 2002. p. 115-143.
2. Pouget A, Beck JM, Ma WJ, Latham PE. Probabilistic brains: knowns and unknowns. Nature Neuroscience. 2013;16(9):1170-1178.
3. Winkler I, Denham S, Mill R, Böhm TM, Bendixen A. Multistability in auditory stream segregation: a predictive coding view. Phil Trans R Soc B: Biol Sci. 2012;367(1591):1001-1012.
4. Brea J, Senn W, Pfister JP. Sequence learning with hidden units in spiking neural networks. In: NIPS. vol. 24; 2011. p. 1422-1430.
5. Rezende DJ, Gerstner W. Stochastic variational learning in recurrent spiking networks. Frontiers in Computational Neuroscience. 2014;8:38.
6. Nessler B, Pfeiffer M, Maass W. STDP enables spiking neurons to detect hidden causes of their inputs. In: NIPS. vol. 22; 2009. p. 1357-1365.
7. MacKay DJ. Bayesian interpolation. Neural Computation. 1992;4(3):415-447.
8. Bishop CM. Pattern Recognition and Machine Learning. New York: Springer; 2006.
9. Holtmaat AJ, Trachtenberg JT, Wilbrecht L, Shepherd GM, Zhang X, Knott GW, et al. Transient and Persistent Dendritic Spines in the Neocortex In Vivo. Neuron. 2005;45:279-291.
10. Loewenstein Y, Kuras A, Rumpel S. Multiplicative dynamics underlie the emergence of the log-normal distribution of spine sizes in the neocortex in vivo. J Neurosci. 2011;31(26):9481-9488.
11. Marder E. Variability, compensation and modulation in neurons and circuits. PNAS. 2011;108(3):15542-15548.
12. Gardiner CW. Handbook of Stochastic Methods. 3rd ed. Springer; 2004.
13. Welling M, Teh YW. Bayesian learning via stochastic gradient Langevin dynamics. In: Proceedings of the 28th International Conference on Machine Learning (ICML-11); 2011. p. 681-688.
14. Sato I, Nakagawa H. Approximation analysis of stochastic gradient langevin dynamics by using fokkerplanck equation and ito process. In: NIPS; 2014. p. 982-990.
15. Kappel D, Nessler B, Maass W. STDP installs in winner-take-all circuits an online approximation to hidden Markov model learning. PLoS Comp Biol. 2014;10(3):e1003511.
16. Jolivet R, Rauch A, Lüscher H, Gerstner W. Predicting spike timing of neocortical pyramidal neurons by simple threshold models. J Comp Neurosci. 2006;21:35-49.
17. Mensi S, Naud R, Gerstner W. From stochastic nonlinear integrate-and-fire to generalized linear models. In: NIPS. vol. 24; 2011. p. 1377-1385.
18. Gerstner W, Kistler WM. Spiking Neuron Models. Cambridge University Press; 2002.
19. Carandini M. From circuits to behavior: a bridge too far? Nature Neurosci. 2012;15(4):507-509.
20. Habenschuss S, Bill J, Nessler B. Homeostatic plasticity in Bayesian spiking networks as Expectation Maximization with posterior constraints. In: NIPS. vol. 25; 2012. p. 782-790.
21. Habenschuss S, Puhr H, Maass W. Emergence of optimal decoding of population codes through STDP. Neural Computation. 2013;25:1-37.
22. Kappel D, Habenschuss S, Legenstein R, Maass W. Network Plasticity as Bayesian Inference. PLoS Comp Biol. 2015;11(11):e1004485.
23. Xiong H, Szedmak S, Rodrguez-Sanchez A, Piater J. Towards sparsity and selectivity: Bayesian learning of restricted Boltzmann machine for early visual features. In: ICANN; 2014. p. 419-426.
24. Bi GQ, Poo MM. Synaptic modifications in cultured hippocampal neurons: dependence on spike timing, synaptic strength, and postsynaptic cell type. J Neurosci. 1998;18(24):10464-10472.
25. Sjöström PJ, Turrigiano GG, Nelson SB. Rate, timing, and cooperativity jointly determine cortical synaptic plasticity. Neuron. 2001;32(6):1149-1164.
26. Montgomery JM, Pavlidis P, Madison DV. Pair recordings reveal all-silent synaptic connections and the postsynaptic expression of long-term potentiation. Neuron. 2001;29(3):691-701.
27. Kennedy AD. The Hybrid Monte Carlo algorithm on parallel computers. Parallel Computing. 1999;25(10):1311-1339.
28. Johannes Schemmel KMEM Andreas Gruebl. Implementing Synaptic Plasticity in a VLSI Spiking Neural Network Model. In: IJCNN; 2006. p. 1-6.
29. Bill J, Legenstein R. A compound memristive synapse model for statistical learning through STDP in spiking neural networks. Frontiers in Neuroscience. 2014;8:412.