An approximation of the error backpropagation algorithm in a predictive coding network with local hebbian synaptic plasticity

Neural Computation

Volumn 29, Issue 5, 2017, Pages 1229-1262

  Whittington, James C R ^a,b   Bogacz, Rafal ^a,b  

^a UNIVERSITY OF OXFORD   (United Kingdom)

^b UNIVERSITY OF OXFORD   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

APPROXIMATION ALGORITHMS; BACKPROPAGATION; BIOINFORMATICS; COMPLEX NETWORKS; ERRORS; LEARNING ALGORITHMS; NETWORK CODING;

BIOLOGICAL SYNAPSIS; COMPLEX FUNCTIONS; CORTICAL HIERARCHIES; ERROR BACKPROPAGATION ALGORITHMS; HEBBIAN PLASTICITY; POST-SYNAPTIC NEURONS; PREDICTIVE CODING; SYNAPTIC PLASTICITY;

BACKPROPAGATION ALGORITHMS;

ALGORITHM; ARTIFICIAL NEURAL NETWORK; BIOLOGICAL MODEL; BRAIN CORTEX; CYTOLOGY; HUMAN; LEARNING; NERVE CELL; NERVE CELL PLASTICITY; PHYSIOLOGICAL FEEDBACK; PHYSIOLOGY;

ALGORITHMS; CEREBRAL CORTEX; FEEDBACK, PHYSIOLOGICAL; HUMANS; LEARNING; MODELS, NEUROLOGICAL; NEURAL NETWORKS (COMPUTER); NEURONAL PLASTICITY; NEURONS;

EID: 85017439802     PISSN: 08997667     EISSN: 1530888X     Source Type: Journal    
DOI: 10.1162/NECO_a_00949     Document Type: Letter

References (53)

1. Ackley, D. H., Hinton, G. E., Sejnowski, T. J. (1985). A learning algorithm for Boltzmann machines. Cognitive Science, 9, 147-169.
2. Balduzzi,D.,Vanchinathan,H., Buhmann, J. (2014). Kickback cuts backprop's red-tape: Biologically plausible credit assignment in neural networks. arXiv:1411.6191v1.
3. Barto, A., Jordan, M. (1987). Gradient following without back-propagation in layered networks. In Proceedings of the 1st Annual International Conference on Neural Networks (vol. 2, pp. 629-636). Piscataway, NJ.
4. Bastos, A. M., Usrey, W. M., Adams, R. A., Mangun, G. R., Fries, P., Friston, K. J. (2012). Canonical microcircuits for predictive coding. Neuron, 76, 695- 711.
5. Bell, A. H., Summerfield, C.,Morin, E. L., Malecek, N. J., Ungerleider, L. G. (2016). Encoding of stimulus probability in macaque inferior temporal cortex. Current Biology, 26(17), 2280.
6. Bengio, Y. (2014). How auto-encoders could provide credit assignment in deep networks via target propagation. arXiv:1407.7906.
7. Bengio, Y., Fischer, A. (2015). Early inference in energy-based models approximates back-propagation. arXiv:1510.02777.
8. Bengio, Y., Lee, D.-H., Bornschein, J., Lin, Z. (2015). Towards biologically plausible deep learning. arXiv:1502.04156.
9. Bogacz, R. (2017). A tutorial on the free-energy framework for modelling perception and learning. Journal of Mathematical Psychology, 76, 198-211.
10. Bogacz, R., Markowska-Kaczmar, U., Kozik, A. (1999). Blinking artefact recognition in EEG signal using artificial neural network. In Proceedings of 4th Conference on Neural Networks and Their Applications (pp. 502-507). Politechnika Czestochowska.
11. Bogacz, R., Moraud, E. M., Abdi, A., Magill, P. J., & Baufreton, J. (2016). Properties of neurons in external globus pallidus can support optimal action selection. PLoS Comput. Biol., 12(7), e1005004.
12. Brown, M. W., & Aggleton, J. P. (2001). Recognition memory: What are the roles of the perirhinal cortex and hippocampus? Nature Reviews Neuroscience, 2(1), 51-61.
13. Chauvin, Y., Rumelhart, D. E. (1995). Backpropagation: Theory, architectures, and applications. Mahwah, NJ: Erlbaum.
14. Crick, F. (1989). The recent excitement about neural networks. Nature, 337, 129-132.
15. Dayan, P., Hinton, G. E., Neal, R.M., Zemel, R. S. (1995). The Helmholtz machine. Neural Computation, 7(5), 889-904.
16. de Sa, V. R., Ballard, D. H. (1998). Perceptual learning from cross-modal feedback. Psychology of Learning and Motivation, 36, 309-351.
17. Feldman, H., Friston, K. (2010). Attention, uncertainty, and free-energy. Frontiers in Human Neuroscience, 4, 215.
18. Fiser, A.,Mahringer, D., Oyibo, H. K., Petersen, A. V., Leinweber,M., Keller, G. B. (2016). Experience-dependent spatial expectations inmouse visual cortex. Nature Neuroscience, 19, 1658-1664.
19. Friston,K. (2003). Learning and inference in the brain. Neural Networks, 16, 1325-1352.
20. Friston, K. (2005). Atheory of cortical responses. Philosophical Transactions of the Royal Society B, 360, 815-836.
21. Friston, K. (2010). The free-energy principle: A unified brain theory? Nature Reviews Neuroscience, 11, 127-138.
22. Friston, K. J., Daunizeau, J., Kilner, J., & Kiebel, S. J. (2010). Action and behavior: A free-energy formulation. Biological Cybernetics, 102(3), 227-260.
23. Hinton, G., Deng, L., Yu, D., Dahl, G., Mohamed, A., Jaitly, N., Kingsbury, B. (2012). Deep neural networks for acoustic modeling in speech recognition: The shared views of four research groups. IEEE Signal Processing Magazine, 29, 82- 97.
24. Hinton, G. E., & McClelland, J. L. (1988). Learning representations by recirculation. In D. Z. Anderson (Ed.), Neural information processing systems (pp. 358-366). New York: American Institute of Physics.
25. Hinton, G. E., Osindero, S., Teh, Y.-W. (2006). A fast learning algorithm for deep belief nets. Neural Computation, 18(7), 1527-1554.
26. Hyvarinen, A. (1999). Regression using independent component analysis, and its connection to multi-layer perceptrons. In Proceedings of the 9th International Conference on Artificial Neural Networks (pp. 491-496). Stevenage, UK: IEE.
27. Kingma, D., Ba, J. (2014). Adam:Amethod for stochastic optimization. arXiv:1412.6980.
28. Krizhevsky, A., Sutskever, I., Hinton, G. E. (2012). Imagenet classification with deep convolutional neural networks. In F. Pereira, C. Burges, L. Bottou, & K. Weinberger (Eds.), Advances in neural information processing systems, 25 (pp. 1097- 1105). Red Hook, NY: Curran.
29. Larochelle, H., Bengio, Y. (2008). Towards biologically plausible deep learning. In Proceedings of the 25th International Conference on Machine Learning (pp. 536-543). New York: ACM.
30. LeCun, Y., Boser, B., Denker, J. S., Henderson, D., Howard, R. E., Hubbard, W., Jackel, L.D. (1989). Backpropagation applied to handwritten zip code recognition. Neural Computation, 1, 541-551.
31. Lillicrap, T. P., Cownden, D., Tweed, D. B., & Akerman, C. J. (2016). Random synaptic feedback weights support error backpropagation for deep learning. Nature Communications, 7, 13276.
32. Mazzoni, P., Andersen, R. A., & Jordan, M. I. (1991). A more biologically plausibile learning rule for neural networks. Proc. Natl. Acad. Sci. USA, 88, 4433-4437.
33. McClelland, J. L., McNaughton, B. L., & O'Reilly, R. C. (1995). Why there are complementary learning systems in the hippocampus and neocortex: Insights from the successes and failures of connectionist models of learning and memory. Psychological Review, 102, 419-457.
34. Miller, L. L., & Desimone, R. (1993). The representation of stimulus familiarity in anterior inferior temporal cortex. Journal of Neurophysiology, 69(6), 1918-1929.
35. Mizuseki, K., Buzśaki, G. (2013). Preconfigured, skewed distribution of firing rates in the hippocampus and entorhinal cortex. Cell Reports, 4(5), 1010-1021.
36. O'Reilly, R. C. (1998). Biologically plausible error-driven learning using local activation differences: The generalized recirculation algorithm. Neural Computation, 8, 895-938.
37. O'Reilly, R. C., & Munakata, Y. (2000). Computational explorations in cognitive neuroscience. Cambridge, MA: MIT Press.
38. Plaut, D. C., McClelland, J. L., Seidenberg, M. S., & Patterson, K. (1996). Understanding normal and impaired word reading: Computational principles in quasiregular domains. Psychological Review, 103, 56-115.
39. Rao, R. P. N., & Ballard, D. H. (1999). Predictive coding in the visual cortex: A functional interpretation of some extra-classical receptive-field effects. Nature Neuroscience, 2, 79-87.
40. Rumelhart, D. E., Durbin, R., Golden, R., & Chauvin, Y. (1995). Backpropagation: The basic theory. In Y. Chauvin & D. E. Rumelhart (Eds.), Backpropagation: Theory, architectures and applications (pp. 1-34). Hillsdale, NJ: Erlbaum.
41. Rumelhart, D. E., Hinton, G. E., Williams, R. J. (1986). Learning representations by back-propagating errors. Nature, 323, 533-536.
42. Scellier, B., Bengio, Y. (2016). Towards a biologically plausible backprop. arXiv:1602.05179.
43. Seidenberg, M. S., McClelland, J. L. (1989). A distributed, developmental model of word recognition and naming. Psychological Review, 96, 523-568.
44. Seung, H. S. (2003). Learning in spiking neural networks by reinforcement of stochastic synaptic transmission. Neuron, 40, 1063-1073.
45. Spratling, M.W. (2008). Reconciling predictive coding and biased competition models of cortical function. Frontiers in Computational Neuroscience, 2, 4.
46. Srivastava, N., Salakhutdinov, R. (2012). Multimodal learning with deep boltzmann machines. In F. Pereira, C. J. C. Burges, L. Bottou, & K. Q. Weinberger (Eds.), Advances in neural information processing systems, 25 (pp. 2222-2230). Red Hook, NY: Curran.
47. Summerfield, C., Egner, T., Greene, M., Koechlin, E., Mangels, J., & Hirsch, J. (2006). Predictive codes for forthcoming perception in the frontal cortex. Science, 314, 1311-1314.
48. Summerfield, C., Trittschuh, E. H., Monti, J. M.,Mesulam,M.-M., & Egner, T. (2008). Neural repetition suppression reflects fulfilled perceptual expectations. Nature Neuroscience, 11(9), 1004-1006.
49. Unnikrishnan, K., & Venugopal, K. (1994). Alopex: A correlation-based learning algorithm for feedforward and recurrent neural networks. Neural Computation, 6, 469-490.
50. Werfel, J., Xiew, X., & Seung, H. S. (2005). Learning curves for stochastic gradient descent in linear feedforward networks. Neural Computation, 17, 2699-2718.
51. Whittington, J. C., Bogacz, R. (2015). Learning in cortical networks through error back-propagation. bioRxiv, p. 035451.
52. Williams, R. J. (1992). Simple statistical gradient-following algorithms for connectionist reinforcement learning. Machine Learning, 8, 229-256.
53. Zmarz, P., Keller, G. B. (2016). Mismatch receptive fields in mouse visual cortex. Neuron, 92(4), 766-772.