Erratum: Hierarchical Prediction Errors in Midbrain and Basal Forebrain during Sensory Learning (Neuron (2013) 80(2) (519–530), (S0896627313008076), (10.1016/j.neuron.2013.09.009));Hierarchical Prediction Errors in Midbrain and Basal Forebrain during Sensory Learning

Neuron

Volumn 80, Issue 2, 2013, Pages 519-530

  Iglesias, Sandra ^a,b   Mathys, Christoph ^a,b   Brodersen, Kay H ^a,b   Kasper, Lars ^a,b   Piccirelli, Marco ^b   denOuden, Hanneke E M ^c   Stephan, Klaas E ^a,b,d  

^a ETH ZURICH   (Switzerland)

^b UNIVERSITY OF ZURICH   (Switzerland)

^c RADBOUD UNIVERSITY   (Netherlands)

^d UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ACETYLCHOLINE; DOPAMINE;

ADULT; ARTICLE; AUDITORY DISCRIMINATION; BAYES THEOREM; CELL TYPE; ERROR; FOREBRAIN; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; LEARNING; MALE; MESENCEPHALON; NERVE CELL; NEUROMODULATION; NORMAL HUMAN; PREDICTION; PREDICTION ERROR; PRIORITY JOURNAL; PROBABILITY; SENSORY LEARNING; STATE DEPENDENT LEARNING; STIMULUS RESPONSE; VISUAL DISCRIMINATION; VISUAL STIMULATION; VOLUNTEER;

EID: 84885760889     PISSN: 08966273     EISSN: 10974199     Source Type: Journal    
DOI: 10.1016/j.neuron.2019.03.001     Document Type: Erratum

References (72)

1. Ashburner J., Friston K.J. Unified segmentation. Neuroimage 2005, 26:839-851.
2. Ashby W.R. Design for a Brain 1952, Chapman & Hall, London.
3. Behrens T.E., Woolrich M.W., Walton M.E., Rushworth M.F. Learning the value of information in an uncertain world. Nat. Neurosci. 2007, 10:1214-1221.
4. Bunzeck N., Düzel E. Absolute coding of stimulus novelty in the human substantia nigra/VTA. Neuron 2006, 51:369-379.
5. Bunzeck N., Dayan P., Dolan R.J., Duzel E. A common mechanism for adaptive scaling of reward and novelty. Hum. Brain Mapp. 2010, 31:1380-1394.
6. d'Acremont M., Fornari E., Bossaerts P. Activity in inferior parietal and medial prefrontal cortex signals the accumulation of evidence in a probability learning task. PLoS Comput. Biol. 2013, 9:e1002895.
7. D'Ardenne K., McClure S.M., Nystrom L.E., Cohen J.D. BOLD responses reflecting dopaminergic signals in the human ventral tegmental area. Science 2008, 319:1264-1267.
8. Daw N.D., Doya K. The computational neurobiology of learning and reward. Curr. Opin. Neurobiol. 2006, 16:199-204.
9. Dayan P. Twenty-five lessons from computational neuromodulation. Neuron 2012, 76:240-256.
10. Dayan P., Hinton G.E., Neal R.M., Zemel R.S. The Helmholtz machine. Neural Comput. 1995, 7:889-904.
11. Demeter E., Sarter M. Leveraging the cortical cholinergic system to enhance attention. Neuropharmacology 2013, 64:294-304.
12. den Ouden H.E., Friston K.J., Daw N.D., McIntosh A.R., Stephan K.E. A dual role for prediction error in associative learning. Cereb. Cortex 2009, 19:1175-1185.
13. den Ouden H.E., Daunizeau J., Roiser J., Friston K.J., Stephan K.E. Striatal prediction error modulates cortical coupling. J.Neurosci. 2010, 30:3210-3219.
14. Diuk C., Tsai K., Wallis J., Botvinick M., Niv Y. Hierarchical learning induces two simultaneous, but separable, prediction errors in human basal ganglia. J.Neurosci. 2013, 33:5797-5805.
15. Doya K. Metalearning and neuromodulation. Neural Netw. 2002, 15:495-506.
16. Doya K., Ishii S., Pouget A., Rao R.P. Bayesian Brain: Probabilistic Approaches to Neural Coding 2011, MIT Press, Cambridge, MA.
17. Düzel E., Bunzeck N., Guitart-Masip M., Wittmann B., Schott B.H., Tobler P.N. Functional imaging of the human dopaminergic midbrain. Trends Neurosci. 2009, 32:321-328.
18. Egner T., Monti J.M., Summerfield C. Expectation and surprise determine neural population responses in the ventral visual stream. J.Neurosci. 2010, 30:16601-16608.
19. Eickhoff S.B., Stephan K.E., Mohlberg H., Grefkes C., Fink G.R., Amunts K., Zilles K. A new SPM toolbox for combining probabilistic cytoarchitectonic maps and functional imaging data. Neuroimage 2005, 25:1325-1335.
20. FitzGerald T.H., Friston K.J., Dolan R.J. Action-specific value signals in reward-related regions of the human brain. J.Neurosci. 2012, 32:16417-16423a.
21. Fletcher P.C., Anderson J.M., Shanks D.R., Honey R., Carpenter T.A., Donovan T., Papadakis N., Bullmore E.T. Responses of human frontal cortex to surprising events are predicted by formal associative learning theory. Nat. Neurosci. 2001, 4:1043-1048.
22. Friston K. A theory of cortical responses. Philos. Trans. R. Soc. Lond. B Biol. Sci. 2005, 360:815-836.
23. Friston K. The free-energy principle: a rough guide to the brain?. Trends Cogn. Sci. 2009, 13:293-301.
24. Friston K., Kilner J., Harrison L. A free energy principle for the brain. J.Physiol. Paris 2006, 100:70-87.
25. Friston K.J., Shiner T., FitzGerald T., Galea J.M., Adams R., Brown H., Dolan R.J., Moran R., Stephan K.E., Bestmann S. Dopamine, affordance and active inference. PLoS Comput. Biol. 2012, 8:e1002327.
26. Gläscher J., Daw N., Dayan P., O'Doherty J.P. States versus rewards: dissociable neural prediction error signals underlying model-based and model-free reinforcement learning. Neuron 2010, 66:585-595.
27. Glover G.H., Li T.Q., Ress D. Image-based method for retrospective correction of physiological motion effects in fMRI: RETROICOR. Magn. Reson. Med. 2000, 44:162-167.
28. Harrison L.M., Stephan K.E., Rees G., Friston K.J. Extra-classical receptive field effects measured in striate cortex with fMRI. Neuroimage 2007, 34:1199-1208.
29. Hasselmo M.E. The role of acetylcholine in learning and memory. Curr. Opin. Neurobiol. 2006, 16:710-715.
30. Horvitz J.C. Mesolimbocortical and nigrostriatal dopamine responses to salient non-reward events. Neuroscience 2000, 96:651-656.
31. Ide J.S., Shenoy P., Yu A.J., Li C.S. Bayesian prediction and evaluation in the anterior cingulate cortex. J.Neurosci. 2013, 33:2039-2047.
32. Kasper L., Marti S., Vannesjö S.J., Hutton C., Dolan R., Weiskopf N., Prüssmann K.P., Stephan K.E. Cardiac artefact correction for human brainstem fMRI at 7T. Neuroimage 2009, 47(Supplement 1):S100.
33. Klein-Flügge M.C., Hunt L.T., Bach D.R., Dolan R.J., Behrens T.E. Dissociable reward and timing signals in human midbrain and ventral striatum. Neuron 2011, 72:654-664.
34. Knill D.C., Pouget A. The Bayesian brain: the role of uncertainty in neural coding and computation. Trends Neurosci. 2004, 27:712-719.
35. Kok P., Rahnev D., Jehee J.F., Lau H.C., de Lange F.P. Attention reverses the effect of prediction in silencing sensory signals. Cereb. Cortex 2012, 22:2197-2206.
36. Körding K.P., Wolpert D.M. Bayesian decision theory in sensorimotor control. Trends Cogn. Sci. 2006, 10:319-326.
37. Law C.T., Gold J.I. Reinforcement learning can account for associative and perceptual learning on a visual-decision task. Nat. Neurosci. 2009, 12:655-663.
38. Logothetis N.K. What we can do and what we cannot do with fMRI. Nature 2008, 453:869-878.
39. MacKay D.J.C. Bayesian interpolation. Neural Comput. 1992, 4:415-447.
40. Maia T.V., Frank M.J. From reinforcement learning models to psychiatric and neurological disorders. Nat. Neurosci. 2011, 14:154-162.
41. Mathys C., Daunizeau J., Friston K.J., Stephan K.E. A bayesian foundation for individual learning under uncertainty. Front. Hum. Neurosci. 2011, 5:39.
42. Maunsell J.H. Neuronal representations of cognitive state: reward or attention?. Trends Cogn. Sci. 2004, 8:261-265.
43. McClure S.M., Berns G.S., Montague P.R. Temporal prediction errors in a passive learning task activate human striatum. Neuron 2003, 38:339-346.
44. Montague P.R., Hyman S.E., Cohen J.D. Computational roles for dopamine in behavioural control. Nature 2004, 431:760-767.
45. Moran R.J., Symmonds M., Stephan K.E., Friston K.J., Dolan R.J. An in vivo assay of synaptic function mediating human cognition. Curr. Biol. 2011, 21:1320-1325.
46. Murray G.K., Corlett P.R., Clark L., Pessiglione M., Blackwell A.D., Honey G., Jones P.B., Bullmore E.T., Robbins T.W., Fletcher P.C. Substantia nigra/ventral tegmental reward prediction error disruption in psychosis. Mol. Psychiatry 2008, 13:267-276.
47. Naidich T.P., Duvernoy H.M., Delman B.N., Sorensen A.G., Kollias S.S., Haacke E.M. Duvernoy's Atlas of the Human Brain Stem and Cerebellum: High-Field MRI, Surface Anatomy, Internal Structure, Vascularization and 3 D Sectional Anatomy 2009, Springer Verlag, Vienna.
48. Nair-Roberts R.G., Chatelain-Badie S.D., Benson E., White-Cooper H., Bolam J.P., Ungless M.A. Stereological estimates of dopaminergic, GABAergic and glutamatergic neurons in the ventral tegmental area, substantia nigra and retrorubral field in the rat. Neuroscience 2008, 152:1024-1031.
49. Nichols T., Brett M., Andersson J., Wager T., Poline J.-B. Valid conjunction inference with the minimum statistic. Neuroimage 2005, 25:653-660.
50. O'Doherty J.P., Dayan P., Friston K., Critchley H., Dolan R.J. Temporal difference models and reward-related learning in the human brain. Neuron 2003, 38:329-337.
51. Payzan-LeNestour E., Dunne S., Bossaerts P., O'Doherty J.P. The neural representation of unexpected uncertainty during value-based decision making. Neuron 2013, 79:191-201.
52. Penny W.D., Stephan K.E., Mechelli A., Friston K.J. Comparing dynamic causal models. Neuroimage 2004, 22:1157-1172.
53. Penny W.D., Stephan K.E., Daunizeau J., Rosa M.J., Friston K.J., Schofield T.M., Leff A.P. Comparing families of dynamic causal models. PLoS Comput. Biol. 2010, 6:e1000709.
54. Pessiglione M., Seymour B., Flandin G., Dolan R.J., Frith C.D. Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans. Nature 2006, 442:1042-1045.
55. Preuschoff K., Bossaerts P. Adding prediction risk to the theory of reward learning. Ann. N Y Acad. Sci. 2007, 1104:135-146.
56. Rao R.P.N., Ballard D.H. Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects. Nat. Neurosci. 1999, 2:79-87.
57. Redgrave P., Gurney K. The short-latency dopamine signal: a role in discovering novel actions?. Nat. Rev. Neurosci. 2006, 7:967-975.
58. Schonberg T., O'Doherty J.P., Joel D., Inzelberg R., Segev Y., Daw N.D. Selective impairment of prediction error signaling in human dorsolateral but not ventral striatum in Parkinson's disease patients: evidence from a model-based fMRI study. Neuroimage 2010, 49:772-781.
59. Schultz W. Predictive reward signal of dopamine neurons. J.Neurophysiol. 1998, 80:1-27.
60. Schultz W., Dayan P., Montague P.R. A neural substrate of prediction and reward. Science 1997, 275:1593-1599.
61. Stephan K.E., Baldeweg T., Friston K.J. Synaptic plasticity and dysconnection in schizophrenia. Biol. Psychiatry 2006, 59:929-939.
62. Stephan K.E., Penny W.D., Daunizeau J., Moran R.J., Friston K.J. Bayesian model selection for group studies. Neuroimage 2009, 46:1004-1017.
63. Summerfield C., Koechlin E. A neural representation of prior information during perceptual inference. Neuron 2008, 59:336-347.
64. Sutton, R.S. (1992). Gain adaptation beats least squares? Proceedings of the Seventh Yale Workshop on Adaptive and Learning Systems 161-166.
65. Tobler P.N., Fiorillo C.D., Schultz W. Adaptive coding of reward value by dopamine neurons. Science 2005, 307:1642-1645.
66. Vickery T.J., Chun M.M., Lee D. Ubiquity and specificity of reinforcement signals throughout the human brain. Neuron 2011, 72:166-177.
67. Worsley K.J., Marrett S., Neelin P., Vandal A.C., Friston K.J., Evans A.C. A unified statistical approach for determining significant signals in images of cerebral activation. Hum. Brain Mapp. 1996, 4:58-73.
68. Wunderlich K., Symmonds M., Bossaerts P., Dolan R.J. Hedging your bets by learning reward correlations in the human brain. Neuron 2011, 71:1141-1152.
69. Yu A.J., Dayan P. Acetylcholine in cortical inference. Neural Netw. 2002, 15:719-730.
70. Yu A.J., Dayan P. Uncertainty, neuromodulation, and attention. Neuron 2005, 46:681-692.
71. Zaborszky L., Hoemke L., Mohlberg H., Schleicher A., Amunts K., Zilles K. Stereotaxic probabilistic maps of the magnocellular cell groups in human basal forebrain. Neuroimage 2008, 42:1127-1141.
72. Zrinzo L., Zrinzo L.V., Massey L.A., Thornton J., Parkes H.G., White M., Yousry T.A., Strand C., Revesz T., Limousin P., et al. Targeting of the pedunculopontine nucleus by an MRI-guided approach: a cadaver study. J. Neural Transm. 2011, 118:1487-1495.