How prediction errors shape perception, attention, and motivation

Frontiers in Psychology

Volumn 3, Issue DEC, 2012, Pages

  Den Ouden, Hanneke E M ^a,b   Kok, Peter ^a   de Lange, Floris P ^a  

^a RADBOUD UNIVERSITY   (Netherlands)

^b NEW YORK UNIVERSITY   (United States)

Author keywords

Decision making; Expectation; Learning; Perceptual inference; Prediction; Prediction error; Predictive coding

Indexed keywords

EID: 84874458910     PISSN: None     EISSN: 16641078     Source Type: Journal    
DOI: 10.3389/fpsyg.2012.00548     Document Type: Review

References (134)

1. Abler, B., Walter, H., Erk, S., Kammerer, H., and Spitzer, M. (2006). Prediction error as a linear func-tion of reward probability is coded in human nucleus accumbens. Neu-roimage 31, 790-795.
2. Adams, W. J., Graf, E. W., and Ernst, M. O. (2004). Experience can change the "light-from-above" prior. Nat. Neurosci. 7, 1057-1058.
3. Akatsuka, K., Wasaka, T., Nakata, H., Kida, T., and Kakigi, R. (2007). The effect of stimulus probability on the somatosensory mismatch field. Exp. Brain Res. 181, 607-614.
4. Alexander, W. H., and Brown, J. W. (2011). Medial prefrontal cortex as an action-outcome predictor. Nat. Neurosci. 14, 1338-1344.
5. Alink, A., Schwiedrzik, C. M., Kohler, A., Singer, W., and Muckli, L. (2010). Stimulus predictability reduces responses in primary visual cortex. J. Neurosci. 30, 2960-2966.
6. Arnal, L. H., and Giraud, A. L. (2012). Cortical oscillations and sensory predictions. Trends Cogn. Sci. 16, 390-398.
7. Arnal, L. H., Morillon, B., Kell, C. A., and Giraud, A. L. (2009). Dual neural routing of visual facilitation in speech processing. J. Neurosci. 29, 13445-13453.
8. Arnal, L. H., Wyart, V., and Giraud, A. L. (2011). Transitions in neural oscillations reflect prediction errors generated in audiovi-sual speech. Nat. Neurosci. 14, 797-801.
9. Baldeweg, T. (2006). Repetition effects to sounds: evidence for predictive coding in the audi-tory system. Trends Cogn. Sci. 10, 93-94.
10. Bar,M. (2004).Visual objects in context. Nat. Rev. Neurosci. 5, 617-629.
11. Bar, M. (2009). Predictions: a universal principle in the operation of the human brain. Introduction. Philos. Trans. R. Soc. Lond. B Biol. Sci. 364, 1181-1182.
12. Bar, M., Kassam, K. S., Ghuman, A. S., Boshyan, J., Schmid, A. M., Dale, A. M., et al. (2006). Topdown facilitation of visual recognition. Proc. Natl.Acad. Sci. U.S.A. 103, 449-454.
13. Bastos, A. M., Usrey, W. M., Adams, R. A., Mangun, G. R., Fries, P., and Fris-ton, K. J. (2012). Canonical microcircuits for predictive coding. Neu-ron 76, 695-711.
14. Behrens, T. E.,Woolrich, M. W.,Walton, M. E., and Rushworth, M. F. (2007). Learning the value of information in an uncertain world. Nat. Neurosci. 10, 1214-1221.
15. Bendixen, A., Sanmiguel, I., and Schröger, E. (2012). Early electrophysiological indicators for predictive processing in audition: a review. Int. J. Psychophysiol. 83, 120-131.
16. Berkes, P., Orban, G., Lengyel, M., and Fiser, J. (2011). Spontaneous cor-tical activity reveals hallmarks of an optimal internal model of the environment. Science 331, 83-87.
17. Bestmann, S., Harrison, L. M., Blanken-burg, F., Mars, R. B., Haggard, P., Friston, K. J., et al. (2008). Influence of uncertainty and surprise on human corticospinal excitability during preparation for action. Curr. Biol. 18, 775-780.
18. Blakemore, S. J., Goodbody, S. J., and Wolpert, D. M. (1998). Predicting the consequences of our own actions: the role of sensorimotor context estimation. J. Neurosci. 18, 7511-7518.
19. Bray, S., and O'Doherty, J. (2007). Neural coding of reward-prediction error signals during classical conditioning with attractive faces. J. Neurophysiol. 97, 3036-3045.
20. Bromberg-Martin, E. S., Matsumoto, M., and Hikosaka, O. (2010). Dopamine in motivational control: rewarding, aversive, and alerting. Neuron 68, 815-834.
21. Bunzeck, N., and Düzel, E. (2006). Absolute coding of stimulus novelty in the human substantia nigra/VTA. Neuron 51, 369-379.
22. Clark,A. (2012).Whatever next? Predic-tive brains, situated agents, and the future of cognitive science. Behav. Brain Sci. (in press).
23. Cohen, J. Y., Haesler, S., Vong, L., Lowell, B. B., and Uchida, N. (2012). Neuron-type-specific signals for reward and punishment in the ventral tegmental area. Nature 482, 85-88.
24. Comoli, E., Coizet, V., Boyes, J., Bolam, J. P., Canteras, N. S., Quirk, R. H., et al. (2003). A direct projection from superior colliculus to substan-tia nigra for detecting salient visual events. Nat. Neurosci. 6, 974-980.
25. Cools, R., Frank, M. J., Gibbs, S. E., Miyakawa, A., Jagust, W., and D'esposito, M. (2009). Striatal dopamine predicts outcome-specific reversal learning and its sensitivity to dopaminergic drug administration. J. Neurosci. 29, 1538-1543.
26. Corlett, P. R., Aitken, M. R., Dickin-son, A., Shanks, D. R., Honey, G. D., Honey, R. A., et al. (2004). Prediction error during retrospective revaluation of causal associations in humans: fMRI evidence in favor of an associative model of learning. Neuron 44, 877-888.
27. Corlett, P. R., Honey, G. D., Krystal, J. H., and Fletcher, P. C. (2010). Glu-tamatergic model psychoses: pre-diction error, learning, and infer-ence. Neuropsychopharmacology 36, 294-315.
28. D'Ardenne, K., McClure, S. M., Nys-trom, L. E., and Cohen, J. D. (2008). BOLD responses reflecting dopaminergic signals in the human ventral tegmental area. Science 319, 1264-1267.
29. Daw, N. D., Gershman, S. J., Sey-mour, B., Dayan, P., and Dolan, R. J. (2011). Model-based influ-ences on humans' choices and stri-atal prediction errors. Neuron 69, 1204-1215.
30. Den Ouden, H. E., Daunizeau, J., Roiser, J., Friston, K. J., and Stephan, K. E. (2010). Striatal prediction error modulates cortical coupling. J. Neu-rosci. 30, 3210-3219.
31. Den Ouden, H. E., Friston, K. J., Daw, N. D., Mcintosh, A. R., and Stephan, K. E. (2009). A dual role for prediction error in associative learning. Cereb. Cortex 19, 1175-1185.
32. Dommett, E., Coizet, V., Blaha, C. D., Martindale, J., Lefebvre, V., Wal-ton, N., et al. (2005). How visual stimuli activate dopaminergic neurons at short latency. Science 307, 1476-1479.
33. Erickson, C. A., and Desimone, R. (1999). Responses of macaque perirhinal neurons during and after visual stimulus association learning. J. Neurosci. 19, 10404-10416.
34. Feldman, H., and Friston, K. J. (2010). Attention, uncertainty, and freeenergy. Front. Hum. Neurosci. 4:215. doi:10.3389/fnhum.2010.00215
35. Fiorillo, C. D., Tobler, P. N., and Schultz, W. (2003). Discrete coding of reward probability and uncertainty by dopamine neurons. Science 299, 1898-1902.
36. Fletcher, P. C., Anderson, J. M., Shanks, D. R., Honey, R., Carpenter, T. A., Donovan,T.,et al. (2001). Responses of human frontal cortex to sur-prising events are predicted by formal associative learning theory. Nat. Neurosci. 4, 1043-1048.
37. Frank, M. J. (2005). Dynamic dopamine modulation in the basal gan-glia: a neurocomputational account of cognitive deficits in medicated and nonmedicated Parkinsonism. J. Cogn. Neurosci. 17, 51-72.
38. Frank, M. J., Seeberger, L. C., and O'Reilly,R. C. (2004). By carrot or by stick: cognitive reinforcement learning in parkinsonism. Science 306, 1940-1943.
39. Franklin, D. W., and Wolpert, D. M. (2011). Computational mechanisms of sensorimotor control. Neuron 72, 425-442.
40. Friston, K. (2005). A theory of cortical responses. Philos.Trans. R. Soc. Lond. B Biol. Sci. 360, 815-836.
41. Friston, K. (2009). The free-energy principle: a rough guide to the brain? Trends Cogn. Sci. (Regul. Ed.) 13, 293-301.
42. Friston, K. J., Shiner, T., Fitzger-ald, T., Galea, J. M., Adams, R., Brown, H., et al. (2012). Dopamine, affordance and active inference. PLoS Comput. Biol. 8:e1002327. doi:10.1371/journal.pcbi.1002327
43. Genoux, D., and Montgomery, J. M. (2007). Glutamate receptor plasticity at excitatory synapses in the brain. Clin. Exp. Pharmacol. Physiol. 34, 1058-1063.
44. Gu, Q. (2002). Neuromodulatory trans-mitter systems in the cortex and their role in cortical plasticity. Neuroscience 111, 815-835.
45. Hare, T. A., O'Doherty, J., Camerer, C. F., Schultz, W., and Rangel, A. (2008). Dissociating the role of the orbitofrontal cortex and the striatum in the computation of goal values and prediction errors. J. Neu-rosci. 28, 5623-5630.
46. Hawkins, J. (2004). On Intelligence. New York: Times Books.
47. Hebb, D. O. (1949). The Organization of Behavior: A Neuropsychological The-ory. New York: Wiley.
48. Hohwy, J. (2012). Attention and conscious perception in the hypothesis testing brain. Front. Psychol. 3:96 doi:10.3389/fpsyg.2012.00096
49. Horton, J. C., and Adams, D. L. (2005). The cortical column: a structure without a function. Philos. Trans. R. Soc. Lond. B Biol. Sci. 360, 837-862.
50. Hsieh, P. J., Vul, E., and Kanwisher, N. (2010). Recognition alters the spatial pattern of FMRI activation in early retinotopic cortex. J. Neurophysiol. 103, 1501-1507.
51. Jhou, T. C., Fields, H. L., Baxter, M. G., Saper, C. B., and Holland, P. C. (2009). The rostromedial tegmen-tal nucleus (RMTg), a GABAergic afferent to midbrain dopamine neu-rons, encodes aversive stimuli and inhibits motor responses. Neuron 61, 786-800.
52. Ji, W., Suga, N., and Gao, E. (2005). Effects of agonists and antagonists of NMDA and ACh receptors on plasticity of bat auditory system elicited by fear conditioning. J. Neurophysiol. 94, 1199-1211.
53. Kamin, L. J. (1969). "Predictability, sur-prise, attention and conditioning," in Punishment and Aversive Behavior, eds R. Church and B. Campbell. (New York: Appleton-Century-Crofts), 279-296.
54. Kapur, S. (2003). Psychosis as a state of aberrant salience: a framework linking biology, phenomenology, and pharmacology in schizophrenia. Am. J. Psychiatry 160, 13-23.
55. Kersten, D., and Yuille, A. (2003). Bayesian models of object perception. Curr. Opin. Neurobiol. 13, 150-158.
56. Klein-Flugge, M. C., Hunt, L. T., Bach, D. R., Dolan, R. J., and Behrens, T. E. (2011). Dissociable reward and timing signals in human midbrain and ventral striatum. Neuron 72, 654-664.
57. Kok, P., Jehee, J. F. M., and De Lange, F. P. (2012a). Less is more: expectation sharpens representations in the primary visual cortex. Neuron 75, 265-270.
58. Kok, P., Rahnev, D., Jehee, J. F. M., Lau, H. C., and De Lange, F. P. (2012b). Attention reverses the effect of prediction in silencing sensory signals. Cereb. Cortex 22, 2197-2206.
59. Kumaran,D.,and Maguire,E. A. (2006). An unexpected sequence of events: mismatch detection in the human hippocampus. PLoS Biol. 4:e424. doi:10.1371/journal.pbio.0040424
60. Kumaran,D.,and Maguire,E. A. (2009). Novelty signals: a window into hippocampal information processing. Trends Cogn. Sci. (Regul. Ed.) 13, 47-54.
61. Kutas, M., and Hillyard, S. A. (1980). Reading senseless sentences: brain potentials reflect semantic incongruity. Science 207, 203-205.
62. Lamme, V. A., and Roelfsema, P. R. (2000). The distinct modes of vision offered by feedforward and recurrent processing. Trends Neurosci. 23, 571-579.
63. Lee, T. S., and Mumford, D. (2003). Hierarchical Bayesian inference in the visual cortex. J. Opt. Soc. Am. A. Opt. Image Sci. Vis. 20, 1434-1448.
64. Li, Z. (2002). A saliency map in primary visual cortex. Trends Cogn. Sci. (Regul. Ed.) 6, 9-16.
65. Lisman, J. E., and Grace, A. A. (2005). The hippocampal-VTA loop: controlling the entry of information into long-term memory. Neuron 46, 703-713.
66. Malinow, R., and Malenka, R. C. (2002). AMPA receptor trafficking and synaptic plasticity. Annu. Rev. Neurosci. 25, 103-126.
67. Matsumoto, M., and Hikosaka, O. (2007). Lateral habenula as a source of negative reward signals in dopamine neurons. Nature 447, 1111-1115.
68. Matsumoto, M., and Hikosaka, O. (2009a). Representation of negative motivational value in the primate lateral habenula. Nat. Neurosci. 12, 77-84.
69. Matsumoto, M., and Hikosaka, O. (2009b). Two types of dopamine neuron distinctly convey positive and negative motivational signals. Nature 459, 837-841.
70. Matsumoto, M., Matsumoto, K., Abe, H., and Tanaka, K. (2007). Medial prefrontal cell activity signaling prediction errors of action values. Nat. Neurosci. 10, 647-656.
71. Matsumura, M., Kojima, J., Gardiner, T. W., and Hikosaka, O. (1992). Visual and oculomotor functions of monkey subthalamic nucleus. J. Neurophysiol. 67, 1615-1632.
72. McClure, S. M., Berns, G. S., and Mon-tague, P. R. (2003). Temporal predic-tion errors in a passive learning task activate human striatum. Neuron 38, 339-346.
73. McGurk, H., and MacDonald, J. (1976). Hearing lips and seeing voices. Nature 264, 746-748.
74. Meyer, T., and Olson, C. R. (2011). Statistical learning of visual transitions in monkey inferotemporal cortex. Proc. Natl. Acad. Sci. U.S.A. 108, 19401-19406.
75. Mirenowicz, J., and Schultz, W. (1994). Importance of unpredictability for reward responses in primate dopamine neurons. J. Neurophysiol. 72, 1024-1027.
76. Mirenowicz, J., and Schultz, W. (1996). Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli. Nature 379, 449-451.
77. Mogenson, G. J., and Yang, C. R. (1991). The contribution of basal forebrain to limbicmotor integration and the mediation of motivation to action. Adv. Exp. Med. Biol. 295, 267-290.
78. Morris, R. G. (1989). Synaptic plasticity and learning: selective impairment of learning rats and blockade of long-term potentiation in vivo by the N-methyl-D-aspartate recep-tor antagonist AP5. J. Neurosci. 9, 3040-3057.
79. Mountcastle, V. B. (1997). The columnar organization of the neocortex. Brain 120(Pt 4), 701-722.
80. Moustafa, A. A., Cohen, M. X., Sher-man, S. J., and Frank, M. J. (2008). A role for dopamine in temporal deci-sion making and reward maximiza-tion in parkinsonism. J. Neurosci. 28, 12294-12304.
81. Näätänen, R. (1990). The role of atten-tion in auditory information processing as revealed by eventrelated potentials and other brain measures of cognitive function. Behav. Brain Sci. 13, 201-233.
82. Niv, Y., Edlund, J. A., Dayan, P., and O'Doherty, J. P. (2012). Neural pre-diction errors reveal a risk-sensitive reinforcement-learning process in the human brain. J. Neurosci. 32, 551-562.
83. Niv, Y., and Schoenbaum, G. (2008). Dialogues on prediction errors. Trends Cogn. Sci. (Regul. Ed.) 12, 265-272.
84. O'Doherty, J. P., Dayan, P., Friston, K., Critchley, H., and Dolan, R. J. (2003). Temporal difference models and reward-related learning in the human brain. Neuron 38, 329-337.
85. Pagnoni, G., Zink, C. F., Montague, P. R., and Berns, G. S. (2002). Activity in human ventral striatum locked to errors of reward prediction. Nat. Neurosci. 5, 97-98.
86. Palminteri, S., Lebreton, M., Worbe, Y., Grabli, D., Hartmann, A., and Pes-siglione, M. (2009). Pharmacological modulation of subliminal learn-ing in Parkinson's and Tourette's syndromes. Proc. Natl. Acad. Sci. U.S.A. 106, 19179-19184.
87. Pearce, J. M., and Hall, G. (1980). A model for Pavlovian learning: vari-ations in the effectiveness of conditioned but not of unconditioned stimuli. Psychol. Rev. 87, 532-552.
88. Peelen, M. V., and Kastner, S. (2011). A neural basis for real-world visual search in human occipitotemporal cortex. Proc. Natl. Acad. Sci. U.S.A. 108, 12125-12130.
89. Pennartz, C. M., Ito, R., Verschure, P. F., Battaglia, F. P., and Robbins, T. W. (2011). The hippocampal-striatal axis in learning,prediction and goal-directed behavior. Trends Neurosci. 34, 548-559.
90. Pessiglione, M., Seymour, B., Flandin, G., Dolan, R. J., and Frith, C. D. (2006). Dopamine-dependent prediction errors underpin rewardseeking behaviour in humans. Nature 442, 1042-1045.
91. Peters, A., Payne, B. R., and Budd, J. (1994). A numerical analysis of the geniculocortical input to striate cortex in the monkey. Cereb. Cortex 4, 215-229.
92. Rao,R. P.,and Ballard,D. H. (1999). Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects. Nat. Neurosci. 2, 79-87.
93. Rauss, K., Schwartz, S., and Pourtois, G. (2011). Top-down effects on early visual processing in humans: a pre-dictive coding framework. Neurosci. Biobehav. Rev. 35, 1237-1253.
94. Redgrave, P., and Gurney, K. (2006). The short-latency dopamine signal: a role in discovering novel actions? Nat. Rev. Neurosci. 7, 967-975.
95. Redgrave, P., Prescott, T. J., and Gurney, K. (1999). The basal ganglia: a verte-brate solution to the selection prob-lem? Neuroscience 89, 1009-1023.
96. Redgrave, P., Vautrelle, N., and Reynolds, J. N. J. (2011). Functional properties of the basal ganglia's re-entrant loop architecture: selection and reinforcement. Neuroscience 198, 138-151.
97. Rescorla, R. A., and Wagner, A. R. (1972). "A theory of Pavlovian con-ditioning: variations in the effec-tiveness of reinforcement and non-reinforcement," in Classical Con-ditioning II: Current Theory and Research, eds A. H. Black and W. F. Prokasy (New York: Appleton-Century-Crofts), 64-99.
98. Rodriguez, P. F., Aron, A. R., and Poldrack, R. A. (2006). Ventralstriatal/nucleus-accumbens sensitivity to prediction errors during classification learning. Hum. Brain Mapp. 27, 306-313.
99. Romo, R., and Schultz, W. (1990). Dopamine neurons of the monkey midbrain: contingencies of responses to active touch during selfinitiated arm movements. J. Neurophysiol. 63, 592-606.
100. Schapiro, A. C., Kustner, L. V., and Turk-Browne, N. B. (2012). Shaping of object representations in the human medial temporal lobe based on temporal regularities. Curr. Biol. 22, 1622-1627.
101. Schultz, W. (1998). Predictive reward signal of dopamine neurons. J. Neu-rophysiol. 80, 1-27.
102. Schultz, W., Dayan, P., and Montague, P. R. (1997). A neural substrate of prediction and reward. Science 275, 1593-1599.
103. Schultz, W., and Dickinson, A. (2000). Neuronal coding of prediction errors. Annu. Rev. Neurosci. 23, 473-500.
104. Seymour, B., Daw, N., Dayan, P., Singer, T., and Dolan, R. (2007). Differential encoding of losses and gains in the human striatum. J. Neurosci. 27, 4826-4831.
105. Sotiropoulos, G., Seitz,A. R., and Series, P. (2011). Changing expectations about speed alters perceived motion direction. Curr. Biol. 21,R883-R884.
106. Spratling, M. W. (2008). Reconciling predictive coding and biased com-petition models of cortical func-tion. Front Comput Neurosci 2:4. doi:10.3389/neuro.10.004.2008
107. Spratling, M. W. (2012). Predictive coding accounts for V1 response properties recorded using reverse correlation. Biol. Cybern. 106, 37-49.
108. Stagg, C., Hindley, P., Tales, A., and Butler, S. (2004). Visual mismatch negativity: the detection of stimulus change. Neuroreport 15, 659-663.
109. Sterzer, P., Frith, C., and Petrovic, P. (2008). Believing is seeing: expec-tations alter visual awareness. Curr. Biol. 18, R697-698-R697-698.
110. Sul, J. H., Kim, H., Huh, N., Lee, D., and Jung, M. W. (2010). Distinct roles of rodent orbitofrontal and medial prefrontal cortex in decision making. Neuron 66, 449-460.
111. Summerfield, C., and Egner, T. (2009). Expectation (and attention) in visual cognition. Trends Cogn. Sci. 13, 403-409.
112. Summerfield, C., and Koechlin, E. (2008). A neural representation of prior information during perceptual inference. Neuron 59, 336-347.
113. Takahashi, Y. K., Roesch, M. R., Stalnaker, T. A., Haney, R. Z., Calu, D. J., Taylor, A. R., et al. (2009). The orbitofrontal cortex and ventral tegmental area are necessary for learning from unexpected outcomes. Neuron 62, 269-280.
114. Takahashi, Y. K., Roesch, M. R., Wilson, R. C.,Toreson,K.,O'Donnell,P.,Niv, Y., et al. (2011). Expectancy-related changes in firing of dopamine neu-rons depend on orbitofrontal cortex. Nat. Neurosci. 14, 1590-1597.
115. Tervaniemi, M., Maury, S., and Näätä-nen, R. (1994). Neural representa-tions of abstract stimulus features in the human brain as reflected by the mismatch negativity. Neuroreport 5, 844-846.
116. Todorovic,A.,and de Lange,F. P. (2012). Repetition suppression and expectation suppression are dissociable in time in early auditory evoked fields. J. Neurosci. 32, 13389-13395.
117. Todorovic,A.,Van Ede, F., Maris, E., and De Lange, F. P. (2011). Prior expectation mediates neural adaptation to repeated sounds in the auditory cor-tex: an MEG study. J. Neurosci. 31, 9118-9123.
118. Turk-Browne, N. B., Scholl, B. J., Chun, M. M., and Johnson, M. K. (2009). Neural evidence of statistical learn-ing: efficient detection of visual reg-ularities without awareness. J. Cogn. Neurosci. 21, 1934-1945.
119. Turner, D. C., Aitken, M. R., Shanks, D. R., Sahakian, B. J., Robbins, T. W., Schwarzbauer, C., et al. (2004). The role of the lateral frontal cortex in causal associative learning: explor-ing preventative and super-learning. Cereb. Cortex 14, 872-880.
120. Tye, K. M., Stuber, G. D., De Rid-der, B., Bonci, A., and Janak, P. H. (2008). Rapid strengthening of thalamo-amygdala synapses medi-ates cue-reward learning. Nature 453, 1253-1257.
121. Ulanovsky, N., Las, L., and Nelken, I. (2003). Processing of low-probability sounds by cortical neurons. Nat. Neurosci. 6, 391-398.
122. van Ede, F., De Lange, F., Jensen, O., and Maris, E. (2011). Ori-enting attention to an upcoming tactile event involves a spatially and temporally specific modulation of sensorimotor alpha-and beta-band oscillations. J. Neurosci. 31, 2016-2024.
123. van Schouwenburg, M. R., Den Ouden, H. E., and Cools, R. (2010). The human basal ganglia modulate frontal-posterior connectivity dur-ing attention shifting. J. Neurosci. 30, 9910-9918.
124. Von Helmholtz, H. (1867). Handbuch der Physiologischen Optik. Leipzig: Leopold Voss.
125. Wacongne, C., Changeux, J.-P., and Dehaene, S. (2012). A neuronal model of predictive coding accounting for the mismatch negativity. J. Neurosci. 32, 3665-3678.
126. Wacongne, C., Labyt, E., Van Wassen-hove, V., Bekinschtein, T., Naccache, L., and Dehaene, S. (2011). Evidence for a hierarchy of predictions and prediction errors in human cortex. Proc. Natl. Acad. Sci. U.S.A. 108, 20754-20759.
127. Watabe-Uchida, M., Zhu, L., Ogawa, S. K., Vamanrao, A., and Uchida, N. (2012). Whole-brain mapping of direct inputs to midbrain dopamine neurons. Neuron 74, 858-873.
128. Weiss, Y., Simoncelli, E. P., and Adel-son, E. H. (2002). Motion illusions as optimal percepts. Nat. Neurosci. 5, 598-604.
129. Wise, R. A. (2004). Dopamine, learning and motivation. Nat. Rev. Neurosci. 5, 483-494.
130. Wittmann, B. C., Bunzeck, N., Dolan, R. J., and Duzel, E. (2007). Anticipation of nov-elty recruits reward system and hippocampus while promoting recollection. Neuroimage 38, 194-202.
131. Wyart, V., Nobre, A. C., and Summer-field, C. (2012). Dissociable prior influences of signal probability and relevance on visual contrast sensitiv-ity. Proc. Natl. Acad. Sci. U.S.A. 109, 3593-3598.
132. Yacubian, J., Glascher, J., Schroeder, K., Sommer, T., Braus, D. F., and Buchel, C. (2006). Dissociable systems for gain-and loss-related value predic-tions and errors of prediction in the human brain. J. Neurosci. 26, 9530-9537.
133. Yacubian, J., Sommer, T., Schroeder, K., Glascher, J., Kalisch, R., Leuenberger, B., et al. (2007). Gene-gene interaction associated with neural reward sensitivity. Proc. Natl. Acad. Sci.U.S.A. 104, 8125-8130.
134. Zink, C. F., Pagnoni, G., Martin, M. E., Dhamala, M., and Berns, G. S. (2003). Human striatal response to salient nonrewarding stimuli. J. Neu-rosci. 23, 8092-8097.