Supplementary eye field encodes reward prediction error

Journal of Neuroscience

Volumn 32, Issue 9, 2012, Pages 2950-2963

  So, Nayoung ^a   Stuphorn, Veit ^a,b  

^a JOHNS HOPKINS UNIVERSITY SCHOOL OF MEDICINE   (United States)

^b JOHNS HOPKINS UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ANIMAL EXPERIMENT; ARTICLE; BEHAVIOR; BRAIN ELECTROPHYSIOLOGY; DECISION MAKING; ERROR; EXPECTATION; MALE; NONHUMAN; OCULOMOTOR SYSTEM; PREDICTION; PRIORITY JOURNAL; REINFORCEMENT; REWARD; RHESUS MONKEY; SACCADIC EYE MOVEMENT; SPIKE WAVE; STATISTICAL MODEL; SUPPLEMENTARY EYE FIELD; TASK PERFORMANCE;

ANIMALS; FORECASTING; MACACA MULATTA; MALE; PHOTIC STIMULATION; PSYCHOMOTOR PERFORMANCE; REWARD; SACCADES; VISUAL FIELDS;

EID: 84857609342     PISSN: 02706474     EISSN: 15292401     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.4419-11.2012     Document Type: Article

References (49)

1. Amador N, Schlag-Rey M, Schlag J (2000) Reward-predicting and rewarddetecting neuronal activity in the primate supplementary eye field. J Neurophysiol 84:2166-2170.
2. Behrens TE, Woolrich MW, Walton ME, Rushworth MF (2007) Learning the value of information in an uncertain world. Nat Neurosci 10:1214-1221.
3. Belova MA, Paton JJ, Morrison SE, Salzman CD (2007) Expectation modulates neural responses to pleasant and aversive stimuli in primate amygdala. Neuron 55:970-984.
4. Burnham KP, Anderson DR (2002) Model selection and multimodal inference. New York: Springer.
5. Busemeyer JR, Diederich A (2010) Cognitive modeling. Thousand Oaks, CA: Sage.
6. Calzavara R, Mailly P, Haber SN (2007) Relationship between the corticostriatal terminals from areas 9 and 46, and those from area 8A, dorsal and rostral premotor cortex and area 24c: an anatomical substrate for cognition to action. Eur J Neurosci 26:2005-2024.
7. Dayan P, Kakade S, Montague PR (2000) Learning and selective attention. Nat Neurosci 3 [Suppl]:1218-1223.
8. Fiorillo CD, Tobler PN, Schultz W (2003) Discrete coding of reward probability and uncertainty by dopamine neurons. Science 299:1898-1902.
9. Gelman A, Carlin JB, Stern HS, Rubin DB (2004) Bayesian data analysis, Ed 2. Boca Raton, FL: Chapman and Hall/CRC.
10. Ghashghaei HT, Hilgetag CC, Barbas H (2007) Sequence of information processing for emotions based on the anatomic dialogue between prefrontal cortex and amygdala. Neuroimage 34:905-923.
11. Hayden BY, Nair AC, McCoy AN, Platt ML (2008) Posterior cingulate cortex mediates outcome-contingent allocation of behavior. Neuron 60:19-25.
12. Holland PC, GallagherM (1999) Amygdala circuitry in attentional and representational processes. Trends Cogn Sci 3:65-73.
13. Holroyd CB, Coles MG (2002) The neural basis of human error processing: reinforcement learning, dopamine, and the error-related negativity. Psychol Rev 109:679-709.
14. Hong S, Hikosaka O (2008) The globus pallidus sends reward-related signals to the lateral habenula. Neuron 60:720-729.
15. Huerta MF, Kaas JH (1990) Supplementary eye field as defined by intracortical microstimulation: connections in macaques. J Comp Neurol 293:299-330.
16. Kass RE, Wasserman L (1995) A reference Bayesian test for nested hypotheses and its relationship to the Schwarz criterion. J Am Stat Assoc 90:928-934.
17. Kastner S, Pinsk MA, De Weerd P, Desimone R, Ungerleider LG (1999) Increased activity in human visual cortex during directed attention in the absence of visual stimulation. Neuron 22:751-761.
18. Kim H, Sul JH, Huh N, Lee D, JungMW (2009) Role of striatum in updating values of chosen actions. J Neurosci 29:14701-14712.
19. Konorski J (1967) Integrative activity of the brain: an interdisciplinary approach. Chicago; London: University of Chicago.
20. LePelley ME (2004) The role of associative history in models of associative learning: a selective review and a hybrid model. Q J Exp Psychol 57:193-243.
21. Lin SC, Nicolelis MA (2008) Neuronal ensemble bursting in the basal forebrain encodes salience irrespective of valence. Neuron 59:138-149.
22. Luce RD (2000) Utility of gains and losses: measurement-theoretical and experimental approaches. Mahwah, NJ: Erlbaum.
23. Matsumoto M, Hikosaka O (2007) Lateral habenula as a source of negative reward signals in dopamine neurons. Nature 447:1111-1115.
24. Matsumoto M, Hikosaka O (2009a) Representation of negative motivational value in the primate lateral habenula. Nat Neurosci 12:77-84.
25. Matsumoto M, Hikosaka O (2009b) Two types of dopamine neuron distinctly convey positive and negative motivational signals. Nature 459:837-841.
26. Matsumoto M, Matsumoto K, Abe H, Tanaka K (2007) Medial prefrontal cell activity signaling prediction errors of action values. Nat Neurosci 10:647-656.
27. McCoy AN, Platt ML (2005) Risk-sensitive neurons in macaque posterior cingulate cortex. Nat Neurosci 8:1220-1227.
28. Nakamura K, Roesch MR, Olson CR (2005) Neuronal activity in macaque SEF and ACC during performance of tasks involving conflict. J Neurophysiol 93:884-908.
29. Neter J, Kutner MH, Nachtsheim CJ, Wasserman W (1996) Applied linear statistical models, Ed 4. Boston: McGraw-Hill.
30. Pearce JM, Hall G (1980) A model for Pavlovian learning: variations in the effectiveness of conditioned but not unconditioned stimuli. Psychol Rev 87:532-552.
31. Preuschoff K, Bossaerts P (2007) Adding prediction risk to the theory of reward learning. Ann N Y Acad Sci 1104:135-146.
32. Preuschoff K, Bossaerts P, Quartz SR (2006) Neural differentiation of expected reward and risk in human subcortical structures. Neuron 51:381-390.
33. Rescorla RA, Wagner AR (1972) A theory of Pavlovian conditioning: variations in the effectiveness of reinforcement and nonreinforcement. In: Classical conditioning II: Current research and theory (Black AH, Prokasy WF, eds), pp 64-99.New York: Appleton-Century-Crofts.
34. Roesch MR, Calu DJ, Esber GR, Schoenbaum G (2010) Neural correlates of variations in event processing during learning in basolateral amygdala. J Neurosci 30:2464-2471.
35. Sawa T (1978) Information criteria for discriminating among alternative regression models. Econometrica 46:1273-1291.
36. Sayer RJ, Friedlander MJ, Redman SJ (1990) The time course and amplitude of EPSPs evoked at synapses between pairs of CA3/CA1 neurons in the hippocampal slice. J Neurosci 10:826-836.
37. Schultz W (1998) Predictive reward signal of dopamine neurons. J Neurophysiol 80:1-27.
38. Schultz W, Dayan P, Montague PR (1997) A neural substrate of prediction and reward. Science 275:1593-1599.
39. Seo H, Lee D (2007) Temporal filtering of reward signals in the dorsal anterior cingulate cortex during a mixed-strategy game. J Neurosci 27:8366-8377.
40. Seo H, Lee D (2009) Behavioral and neural changes after gains and losses of conditioned reinforcers. J Neurosci 29:3627-3641.
41. So NY, Stuphorn V (2010) Supplementary eye field encodes option and action value for saccades with variable reward. J Neurophysiol 104:2634-2653.
42. Solomon RL, Corbit JD (1974) An opponent-process theory of motivation. I. Temporal dynamics of affect. Psychol Rev 81:119-145.
43. Stuphorn V, Taylor TL, Schall JD (2000) Performance monitoring by the supplementary eye field. Nature 408:857-860.
44. Stuphorn V, Brown JW, Schall JD (2010) Role of supplementary eye field in saccade initiation: executive, not direct, control. J Neurophysiol 103:801-816.
45. Sul JH, Kim H, Huh N, Lee D, Jung MW (2010) Distinct roles of rodent orbitofrontal and medial prefrontal cortex in decision making. Neuron 66:449-460.
46. Sutton RS, BartoAG (1998) Reinforcement learning. Cambridge, MA: MIT.
47. Tobler PN, Fiorillo CD, Schultz W (2005) Adaptive coding of reward value by dopamine neurons. Science 307:1642-1645.
48. Tremblay L, Schultz W (1999) Relative reward preference in primate orbitofrontal cortex. Nature 398:704-708.
49. Yu AJ, Dayan P (2005) Uncertainty, neuromodulation, and attention. Neuron 46:681-692.