메뉴 건너뛰기




Volumn 109, Issue 11, 2012, Pages 4285-4289

Adaptive coding of reward prediction errors is gated by striatal coupling

Author keywords

Adjustment; Context invariance; Dopamine; Functional connectivity; Normalization

Indexed keywords

ARTICLE; ASSOCIATION; BRAIN REGION; CORPUS STRIATUM; ERROR; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; MESENCEPHALON; NORMAL HUMAN; PREDICTION; PREFRONTAL CORTEX; PRIORITY JOURNAL; REWARD; TASK PERFORMANCE;

EID: 84863269144     PISSN: 00278424     EISSN: 10916490     Source Type: Journal    
DOI: 10.1073/pnas.1119969109     Document Type: Article
Times cited : (37)

References (46)
  • 1
    • 0016264378 scopus 로고
    • Judgment under uncertainty: Heuristics and biases
    • Tversky A, Kahneman D (1974) Judgment under uncertainty: Heuristics and biases. Science 185:1124-1131.
    • (1974) Science , vol.185 , pp. 1124-1131
    • Tversky, A.1    Kahneman, D.2
  • 2
    • 0000125532 scopus 로고
    • Prospect theory: Analysis of decision under risk
    • Kahneman D, Tversky A (1979) Prospect theory: Analysis of decision under risk. Econometrica 47(2):263-291.
    • (1979) Econometrica , vol.47 , Issue.2 , pp. 263-291
    • Kahneman, D.1    Tversky, A.2
  • 3
    • 0002109138 scopus 로고
    • A theory of Pavlovian conditioning: Variations in the effectiveness of reinforcement and nonreinforcement
    • eds Black AH, Prokasy WF (Appleton-Century-Crofts, New York)
    • Rescorla RA, Wagner AR (1972) A theory of Pavlovian conditioning: Variations in the effectiveness of reinforcement and nonreinforcement. Classical Conditioning II: Current Research and Theory, eds Black AH, Prokasy WF (Appleton-Century-Crofts, New York), pp 64-99.
    • (1972) Classical Conditioning II: Current Research and Theory , pp. 64-99
    • Rescorla, R.A.1    Wagner, A.R.2
  • 5
    • 0030896968 scopus 로고    scopus 로고
    • A neural substrate of prediction and reward
    • DOI 10.1126/science.275.5306.1593
    • Schultz W, Dayan P, Montague PR (1997) A neural substrate of prediction and reward. Science 275:1593-1599. (Pubitemid 27120526)
    • (1997) Science , vol.275 , Issue.5306 , pp. 1593-1599
    • Schultz, W.1    Dayan, P.2    Montague, P.R.3
  • 6
    • 21544435722 scopus 로고    scopus 로고
    • Midbrain dopamine neurons encode a quantitative reward prediction error signal
    • DOI 10.1016/j.neuron.2005.05.020, PII S0896627305004678
    • Bayer HM, Glimcher PW (2005) Midbrain dopamine neurons encode a quantitative reward prediction error signal. Neuron 47(1):129-141. (Pubitemid 40922855)
    • (2005) Neuron , vol.47 , Issue.1 , pp. 129-141
    • Bayer, H.M.1    Glimcher, P.W.2
  • 7
    • 14844349975 scopus 로고    scopus 로고
    • Adaptive coding of reward value by dopamine neurons
    • DOI 10.1126/science.1105370
    • Tobler PN, Fiorillo CD, Schultz W (2005) Adaptive coding of reward value by dopamine neurons. Science 307:1642-1645. (Pubitemid 40354749)
    • (2005) Science , vol.307 , Issue.5715 , pp. 1642-1645
    • Tobler, P.N.1    Fiorillo, C.D.2    Schultz, W.3
  • 8
    • 33748302924 scopus 로고    scopus 로고
    • Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans
    • DOI 10.1038/nature05051, PII NATURE05051
    • Pessiglione M, Seymour B, Flandin G, Dolan RJ, Frith CD (2006) Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans. Nature 442: 1042-1045. (Pubitemid 44330261)
    • (2006) Nature , vol.442 , Issue.7106 , pp. 1042-1045
    • Pessiglione, M.1    Seymour, B.2    Flandin, G.3    Dolan, R.J.4    Frith, C.D.5
  • 9
    • 0036159133 scopus 로고    scopus 로고
    • Activity in human ventral striatum locked to errors of reward prediction
    • DOI 10.1038/nn802
    • Pagnoni G, Zink CF, Montague PR, Berns GS (2002) Activity in human ventral striatum locked to errors of reward prediction. Nat Neurosci 5(2):97-98. (Pubitemid 34121573)
    • (2002) Nature Neuroscience , vol.5 , Issue.2 , pp. 97-98
    • Pagnoni, G.1    Zink, C.F.2    Montague, P.R.3    Berns, G.S.4
  • 10
    • 0037650217 scopus 로고    scopus 로고
    • Temporal prediction errors in a passive learning task activate human striatum
    • DOI 10.1016/S0896-6273(03)00154-5
    • McClure SM, Berns GS, Montague PR (2003) Temporal prediction errors in a passive learning task activate human striatum. Neuron 38:339-346. (Pubitemid 36555658)
    • (2003) Neuron , vol.38 , Issue.2 , pp. 339-346
    • McClure, S.M.1    Berns, G.S.2    Montague, P.R.3
  • 11
    • 0037987978 scopus 로고    scopus 로고
    • Temporal difference models and reward-related learning in the human brain
    • DOI 10.1016/S0896-6273(03)00169-7
    • O'Doherty JP, Dayan P, Friston K, Critchley H, Dolan RJ (2003) Temporal difference models and reward-related learning in the human brain. Neuron 38:329-337. (Pubitemid 36555657)
    • (2003) Neuron , vol.38 , Issue.2 , pp. 329-337
    • O'Doherty, J.P.1    Dayan, P.2    Friston, K.3    Critchley, H.4    Dolan, R.J.5
  • 12
    • 77953177140 scopus 로고    scopus 로고
    • Prefrontal cortex fails to learn from reward prediction errors in alcohol dependence
    • Park SQ, et al. (2010) Prefrontal cortex fails to learn from reward prediction errors in alcohol dependence. J Neurosci 30:7749-7753.
    • (2010) J Neurosci , vol.30 , pp. 7749-7753
    • Park, S.Q.1
  • 13
    • 67650045779 scopus 로고    scopus 로고
    • Dorsal striatal-midbrain connectivity in humans predicts how reinforcements are used to guide decisions
    • Kahnt T, et al. (2009) Dorsal striatal-midbrain connectivity in humans predicts how reinforcements are used to guide decisions. J Cogn Neurosci 21:1332-1345.
    • (2009) J Cogn Neurosci , vol.21 , pp. 1332-1345
    • Kahnt, T.1
  • 14
    • 0034988599 scopus 로고    scopus 로고
    • Functional imaging of neural responses to expectancy and experience of monetary gains and losses
    • DOI 10.1016/S0896-6273(01)00303-8
    • Breiter HC, Aharon I, Kahneman D, Dale A, Shizgal P (2001) Functional imaging of neural responses to expectancy and experience of monetary gains and losses. Neuron 30:619-639. (Pubitemid 32530601)
    • (2001) Neuron , vol.30 , Issue.2 , pp. 619-639
    • Breiter, H.C.1    Aharon, I.2    Kahneman, D.3    Dale, A.4    Shizgal, P.5
  • 15
    • 0033594310 scopus 로고    scopus 로고
    • Relative reward preference in primate orbitofrontal cortex
    • DOI 10.1038/19525
    • Tremblay L, Schultz W (1999) Relative reward preference in primate orbitofrontal cortex. Nature 398:704-708. (Pubitemid 29197648)
    • (1999) Nature , vol.398 , Issue.6729 , pp. 704-708
    • Tremblay, L.1    Schultz, W.2
  • 16
    • 70449337875 scopus 로고    scopus 로고
    • Range-adapting representation of economic value in the orbitofrontal cortex
    • Padoa-Schioppa C (2009) Range-adapting representation of economic value in the orbitofrontal cortex. J Neurosci 29:14004-14014.
    • (2009) J Neurosci , vol.29 , pp. 14004-14014
    • Padoa-Schioppa, C.1
  • 17
    • 74949088060 scopus 로고    scopus 로고
    • Adaptation of reward sensitivity in orbitofrontal neurons
    • Kobayashi S, Pinto de Carvalho O, Schultz W (2010) Adaptation of reward sensitivity in orbitofrontal neurons. J Neurosci 30:534-544.
    • (2010) J Neurosci , vol.30 , pp. 534-544
    • Kobayashi, S.1    Pinto De Carvalho, O.2    Schultz, W.3
  • 18
  • 19
    • 77950521712 scopus 로고    scopus 로고
    • The neural code of reward anticipation in human orbitofrontal cortex
    • Kahnt T, Heinzle J, Park SQ, Haynes JD (2010) The neural code of reward anticipation in human orbitofrontal cortex. Proc Natl Acad Sci USA 107:6010-6015.
    • (2010) Proc Natl Acad Sci USA , vol.107 , pp. 6010-6015
    • Kahnt, T.1    Heinzle, J.2    Park, S.Q.3    Haynes, J.D.4
  • 20
    • 77952686983 scopus 로고    scopus 로고
    • A mechanistic account of value computation in the human brain
    • Philiastides MG, Biele G, Heekeren HR (2010) A mechanistic account of value computation in the human brain. Proc Natl Acad Sci USA 107:9430-9435.
    • (2010) Proc Natl Acad Sci USA , vol.107 , pp. 9430-9435
    • Philiastides, M.G.1    Biele, G.2    Heekeren, H.R.3
  • 21
    • 0034715313 scopus 로고    scopus 로고
    • Prefrontal cortical projections to the striatum in macaque monkeys: Evidence for an organization related to prefrontal networks
    • DOI 10.1002/1096-9861(20000925)425:3<447::AID-CNE9>3.0.CO;2-V
    • Ferry AT, Ongür D, An X, Price JL (2000) Prefrontal cortical projections to the striatum in macaque monkeys: Evidence for an organization related to prefrontal networks. J Comp Neurol 425:447-470. (Pubitemid 30659209)
    • (2000) Journal of Comparative Neurology , vol.425 , Issue.3 , pp. 447-470
    • Ferry, A.T.1    Ongur, D.2    An, X.3    Price, J.L.4
  • 22
    • 0040246220 scopus 로고    scopus 로고
    • The organization of networks within the orbital and medial prefrontal cortex of rats, monkeys and humans
    • Ongür D, Price JL (2000) The organization of networks within the orbital and medial prefrontal cortex of rats, monkeys and humans. Cereb Cortex 10(3):206-219. (Pubitemid 30159289)
    • (2000) Cerebral Cortex , vol.10 , Issue.3 , pp. 206-219
    • Ongur, D.1    Price, J.L.2
  • 23
    • 79959648403 scopus 로고    scopus 로고
    • Neurobiology of value integration: When value impacts valuation
    • Park SQ, Kahnt T, Rieskamp J, Heekeren HR (2011) Neurobiology of value integration: When value impacts valuation. J Neurosci 31:9307-9314.
    • (2011) J Neurosci , vol.31 , pp. 9307-9314
    • Park, S.Q.1    Kahnt, T.2    Rieskamp, J.3    Heekeren, H.R.4
  • 24
    • 79954992040 scopus 로고    scopus 로고
    • Decoding different roles for vmPFC and dlPFC in multi-attribute decision making
    • Kahnt T, Heinzle J, Park SQ, Haynes JD (2011) Decoding different roles for vmPFC and dlPFC in multi-attribute decision making. Neuroimage 56:709-715.
    • (2011) Neuroimage , vol.56 , pp. 709-715
    • Kahnt, T.1    Heinzle, J.2    Park, S.Q.3    Haynes, J.D.4
  • 25
    • 0035939908 scopus 로고    scopus 로고
    • Efficiency and ambiguity in an adaptive neural code
    • DOI 10.1038/35090500
    • Fairhall AL, Lewen GD, Bialek W, de Ruyter Van Steveninck RR (2001) Efficiency and ambiguity in an adaptive neural code. Nature 412:787-792. (Pubitemid 32801454)
    • (2001) Nature , vol.412 , Issue.6849 , pp. 787-792
    • Fairhall, A.L.1    Lewen, G.D.2    Bialek, W.3    De Ruyter Van Steveninck, R.R.4
  • 26
    • 0033714122 scopus 로고    scopus 로고
    • Adaptive rescaling maximizes information transmission
    • Brenner N, Bialek W, de Ruyter van Steveninck R (2000) Adaptive rescaling maximizes information transmission. Neuron 26:695-702.
    • (2000) Neuron , vol.26 , pp. 695-702
    • Brenner, N.1    Bialek, W.2    De Ruyter Van Steveninck, R.3
  • 27
    • 34948845686 scopus 로고    scopus 로고
    • Light adaptation in cone vision involves switching between receptor and post-receptor sites
    • DOI 10.1038/nature06150, PII NATURE06150
    • Dunn FA, Lankheet MJ, Rieke F (2007) Light adaptation in cone vision involves switching between receptor and post-receptor sites. Nature 449:603-606. (Pubitemid 47525145)
    • (2007) Nature , vol.449 , Issue.7162 , pp. 603-606
    • Dunn, F.A.1    Lankheet, M.J.2    Rieke, F.3
  • 28
    • 34447623582 scopus 로고    scopus 로고
    • Adding prediction risk to the theory of reward learning
    • DOI 10.1196/annals.1390.005, Reward and Decision Making in Corticobasal Ganglia Networks
    • Preuschoff K, Bossaerts P (2007) Adding prediction risk to the theory of reward learning. Ann N Y Acad Sci 1104:135-146. (Pubitemid 47092731)
    • (2007) Annals of the New York Academy of Sciences , vol.1104 , pp. 135-146
    • Preuschoff, K.1    Bossaerts, P.2
  • 29
    • 79960661918 scopus 로고    scopus 로고
    • Reward value-based gain control: Divisive normalization in parietal cortex
    • Louie K, Grattan LE, Glimcher PW (2011) Reward value-based gain control: Divisive normalization in parietal cortex. J Neurosci 31:10627-10639.
    • (2011) J Neurosci , vol.31 , pp. 10627-10639
    • Louie, K.1    Grattan, L.E.2    Glimcher, P.W.3
  • 30
    • 42549094464 scopus 로고    scopus 로고
    • Medial orbitofrontal cortex codes relative rather than absolute value of financial rewards in humans
    • DOI 10.1111/j.1460-9568.2008.06202.x
    • Elliott R, Agnew Z, Deakin JF (2008) Medial orbitofrontal cortex codes relative rather than absolute value of financial rewards in humans. Eur J Neurosci 27:2213-2218. (Pubitemid 351590911)
    • (2008) European Journal of Neuroscience , vol.27 , Issue.9 , pp. 2213-2218
    • Elliott, R.1    Agnew, Z.2    Deakin, J.F.W.3
  • 31
    • 21344441431 scopus 로고    scopus 로고
    • Activity in human reward-sensitive brain areas is strongly context dependent
    • Nieuwenhuis S, et al. (2005) Activity in human reward-sensitive brain areas is strongly context dependent. Neuroimage 25:1302-1309.
    • (2005) Neuroimage , vol.25 , pp. 1302-1309
    • Nieuwenhuis, S.1
  • 32
    • 77956281978 scopus 로고    scopus 로고
    • A common mechanism for adaptive scaling of reward and novelty
    • Bunzeck N, Dayan P, Dolan RJ, Duzel E (2010) A common mechanism for adaptive scaling of reward and novelty. Hum Brain Mapp 31:1380-1394.
    • (2010) Hum Brain Mapp , vol.31 , pp. 1380-1394
    • Bunzeck, N.1    Dayan, P.2    Dolan, R.J.3    Duzel, E.4
  • 34
    • 74049156284 scopus 로고    scopus 로고
    • Intrinsic functional connectivity as a tool for human connectomics: Theory, properties, and optimization
    • Van Dijk KR, et al. (2010) Intrinsic functional connectivity as a tool for human connectomics: Theory, properties, and optimization. J Neurophysiol 103:297-321.
    • (2010) J Neurophysiol , vol.103 , pp. 297-321
    • Van Dijk, K.R.1
  • 35
    • 57649158932 scopus 로고    scopus 로고
    • The impact of global signal regression on resting state correlations: Are anti-correlated networks introduced?
    • Murphy K, Birn RM, Handwerker DA, Jones TB, Bandettini PA (2009) The impact of global signal regression on resting state correlations: Are anti-correlated networks introduced? Neuroimage 44:893-905.
    • (2009) Neuroimage , vol.44 , pp. 893-905
    • Murphy, K.1    Birn, R.M.2    Handwerker, D.A.3    Jones, T.B.4    Bandettini, P.A.5
  • 36
    • 66349133709 scopus 로고    scopus 로고
    • The global signal and observed anticorrelated resting state brain networks
    • Fox MD, Zhang D, Snyder AZ, Raichle ME (2009) The global signal and observed anticorrelated resting state brain networks. J Neurophysiol 101:3270-3283.
    • (2009) J Neurophysiol , vol.101 , pp. 3270-3283
    • Fox, M.D.1    Zhang, D.2    Snyder, A.Z.3    Raichle, M.E.4
  • 37
    • 0029076348 scopus 로고
    • The orbital and medial prefrontal circuit through the primate basal ganglia
    • Haber SN, Kunishio K, Mizobuchi M, Lynd-Balta E (1995) The orbital and medial prefrontal circuit through the primate basal ganglia. J Neurosci 15:4851-4867.
    • (1995) J Neurosci , vol.15 , pp. 4851-4867
    • Haber, S.N.1    Kunishio, K.2    Mizobuchi, M.3    Lynd-Balta, E.4
  • 38
    • 0034654526 scopus 로고    scopus 로고
    • Striatonigrostriatal pathways in primates form an ascending spiral from the shell to the dorsolateral striatum
    • Haber SN, Fudge JL, McFarland NR (2000) Striatonigrostriatal pathways in primates form an ascending spiral from the shell to the dorsolateral striatum. J Neurosci 20: 2369-2382. (Pubitemid 30230089)
    • (2000) Journal of Neuroscience , vol.20 , Issue.6 , pp. 2369-2382
    • Haber, S.N.1    Fudge, J.L.2    McFarland, N.R.3
  • 39
    • 72049086941 scopus 로고    scopus 로고
    • The reward circuit: Linking primate anatomy and human imaging
    • Haber SN, Knutson B (2010) The reward circuit: Linking primate anatomy and human imaging. Neuropsychopharmacology 35(1):4-26.
    • (2010) Neuropsychopharmacology , vol.35 , Issue.1 , pp. 4-26
    • Haber, S.N.1    Knutson, B.2
  • 40
    • 36148977592 scopus 로고    scopus 로고
    • Dopamine reward circuitry: Two projection systems from the ventral midbrain to the nucleus accumbens-olfactory tubercle complex
    • Ikemoto S (2007) Dopamine reward circuitry: Two projection systems from the ventral midbrain to the nucleus accumbens-olfactory tubercle complex. Brain Res Brain Res Rev 56(1):27-78.
    • (2007) Brain Res Brain Res Rev , vol.56 , Issue.1 , pp. 27-78
    • Ikemoto, S.1
  • 41
    • 33746289235 scopus 로고    scopus 로고
    • Prefrontal cortical projections to the midbrain in primates: Evidence for a sparse connection
    • DOI 10.1038/sj.npp.1300990, PII 1300990
    • Frankle WG, Laruelle M, Haber SN (2006) Prefrontal cortical projections to the midbrain in primates: Evidence for a sparse connection. Neuropsychopharmacology 31: 1627-1636. (Pubitemid 44106694)
    • (2006) Neuropsychopharmacology , vol.31 , Issue.8 , pp. 1627-1636
    • Frankle, W.G.1    Laruelle, M.2    Haber, S.N.3
  • 42
    • 0030047416 scopus 로고    scopus 로고
    • The prefrontal cortex regulates the basal release of dopamine in the limbic striatum: An effect mediated by ventral tegmental area
    • Karreman M, Moghaddam B (1996) The prefrontal cortex regulates the basal release of dopamine in the limbic striatum: An effect mediated by ventral tegmental area. J Neurochem 66:589-598. (Pubitemid 26036693)
    • (1996) Journal of Neurochemistry , vol.66 , Issue.2 , pp. 589-598
    • Karreman, M.1    Moghaddam, B.2
  • 43
    • 33748709841 scopus 로고    scopus 로고
    • Dissociable systems for gain- and loss-related value predictions and errors of prediction in the human brain
    • DOI 10.1523/JNEUROSCI.2915-06.2006
    • Yacubian J, et al. (2006) Dissociable systems for gain- and loss-related value predictions and errors of prediction in the human brain. J Neurosci 26:9530-9537. (Pubitemid 44396866)
    • (2006) Journal of Neuroscience , vol.26 , Issue.37 , pp. 9530-9537
    • Yacubian, J.1    Glascher, J.2    Schroeder, K.3    Sommer, T.4    Braus, D.F.5    Buchel, C.6
  • 45
    • 0344157389 scopus 로고    scopus 로고
    • Characterizing stimulus-response functions using nonlinear regressors in parametric fMRI experiments
    • DOI 10.1006/nimg.1998.0351
    • Büchel C, Holmes AP, Rees G, Friston KJ (1998) Characterizing stimulus-response functions using nonlinear regressors in parametric fMRI experiments. Neuroimage 8(2):140-148. (Pubitemid 28471359)
    • (1998) NeuroImage , vol.8 , Issue.2 , pp. 140-148
    • Buchel, C.1    Holmes, A.P.2    Rees, G.3    Friston, K.J.4


* 이 정보는 Elsevier사의 SCOPUS DB에서 KISTI가 분석하여 추출한 것입니다.