Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning

Science

Volumn 304, Issue 5669, 2004, Pages 452-454

  O'Doherty, John ^a   Dayan, Peter ^b   Schultz, Johannes ^a   Deichmann, Ralf ^a   Friston, Karl ^a   Dolan, Raymond J ^a  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

^b UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

BIOMECHANICS; ENVIRONMENTAL IMPACT; LEARNING SYSTEMS; MAGNETIC RESONANCE IMAGING; MATHEMATICAL MODELS;

AFFECTIVE STRUCTURE; INSTRUMENTAL CONDITIONING; LEARNING MODELS; VENTRAL AND DORSAL STRIATUM;

BEHAVIORAL RESEARCH;

BIOLOGY;

ARTICLE; CORPUS STRIATUM; HUMAN; INSTRUMENTAL CONDITIONING; LEARNING; NONHUMAN; NUCLEAR MAGNETIC RESONANCE IMAGING; PRIORITY JOURNAL; REINFORCEMENT; STIMULUS RESPONSE; TASK PERFORMANCE;

ADULT; BASAL GANGLIA; CAUDATE NUCLEUS; CONDITIONING, CLASSICAL; CONDITIONING, OPERANT; FEMALE; HUMANS; LEARNING; MAGNETIC RESONANCE IMAGING; MALE; MIDDLE AGED; NUCLEUS ACCUMBENS; PROBABILITY; PUTAMEN; REINFORCEMENT (PSYCHOLOGY); REWARD;

ANIMALIA;

EID: 1942520195     PISSN: 00368075     EISSN: None     Source Type: Journal    
DOI: 10.1126/science.1094285     Document Type: Article

References (34)

1. B. F. Skinner, The Behavior of Organisms (Appleton-Century-Crofts, New York, 1938).
2. E. L. Thorndike, Animal Iintelligence: Experimental Studies (Macmillan, New York, 1911).
3. N. J. Mackintosh, Conditioning and Associative Learning (Clarendon Press, Oxford, 1983).
4. B. W. Balleine, A. Dickinson, Neuropharmacology 37, 407 (1998).
5. P. Dayan, B. W. Balleine, Neuron 36, 285 (2002).
6. R. S. Sutton, A. G. Barto, Reinforcement Learning (MIT Press, Cambridge, MA, 1998).
7. L. C. Baird, Advantage Updating (Rep. No. WL-TR-93-1146, Wright Patterson Air Force Base, Dayton, OH, 1993).
8. A. G. Barto, in Models of Information Processing in the Basal Ganglia, J. C. Houk, J. L. Davis, B. G. Beiser, Eds. (MIT Press, Cambridge, MA, 1996), chap. 11.
9. J. C. Houk, J. L. Adams, A. G. Barto, in Models of Information Processing in the Basal Ganglia, J. C. Houk, J. L. Davis, D. G. Beiser, Eds. (MIT Press, Cambridge, MA, 1996), pp. 249-270.
10. R. E. Suri, W. Schultz, Neuroscience 91, 871 (1999).
11. D. Joel, Y. Niv, E. Ruppin, Neural Networks 15, 535 (2002).
12. R. Romo, W. Schultz, J. Neurophysiol. 63, 592 (1990).
13. J. Mirenowicz, W. Schultz, J. Neurophysiol. 72, 1024 (1994).
14. J. R. Hollerman, W. Schultz, Nature Neurosci. 1, 304 (1998).
15. R. N. Cardinal, J. A. Parkinson, J. Hall, B. J. Everitt, Neurosci. Biobehav. Rev. 26, 321 (2002).
16. G. E. Alexander, M. R. DeLong, P. L. Strick, Annu. Rev. Neurosci. 9, 357 (1986).
17. M. G. Packard, B. J. Knowlton, Annu. Rev. Neurosci. 25, 563 (2002).
18. N. M. White, Curr. Opin. Neurobiol. 7, 164 (1997).
19. L. Toni, R. E. Passingham, Exp. Brain Res. 127, 19 (1999).
20. P. R. Montague, P. Dayan, T. J. Sejnowski, J. Neurosci. 16, 1936 (1996). Also see discussion in (11).
21. Materials and methods are available as supporting material on Science Online.
22. R. J. Herrnstein, J. Exp. Anal. Behav. 21, 159 (1974).
23. J. P. O'Doherty, P. Dayan, K. Friston, H. Critchley, R. J. Dolan, Neuron 38, 329 (2003).
24. S. M. McClure, G. S. Berns, P. R. Montague, Neuron 38, 339 (2003).
25. G. Pagnoni, C. F. Zink, P. R. Montague, G. S. Berns, Nature Neurosci. 5, 97 (2002).
26. B. Knutson, G. W. Fong, C. M. Adams, J. L. Varner, D. Hommer, Neuroreport 12, 3683 (2001).
27. M. R. Delgado, H. M. Locke, V. A. Stenger, J. A. Fiez, Cogn. Affect. Behav. Neurosci. 3, 27 (2003).
28. C. R. Gerfen, Trends Neurosci. 15, 133 (1992).
29. A. M. Graybiel, Curr. Opin. Neurobiol. 5, 733 (1995).
30. J. Brown, D. Bullock, S. Grossberg, J. Neurosci. 19, 10502 (1999).
31. P. Dayan, in Advances in Neural Information Processing Systems 14, T. G. Dietterich, S. Becker, Z. Ghahramani, Eds. (MIT Press, Cambridge, MA, 2002), pp. 11-18.
32. S. Killcross, E. Coutureau, Cereb. Cortex 13, 400 (2003).
33. W. Schultz, P. Dayan, P. R. Montague, Science 275, 1593 (1997).
34. We thank B. Seymour and R. Passingham for helpful discussions. Supported by Wellcome Programme grants (R.J.D. and K.F.). P.D. is supported by the Gatsby Charitable Foundation.