The neural basis of human error processing: Reinforcement learning, dopamine, and the error-related negativity

Psychological Review

Volumn 109, Issue 4, 2002, Pages 679-709

  Holroyd, Clay B ^a,c   Coles, Michael G H ^a,b  

^a UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

^b RADBOUD UNIVERSITY NIJMEGEN   (Netherlands)

^c PRINCETON UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DOPAMINE;

ANALYSIS OF VARIANCE; ARTICLE; BIOLOGICAL MODEL; BRAIN MAPPING; CLINICAL TRIAL; CONTROLLED CLINICAL TRIAL; CONTROLLED STUDY; HUMAN; LEARNING; MOTOR CORTEX; PHYSIOLOGY; RANDOMIZED CONTROLLED TRIAL; REINFORCEMENT;

ANALYSIS OF VARIANCE; BRAIN MAPPING; DOPAMINE; HUMANS; MODELS, NEUROLOGICAL; MOTOR CORTEX; PROBABILITY LEARNING; REINFORCEMENT (PSYCHOLOGY);

EID: 85047670409     PISSN: 0033295X     EISSN: None     Source Type: Journal    
DOI: 10.1037/0033-295X.109.4.679     Document Type: Article

References (266)

1. Abercrombie, E. D., Keefe, K. A., DiFrischia, D. S., & Zigmond, M. J. (1989). Differential effect of stress on in vivo dopamine release in striatum, nucleus accumbens, and medial frontal cortex. Journal of Neurochemistry, 52, 1655-1658.
2. Alexander, G. E., & Crutcher, M. D. (1990). Functional architecture of basal ganglia circuits: Neural substrates of parallel processing. Trends in Neurosciences, 13, 266-271.
3. Allport, A. (1987). Selection for action: Some behavioral and neurophysiological considerations of attention and action. In H. Heuer & A. F. Sanders (Eds.), Perspectives on perception and action (pp. 395-419). Hillsdale. NJ: Erlbaum.
4. Angel, R. W. (1976). Efference copy in the control of movement. Neurology, 26, 1164-1168.
5. Aou, S., Oomura, Y., Nishino, H., Inokuchi, A., & Mizuno, Y. (1983). Influence of catecholamines on reward-related neuronal activity in monkey orbitofrontal cortex. Brain Research, 267, 165-170.
6. Arnsten, A. F. T. (1997). Catecholamine regulation of the prefromal cortex. Journal of Psychopharmacology, 11, 151-162.
7. Baddeley, A. D. (1986). The central executive and its malfunctions. In A. D. Baddeley (Ed.), Working memory (pp. 224-253). New York: Oxford University Press.
8. Barch, D. M., Braver. T. S., Sabb, F. W., & Noll, D. C. (2000). Anterior cingulate and the monitoring of response conflict: Evidence from an fMRI study of overt verb generation. Journal of Cognitive Neuroscience, 12, 298-309.
9. Barto, A. G. (1995). Adaptive critics and the basal ganglia. In J. Houk, J. Davis, & D. Beiser (Eds.), Models of information processing in the basal ganglia (pp. 215-232). Cambridge, MA: MIT Press.
10. Barto, A. G., & Sutton, R. S. (1997). Reinforcement learning in artificial intelligence. Advances in Psychology, 121, 358-386.
11. Bates, J. F., & Goldman-Rakic, P. S. (1993). Prefrontal connections of medial motor areas in the rhesus monkey. Journal of Comparative Neurology, 336, 211-228.
12. Bechara, A., Damasio, H., Tranel, D., & Anderson, S. W. (1998). Dissociation of working memory from decision making within the human prefrontal cortex. Journal of Neuroscience, 18, 428-437.
13. Bechara, A., Damasio, H., Tranel, D., & Damasio, A. R. (1997, February 28). Deciding advantageously before knowing the advantageous strat-egy. Science, 275, 1293-1295.
14. Bentivoglio, M., Kultas-Ilinsky, K., & Ilinsky, I. (1993). Limbic thalamus: Structure, intrinsic organization, and connections. In B. A. Vogt & M. Gabriel (Eds.), Neurobiology of cingulate cortex and limbic thalamus: A comprehensive handbook (pp. 71-122). Boston: Birkhauser.
15. Berger, B., Febvret, A., Greengard, P., & Goldman-Rakic, P. S. (1990). DARPP-32, a phosphoprotein enriched in dopaminoceptive neurons bearing dopamine D1 receptors: Distribution in the cerebral cortex of the newborn and adult rhesus monkey. Journal of Comparative Neurology, 299, 327-348.
16. Berger, B., Caspar, P., & Verney, C. (1991). Dopaminergic innervation of the cerebral cortex: Unexpected differences between rodents and primates. Trends in Neurosciences, 14, 21-27.
17. Bernardi, G., Cherubini, E., Marciani, M. G., Mercuri, N., & Stanzione, P. (1982). Responses of intracellularly recorded cortical neurons to the iontophoretic application of dopamine. Brain Research, 245, 267-274.
18. Berns, G. S., McClure, S. M., Pagnoni, G., & Montague, P. R. (2001). Predictability modulates human brain response to reward. Journal of Neuroscience, 21, 2793-2798.
19. Bernstein, P. S., Scheffers, M. K., & Coles, M. G. H. (1995). "Where did I go wrong?" A psychophysiological analysis of error detection. Journal of Experimental Psychology: Human Perception and Performance, 21, 1312-1322.
20. Berridge, K. C., & Robinson, T. E. (1998). What is the role of dopamine in reward: Hedonic impact, reward learning, or incentive salience? Brain Research Reviews, 28, 309-369.
21. Botvinick, M., Braver, T. S., Barch, D. M., Carter, C. S., & Cohen, J. D. (2001). Conflict monitoring and cognitive control. Psychological Review, 108, 624-652.
22. Botvinick, M., Nystrom, L. E., Fissell, K., Carter, C. S., & Cohen, J. D. (1999, November 11). Conflict monitoring versus selection-for-action in anterior cingulate cortex. Nature, 402, 179-181.
23. Braak, H. (1976). A primitive gigantopyramidal field buried in the depth of the cingulate sulcus of the human brain. Brain Research, 109, 219-233.
24. Braver, T. S., Barch, D. M., Gray, J. R., Molfese, D. L., & Snyder, A. Z. (2001). Anterior cingulate and response conflict: Effects of frequency, inhibition, and errors. Cerebral Cortex, 11, 825-836.
25. Braver, T. S., & Cohen, J. D. (1999). Dopamine, cognitive control, and the gating model. In J. A. Reggia, E. Ruppin, & D. Glanzman (Eds.), Progress in brain research (pp. 327-349). Amsterdam: North-Holland/ Elsevier Science.
26. Braver, T. S. & Cohen, J. D. (2000). On the control of control: The role of dopamine in regulating prefrontal function. In S. Monsell & J. Driver (Eds.), Attention and performance (Vol. 18, pp. 713-737). Cambridge, MA: MIT Press.
27. Bridle, J. S. (1990). Training stochastic model recognition algorithms as networks can lead to maximum mutual information estimation of parameters. In D. S. Touretzky (Ed.), Advances in neural information processing systems (Vol. 2, pp. 211-217). San Mateo, CA: Kaufmann.
28. Brooks, V. B. (1986). How does the limbic system assist motor learning? A limbic comparator hypothesis. Brain, Behavior and Evolution, 29, 29-53.
29. Brooks, V. B. (1989). Limbic assistance in task-related use of motor skill. In J. C. Eccles (Ed.), Principles of design and operation of the brain (pp. 343-368). Berlin, Germany: Springer-Verlag.
30. Brown, J., Bullock, D., & Grossberg, S. (1999). How the basal ganglia use parallel excitatory and inhibitory learning pathways to selectively respond to unexpected rewarding cues. Journal of Neuroscience, 19, 10502-10511.
31. Brown, L. L., Schneider, J. S., & Lidsky, T. I. (1997). Sensory and cognitive functions of the basal ganglia. Current Opinion in Neurobiology, 7, 157-163.
32. Brozoski, T. J., Brown, R. M., Rosvold, H. E., & Goldman, P. S. (1979, August 31). Cognitive deficit caused by regional depletion of dopamine in prefrontal cortex of rhesus monkey. Science, 205, 929-932.
33. Bunney, B. S., & Aghajanian, G. K. (1976). Dopamine and norepinephrine innervated cells in the rat prefrontal cortex: Pharmacological differentiation using microiontophoretic techniques. Life Sciences, 19, 1783-1792.
34. Bush, G., Whalen, P. J., Rosen, B. R., Jenike, M. A., McInerey, S. C., & Rauch, S. L. (1998). The counting Stroop: An interference task specialized for functional neuroimaging-validation study with functional MRI. Human Brain Mapping, 6, 270-282.
35. Bussey, T. J., Muir, J. L., Everitt, B. J., & Robbins, T. W. (1996). Dissociable effects of anterior and posterior cingulate cortex lesions on the acquisition of a conditional visual discrimination: Facilitation of early learning vs. impairment of late learning. Behavioral Brain Research, 82, 45-56.
36. Calabresi, P., Pisani, A., Mercuri, N. B., & Bernardi, G. (1996). The corticostriatal projection: From synaptic plasticity to dysfunctions of the basal ganglia. Trends in Neurosciences, 19, 19-24.
37. Carter, C. S., Braver, T. S., Barch, D. M., Botvinick, M. M., Noll. D., & Cohen, J. D. (1998, May 1). Anterior cingulate cortex, error detection, and the online monitoring of performance. Science, 280, 747-749.
38. Cauller, L. J., & Conners, B. W. (1992). Functions of very distal dendrites: Experimental and computational studies of Layer I synapses on neocortical pyramidal cells. In T. McKenna, J. Davis, & S. F. Zornetzer (Eds.), Single neuron computation (pp. 199-229). New York: Academic Press.
39. Cepeda, C., Radisavljevic, Z., Peacock, W., Levine, M. S., & Buchwald, N. A. (1992). Differential modulation by dopamine of responses evoked by excitatory amino acids in human cortex. Synapse, 11, 330-341.
40. Channon, S., & Crawford, S. (1999). Problem-solving in real-life-type situations: The effects of anterior and posterior lesions on performance. Neuropsychologia, 37, 757-770.
41. Coles, M. G. H., & Rugg, M. D. (1995). Event-related brain potentials: An introduction. In M. D. Rugg & M. G. H. Coles (Eds.), Electrophysiology of mind (pp. 1-26). Oxford, England: Oxford University Press.
42. Coles, M. G. H., Scheffers, M. K., & Holroyd, C. (1998). Berger's dream? The error-related negativity and modern cognitive psychophysiology. In H. Wilted, U. Zweiner, B. Schack, & A. Doling (Eds.), Quantitative and topological EEG and MEG analysis (pp. 96-102). Jena-Erlangen, Germany: Druckhaus Mayer Verlag.
43. Coles, M. G. H., Scheffers, M. K., & Holroyd, C. B. (2001). Why is there an ERN/Ne on correct trials? Response representations, stimulus-related components, and the theory of error-processing. Biological Psychology, 56, 173-189.
44. Corbetta, M., Miezin, F. M., Dobmeyer, S., Shulman, G. L., & Petersen, S. E. (1991). Selective and divided attention during visual discriminations of shape, color, and speed: Functional anatomy by positron emission tomography. Journal of Neuroscience, 11, 2383-2402.
45. Crick, F. (1989, January 12). The recent excitement about neural networks. Nature, 337, 129-132.
46. Crino, P. B., Morrison, J. H., & Hof, P. R. (1993). Monoaminergic innervation of cingulate cortex. In B. A. Vogt & M. Gabriel (Eds.), Neurobiology of cingulate cortex and limbic thalamus: A comprehensive handbook (pp. 285-310). Boston: Birkhauser.
47. Cummings, J. L. (1993). Frontal-subcortical circuits and human behavior. Archives of Neurology, 50, 873-880.
48. Damasio, A. R. (1994). Descartes' error: Emotion, reason, and the human brain. New York: Avon Books.
49. Damasio, A. R., & Van Hoesen, G. W. (1983). Emotional disturbances associated with focal lesions of the limbic frontal lobe. In K. M. Heilman & P. Satz (Eds.), Neuropsychology of human emotion (pp. 85-110). New York: Guilford Press.
50. Dayan, P., & Sejnowski, T. J. (1994). TD(λ) converges with probability 1. Machine Learning, 14, 295-301.
51. Degos, J.-D., da Fonseca, N., Gray, F., & Cesaro, P. (1993). Severe frontal syndrome associated with infarcts of the left anterior cingulate gyms and the head of the right caudate nucleus. Brain, 116, 1541-1548.
52. Dehaene, S., & Changeux, J.-P. (1991). The Wisconsin Card Sort Task: Theoretical analysis and modeling in a neuronal network. Cerebral Correx, 1, 62-79.
53. Dehaene, S., Kerszberg, M., & Changeux, J.-P. (1998). A neuronal model of a global workspace in effortful cognitive tasks. Proceedings of the National Academy of Sciences, 95, 14529-14534.
54. Dehaene, S., Posner, M. I., & Tucker, D. M. (1994). Localization of a neural system for error detection and compensation. Psychological Science, 5, 303-305.
55. Deiber, M.-P., Passingham, R. E., Colebatch, J. G., Friston, K. J., Nixon, P. D., & Frackowiak, R. S. J. (1991). Cortical areas and the selection of movement: A study with positron emission tomography. Experimental Brain Research, 84, 393-402.
56. D'Esposito, M., Detre, J. A., Alsop, D. C., Shin, R. K., Atlas, S., & Grossman, M. (1995, November 16). The neural basis of the central executive of working memory. Nature, 16, 279-281.
57. Devinsky, O., Morrell, M. J., & Vogt, B. A. (1995). Contributions of anterior cingulate cortex to behaviour. Brain, 118, 279-306.
58. Diamond, A., & Goldman-Rakic, P. S. (1989). Comparison of human infants and rhesus monkeys on Piaget's AB task: Evidence for dependence on dorsolateral prefrontal cortex. Experimental Brain Research, 74, 24-40.
59. Diehl, B., Dinner, D. S., Mohamed, A., Najm, I., Klem, G., LaPresto, E., et al. (2000). Evidence of cingulate motor representation in humans. Neurology, 55, 725-728.
60. Doherty, M. D., & Gratton, A. (1992). High-speed chronoamperometric measurements of mesolimbic and nigrostriatal dopamine release associated with repeated daily stress. Brain Research, 586, 295-302.
61. Dolan, R. J., Fletcher, P., Frith, C. D., Friston, K. J., Frackowiak, R. S. J., & Grasby, P. M. (1995, November 9). Dopaminergic modulation of impaired cognitive activation in the anterior cingulate cortex in schizophrenia. Nature, 378, 180-182.
62. Dum, R. P., & Strick, P. L. (1993). Cingulate motor areas. In B. A. Vogt & M. Gabriel (Eds.), Neurobiology of cingulate cortex and limbic thalamus: A comprehensive handbook (pp. 415-441). Boston: Birkhauser.
63. Eblen, F., & Graybiel, A. M. (1995). Highly restricted origin of prefrontal cortical inputs to striosomes in the macaque monkey. Journal of Neuroscience, 15, 5999-6013.
64. Egelman, D. M., Person, C., & Montague, P. R. (1998). A computational role for dopamine delivery in human decision-making. Journal of Cognitive Neuroscience, 10, 623-630.
65. Elliott, R., & Dolan, R. J. (1998). Activation of different anterior cingulate foci in association with hypothesis testing and response selection. Neurolmage, 8, 17-29.
66. Elliott, R., Rees, G., & Dolan, R. J. (1999). Ventromedial prefrontal cortex mediates guessing. Neuropsychologia, 37, 403-411.]
67. Eriksen, B. A., & Eriksen, C. W. (1974). Effects of noise letters upon the identification of a target letter in a nonsearch task. Perception & Psychophysics, 16, 143-149.
68. Eslinger, P. J., & Grattan, L. M. (1993). Frontal lobe and frontal-striatal substrates for different forms of human cognitive flexibility. Neuropsychologia, 31, 17-28.
69. Falkenstein, M., Hohnsbein, J., Hoormann, J., & Blanke, L. (1990). Effects of errors in choice reaction tasks on the ERP under focused and divided attention. In C. Brunia, A. Gaillard, & A. Kok (Eds.), Psychophysiological brain research (pp. 192-195). Tilburg, the Netherlands: Tilburg University Press.
70. Falkenstein, M., Hoormann, J., Christ, S., & Hohnsbein, J. (2000). ERP components on reaction errors and their functional significance: A tutorial. Biological Psychology, 51, 87-107.
71. Perron, A., Thierry, A. M., Le Douarin, C., & Glowinski, J. (1984). Inhibitory influence of the mesocortical dopaminergic system on spontaneous activity or excitatory response induced from the thalamic mediodorsal nucleus in the rat medial prefrontal cortex. Brain Research, 302, 257-265.
72. Finch, D. M. (1993). Hippocampal, subicular, and entorhinal afferents and synaptic integration in rodent cingulate cortex. In B. A. Vogt & M. Gabriel (Eds.), Neurobiology of cingulate cortex and limbic thalamus: A comprehensive handbook (pp. 224-248). Boston: Birkhauser.
73. Fink, G. R., Frackowiak, R. S. J., Pietrzyk, U., & Passingham, R. E. (1997). Multiple nonprimary motor areas in the human cortex. Journal of Neurophysiology, 77, 2164-2174.
74. Frank, M. J., Loughry, B., & O'Reilly, R. C. (2001). Interactions between frontal cortex and basal ganglia in working memory: A computational model. Cognitive, Affective, and Behavioral Neuroscience, 1, 137-160.
75. Friston, K. J., Tononi, G., Reeke, G. N., Jr., Sporns, O., & Edelman, G. M. (1994). Value-dependent selection in the brain: Simulation in a synthetic neural model. Neuroscience, 59, 229-243.
76. Frith, C. D., Fristen, K. J., Liddle, P. F., & Frackowiak, R. S. J. (1991a). A PET study of word finding. Neuropsychologia, 29, 1137-1148.
77. Frith, C. D., Fristen, K. J., Liddle, P. F., & Frackowiak, R. S. J. (1991b). Willed action and the prefrontal cortex in man: A study with PET. Proceedings of the Roval Society of London, 244, 241-246.
78. Gabriel, M. (1993). Discriminative avoidance learning: A model system. In B. A. Vogt & M. Gabriel (Eds.), Neurobiology of cingulate cortex and limbic thalamus: A comprehensive handbook (pp. 478-523). Boston: Birkhauser.
79. Gabriel, M., & Taylor, C. (1998). Prefrontal exposure to cocaine impairs neuronal coding of attention and discriminative learning. In J. A. Harvey & B. E. Kosofsky (Eds.), Annals of the New York Academy of Sciences: Vol. 846. Cocaine: Effects on the developing brain (pp. 194-212). New York: Academy of Sciences.
80. Gariano, R. F., & Groves, P. M. (1988). Burst firing induced in midbrain dopamine neurons by stimulation of the medial prefrontal and anterior cingulate cortices. Brain Research, 462, 194-198.
81. Gaspar, P., Berger, B., Febvret, A., Vigny, A., & Henry, J. P. (1989). Catecholamine innervation of the human cerebral cortex as revealed by comparative immunohistochemistry of tyrosine hydroxylase and dopamine-beta-hydroxylase. Journal of Comparative Neurology, 279, 249-271.
82. Gehring, W. J. (1992). The error-related negativity: Evidence for a neural mechanism for error-related processing. Unpublished doctoral dissertation, University of Illinois at Urbana-Champaign.
83. Gehring, W. J., Coles, M. G. H., Meyer, D. E., & Donchin, E. (1995). A brain potential manifestation of error-related processing. In G. Karmos, M. Molnar, V. Csepe, I. Czigler, & J. E. Desmedt (Eds.), Perspectives of event-related potentials research (EEG Suppl. 44) (pp. 261-272). Amsterdam: North-Holland/Elsevier Science.
84. Gehring, W. J., Goss, B., Coles. M. G. H., Meyer, D. E., & Donchin, E. (1993). A neural system for error detection and compensation. Psychological Science, 4, 385-390.
85. Gehring, W. J., Himle, J., & Nisenson, L. G. (2000). Action-monitoring deficits in obsessive-compulsive disorder. Psychological Science, 11, 1-6.
86. Gehring, W. J., & Knight, R. T. (2000). Prefrontal-cingulate interactions in action monitoring. Nature Neuroscience, 3, 516-520.
87. Gemba, H., Sasaki, K., & Brooks, V. B. (1986). "Error" potentials in limbic cortex (anterior cingulate area 24) of monkeys during motor learning. Neuroscience Letters, 70, 223-227.
88. Goff, W. R., Allison, T., & Vaughan, H. G. (1978). The functional neuroanatomy of event-related potentials. In E. Callaway, P. Tueting, & S. Koslow (Eds.), Event-related brain potentials in man (pp. 1-91). New York: Academic Press.
89. Goldberg, E., & Barr, W. B. (1991). Three possible mechanisms of unawareness of deficit. In G. P. Prigatano & D. Schacter (Eds.), Unawareness of deficit after brain injury (pp. 152-175). New York: Oxford University Press.
90. Goldberg, T. E., Weinberger, D. R., Berman, K. F., Pliskin, N. H., & Podd, M. H. (1987). Further evidence for dementia of the prefrontal type in schizophrenia? Archives of General Psychiatry, 44, 1008-1014.
91. Goldman-Rakic, P. S. (1989). The prefrontal contribution to working memory and conscious experience. In J. C. Eccles (Ed.), Principles of design and operation of the brain (pp. 389-410). Berlin, Germany: Springer-Verlag.
92. Goldman-Rakic, P. S. (1995). Toward a circuit model of working memory and the guidance of voluntary motor action. In J. Houk, J. Davis, & D. Beiser (Eds.), Models of information processing in the basal ganglia (pp. 131-148). Cambridge, MA: MIT Press.
93. Goldman-Rakic, P. S., Leranth, C., Williams, S. M., Mons, N., & Geffard, M. (1989). Dopamine synaptic complex with pyramidal neurons in primate cerebral cortex. Proceedings of the National Academy of Sciences, USA, 86, 9015-9019.
94. Gratton, G., Coles, M. G. H., & Donchin, E. (1983). A new method for off-line removal of ocular artifact. Electroencephalography and Clinical Neurophysiology, 55, 468-484.
95. Graybiel, A. M., Aosaki, T., Flaherty, A. W., & Kimura, M. (1994, September 23). The basal ganglia and adaptive motor control. Science, 265, 1826-1831.
96. Graybiel, A. M., & Kimura, M. (1995). Adaptive neural networks in the basal ganglia. In J. Houk, J. Davis, & D. Beiser (Eds.), Models of information processing in the basal ganglia (pp. 103-116). Cambridge, MA: MIT Press.
97. Griffiths, D. J. (1989). Introduction to electrodynamics. Englewood Cliffs, NJ: Prentice-Hall.
98. Guarraci, F. A., & Kapp, B. S. (1999). An electrophysiological characterization of ventral tegmental area dopaminergic neurons during differential Pavlovian fear conditioning in the awake rabbit. Behavioral Brain Research, 99, 169-179.
99. Gulledge, A. T., & Jaffe, D. B. (1998). Dopamine decreases the excitability of Layer V pyramidal cells in the rat prefrontal cortex. Journal of Neuroscience, 18, 9139-9151.
100. Haber, S. N., & Fudge, J. L. (1997). The primate substantia nigra and VTA: Integrative circuitry and function. Critical Reviews in Neurobiology, II, 323-342.
101. Herrnstein, R. J. (1997). The matching law. New York: Russell Sage Foundation.
102. Hollerman, J. R., & Schultz, W. (1998). Dopamine neurons report an error in the temporal prediction of reward during learning. Nature Neuroscience, 1, 304-309.
103. Holroyd, C. B. (2001). Reinforcement learning and the error-related negativity: A computational and neurophysiological investigation. Doctoral dissertation, University of Illinois at Urbana-Champaign.
104. Holroyd, C. B., & Coles, M. G. H. (2002). Response selection in a modified version of the Eriksen Flankers Task. Manuscript in preparation.
105. Holroyd, C. B., Dien, J., & Coles, M. G. H. (1998). Error-related scalp potentials elicited by hand and foot movements: Evidence for an output-independent error-processing system in humans. Neuroscience Letters, 242, 65-68.
106. Holroyd, C., Reichler, J., & Coles, M. G. H. (1998). Generation of error-related scalp potentials by a mesencephalic dopamine system for error processing: Hypothesis and model. In Proceedings of the Second International Conference on Cognitive and Neural Systems (p. 114). Boston: Department of Cognitive and Neural Systems, Boston University.
107. Holroyd, C., Reichler, J., & Coles, M. G. H. (1999, April). Is the error-related negativity generated by a dopaminergic error signal for reinforcement learning? Hypothesis and model. In abstract program of the Cognitive Neuroscience Society 1999 annual meeting, Washington DC (p. 45).
108. Houk, J. C. (1995). Information processing in modular circuits linking basal ganglia and cerebral cortex. In J. Houk, J. Davis, & D. Beiser (Eds.), Models of information processing in the basal ganglia (pp. 3-9). Cambridge, MA: MIT Press.
109. Houk, J. C., Adams, J. L., & Barto, A. G. (1995). A model of how the basal ganglia generate and use neural signals that predict reinforcement. In J. Houk, J. Davis, & D. Beiser (Eds.), Models of information processing in the basal ganglia (pp. 249-270). Cambridge, MA: MIT Press.
110. Jaakkola, T., Jordan, M. I., & Singh, S. P. (1994). On the convergence of stochastic iterative dynamic programming algorithms. Neural Computation, 6, 1185-1201.]
111. Jacobs, R. A., Jordan, M. I., & Barto, A. G. (1991). Task decomposition through competition in a modular connectionist architecture: The what and where vision tasks. Cognitive Science, 15, 219-250.
112. Jahanshahi, M., Jenkis, I. H., Brown, R. G., Marsden, C. D., Passingham, R. E., & Brooks, D. J. (1995). Self-initiated versus externally triggered movements. Brain, 118, 913-933.
113. Jasper, H. H. (1958). The ten twenty electrode system of the international federation. Electroencephalographv and Clinical Neurophysiology 10 371-375.
114. Jeannerod, M. (1991). The interaction of visual and proprioceptive cues in controlling reaching movements. In D. R. Humphrey, & H.-J. Freund (Eds.), Motor control: Concepts and issues (pp. 277-291). New York: Wiley.
115. Jenkins, I. H., Brooks, D. J., Nixon, P. D., Frackowiak, R. S. J., & Passingham, R. E. (1994). Motor sequence learning: A study with positron emission tomography. Journal of Neuroscience, 14, 3775-3790.
116. Johnson, T. M., Otten, L. J., Boeck, K., & Coles, M. G. H. (1997). Am I too late? The neural consequences of missing a deadline. Psychophysiology, 34, S48.
117. Kalmar, Z., Szepesvari, C., & Lorincz, A. (1998). Module-based reinforcement learning: Experiments with a real robot. Machine Learning, 31, 55-85.
118. Kawagoe, R., Takikawa, Y., & Hikosaka, O. (1998). Expectation of reward modulates cognitive signals in the basal ganglia. Nature Neuroscience, 1, 411-416.
119. Kiehl, K. A., Liddle, P. F., & Hopfmger, J. B. (2000). Error processing and the rostral anterior cingulate: An event-related fMRI study. Psychophysiology, 37, 216-223.
120. Kimura, M., & Matsumoto, N. (1997). Nigrostriatal dopamine system may contribute to behavioral learning through providing reinforcement signals to the striatum. European Neurology, 38, 11-17.
121. Knowlton, B. J., Mangels, J. A., & Squire, L. R. (1996, September 6). A neostriatal habit learning system in humans. Science, 273, 1399-1402.
122. Knutson, B., Westdorp, A., Kaiser, E., & Hommer, D. (2000). FMRI visualization of brain activity during a monetary incentive delay task. Neurolmage, 12, 20-27.
123. Konow, A., & Pribram, K. H. (1970). Error recognition and utilization produced by injury to the frontal cortex in man. Neuropsychologia, 8, 489-491.
124. Kopp, B., & Wolff, M. (2000). Brain mechanisms of selective learning: Event-related potentials provide evidence for error-driven learning in humans. Biological Psychology, 51, 223-246.
125. Koski, L., & Paus, T. (2000). Functional connectivity of the anterior cingulate cortex within the human frontal lobe: A brain mapping analysis. Experimental Brain Research, 133, 55-65.
126. Kubota, K., & Komatsu, H. (1985). Neuron activities of monkey prefrontal cortex during the learning of visual discrimination tasks with go/no-go performances. Neuroscience Research, 3, 106-129.
127. Law-Tho, D., Hirsch, J. C., & Crepel, F. (1994). Dopamine modulation of synaptic transmission in rat prefrontal cortex: An in vitro electrophysiological study. Neuroscience Research, 21, 151-160.
128. Ljungberg, T., Apicella, P., & Schultz, W. (1991). Responses of midbrain dopamine neurons during delayed alternation performance. Brain Research, 567, 337-341.
129. Ljungberg, T., Apicella, P., & Schultz, W. (1992). Responses of monkey dopamine neurons during learning of behavioral reactions. Journal of Neurophysiology, 67, 145-163.
130. Logan, G. D. (1985). Executive control of thought and action. Acta Psychologica, 60, 193-210.
131. Lopes da Silva, F., & Van Rotterdam, A. (1982). Biophysical aspects of EEG and MEG generation. In E. Niedemeyer & F. Lopez da Silva (Eds.), Electroencephalography: Basic principles, clinical applications, and related fields (pp. 1-13). Baltimore: Urban & Schwarzenberg.
132. Louilot, A., Le Moal, M., & Simon, H. (1986). Differential reactivity of dopaminergic neurons in the nucleus accumbens in response to different behavioral situations: An in vivo voltammetric study in free-moving rats. Brain Research, 397, 395-400.
133. Luria, A. R. (1973). The working brain: An introduction to neuropsychology (B. Haigh, Trans.). New York: Basic Books.
134. Luu, P., Flaisch, T., & Tucker, D. M. (2000). Medial frontal cortex in action monitoring. Journal of Neuroscience, 20, 464-469.
135. Machlin, S. R., Harris, G. J., Pearlson, G. D., Hoehn-Saric, R., Jeffrey, P., & Camargo, E. E. (1991). Elevated medial-frontal cerebral blood flow in obsessive-compulsive patients: A SPECT study. American Journal of Psychiatry, 148, 1240-1242.
136. Mantz, J., Milla, C., Glowinski, J., & Thierry, A.M. (1988). Differential effects of ascending neurons containing dopamine and noradrenaline in the control of spontaneous activity and of evoked responses in the rat prefrontal cortex. Neuroscience, 27, 517-526.
137. Martin, J. H. (1991). The collective electrical behavior of cortical neurons: The electroencephalogram and the mechanisms of epilepsy. In E. R. Kandel, J. H. Schwartz, & T. M. Jessell (Eds.), Principles of neural science (pp. 777-791). Norwalk, CT: Appleton & Lange.
138. Mazzoni, P., Andersen, R. A., & Jordan, M. I. (1991). A more biologically plausible learning rule for neural networks. Proceedings of the National Academy of Sciences, USA, 88, 4433-4437.
139. Menon, V., Adleman, N. E., White, C. D., Glover, G. H., & Reiss, A. L. (2001). Error-related brain activation during a go/no-go response inhibition task. Human Brain Mapping, 12, 131-143.
140. Milner, B. (1963). Effects of different brain lesions on card sorting. Archives of Neurology, 9, 90-100.
141. Milner, B., & Petrides, M. (1984). Behavioral effects of frontal-lobe lesions in man. Trends in Neurosciences, 7, 403-407.
142. Miltner, W. H. R., Braun, C. H., & Coles, M. G. H. (1997). Event-related brain potentials following incorrect feedback in a time-estimation task: Evidence for a "generic" neural system for error detection. Journal of Cognitive Neuroscience, 9, 788-798.
143. Miltner, W. H. R., Lemke, U., Weiss, T., Holroyd, C., Scheffers, M. K., & Coles, M. G. H. (1997). The source of the magnetic equivalent of the error-related negativity. Psychophysiology, 34, S65.
144. Mirenowicz, J., & Schultz, W. (1996, February 1). Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli. Nature, 379, 449-451.
145. Montague, P. R., Dayan. P., & Sejnowski, T. J. (1996). A framework for mesencephalic dopamine systems based on predictive Hebbian learning. Journal of Neuroscience, 16, 1936-1947.
146. Mora, F., Avrith, D. B., Phillips, A. G., & Rolls, E. T. (1979). Effects of satiety on self-stimulation of the orbitofrontal cortex in the rhesus monkey. Neuroscience Letters, 13, 141-145.
147. Mora, F., & Myers, R. D. (1977, September 30). Brain self-stimulation: Direct evidence for the involvement of dopamine in the prefrontal cortex. Science. 197, 1387-1389.
148. Morecraft, R. J., & Van Hoesen, G. W. (1991). A comparison of frontal lobe inputs to the primary, supplementary, and cingulate motor areas in the monkey. Society for Neuroscience Abstracts, 17, 1019.
149. Morecraft, R. J., & Van Hoesen, G. W. (1998). Convergence of limbic input to the cingulate motor cortex in the rhesus monkey. Brain Research Bulletin, 45, 209-232.
150. Morecraft, R. J., Van Hoesen, G. W., & Maynard, J. A. (1989). Cortical afferents to caudal area 24c (the cingulate motor area) and rostral area 23c. Society for Neuroscience Abstracts, 15, 73.
151. Murase, S., Grenhoff, J., Chouvet, G., Gonon, F. G., & Svensson, T. H. (1993). Prefrontal cortex regulates burst firing and transmitter release in rat mesolimbic dopamine neurons studied in vivo. Neuroscience Letters, 157, 53-56.
152. Nauta, W. J. H. (1971). The problem of the frontal lobe: A reinterpretation. Journal of Psychiatric Research, 8, 167-187.
153. Nieuwenhuis, S., Ridderinkhof, K. R., Blom, J., Band, G. P. H., & Kok, A. (2001). Error-related potentials are differentially related to awareness of response errors: Evidence from an antisaccade task. Psychophysiology, 38, 752-760.
154. Niki, H. (1982). Reward-related and error-related neurons in the primate frontal cortex. In S. Saito & T. Yanagita (Eds.). Learning and memory drugs as reinforcer (pp. 22-34). Amsterdam: Excerpta Medica.
155. Niki, H., & Watanabe, M. (1979). Prefrontal and cingulate unit activity during timing behavior in the monkey. Brain Research, 171, 213-224.
156. Nishijo, H., Yamamoto, Y., Ono, T., Uwano, T., Yamashita, J., & Yamashima, T. (1997). Single neuron responses in monkey anterior cingulate cortex during visual discrimination. Neuroscience Letters, 227, 79-82.
157. Norman, D. A., & Shallice, T. (1986). Attention to action: Willed and automatic control of behavior. In R. J. Davidson, G. E. Schwartz, & D. Shapiro (Eds.), Consciousness and self-regulation (Vol. 4. pp. 1-19). New York: Plenum Press.
158. Olds, J., & Milner, P. (1954). Positive reinforcement produced by electrical stimulation of septal area and other regions of rat brain. Journal of Comparative and Physiological Psychology, 47, 419-427.
159. O'Reilly, R. C., Noelle, D. C., Braver, T. S., & Cohen, J. D. (2002). Prefrontal cortex and dynamic categorization tasks: Representational organization and neuromodulatory control. Cerebral Cortex, 12, 246-257.
160. Otani, S., Blond, O., Desce, J.-M., & Crepel, F. (1998). Dopamine facilitates long-term depression of glutamatergic transmission in rat prefrontal cortex. Neuroscience, 85, 669-676.
161. Owen, A. M. (1997). The functional organization of working memory processes within human lateral frontal cortex: The contribution of functional neuroimaging. European Journal of Neuroscience, 9, 1329-1339.
162. Pandya, D. N., Van Hoesen, G. W., & Mesulam, M. M. (1981). Efferent connections of the cingulate gyrus in the monkey. Experimental Brain Research, 42, 319-330.
163. Paus, T., Petrides, M., Evans, A. C., & Meyer, E. (1993). Role of the human anterior cingulate cortex in the control of oculomotor, manual, and speech responses: A positron emission tomography study. Journal of Neurophysiology, 70, 453-462.
164. Paus, T., Tomaiuolo, F., Otaky, N., MacDonald, D., Petrides, M., Atlas, J., et al. (1996). Human cingulate and paracingulate sulci: Pattern, variability, asymmetry, and a probabilistic map. Cerebral Cortex, 6, 207-214.
165. Pennartz, C. M. A. (1996). The ascending neuromodulatory systems in learning by reinforcement: Comparing computational conjectures with experimental findings. Brain Research Reviews, 21, 219-245.
166. Petersen, S. E., Fox, P. T., Posner, M. I., Mintun, M., & Raichle, M. E. (1989). Positron emission tomographic studies of the processing of single words. Journal of Cognitive Neuroscience, 1, 153-170.
167. Phillips, A. G., & Fibiger, H. C. (1989). Neuroanatomical bases of intracranial self-stimulation: Untangling the Gordian knot. In J. M. Leibmen & J. J. Cooper (Eds.), The neuropharmacological basis of reward (pp. 66-105). New York: Oxford University Press.
168. Phillips, A. G., Pfaus, J. G., & Blaha, C. D. (1991). Dopamine and motivated behavior: Insights provided by in vivo analyses. In P. Willner & J. Scheel-Kruger (Eds.), The mesolimbic dopamine system: From motivation to action (pp. 199-224). New York: Wiley.
169. Picard, N., & Strick. P. L. (1996). Motor areas of the medial wall: A review of their location and functional activation. Cerebral Cortex, 6, 342-353.
170. Picton, T. W., Stuss, D. T., & Marshall, K. C. (1986). Attention and the brain. In S. L. Friedman, K. A. Klivingston, & R. W. Peterson (Eds.), The brain, cognition, and education (pp. 19-79). Orlando, FL: Academic Press.
171. Pirot, S., Glowinski, J., & Thierry, A.-M. (1996). Mediodorsal thalamic evoked responses in the rat prefrontal cortex: Influence of the mesocortical DA system. Neuroreport, 7, 1437-1441.
172. Pirot, S., Godbout, R., Mantz, J., Tassin, J.-P., Glowinski, J., & Thierry. A.-M. (1992). Inhibitory effects of ventral tegmental area stimulation on the activity of prefrontal cortical neurons: Evidence for the involvement of both dopaminergic and gabaergic components. Neuroscience 49 857-865.
173. Porrino, L. J. (1993). Cortical mechanisms of reinforcement. In B. A. Vogt & M. Gabriel (Eds.), Neurobiology of cingulate cortex and limbic thalamus: A comprehensive handbook (pp. 445-460). Boston: Birkhauser.
174. Porrino, L. J., Esposito. R. U., Seeger, T. F., Crane, A. M., Pert, A., & Sokoloff, L. (1984, April 20). Metabolic mapping of the brain during rewarding self-stimulation. Science, 224, 306-309.
175. Posner, M. I., & DiGirolamo, G. J. (1998). Executive attention: Conflict, target detection, and cognitive control. In R. Parasuraman (Ed.), The attentive brain (pp. 401-423). Cambridge, MA: MIT Press.
176. Posner, M. I., Petersen, S. E., Fox, P. T., & Raichle, M. E. (1988, June 17). Localization of cognitive operations in the human brain. Science, 240 1627-1631.
177. Posner, M. I., & Raichle, M. E. (1994). Images of mind. New York: Scientific American Library.
178. Pratt, W. E., & Mizumori, S. J. Y. (2001). Neurons in rat medial prefrontal cortex show anticipatory rate changes to predictable differential rewards in a spatial memory task. Behavioral Brain Research, 123, 165-183.
179. Procyk, E., Tanaka, Y. L., & Joseph, J. P. (2000). Anterior cingulate activity during routine and non-routine sequential behaviors in macaques. Nature Neuroscience, 3, 502-508.
180. Raichle, M. E., Fiez. J. A., Videen, T. O., MacLeod, A.-M. K., Pardo, J. V., Fox, P. T., & Petersen, S. E. (1994). Practice-related changes in human brain functional anatomy during non-motor learning. Cerebral Cortex 4 8-26.
181. Rapoport, J. L., & Wise, S. P. (1988). Obsessive-compulsive disorder: Evidence for basal ganglia dysfunction. Psychopharmacologv Bulletin, 24, 380-384.
182. Reader, T. A., Ferron, A., Descarries, L., & Jasper, H. H. (1979). Modulatory role for biogenic amines in the cerebral cortex: Microiontophoretic studies. Brain Research, 160, 217-229.
183. Redgrave, P., Prescott, T. J., & Gurney, K. (1999). Is the short-latency dopamine response too short to signal reward error? Trends in Neurosciences, 22, 146-151.
184. Rescorla, R. A., & Wagner, A. R. (1972). A theory of Pavlovian conditioning: Variations in the effectiveness of reinforcement and nonreinforcement. In A. H. Black & W. F. Prokasy (Eds.), Classical conditioning II: Current research and theory (pp. 64-99). New York: Appleton-Century-Crofts.
185. Richardson, N. R., & Gratton, A. (1996). Behavior-relevant changes in nucleus accumbens dopamine transmission elicited by food reinforcement: An electrochemical study in the rat. Journal of Neuroscience, 16, 8160-8169.
186. Richardson, N. R., & Gratton, A. (1998). Changes in medial prefrontal cortical dopamine levels associated with response-contingent food reward: An electrochemical study in rat. Journal of Neuroscience 18 9130-9138.
187. Robbins, T. W., & Everitt, B. J. (1996). Neurobehavioral mechanisms of reward and motivation. Current Opinion in Neurobiology, 6, 228-236.
188. Rogers, R. O., Owen, A. M., Middleton, H. C., Williams, E. J., Pickard, J. D., Sahakian, B. J., & Robbins, T. W. (1999). Choosing between small, likely rewards and large, unlikely rewards activates inferior and orbital prefrontal cortex. Journal of Neuroscience, 19, 9029-9038.
189. Rolls, E. T., Hornak, J., Wade, D., & McGrath, J. (1994). Emotion-related learning in patients with social and emotional changes associated with frontal lobe damage. Journal of Neurology, Neurosurgery, and Psychiatry, 57, 1518-1524.
190. Rosenkilde, C. E., Bauer, R. H., & Fuster, J. M. (1981). Single cell activity in ventral prefrontal cortex of behaving monkeys. Brain Research, 209 375-394.
191. Routtenberg, A., & Sloan, M. (1972). Self-stimulation in the frontal cortex of rattus norvegicus. Behavioral Biology, 7, 567-572.
192. Sawaguchi, T. (1995). The role of dopamine in frontal motor cortical functions of monkeys. In M. Kimura & A. M. Graybiel (Eds.), Functions of the cortical-basal ganglia loop (pp. 166-188). Tokyo: Springer-Verlag.
193. Sawaguchi, T., & Goldman-Rakic, P. S. (1991. February 22). D1 dopamine receptors in prefrontal cortex: Involvement in working memory. Science, 251, 947-950.
194. Sawaguchi, T., & Matsumura, M. (1985). Laminar distributions of neurons sensitive to acetylcholine, noradrenaline, and dopamine in the dorsolateral prefrontal cortex of the monkey. Neuroscience Research, 2, 255-273.
195. Sawaguchi, T., Matsumura, M., & Kubota, K. (1986). Catecholamine sensitivities of motor cortical neurons of the monkey. Neuroscience Letters, 66, 135-140.
196. Scheffers, M. K. (1999). Performance monitoring: Error detection and the error-related negativity in choice-reaction time tasks. Doctoral dissertation. University of Illinois at Urbana-Champaign.
197. Scherg, M. (1990). Fundamentals of dipole source potential analysis. In F. Grandori, M. Hoke, & G. L. Romani (Eds.), Auditor evoked magnetic fields and electric potentials (pp. 40-69). Basel, Switzerland: Karger.
198. Scherg, M., & Picton, T. W. (1991). Separation and identification of event-related potential components by brain electric source analysis. In C. H. M. Brunia, G. Mulder, & M. N. Verbaten (Eds.), Event-related brain research (EEC suppl. 42) (pp. 24-37). Amsterdam: North-Holland/Elsevier.
199. Schneider, J. S., & Kovelowski, C. J., II. (1990). Chronic exposure to low doses of MPTP: I. Cognitive deficits in motor asymptomatic monkeys. Brain Research, 519, 122-128.
200. Schultz, W. (1997). Dopamine neurons and their role in reward mechanisms. Current Opinion in Neurobiology, 7, 191-197.
201. Schultz, W. (1998). Predictive reward signal of dopamine neurons. Journal of Neurophysiology, 80, 1-27.
202. Schultz, W., Apicella, P., & Ljungberg, T. (1993). Responses of monkey dopamine neurons to reward and conditioned stimuli during successive steps of learning a delayed response task. Journal of Neuroscience, 13, 900-913.
203. Schultz, W., Dayan, P., & Montague, P. R. (1997, March 14). A neural substrate of prediction and reward. Science, 275, 1593-1599.
204. Schultz, W., Romo, R., Ljungberg, T., Mirenowicz, J., Hollerman, J. R., & Dickinson, A. (1995). Reward-related signals carried by dopamine neurons. In J. Houk, J. Davis, & D. Beiser (Eds.), Models of information processing in the basal ganglia (pp. 233-248). Cambridge. MA: MIT Press.
205. Servan-Schreiber, D., Printz, H., & Cohen, J. D. (1990, August 24). A network model of catecholamine effects: Gain, signal-to-noise ratio, and behavior. Science, 249, 892-895.
206. Shepherd, G. M. (1988). A basic circuit of cortical organization. In M. Gazzaniga (Ed.), Perspectives in memory research (pp. 93-134). Cambridge, MA: MIT Press.
207. Shepherd, G. M., Woolf, T. B., & Carnevale, N. T. (1989). Comparisons between active properties of distal dendritic branches and spines: Implications for neuronal computations. Journal of Cognitive Neuroscience, 1, 273-286.
208. Shima, K., & Tanji, J. (1998, November 13). Role for cingulate motor area cells in voluntary movement selection based on reward. Science, 282, 1335-1338.
209. Simon, H., Scatton, B., & Le Moal, M. (1980, July 10). Dopaminergic A10 neurones are involved in cognitive functions. Nature, 286, 150-151.
210. Slachevsky, A., Pillon, B., Fourneret, P., Pradat-Diehl, P., Jeannerod, M., & Dubois, B. (2001). Preserved adjustment but impaired awareness in a sensory motor conflict following prefrontal lesions. Journal of Cognitive Neuroscience, 13, 332-340.
211. Smiley, J. F., Williams, S. M., Szigeti, K., & Goldman-Rakic, P. S. (1992). Light and electron microscopic characterization of dopamine-immunoreactive axons in human cerebral cortex. Journal of Comparative Neurology, 321, 325-335.
212. Smith, A. D., & Bolam, J. P. (1990). The neural network of the basal ganglia as revealed by the study of synaptic connections of identified neurones. Trends in Neurosciences, 13, 259-265.
213. 14C] deoxyglucose method for the measurement of local cerebral glucose utilization: Theory, procedure, and normal values in the conscious and anesthetized albino rat. Journal of Neurochemistry, 28, 897-916.
214. Speckmann, E.-J., & Elger, C. E. (1982). Neurophysiological basis of the EEG and of DC potentials. In E. Niedermeyer & F. Lopez da Silva (Eds.), Electroencephalography: Basic principles, clinical applications, and related fields (pp. 1-13). Baltimore: Urban & Schwarzenberg.
215. Steinmetz, H., Furst, G., & Meyer, B.-U. (1989). Craniocerebral topography within the international 10-20 system. Electroencephalography and Clinical Neurophysiology, 72, 499-506.
216. Stuphorn, V., Taylor, T. L., & Schall, J. D. (2000, December 14). Performance monitoring by the supplementary eye field. Nature, 408, 857-860.
217. Stuss, D. T., & Benson, D. F. (1986). The frontal lobes. New York: Raven Press.
218. Suri, R. E., Bargas. J., & Arbib, M. A. (2001). Modeling functions of striatal dopamine modulation in learning and planning. Neuroscience, 103, 65-85.
219. Suri, R. E., & Schultz, W. (1998). Learning of sequential movements by neural network model with dopamine-like reinforcement. Experimental Brain Research, 121, 350-354.
220. Suri, R. E., & Schultz, W. (1999). A neural network model with dopamine-like reinforcement signal that learns a spatial delayed response task. Neuroscience, 91, 871-890.
221. Suri, R. E., & Schultz, W. (2001). Temporal difference model reproduces anticipatory neural activity. Neural Computation, 13, 841-862.
222. Sutton, R. S. (1988). Learning to predict by the methods of temporal differences. Machine Learning, 3, 9-44.
223. Sutton, R. S., & Barto, A. G. (1990). Time-derivative models of Pavlovian reinforcement. In M. Gabriel & J. Moore (Eds.), Learning and computational neuroscience: Foundations of adaptive networks (pp. 497-537). Cambridge, MA: MIT Press.
224. Sutton, R. S., & Barto, A. G. (1998). Reinforcement learning: An introduction. Cambridge, MA: MIT Press.
225. Svensson, T. H., & Tung, C.-S. (1989). Local cooling of pre-frontal cortex induces pacemaker-like firing of dopamine neurons in rat tegmental area in vivo. Acta Physiologica Scandinavica, 136, 135-136.
226. Swedo, S. E., Schapiro, M. B., Grady, C. L., Cheslow, D. L., Leonard, H. L., Kumar, A., et al. (1989). Cerebral glucose metabolism in childhood-onset obsessive-compulsive disorder. Archives of General Psychiatry, 46, 518-523.
227. Takenouchi, K., Nishijo, H., Uwano, T., Tamura, R., Takigawa, M., & Ono, T. (1999). Emotional and behavioral correlates of the anterior cingulate cortex during associative learning in rats. Neuroscience, 93, 1271-1287.
228. Taylor, C., Freeman. J. H., Jr., Holt, W., & Gabriel, M. (1997). Prenatal exposure to cocaine impairs anterior cingulate cortical neuronal activity and learning in rabbits. Society for Neuroscience Abstracts, 23, 262.
229. Taylor, J. R., Elsworth, J. D., Roth, R. H., Sladek, J. R., & Redmond, D. E., Jr. (1990).Cognitive and motor deficits in the acquisition of an object retrieval/detour task in MPTP-treated monkeys. Brain, 113, 617-637.
230. Tesauro, G. (1994). TD-gammon, a self-teaching backgammon program, achieves master-level play. Neural Computation, 6, 215-219.
231. Thorndike, E. L. (1970). Laws and hypotheses for behavior. In E. L. Thorndike, Animal intelligence (pp. 241-281). Darien, CT: Hafner Publishing Co. (Original work published 1911)
232. Thorpe, S. J., & Imbert, M. (1989). Biological constraints on connectionist modelling. In R. Pfeifer, Z. Schreter, F. Fogelman-Soulie. & L. Steels (Eds.), Connectionism in perspective (pp. 63-92). Amsterdam: North-Holland/Elsevier Science.
233. Thorpe, S. J., Rolls, E. T., & Maddison, S. (1983). The orbitofrontal cortex: Neuronal activity in the behaving monkey. Experimental Brain Research, 49. 93-115.
234. Tong, Z.-Y., Overton, P. G., & Clark, D. (1996). Stimulation of the prefrontal cortex in the rat induces patterns of activity in midbrain dopaminergic neurons which resemble natural burst events. Synapse, 22, 195-208.
235. Toni, I., & Passingham, R. E. (1999). Prefrontal-basal ganglia pathways are involved in the learning of arbitrary visuomotor associations: A PET study. Experimental Brain Research, 127, 19-32.
236. Tremblay, L., & Schultz, W. (1999. April 22). Relative reward preference in primate orbitofrontal cortex. Nature, 398, 704-708.
237. Turken, A. U., & Swick, D. (1999). Response selection in the human anterior cingulate cortex. Nature Neuroscience, 2, 920-924.
238. Ullsperger, M., & von Cramon, D. Y. (2001 ). Subprocesses of performance monitoring: A dissociation of error processing and response competition revealed by event-related fMRI and ERPs. Neurolmage, 14, 1387-1401.
239. Van Hoesen, G. W., Morecraft. R. J., & Vogt, B. A. (1993). Connections of the monkey cingulate cortex. In B. A. Vogt & M. Gabriel (Eds.), Neurobiology of cingulate cortex and limbic thalamus: A comprehensive handbook (pp. 249-284). Boston: Birkhauser.
240. Van 't Ent, D., & Apkarian, P. (1999). Motoric response inhibition in finger movement and saccadic eye movement: A comparative study. Clinical Neurophysiology, 110, 1058-1072.
241. Verney, C., Alvarez, C., Geffard, M., & Berger, B. (1990). Ultrastructural double-labelling study of dopamine terminals and GABA-containing neurons in rat anteromedial cerebral cortex. European Journal of Neuroscience, 2, 960-972.
242. Vidal, F., Hasbroucq, T., Grapperon, J., & Bonnet, M. (2000). Is the "error negativity" specific to errors? Biological Psychology, 51, 109-128.
243. Vogt, B. A. (1993). Structural organization of cingulate cortex: Areas, neurons, and somatodendritic transmitter receptors. In B. A. Vogt & M. Gabriel (Eds.), Neurobiology of cingulate cortex and limbic thalamus: A comprehensive handbook (pp. 19-70). Boston: Birkhauser.
244. Vogt, B. A., & Gorman, A. L. F. (1982). Responses of cortical neurons to stimulation of corpus callosum in vitro. Journal of Neurophysiology, 48, 1257-1273.
245. Vogt, B. A., Nimchinsky, E. A., Vogt, L. J., & Hof, P. R. (1995). Human cingulate cortex: Surface features, flat maps, and cytoarchitecture. Journal of Comparative Neurology, 359, 490-506.
246. Vogt, B. A., Sikes, R. W., & Vogt, L. J. (1993). Anterior cingulate cortex and the medial pain system. In B. A. Vogt & M. Gabriel (Eds.), Neurobiology of cingulate cortex and limbic thalamus: A comprehensive handbook (pp. 313-344). Boston: Birkhauser.
247. Waelti, P., Dickinson, A., & Schultz, W. (2001, July 5). Dopamine responses comply with basic assumptions of formal learning theory. Nature, 412, 43-48.
248. Watanabe, M. (1989). The appropriateness of behavioral responses coded in post-trial activity of primate prefrontal units. Neuroscience Letters 101, 113-117.
249. Whitehead, S., Karlsson, J., & Tenenberg, J. (1993). Learning multiple goal behavior via task decomposition and dynamic policy merging. In J. H. Connell & S. Mahadevan (Eds.), Robot learning (pp. 45-78). Boston: Kluwer Academic Publishers.
250. Wickelgren, I. (1997, October 3). Getting the brain's attention. Science 278, 35-37.
251. Wickens, J. (1990). Striatal dopamine in motor activation and reward-mediated learning: Steps toward a unifying model. Journal of Neural Transmission, 80, 9-31.
252. Wickens, J. R., Begg, A. J., & Arbuthnott, G. W. (1996). Dopamine reverses the depression of rat corticostriatal synapses which normally follows high-frequency stimulation of cortex in vitro. Neuroscience 70 1-5.
253. Wickens, J., & Kotter, R. (1995). Cellular models of reinforcement. In J. Houk, J. Davis, & D. Beiser (Eds.), Models of information processing in the basal ganglia (pp. 187-214). Cambridge, MA: MIT Press.
254. Wilkinson, L. S., Humby, T., Killcross, A. S., Torres, E. M., Everitt, B. J., & Robbins, T. W. (1998). Dissociations in dopamine release in medial prefrontal cortex and ventral striatum during the acquisition and extinction of classical aversive conditioning in the rat. European Journal of Neuroscience, 10, 1019-1026.
255. Williams, G. V., & Goldman-Rakic, P. S. (1995, August 17). Modulation of memory fields by dopamine D1 receptors in prefrontal cortex Nature 376, 572-575.
256. Williams, S. M., & Goldman-Rakic. P. S. (1993). Characterization of the dopaminergic innervation of the primate frontal cortex using a dopamine-specific antibody. Cerebral Cortex, 3, 199-222.
257. Wise, R. A., & Rompre, P.-P. (1989). Brain dopamine and reward. Annual Review of Psychology, 40, 191-225.
258. Wise, R. A., Spindler, J., DeWit, H., & Gerber, G. J. (1978, July 21). Neuroleptic-induced "anhedonia" in rats: Pimozide blocks reward quality of food. Science, 201, 262-264.
259. Wise, S. P., Murray, E. A., & Gerfen, C. R. (1996). The frontal cortex-basal ganglia system in primates. Critical Reviews in Neurobiology, 10, 317-356.
260. Wise, S. P., & Rapoport, J. L. (1991). Obsessive-compulsive disorder: Is it basal ganglia dysfunction? In J. L. Rapoport (Ed.), Obsessive-compulsive disorder in children and adolescents (pp. 327-344). Washington, DC: American Psychiatric Press.
261. Wolpert, D. M., & Kawato, M. (1998). Multiple paired forward and inverse models for motor control. Neural Networks, 11, 1317-1329.
262. Wood, C. (1987). Generators of event-related potentials. In A. M. Halliday, S. R. Butler, & R. Paul (Eds.), Textbook of clinical neurophysiology (pp. 535-567). New York: Wiley.
263. Yang, C. R., & Seamans, J. K. (1996). Dopamine D1 receptor actions in layers V-VI rat prefrontal cortex neurons in vitro: Modulation of dendritic-somatic signal integration. Journal of Neuroscience, 16, 1922-1935.
264. Young, A. M. J., Joseph, M. H., & Gray, J. A. (1993). Latent inhibition of conditioned dopamine release in rat nucleus accumbens. Neuroscience, 54, 5-9.
265. Zahn, J., Taylor, J. R., Mathew, R. G., & Arnsten, A. F. T. (1997). Supranormal stimulation of D1 dopamine receptors in the rodent prefrontal cortex impairs spatial working memory performance. Journal of Neuroscience, 17, 8528-8535.
266. Zald, D. H., & Kim, S. W. (1996). Anatomy and function of the orbito-frontal cortex: II. Function and relevance to obsessive-compulsive disorder. Journal of Neuropsychiatry, 8, 249-261.