Operant conditioning of primate prefrontal neurons

Journal of Neurophysiology

Volumn 103, Issue 4, 2010, Pages 1843-1855

  Kobayashi, Shunsuke ^a,b   Schultz, Wolfram ^b   Sakagami, Masamichi ^a  

^a TAMAGAWA UNIVERSITY   (Japan)

^b UNIVERSITY OF CAMBRIDGE   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ANIMAL EXPERIMENT; ARTICLE; CELL ACTIVITY; ELECTROENCEPHALOGRAM; INSTRUMENTAL CONDITIONING; KINEMATICS; MALE; MONKEY; MOTOR PERFORMANCE; NERVE CELL; NONHUMAN; PREFRONTAL CORTEX; PRIMATE; PRIORITY JOURNAL;

ANIMALS; BEHAVIOR, ANIMAL; CONDITIONING, OPERANT; MACACA; MALE; MODELS, ANIMAL; PHOTIC STIMULATION; PREFRONTAL CORTEX; PSYCHOMOTOR PERFORMANCE; REWARD; SENSORY RECEPTOR CELLS;

EID: 77951230746     PISSN: 00223077     EISSN: 15221598     Source Type: Journal    
DOI: 10.1152/jn.00173.2009     Document Type: Article

References (42)

1. Asaad WF, Rainer G, Miller EK. Task-specific neural activity in the primate prefrontal cortex. J Neurophysiol 84: 451-459, 2000.
2. Balleine BW, Dickinson A. Goal-directed instrumental action: contingency and incentive learning and their cortical substrates. Neuropharmacology 37: 407-419, 1998.
3. Carp JS, Tennissen AM, Chen XY, Wolpaw JR. H-reflex operant conditioning in mice. J Neurophysiol 96: 1718-1727, 2006.
4. Chapin JK, Moxon KA, Markowitz RS, Nicolelis MA. Real-time control of a robot arm using simultaneously recorded neurons in the motor cortex. Nat Neurosci 2: 664-670, 1999.
5. Engbert R, Kliegl R. Microsaccades uncover the orientation of covert attention. Vision Res 43: 1035-1045, 2003.
6. Fetz EE. Operant conditioning of cortical unit activity. Science 163: 955-958, 1969.
7. Fetz EE, Baker MA. Operantly conditioned patterns on precentral unit activity and correlated responses in adjacent cells and contralateral muscles. J Neurophysiol 36: 179-204, 1973.
8. Fuster JM. Executive frontal functions. Exp Brain Res 133: 66-70, 2000.
9. Gibbon J, Berryman R, Thompson RL. Contingency spaces and measures in classical and instrumental conditioning. J Exp Anal Behav 21: 585-605, 1974.
10. Hammond LJ. The effect of contingency upon the appetitive conditioning of free-operant behavior. J Exp Anal Behav 34: 297-304, 1980.
11. Hendry DP. The effect of correlated amount of reward on performance on a fixed-interval schedule of reinforcement. J Comp Physiol Psychol 55: 387-391, 1962.
12. Hoshi E, Shima K, Tanji J. Neuronal activity in the primary prefrontal cortex in the process of motor selection based on two behavioral rules. J Neurophysiol 83: 2355-2373, 2000.
13. Ikeda T, Hikosaka O. Positive and negative modulation of motor response in primate superior colliculus by reward expectation. J Neurophysiol 98: 3163-3170, 2007.
14. Judge SJ, Richmond BJ, Chu FC. Implantation of magnetic search coils for measurement of eye position: an improved method. Vision Res 20: 535-538, 1980.
15. Killeen PR. Incentive theory: IV. Magnitude of reward. J Exp Anal Behav 43: 407-417, 1985.
16. Kobayashi S, Lauwereyns L, Koizumi M, Sakagami M, Hikosaka O. Influence of reward expectation on visuospatial processing in macaque lateral prefrontal cortex. J Neurophysiol 87: 1488-1498, 2002.
17. Kobayashi S, Nomoto K, Watanabe M, Hikosaka O, Schultz W, Sakagami M. Influences of rewarding and aversive outcomes on activity in macaque lateral prefrontal cortex. Neuron 51: 861-870, 2006.
18. Lau B, Glimcher PW. Value representation in the primate striatum during matching behavior. Neuron 58: 451-463, 2008.
19. Lhermitte F. Human autonomy and the frontal lobes. Part II: Patient behavior in complex and social situations: the "environmental dependency syndrome." Ann Neurol 19: 335-343, 1986.
20. Luria AR. The frontal lobes and the regulation of behavior. In: Psychophysiology of the Frontal Lobes, edited by Pribram KH, Luria AR. New York: Academic Press, 1973, p. 3-28.
21. Martinez-Conde S, Macknik SL, Hubel DH. Microsaccadic eye movements and firing of single cells in the striate cortex of macaque monkeys. Nat Neurosci 3: 251-258, 2000.
22. Matsumoto K, Suzuki W, Tanaka K. Neuronal correlates of goal-based motor selection in the prefrontal cortex. Science 301: 229-232, 2003.
23. Miller EK, Cohen JD. An integrative theory of prefrontal cortex function. Annu Rev Neurosci 24: 167-202, 2001.
24. Moritz CT, Perlmutter SI, Fetz EE. Direct control of paralysed muscles by cortical neurons. Nature 456: 639-642, 2008.
25. Musallam S, Corneil BD, Greger B, Scherberger H, Andersen RA. Cognitive control signals for neural prosthetics. Science 305: 258-262, 2004.
26. Rainer G, Asaad WF, Miller EK. Selective representation of relevant information by neurons in the primate prefrontal cortex. Nature 393: 577-579, 1998.
27. Reed P. Multiple determinants of the effects of reinforcement magnitude on free-operant response rates. J Exp Anal Behav 55: 109-123, 1991.
28. Reed P, Wright JE. Effects of magnitude of food reinforcement on freeoperant response rates. J Exp Anal Behav 49: 75-85, 1988.
29. Robinson DA. A method of measuring eye movement using a scleral search coil in a magnetic field. IEEE Trans Biomed Eng 10: 137-145, 1963.
30. Roesch MR, Olson CR. Neuronal activity related to reward value and motivation in primate frontal cortex. Science 304: 307-310, 2004.
31. Rossi AF, Pessoa L, Desimone R, Ungerleider LG. The prefrontal cortex and the executive control of attention. Exp Brain Res 192: 489-497, 2008.
32. Sakagami M, Niki H. Encoding of behavioral significance of visual stimuli by primate prefrontal neurons: relation to relevant task conditions. Exp Brain Res 97: 423-436, 1994.
33. Sakagami M, Pan X. Functional role of the ventrolateral prefrontal cortex in decision making. Curr Opin Neurobiol 17: 228-233, 2007. (Pubitemid 46584799)
34. Samejima K, Ueda Y, Doya K, Kimura M. Representation of action-specific reward values in the striatum. Science 310: 1337-1340, 2005.
35. Skinner BF. The Behavior of Organisms: An Experimental Analysis. Acton, MA: Copley, 1938.
36. Tanaka SC, Balleine BW, O'Doherty JP. Calculating consequences: brain systems that encode the causal effects of actions. J Neurosci 28: 6750-6755, 2008.
37. Tanji J, Hoshi E. Role of the lateral prefrontal cortex in executive behavioral control. Physiol Rev 88: 37-57, 2008.
38. Taylor DM, Tillery SI, Schwartz AB. Direct cortical control of 3D neuroprosthetic devices. Science 296: 1829-1832, 2002.
39. Thorndike EL. Animal Intelligence: Experimental Studies. New York: Macmillan, 1911.
40. Tricomi EM, Delgado MR, Fiez JA. Modulation of caudate activity by action contingency. Neuron 41: 281-292, 2004.
41. Vendrell P, Junqué C, Pujol J, Jurado MA, Molet J, Grafman J. The role of prefrontal regions in the Stroop task. Neuropsychologia 33: 341-352, 1995.
42. Wise SP. Forward frontal fields: phylogeny and fundamental function. Trends Neurosci 31: 599-608, 2008.