Single-cell and population coding of expected reward probability in the orbitofrontal cortex of the rat

Journal of Neuroscience

Volumn 29, Issue 28, 2009, Pages 8965-8976

  Van Duuren, Esther ^a,b   Van Der Plasse, Geoffrey ^c,e   Lankelma, Jan ^a   Joosten, Ruud N J M A ^b   Feenstra, Matthijs G P ^b   Pennartz, Cyriel M A ^a,d  

^a UNIVERSITY OF AMSTERDAM   (Netherlands)

^b NETHERLANDS INSTITUTE FOR NEUROSCIENCE   (Netherlands)

^c VU UNIVERSITY MEDICAL CENTER   (Netherlands)

^d Rudolf Magnus Institute of Neuroscience ^*  (Netherlands)

^e UNIVERSITY MEDICAL CENTER UTRECHT   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

ANIMAL CELL; ANIMAL EXPERIMENT; ARTICLE; CELL POPULATION; CONTROLLED STUDY; MALE; MOVEMENT (PHYSIOLOGY); NERVE CELL; NONHUMAN; ODOR; OLFACTORY DISCRIMINATION; ORBITAL CORTEX; PRIORITY JOURNAL; PROBABILITY; RAT; REWARD; SENSORY STIMULATION; WISTAR RAT;

ACTION POTENTIALS; ANIMALS; BEHAVIOR, ANIMAL; BRAIN MAPPING; CONDITIONING, OPERANT; DECISION MAKING; DISCRIMINATION (PSYCHOLOGY); MALE; MOVEMENT; NEURONS; ODORS; OLFACTORY PATHWAYS; PREFRONTAL CORTEX; PROBABILITY; RATS; RATS, WISTAR; REWARD; STATISTICS, NONPARAMETRIC; TIME FACTORS;

EID: 67650732982     PISSN: 02706474     EISSN: 15292401     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.0005-09.2009     Document Type: Article

References (49)

1. Baeg EH, Kim YB, Huh K, Mook-Jung I, Kim HT, Jung MW (2003) Dynamics of population code for working memory in the prefrontal cortex. Neuron 40:177-188.
2. Bechara A, Tranel D, Damasio H, Damasio AR (1996) Failure to respond autonomically to anticipated future outcomes following damage to the prefrontal cortex. Cereb Cortex 6:215-225.
3. Bechara A, Damasio H, Tranel D, Damasio AR (1997) Deciding advantageously before knowing the advantageous strategy. Science 275:1293-1295.
4. Cardinal RN, Howes NJ (2005) Effects of lesions of the nucleus accumbens core on choice between small certain rewards and large uncertain rewards in rats. BMC Neurosci 6:37.
5. Critchley HD, Mathias CJ, Dolan RJ (2001) Neural activity in the human brain relating to uncertainty and arousal during anticipation. Neuron 29:537-545.
6. Daw ND, Niv Y, Dayan P (2005) Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nat Neurosci 8:1704-17011.
7. Deneve S, Latham PE, Pouget A (1999) Reading population codes: a neural implementation of ideal observers. Nat Neurosci 2:740-745.
8. Dreher JC, Kohn P, Berman KF (2006) Neural coding of distinct statistical properties of reward information in humans. Cereb Cortex 16:561-573.
9. Ernst M, Nelson EE, McClure EB, Monk CS, Munson S, Eshel N, Zarahn E, Leibenluft E, Zametkin A, Towbin K, Blair J, Charney D, Pine DS (2004) Choice selection and reward anticipation: an fMRI study. Neuropsychologia 42:1585-1597.
10. Fiorillo CD, Tobler PN, Schultz W (2003) Discrete coding of reward probability and uncertainty by dopamine neurons. Science 299:1898-1902.
11. Gothard KM, Skaggs WE, Moore KM, McNaughton BL (1996) Binding of hippocampal CA1 neural activity to multiple reference frames in a landmark-based navigation task. J Neurosci 16:823-835.
12. Gray CM, Maldonado PE, Wilson M, McNaughton B (1995) Tetrodes markedly improve the reliability and yield of multiple single-unit isolation from multi-unit recordings in cat striate cortex. J Neurosci Methods 63:43-54.
13. Hsu M, Bhatt M, Adolphs R, Tranel D, Camerer CF (2005) Neural systems responding to degrees of uncertainty in human-decision making. Science 310:1680-1683.
14. Kalenscher T, Pennartz CMA (2008) Is a bird in the hand worth two in the future? The neuroeconomics of intertemporal decision-making. Prog Neurobiol 84:284-315.
15. Kepecs A, Uchida N, Zariwala HA, Mainen ZF (2008) Neural correlates, computation and behavioural impact of decision confidence. Nature 455:227-231.
16. Knill DC, Pouget A (2004) The Bayesian brain: the role of uncertainty in neural coding and computation. Trends Neurosci 27:712-719.
17. Lehky SR, Sejnowski TJ (1990) Neural model of stereoacuity and depth interpolation based on a distributed representation of stereo disparity. J Neurosci 10:2281-2299.
18. Logothetis NK, Pauls J, Augath M, Trinath T, Oeltermann A (2001) Neurophysiological investigation of the basis of the fMRI signal. Nature 412:150-157.
19. Mobini S, Body S, Ho MY, Bradshaw CM, Szabadi E, Deakin JF, Anderson IM (2002) Effects of lesions of the orbitofrontal cortex on sensitivity to delayed and probabilistic reinforcement. Psychopharmacology 160:290-298.
20. Montague PR, Berns GS (2002) Neural economics and the biological substrates of valuation. Neuron 36:265-284.
21. Mulder AB, Nordquist RE, Orgüt O, Pennartz CM (2003) Learning-related changes in response patterns of prefrontal neurons during instrumental conditioning. Behav Brain Res 146:77-88.
22. Narayanan NS, Kimchi EY, Laubach M (2005) Redundancy and synergy of neuronal ensembles in rat motor cortex. J Neurosci 25:4207-4216.
23. O'Doherty J, Kringelbach ML, Rolls ET, Hornak J, Andrews C (2001) Abstract reward and punishment representations in the human orbitofrontal cortex. Nat Neurosci 4:95-102.
24. O'Doherty J, Critchley H, Deichmann R, Dolan RJ (2003) Dissociating valence of outcome from behavioral control in human orbital and ventral prefrontal cortices. J Neurosci 23:7931-7939.
25. Padoa-Schioppa C, Assad JA (2006) Neurons in the orbitofrontal cortex encode economic value. Nature 441:223-226.
26. Pais-Vieira M, Lima D, Galhardo V (2007) Orbitofrontal cortex lesions disrupt risk assessment in a novel serial decision-making task for rats. Neuroscience 145:225-231.
27. Paxinos G, Watson C (2005) The rat brain in stereotaxic coordinates, Ed 5. Amsterdam: Elsevier.
28. Perez-Orive J, Mazor O, Turner GC, Cassenaer S, Wilson RI, Laurent G (2002) Oscillations and sparsening of odor representations in the mushroom body. Science 297:359-365.
29. Phillipson OT (1979) Afferent projections to the ventral tegmental area of Tsai and interfascicular nucleus: a horseradish peroxidase study in the rat. J Comp Neurol 187:117-143.
30. Rachlin H, Raineri A, Cross D (1991) Subjective probability and delay. J Exp Anal Behav 55:233-244.
31. Ramus SJ, Eichenbaum H (2000) Neural correlates of olfactory recognition memory in the rat orbitofrontal cortex. J Neurosci 20:8199-8208.
32. Roesch MR, Olson CR (2004) Neuronal activity related to reward value and motivation in primate frontal cortex. Science 304:307-310.
33. Roesch MR, Taylor AR, Schoenbaum G (2006) Encoding of timediscounted reward sin orbitofrontal cortex is independent of value representation. Neuron 51:509-520.
34. Rogers RD, Owen AM, Middleton HC, Williams EJ, Pickard JD, Sahakian BJ, Robbins TW (1999) Choosing between small, likely rewards and large, unlikely rewards activates inferior and orbital prefrontal cortex. J Neurosci 19:9029-9038.
35. Rolls ET, Tovee MJ (1995) Sparseness of the neuronal representation of stimuli in the primate temporal visual cortex. J Neurophysiol 73:713-726.
36. Schoenbaum G, Chiba AA, Gallagher M (1998) Orbitofrontal cortex and basolateral amygdala encode expected outcomes during learning. Nat Naurosci 1:155-159.
37. Schultz W, Dayan P, Montague PR (1997) A neural substrate of prediction and reward. Science 275:1593-1599.
38. Schultz W, Preuschoff K, Camerer C, Hsu M, Fiorillo CD, Tobler PN, Bossaerts P (2008) Explicit neural signals reflecting reward uncertainty. Philos Trans R Soc Lond B Biol Sci 363:3801-3811.
39. Sokal RR, Rohlf FJ (1995) Biometry, Ed 3. New York: Freeman.
40. Tanaka SC, Doya K, Okada G, Ueda K, Okamoto Y, Yamawaki S (2004) Prediction of immediate and future rewards differentially recruits cortico-basal ganglia loops. Nat Neurosci 7:887-893.
41. Tobler PN, O'Doherty JP, Dolan RJ, SchultzW (2007) Reward value coding distinct from risk attitude-related uncertainty coding in human reward systems. J Neurophysiol 97:1621-1632.
42. Tremblay L, Schultz W (1999) Relative reward preference in primate orbitofrontal cortex. Nature 398:704-708.
43. Uylings HB, Groenewegen HJ, Kolb B (2003) Do rats have a prefrontal cortex? Behav Brain Res 146:3-17.
44. Van De Werd HJ, UylingsHBM (2008) The rat orbital and agranular insular prefrontal cortical area: a cytoarchitectonic and chemoarchitectonic study. Brain Struct Funct 212:387-401.
45. van Duuren E, Escámez FA, Joosten RN, Visser R, Mulder AB, Pennartz CM (2007) Neural coding of reward magnitude in the orbitofrontal cortex of the rat during a five-odor discrimination task. Learn Mem 14:446-456.
46. van Duuren E, Lankelma J, Pennartz CMA (2008) Population coding of reward magnitude in the orbitofrontal cortex of the rat. J Neurosci 28:8590-8603.
47. Voorn P, Vanderschuren LJ, Groenewegen HJ, Robbins TW, Pennartz CM (2004) Putting a spin on the dorsal-ventral divide of the striatum. Trends Neurosci 27:468-474.
48. Wu S, Amari S (2005) Computing with continuous attractors: stability and online aspects. Neural Comput 17:2215-2239.
49. Zhang K, Ginzburg I, McNaughton BL, Sejnowski TJ (1998) Interpreting neuronal population activity by reconstruction: unified framework with application to hippocampal place cells. J Neurophysiol 79:1017-1044.