Reward cues in space: Commonalities and differences in neural coding by hippocampal and ventral striatal ensembles

Journal of Neuroscience

Volumn 32, Issue 36, 2012, Pages 12444-12459

  Lansink, Carien S ^a   Jackson, Jadin C ^a,b   Lankelma, Jan V ^a   Ito, Rutsuko ^c   Robbin, Trevor W ^d   Everitt, Barry J ^d   Pennartz, Cyriel M A ^a  

^a UNIVERSITY OF AMSTERDAM   (Netherlands)

^b UNIVERSITY OF ST THOMAS   (United States)

^c UNIVERSITY OF TORONTO   (Canada)

^d UNIVERSITY OF CAMBRIDGE   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ANIMAL EXPERIMENT; ANIMAL TISSUE; ARTICLE; ASSOCIATION; BEHAVIOR; CONDITIONED REFLEX; CONDITIONING; CORPUS STRIATUM; ELECTRODE; GOAL ATTAINMENT; HABITUATION; HIPPOCAMPUS; MALE; MAZE TEST; NONHUMAN; ORIENTING RESPONSE; PLACE PREFERENCE; PRIORITY JOURNAL; RAT; REWARD; RUNNING; SPIKE WAVE; TRAINING;

ACTION POTENTIALS; ANIMALS; BASAL GANGLIA; CUES; HIPPOCAMPUS; MALE; NEURONS; RATS; RATS, WISTAR; REWARD; SPATIAL BEHAVIOR;

EID: 84865776542     PISSN: 02706474     EISSN: 15292401     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.0593-12.2012     Document Type: Article

References (61)

1. Aggleton JP, Petrides M, Iversen SD (1981) Differential effects of amygdaloid lesions on conditioned taste aversion learning by rats. Physiol Behav 27:397-400.
2. Alexander GE, Crutcher MD, DeLong MR (1990) Basal gangliathalamocortical circuits: parallel substrates for motor, oculomotor, "prefrontal" and "limbic" functions. Prog Brain Res 85:119-146.
3. Annett LE, McGregor A, Robbins TW (1989) The effects of ibotenic acid lesions of the nucleus accumbens on spatial learning and extinction in the rat. Behav Brain Res 31:231-242.
4. Balleine BW, Dickinson A (1998) Goal-directed instrumental action: contingency and incentive learning and their cortical substrates. Neuropharmacology 37:407-419.
5. Berke JD, Breck JT, Eichenbaum H (2009) Striatal versus hippocampal representations during win-stay maze performance. J Neurophysiol 101:1575-1587.
6. Birrell JM, Brown VJ (2000) Medial frontal cortex mediates perceptual attentional set shifting in the rat. J Neurosci 20:4320-4324.
7. Buzsáki G (1986) Hippocampal sharp waves: their origin and significance. Brain Res 398:242-252.
8. Buzsáki G (1989) Two-stage model of memory trace formation: a role for "noisy" brain states. Neuroscience 31:551-570.
9. Cardinal RN, Parkinson JA, Hall J, Everitt BJ (2002) Emotion and motivation: the role of the amygdala, ventral striatum, and prefrontal cortex. Neurosci Biobehav Rev 26:321-352.
10. Carr GD, White NM (1983) Conditioned place preference from intraaccumbens but not intra-caudate amphetamine injections. Life Sci 33:2551-2557.
11. Cromwell HC, Schultz W (2003) Effects of expectations for different reward magnitudes on neuronal activity in primate striatum. J Neurophysiol 89:2823-2838.
12. Everitt BJ, Cador M, Robbins TW (1989) Interactions between the amygdala and ventral striatum in stimulus-reward associations: studies using a second-order schedule of sexual reinforcement. Neuroscience 30:63-75.
13. Fenton AA, Lytton WW, Barry JM, Lenck-Santini PP, Zinyuk LE, Kubík S, Bures J, Poucet B, Muller RU, Olypher AV (2010) Attention-like modulation of hippocampus place cell discharge. J Neurosci 30:4613-4625.
14. Fuchs RA, Evans KA, Parker MC, See RE (2004) Differential involvement of the core and shell subregions of the nucleus accumbens in conditioned cue-induced reinstatement of cocaine seeking in rats. Psychopharmacology (Berl) 176:459-465.
15. Fyhn M, Hafting T, Treves A, Moser MB, Moser EI (2007) Hippocampal remapping and grid realignment in entorhinal cortex. Nature 446:190-194.
16. Gray CM, Maldonado PE, Wilson M, McNaughton B (1995) Tetrodes markedly improve the reliability and yield of multiple single-unit isolation from multi-unit recordings in cat striate cortex. J Neurosci Methods 63:43-54.
17. Groenewegen HJ, Vermeulen-Vander Zee E, te Kortschot A, Witter MP (1987) Organization of the projections from the subiculum to the ventral striatum in the rat. A study using anterograde transport of Phaseolus vulgaris leucoagglutinin. Neuroscience 23:103-120.
18. Hafting T, Fyhn M, Molden S, Moser MB, Moser EI (2005) Microstructure of a spatial map in the entorhinal cortex. Nature 436:801-806.
19. Ito R, Robbins TW, McNaughton BL, Everitt BJ (2006) Selective excitotoxic lesions of the hippocampus and basolateral amygdala have dissociable effects on appetitive cue and place conditioning based on path integration in a novel Y-maze procedure. Eur J Neurosci 23:3071-3080.
20. Ito R, Robbins TW, Pennartz CM, Everitt BJ (2008) Functional interaction between the hippocampus and nucleus accumbens shell is necessary for the acquisition of appetitive spatial context conditioning. J Neurosci 28:6950-6959.
21. Jog MS, Kubota Y, Connolly CI, Hillegaart V, Graybiel AM (1999) Building neural representations of habits. Science 286:1745-1749.
22. Kim JJ, Fanselow MS (1992) Modality-specific retrograde amnesia of fear. Science 256:675-677.
23. Kjelstrup KB, Solstad T, Brun VH, Hafting T, Leutgeb S, Witter MP, Moser EI, Moser MB (2008) Finite scale of spatial representation in the hippocampus. Science 321:140-143.
24. Lansink CS, Bakker M, Buster W, Lankelma J, van der Blom R, Westdorp R, Joosten RN, McNaughton BL, Pennartz CM (2007) A split microdrive for simultaneous multi-electrode recordings from two brain areas in awake small animals. J Neurosci Methods 162:129-138.
25. Lansink CS, Goltstein PM, Lankelma JV, Joosten RN, McNaughton BL, Pennartz CM (2008) Preferential reactivation of motivationally relevant information in the ventral striatum. J Neurosci 28:6372-6382.
26. Lansink CS, Goltstein PM, Lankelma JV, McNaughton BL, Pennartz CM (2009) Hippocampus leads ventral striatum in replay of place-reward information. PLoS Biol 7:e1000173.
27. Lansink CS, Goltstein PM, Lankelma JV, Pennartz CM (2010) Fast-spiking interneurons of the rat ventral striatum: temporal coordination of activity with principal cells and responsiveness to reward. Eur J Neurosci 32:494-508.
28. Lavoie AM, Mizumori SJ (1994) Spatial, movement-and reward-sensitive discharge by medial ventral striatum neurons of rats. Brain Res 638:157-168.
29. Leutgeb JK, Leutgeb S, Moser MB, Moser EI (2007) Pattern separation in the dentate gyrus and CA3 of the hippocampus. Science 315:961-966.
30. Leutgeb S, Leutgeb JK, Treves A, Moser MB, Moser EI (2004) Distinct ensemble codes in hippocampal areas CA3 and CA1. Science 305:1295-1298.
31. Leutgeb S, Leutgeb JK, Barnes CA, Moser EI, McNaughton BL, Moser MB (2005) Independent codes for spatial and episodic memory in hippocampal neuronal ensembles. Science 309:619-623.
32. Markus EJ, Qin YL, Leonard B, Skaggs WE, McNaughton BL, Barnes CA (1995) Interactions between location and task affect the spatial and directional firing of hippocampal neurons. J Neurosci 15:7079-7094.
33. McNaughton BL, Barnes CA, O'Keefe J (1983) The contributions of position, direction, and velocity to single unit activity in the hippocampus of freely-moving rats. Exp Brain Res 52:41-49.
34. McNaughton BL, Barnes CA, Gerrard JL, Gothard K, Jung MW, Knierim JJ, Kudrimoti H, Qin Y, Skaggs WE, Suster M, Weaver KL (1996) Deciphering the hippocampal polyglot: the hippocampus as a path integration system. J Exp Biol 199:173-185.
35. McNaughton BL, Battaglia FP, Jensen O, Moser EI, Moser MB (2006) Path integration and the neural basis of the 'cognitive map'. Nat Rev Neurosci 7:663-678.
36. Mulder AB, Hodenpijl MG, Lopes da Silva FH (1998) Electrophysiology of the hippocampal and amygdaloid projections to the nucleus accumbens of the rat: convergence, segregation, and interaction of inputs. J Neurosci 18:5095-5102.
37. Mulder AB, Shibata R, Trullier O, Wiener SI (2005) Spatially selective reward site responses in tonically active neurons of the nucleus accumbens in behaving rats. Exp Brain Res 163:32-43.
38. Muller RU, Kubie JL (1987) The effects of changes in the environment on the spatial firing of hippocampal complex-spike cells. J Neurosci 7:1951-1968.
39. O'Keefe J (2006) Hippocampal physiology in the behaving animal. In: The hippocampus book. (Andersen P, Morris RG, Amaral DG, Bliss T, O'Keefe J, eds), pp 475-548. New York: Oxford UP.
40. O'Keefe J, Dostrovsky J (1971) The hippocampus as a spatial map. Preliminary evidence from unit activity in the freely-moving rat. Brain Res 34:171-175.
41. O'Keefe J, Nadel L (1978) The hippocampus as a cognitive map: Oxford: Clarendon.
42. Paxinos G, Watson C (1986) The rat brain in stereotaxic coordinates, Ed 2. New York: Academic.
43. Pennartz CM, Groenewegen HJ, Lopes da Silva FH (1994) The nucleus accumbens as a complex of functionally distinct neuronal ensembles: an integration of behavioural, electrophysiological and anatomical data. Prog Neurobiol 42:719-761.
44. Pennartz CM, Lee E, Verheul J, Lipa P, Barnes CA, McNaughton BL (2004) The ventral striatum in off-line processing: ensemble reactivation during sleep and modulation by hippocampal ripples. J Neurosci 24:6446-6456.
45. Pennartz CM, Ito R, Verschure PF, Battaglia FP, Robbins TW (2011) The hippocampal-striatal axis in learning, prediction and goal-directed behavior. Trends Neurosci 34:548-559.
46. Riedel G, Harrington NR, Hall G, Macphail EM (1997) Nucleus accumbens lesions impair context, but not cue, conditioning in rats. Neuroreport 8:2477-2481.
47. Roitman MF, Wheeler RA, Carelli RM (2005) Nucleus accumbens neurons are innately tuned for rewarding and aversive taste stimuli, encode their predictors, and are linked to motor output. Neuron 45:587-597.
48. Schultz W, Apicella P, Scarnati E, Ljungberg T (1992) Neuronal activity in monkey ventral striatum related to the expectation of reward. J Neurosci 12:4595-4610.
49. Seamans JK, Phillips AG (1994) Selective memory impairments produced by transient lidocaine-induced lesions of the nucleus accumbens in rats. Behav Neurosci 108:456-468.
50. Sharp PE (1997) Subicular cells generate similar spatial firing patterns in two geometrically and visually distinctive environments: comparison with hippocampal place cells. Behav Brain Res 85:71-92.
51. Shibata R, Mulder AB, Trullier O, Wiener SI (2001) Position sensitivity in phasically discharging nucleus accumbens neurons of rats alternating between tasks requiring complementary types of spatial cues. Neuroscience 108:391-411.
52. Skaggs WE, McNaughton BL, Gothard KM (1993) An information-theoretic approach to deciphering the hippocampal code. In: Neural information processing systems (Hanson S, Cowan J, Giles L, eds), pp 1030-1037. San Francisco: Morgan Kaufmann.
53. Sutherland RJ, Rodriguez AJ (1989) The role of the fornix/fimbria and some related subcortical structures in place learning and memory. Behav Brain Res 32:265-277.
54. van der Meer MA, Redish AD (2009) Covert expectation-of-reward in rat ventral striatum at decision points. Front Integr Neurosci 3:1.
55. van Duuren E, Escámez FA, Joosten RN, Visser R, Mulder AB, Pennartz CM (2007) Neural coding of reward magnitude in the orbitofrontal cortex of the rat during a five-odor olfactory discrimination task. Learn Mem 14:446-456.
56. Vinje WE, Gallant JL (2000) Sparse coding and decorrelation in primary visual cortex during natural vision. Science 287:1273-1276.
57. Voorn P, Vanderschuren LJ, Groenewegen HJ, Robbins TW, Pennartz CM (2004) Putting a spin on the dorsal-ventral divide of the striatum. Trends Neurosci 27:468-474.
58. Wallis JD, Anderson KC, Miller EK (2001) Single neurons in prefrontal cortex encode abstract rules. Nature 411:953-956.
59. West MO, Carelli RM, Pomerantz M, Cohen SM, Gardner JP, Chapin JK, Woodward DJ (1990) A region in the dorsolateral striatum of the rat exhibiting single-unit correlations with specific locomotor limb movements. J Neurophysiol 64:1233-1246.
60. Wilson MA, McNaughton BL (1993) Dynamics of the hippocampal ensemble code for space. Science 261:1055-1058.
61. Zhang K, Ginzburg I, McNaughton BL, Sejnowski TJ (1998) Interpreting neuronal population activity by reconstruction: unified framework with application to hippocampal place cells. J Neurophysiol 79:1017-1044.