Context, emotion, and the strategic pursuit of goals: Interactions among multiple brain systems controlling motivated behavior

Frontiers in Behavioral Neuroscience

Volumn , Issue AUGUST, 2012, Pages

  Gruber, Aaron J ^a   McDonald, Robert J ^a  

^a UNIVERSITY OF LETHBRIDGE   (Canada)

Author keywords

Amygdala; Dopamine; Emotion; Hippocampus; Inhibition; Pavlovian instrumental transfer; Reinforcement learning; Striatum

Indexed keywords

4 AMINOBUTYRIC ACID; DOPAMINE;

AFFECT; AMYGDALOID NUCLEUS; BEHAVIOR CONTROL; BIOLOGICAL MODEL; BRAIN DEPTH STIMULATION; CONTROL SYSTEM; CORPUS STRIATUM; DECISION MAKING; DISCRIMINATION LEARNING; DOPAMINE RELEASE; DOPAMINERGIC SYSTEM; EMOTION; EVOKED RESPONSE; FUNCTIONAL ANATOMY; GABAERGIC TRANSMISSION; HIPPOCAMPUS; HUMAN; INSTRUMENTAL CONDITIONING; LIMBIC SYSTEM; MEMORY; MOTOR PERFORMANCE; NERVE CELL NETWORK; NERVE STIMULATION; NEUROANATOMY; NEUROMODULATION; NEUROPATHOLOGY; NONHUMAN; PLACE PREFERENCE; REINFORCEMENT; REVIEW; VENTROMEDIAL PREFRONTAL CORTEX; VISUAL DISCRIMINATION;

EID: 84865034195     PISSN: 16625153     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Review

References (365)

1. Abercrombie, E. D., Keefe, K. A., Difrischia, D. S., and Zigmond, M. J. (1989). Differential effect of stress on in vivo dopamine release in striatum, nucleus accumbens, and medial frontal cortex. J. Neurochem. 52, 1655-1658.
2. Adams, C. D., and Dickinson, A. (1981). Instrumental responding following reinforcer devaluation. Q. J. Exp. Psychol. 33, 109-122.
3. Albin, R. L., Young, A. B., and Penney, J. B. (1989). The functional anatomy of basal ganglia disorders. Trends Neurosci. 12, 366-375.
4. Alexander, G. E., Delong, M. R., and Strick, P. L. (1986). Parallel organization of functionally segre-gated circuits linking basal ganglia and cortex. Ann. Rev. Neurosci. 9, 357-381.
5. Amaral, D., and Witter, M. (1995). "Hippocampal formation, " in The Rat Nervous System, 2nd Edn. ed G. Paxinos (Sydney, NSW: Academic Press), 443-485.
6. Amaral, D. G., and Witter, M. P. (1989). The three-dimensional organization of the hippocam-pal formation: a review of anatomical data. Neuroscience 31, 571-591.
7. Ambroggi, F., Ishikawa, A., Fields, H. L., and Nicola, S. M. (2008). Basolateral amygdala neurons facilitate reward-seeking behavior by exciting nucleus accumbens neurons. Neuron 59, 648-661.
8. Antoniadis, E. A., and McDonald, R. J. (2000). Amygdala, hippocampus and discriminative fear condition-ing to context. Behav. Brain Res. 108, 1-19.
9. Aragona, B. J., Day, J. J., Roitman, M. F., Cleaveland, N. A., Wightman, R. M., and Carelli, R. M. (2009). Regional specificity in the real-time development of phasic dopamine transmission patterns during acqui-sition of a cue-cocaine associa-tion in rats. Eur. J. Neurosci. 30, 1889-1899.
10. Aron, A. R., and Poldrack, R. A. (2006). Cortical and subcortical contribu-tions to Stop signal response inhi-bition: role of the subthalamic nucleus. J. Neurosci. 26, 2424-2433.
11. Bagshaw, M. H., and Benzies, S. (1968). Multiple measures of the orienting reaction and their dissociation after amygdalectomy in monkeys. Exp. Neurol. 20, 175-187.
12. Balleine, B., and Killcross, S. (1994). Effects of ibotenic acid lesions of the nucleus accumbens on instru-mental action. Behav. Brain Res. 65, 181-193.
13. Balleine, B. W., and Dickinson, A. (1998). Goal-directed instrumen-tal action: contingency and incen-tive learning and their cortical substrates. Neuropharmacology 37, 407-419.
14. Barnes, T. D., Kubota, Y., Hu, D., Jin, D. Z., and Graybiel, A. M. (2005). Activity of striatal neurons reflects dynamic encoding and recoding of procedural memories. Nature 437, 1158-1161.
15. Bassareo, V., De Luca, M. A., and Di Chiara, G. (2002). Differential expression of motivational stimulus properties by dopamine in nucleus accumbens shell versus core and prefrontal cortex. J. Neurosci. 22, 4709-4719.
16. Bast, T. (2011). The hippocampal learning-behavior translation and the functional significance of hippocampal dysfunction in schizophrenia. Curr. Opin. Neurobiol. 21, 492-501.
17. Bast, T., and Feldon, J. (2003). Hippocampal modulation of senso-rimotor processes. Prog. Neurobiol. 70, 319-345.
18. Bast, T., Wilson, I. A., Witter, M. P., and Morris, R. G. (2009). From rapid place learning to behavioral performance: a key role for the intermediate hippocampus. PLoS Biol. 7:e1000089. doi: 10.1371/jour-nal.pbio.1000089
19. Bast, T., Zhang, W. N., and Feldon, J. (2001). The ventral hippocam-pus and fear conditioning in rats. Different anterograde amnesias of fear after tetrodotoxin inactivation and infusion of the GABA(A) ago-nist muscimol. Exp. Brain Res. 139, 39-52.
20. Bayer, H. M., and Glimcher, P. W. (2005). Midbrain dopamine neu-rons encode a quantitative reward prediction error signal. Neuron 47, 129-141.
21. Beckstead, R. M., Domesick, V. B., and Nauta, W. J. (1979). Efferent con-nections of the substantia nigra and ventral tegmental area in the rat. BrainRes. 175, 191-217.
22. Ben-Ari, Y., and Le Gal La Salle, G. (1974). Lateral amygdala unit activity: II. Habituating and non-habituating neu-rons. Electroencephalogr. Clin. Neurophysiol. 37, 463-472.
23. Benchenane, K., Peyrache, A., Khamassi, M., Tierney, P. L., Gioanni, Y., Battaglia, F. P., and Wiener, S. I. (2010). Coherent theta oscillations and reorganization of spike timing in the hippocampal-prefrontal network upon learning. Neuron 66, 921-936.
24. Bennett, B. D., and Bolam, J. P. (1994). Synaptic input and output of parvalbumin-immunoreactive neu-rons in the neostriatum of the rat. Neuroscience 62, 707-719.
25. Berke, J. D. (2008). Uncoordinated fir-ing rate changes of striatal fast-spiking interneurons during behav-ioral task performance. J. Neurosci. 28, 10075-10080.
26. Berridge, C. W., Espana, R. A., and Vittoz, N. M. (2010). Hypocretin/orexin in arousal and stress. Brain Res. 1314, 91-102.
27. Berridge, K. C., and Robinson, T. E. (1998). What is the role of dopamine in reward: hedonic impact, reward learning, or incen-tive salience? Brain Res. Brain Res. Rev. 28, 309-369.
28. Bevan, M. D., Booth, P. A., Eaton, S. A., and Bolam, J. P. (1998). Selective innervation of neostriatal interneu-rons by a subclass of neuron in the globus pallidus of the rat. J. Neurosci. 18, 9438-9452.
29. Biedenkapp, J. C., and Rudy, J. W.(2009). Hippocampal and extrahip-pocampal systems compete for con-trol of contextual fear: role of ven-tral subiculum and amygdala. Learn. Mem. 16, 38-45.
30. Birrell, J. M., and Brown, V. J. (2000). Medial frontal cortex mediates perceptual attentional set shift-ing in the rat. J. Neurosci. 20, 4320-4324.
31. Blundell, P., Hall, G., and Killcross, S. (2001). Lesions of the baso-lateral amygdala disrupt selective aspects of reinforcer represen-tation in rats. J. Neurosci. 21, 9018-9026.
32. Bolam, J. P., and Izzo, P. N. (1988). The postsynaptic targets of substance P-immunoreactive terminals in the rat neostriatum with particular refer-ence to identified spiny striatoni-gral neurons. Exp. Brain Res. 70, 361-377.
33. Bostock, E., Muller, R. U., and Kubie, J. L. (1991). Experience-dependent modifications of hippocampal place cell firing. Hippocampus 1, 193-205.
34. Braff, D. L., and Geyer, M. A. (1990). Sensorimotor gating and schizophrenia. Human and animal model studies. Arch. Gen. Psychiatry 47, 181-188.
35. Breiter, H. C., Etcoff, N. L., Whalen, P. J., Kennedy, W. A., Rauch, S. L., Buckner, R. L., Strauss, M. M., Hyman, S. E., and Rosen, B. R. (1996). Response and habituation of the human amygdala during visual processing of facial expres-sion. Neuron 17, 875-887.
36. Brischoux, F., Chakraborty, S., Brierley, D. I., and Ungless, M. A. (2009). Phasic excitation of dopamine neu-rons in ventral VTA by noxious stimuli. Proc. Natl. Acad. Sci. U.S.A. 106, 4894-4899.
37. Brog, J. S., Salyapongse, A., Deutch, A. Y., and Zahm, D. S. (1993). The patterns of afferent innerva-tion of the core and shell in the "accumbens" part of the rat ven-tral striatum: immunohistochemi-cal detection of retrogradely trans-ported fluoro-gold. J. Comp. Neurol. 338, 255-278.
38. Bromberg-Martin, E. S., Matsumoto, M., and Hikosaka, O. (2010). Dopamine in motivational control: rewarding, aversive, and alerting. Neuron 68, 815-834.
39. Brown, P. L., and Jenkins, H. M. (1968). Auto-shaping of the pigeon's key-peck. J. Exp. Anal. Behav. 11, 1-8.
40. Buzsaki, G. (2005). Theta rhythm of navigation: link between path inte-gration and landmark navigation, episodic and semantic memory. Hippocampus 15, 827-840.
41. Cador, M., Robbins, T. W., and Everitt, B. J. (1989). Involvement of the amygdala in stimulus-reward asso-ciations: interaction with the ventral striatum. Neuroscience 30, 77-86.
42. Cardinal, R. N., Parkinson, J. A., Hall, J., and Everitt, B. J. (2002a). Emotion and motivation: the role of the amygdala, ventral striatum, and prefrontal cor-tex. Neurosci. Biobehav. Rev. 26, 321-352.
43. Cardinal, R. N., Parkinson, J. A., Lachenal, G., Halkerston, K. M., Rudarakanchana, N., Hall, J., Morrison, C. H., Howes, S. R., Robbins, T. W., and Everitt, B. J. (2002b). Effects of selective excitotoxic lesions of the nucleus accumbens core, anterior cingulate cortex, and central nucleus of the amygdala on autoshaping perfor-mance in rats. Behav. Neurosci. 116, 553-567.
44. Carelli, R. M., and Deadwyler, S. A. (1994). A comparison of nucleus accumbens neuronal firing patterns during cocaine self-administration and water reinforcement in rats. J. Neurosci. 14, 7735-7746.
45. Castane, A., Theobald, D. E., and Robbins, T. W. (2010). Selective lesions of the dorsomedial striatum impair serial spatial reversal learn-ing in rats. Behav. Brain Res. 210, 74-83.
46. Cenquizca, L. A., and Swanson, L. W. (2007). Spatial organization of direct hippocampal field CA1 axonal projections to the rest of the cerebral cortex. Brain Res. Rev. 56, 1-26.
47. Chang, H. T., Wilson, C. J., and Kitai, S. T. (1982). A Golgi study of rat neostriatal neurons: light micro-scopic analysis. J. Comp. Neurol. 208, 107-126.
48. Cheer, J. F., Aragona, B. J., Heien, M. L., Seipel, A. T., Carelli, R. M., and Wightman, R. M. (2007). Coordinated accumbal dopamine release and neural activity drive goal-directed behavior. Neuron 54, 237-244.
49. Chevalier, G., and Deniau, J. M. (1990). Disinhibition as a basic process in the expression of striatal functions. Trends Neurosci. 13, 277-280.
50. Collins, A. G., and Frank, M. J. (2012). How much of reinforcement learning is working memory, not reinforcement learning? A behav-ioral, computational, and neuroge-netic analysis. Eur. J. Neurosci. 35, 1024-1035.
51. Colwill, R. M., and Rescorla, R. A. (1988). Associations between the discriminative stimulus and the reinforcer in instrumental learning. J. Exp. Psychol. Anim. Behav. Process. 14, 155-164.
52. Corbit, L. H., and Balleine, B. W. (2005). Double dissociation ofbaso-lateral and central amygdala lesions on the general and outcome-specific forms of pavlovian-instrumental transfer. J. Neurosci. 25, 962-970.
53. Corbit, L. H., and Balleine, B. W. (2011). The general and outcome-specific forms of Pavlovian-instrumental transfer are differentially mediated by the nucleus accumbens core and shell. J. Neurosci. 31, 11786-11794.
54. Corbit, L. H., and Janak, P. H. (2007). Inactivation of the lateral but not medial dorsal striatum eliminates the excitatory impact of Pavlovian stimuli on instrumental responding. J. Neurosci. 27, 13977-13981.
55. Corbit, L. H., Muir, J. L., and Balleine, B. W. (2001). The role of the nucleus accumbens in instrumental conditioning: evidence of a func-tional dissociation between accum-bens core and shell. J. Neurosci. 21, 3251-3260.
56. Coutureau, E., Galani, R., Gosselin, O., Majchrzak, M., and Di Scala, G. (1999). Entorhinal but not hip-pocampal or subicular lesions disrupt latent inhibition in rats. Neurobiol. Learn. Mem. 72, 143-157.
57. Czubayko, U., and Plenz, D. (2002). Fast synaptic transmission between striatal spiny projection neurons. Proc. Natl. Acad. Sci. U.S.A. 99, 15764-15769.
58. Dalley, J. W., Cardinal, R. N., and Robbins, T. W. (2004). Prefrontal executive and cognitive functions in rodents: neural and neurochemical substrates. Neurosci. Biobehav. Rev. 28, 771-784.
59. Davis, M. (1986). Pharmacological and anatomical analysis of fear condi-tioning using the fear-potentiated startle paradigm. Behav. Neurosci. 100, 814-824.
60. Davis, M. (1990). Animal mod-els of anxiety based on classical conditioning: the conditioned emotional response (CER) and the fear-potentiated startle effect. Pharmacol. Ther. 47, 147-165.
61. Davis, M. (1992a). The role of the amygdala in fear-potentiated startle: implications for animal models of anxiety. Trends Pharmacol. Sci. 13, 35-41.
62. Davis, M. (1992b). The role of the amygdala in fear and anxiety. Annu. Rev. Neurosci. 15, 353-375.
63. Davis, M., Gendelman, D. S., Tischler, M. D., and Gendelman, P. M. (1982). A primary acoustic startle circuit: lesion and stimulation stud-ies. J. Neurosci. 2, 791-805.
64. Daw, N. D., Niv, Y., and Dayan, P. (2005). Uncertainty-based com-petition between prefrontal and dorsolateral striatal systems for behavioral control. Nat. Neurosci. 8, 1704-1711.
65. Daw, N. D., O'doherty, J. P., Dayan, P., Seymour, B., and Dolan, R. J. (2006). Cortical substrates for exploratory decisions in humans. Nature 441,876-879.
66. Day, J. J., Wheeler, R. A., Roitman, M. F., and Carelli, R. M. (2006). Nucleus accumbens neurons encode Pavlovian approach behav-iors: evidence from an autoshaping paradigm. Eur. J. Neurosci. 23, 1341-1351.
67. De Borchgrave, R., Rawlins, J. N., Dickinson, A., and Balleine, B. W. (2002). Effects of cytotoxic nucleus accumbens lesions on instrumental conditioning in rats. Exp. Brain Res. 144, 50-68.
68. Derdikman, D., and Moser, E. I. (2010). A manifold of spatial maps in the brain. Trends Cogn. Sci. 14, 561-569.
69. Devan, B. D., Hong, N. S., and McDonald, R. J. (2011). Parallel associative processing in the dorsal striatum: segregation of stimulus-response and cognitive control sub-regions. Neurobiol. Learn. Mem. 96, 95-120.
70. Devan, B. D., McDonald, R. J., and White, N. M. (1999). Effects of medial and lateral caudate-putamen lesions on place-and cue-guided behaviors in the water maze: rela-tion to thigmotaxis. Behav. Brain Res. 100, 5-14.
71. Devan, B. D., and White, N. M. (1999). Parallel information processing in the dorsal striatum: relation to hip-pocampal function. J. Neurosci. 19, 2789-2798.
72. Dickinson, A., and Dawson, G. R. (1987). Pavlovian processes in the motivated control of instrumental performance. Q. J. Exp. Psychol. B Comp. Physiol. Psychol. 39, 201-213.
73. DiFiglia, M., Pasik, P., and Pasik, T. (1976). A Golgi study of neuronal types in the neostriatum of mon-keys. Brain Res. 114, 245-256.
74. Ditto, P. H., Pizarro, D. A., Epstein, E. B., Jacobson, J. A., and Macdonald, T. K. (2006). Visceral influences on risk-taking behavior. J. Behav. Decis. Making 19, 99-113.
75. Doya, K. (2008). Modulators of deci-sion making. Nat. Neurosci. 11, 410-416.
76. El-Amamy, H., and Holland, P. C. (2007). Dissociable effects of disconnecting amygdala central nucleus from the ventral tegmen-tal area or substantia nigra on learned orienting and incentive motivation. Eur. J. Neurosci. 25, 1557-1567.
77. Estes, W. K. (1943). Discriminative conditioning. I: a discriminative property of conditioned anticipa-tion. J. Exp. Psychol. 32, 150-155.
78. Estes, W. K., and Skinner, B. F. (1941). Some quantitative properties of anxiety. J. Exp. Psychol. 29, 390-400.
79. Euston, D. R., Tatsuno, M., and McNaughton, B. L. (2007). Fast-forward playback of recent memory sequences in prefrontal cortex during sleep. Science 318, 1147-1150.
80. Everitt, B. J., Cador, M., and Robbins, T. W. (1989). Interactions between the amygdala and ventral striatum in stimulus reward associations-stud-ies using a 2nd-order schedule of sexual reinforcement. Neuroscience 30, 63-75.
81. Everitt, B. J., Cardinal, R. N., Parkinson, J. A., and Robbins, T. W. (2003). Appetitive behavior: impact of amygdala-dependent mechanisms of emotional learning. Ann. N.Y. Acad. Sci. 985, 233-250.
82. Everitt, B. J., Morris, K. A., O'brien, A., and Robbins, T. W. (1991). The basolateral amygdala-ventral stri-atal system and conditioned place preference: further evidence of limbic-striatal interactions under-lying reward-related processes. Neuroscience 42, 1-18.
83. Everitt, B. J., Parkinson, J. A., Olmstead, M. C., Arroyo, M., Robledo, P., and Robbins, T. W. (1999). Associative processes in addiction and reward-the role of amygdala-ventral stri-atal subsystems. Ann. N.Y. Acad. Sci. 877, 412-438.
84. Fanselow, M. S. (2000). Contextual fear, gestalt memories, and the hip-pocampus. Behav. Brain Res. 110, 73-81.
85. Fanselow, M. S., and Dong, H. W. (2010). Are the dorsal and ventral hippocampus functionally distinct structures? Neuron 65, 7-19.
86. Fanselow, M. S., and Poulos, A. M. (2005). The neuroscience of mam-malian associative learning. Annu. Rev. Psychol. 56, 207-234.
87. Featherstone, R. E., and McDonald, R. J. (2004). Dorsal striatum and stimulus-response learning: lesions of the dorsolateral, but not dorsomedial, striatum impair acquisition of a simple discrimi-nation task. Behav. Brain Res. 150, 15-23.
88. Ferbinteanu, J., Holsinger, R. M., and McDonald, R. J. (1999). Lesions of the medial or lateral perforant path have different effects on hip-pocampal contributions to place learning and on fear conditioning to context. Behav. Brain Res. 101, 65-84.
89. Ferbinteanu, J., and McDonald, R. J. (2001). Dorsal/ventral hip-pocampus, fornix, and conditioned place preference. Hippocampus 11, 187-200.
90. Ferbinteanu, J., Ray, C., and McDonald, R. J. (2003). Both dorsal and ven-tral hippocampus contribute to spa-tial learning in Long-Evans rats. Neurosci. Lett. 345, 131-135.
91. Ferbinteanu, J., Shirvalkar, P., and Shapiro, M. L. (2011). Memory modulates journey-dependent cod-ing in the rat hippocampus. J. Neurosci. 31, 9135-9146.
92. Floresco, S. B., Blaha, C. D., Yang, C. R., and Phillips, A. G. (2001). Modulation of hippocampal and amygdalar-evoked activity of nucleus accumbens neurons by dopamine: cellular mechanisms of input selection. J. Neurosci. 21, 2851-2860.
93. Fortin, N. J., Agster, K. L., and Eichenbaum, H. B. (2002). Critical role of the hippocampus in mem-ory for sequences of events. Nat. Neurosci. 5, 458-462.
94. Frank, M. J., Seeberger, L. C., and O'reilly, R, C. (2004). By carrot or by stick: cognitive reinforcement learn-ing in parkinsonism. Science 306, 1940-1943.
95. Frankland, P. W., Cestari, V., Filipkowski, R. K., McDonald, R. J., and Silva, A. J. (1998). The dorsal hippocampus is essential for context discrimination but not for contextual conditioning. Behav. Neurosci. 112,863-874.
96. Gage, G. J., Stoetzner, C. R., Wiltschko, A. B., and Berke, J. D. (2010). Selective activation of striatal fast-spiking interneurons during choice execution. Neuron 67, 466-479.
97. Gal, G., Joel, D., Gusak, O., Feldon, J., and Weiner, I. (1997). The effects of electrolytic lesion to the shell subterritory of the nucleus accumbens on delayed non-matching-to-sample and four-arm baited eight-arm radial-maze tasks. Behav. Neurosci. 111, 92-103.
98. Galinanes, G. L., Braz, B. Y., and Murer, M. G. (2011). Origin and properties of striatal local field potential responses to cortical stimulation: temporal regulation by fast inhibitory con-nections. PLoS ONE 6:e28473. doi: 10.1371/journal.pone.0028473
99. Gallagher, M., Graham, P. W., and Holland, P. C. (1990). The amygdala central nucleus and appetitive Pavlovian conditioning: lesions impair one class of condi-tioned behavior. J. Neurosci. 10, 1906-1911.
100. Gallagher, M., McMahan, R. W., and Schoenbaum, G. (1999). Orbitofrontal cortex and repre-sentation of incentive value in associative learning. J. Neurosci. 19, 6610-6614.
101. Gan, J. O., Walton, M. E., and Phillips, P. E. (2010). Dissociable cost and benefit encoding of future rewards by mesolimbic dopamine. Nat. Neurosci. 13, 25-27.
102. Gardiner, T. W., and Kitai, S. T. (1992). Single-unit activity in the globus pallidus and neostriatum of the rat during performance of a trained head movement. Exp. Brain Res. 88, 517-530.
103. Gerfen, C. R. (1992). The neostriatal mosaic: multiple levels of compart-mental organization in the basal ganglia. Annu. Rev. Neurosci. 15, 285-320.
104. Gerfen, C. R., Engber, T. M., Mahan, L. C., Susel, Z., Chase, T. N., Monsma, F. J., and Sibley, D. R. (1990). D1 and D2 dopamine receptors-regulated gene expression of striatonigral and striatopallidal neurons. Science 250, 1429-1432.
105. Gilbert, P. E., Kesner, R. P., and Decoteau, W. E. (1998). Memory for spatial location: role of the hippocampus in mediating spatial pattern separation. J. Neurosci. 18, 804-810.
106. Gittis, A. H., Leventhal, D. K., Fensterheim, B. A., Pettibone, J. R., Berke, J. D., and Kreitzer, A. C. (2011). Selective inhibition of striatal fast-spiking interneurons causes dyskinesias. J. Neurosci. 31, 15727-15731.
107. Glascher, J., Daw, N., Dayan, P., and O'doherty, J. P. (2010). States versus rewards: dissociable neural prediction error signals underly-ing model-based and model-free reinforcement learning. Neuron 66, 585-595.
108. Goddard, G. V. (1964). Functions of the amygdala. Psychol. Bull. 62, 89-109.
109. Gold, J. M., Waltz, J. A., Prentice, K. J., Morris, S. E., and Heerey, E. A. (2008). Reward processing in schizophrenia: a deficit in the rep-resentation of value. Schizophr. Bull. 34, 835-847.
110. Goldstein, B. L., Barnett, B. R., Vasquez, G., Tobia, S. C., Kashtelyan, V., Burton, A. C., Bryden, D. W., and Roesch, M. R. (2012). Ventral striatum encodes past and pre-dicted value independent of motor contingencies. J. Neurosci. 32, 2027-2036.
111. Goto, Y., and Grace, A. A. (2005). Dopaminergic modulation of lim-bic and cortical drive of nucleus accumbens in goal-directed behav-ior. Nat. Neurosci. 8, 805-812.
112. Goto, Y., and O'Donnell, P. (2001). Synchronous activity in the hip-pocampus and nucleus accumbens in vivo. J. Neurosci. 21, RC131.
113. Grace, A. A. (2000). Gating of infor-mation flow within the limbic sys-tem and the pathophysiology of schizophrenia. Brain Res. Brain Res. Rev. 31, 330-341.
114. Groenewegen, H. J., Berendse, H. W., and Haber, S. N. (1993). Organization of the output of the ventral striatopallidal system in the rat: ventral pallidal efferents. Neuroscience 57, 113-142.
115. Groenewegen, H. J., Berendse, H. W., Wolters, J. G., and Lohman, A. H. (1990). The anatomical relation-ship of the prefrontal cortex with the striatopallidal system, the tha-lamus and the amygdala: evidence for a parallel organization. Prog. Brain Res. 85, 95-116. discussion: 116-118.
116. Groenewegen, H. J., and Russchen, F. T. (1984). Organization of the efferent projections of the nucleus accumbens to pallidal, hypothala-mic, and mesencephalic structures: a tracing and immunohistochemi-cal study in the cat. J. Comp. Neurol. 223, 347-367.
117. Groenewegen, H. J., Vermeulen-Van Der Zee, E., Te Kortschot, A., and Witter, M. P. (1987). Organization of the projections from the subicu-lum to the ventral striatum in the rat. A study using antero-grade transport of Phaseolus vul-garis leucoagglutinin. Neuroscience 23, 103-120.
118. Groves, P. M. (1983). A theory of the functional organization of the neos-triatum and the neostriatal control of voluntary movement. Brain Res. 286, 109-132.
119. Gruber, A. J., Dayan, P., Gutkin, B. G., and Solla, S. A. (2004). "Dopamine modulation in a basal ganglio-cortical network imple-ments saliency-based gating of working memory, " in Advances in Neural Information Processing Systems 16, eds S. Thrun, L. Saul, and B. Scholkopf (Cambridge, MA: MIT Press), 1271-1278.
120. Gruber, A. J., Dayan, P., Gutkin, B. S., and Solla, S. A. (2006). Dopamine modulation in the basal ganglia locks the gate to working memory. J. Comput. Neurosci. 20, 153-166.
121. Gruber, A. J., Hussain, R. J., and O'Donnell, P. (2009a). The nucleus accumbens: a switchboard for goal-directed behaviors. PLoS ONE 4:e5062. doi: 10.1371/journal.pone.0005062
122. Gruber, A. J., Powell, E. M., and O'Donnell, P. (2009b). Cortically activated interneurons shape spa-tial aspects of cortico-accumbens processing. J. Neurophysiol. 101, 1876-1882.
123. Haas, H. L., Sergeeva, O. A., and Selbach, O. (2008). Histamine in the nervous system. Physiol. Rev. 88, 1183-1241.
124. Haber, S. N., Fudge, J. L., and McFarland, N. R. (2000). Striatonigrostriatal pathways in primates form an ascending spiral from the shell to the dorsolateral striatum. J. Neurosci. 20, 2369-2382.
125. Hall, J., Parkinson, J. A., Connor, T. M., Dickinson, A., and Everitt, B. J. (2001). Involvement of the cen-tral nucleus of the amygdala and nucleus accumbens core in mediat-ing Pavlovian influences on instru-mental behaviour. Eur. J. Neurosci. 13, 1984-1992.
126. Harley, C. W. (1979). Arm choices in a sunburst maze: effects of hippocam-pectomy in the rat. Physiol. Behav. 23, 283-290.
127. Hasselmo, M. E., and Eichenbaum, H. (2005). Hippocampal mecha-nisms for the context-dependent retrieval of episodes. Neural Netw. 18, 1172-1190.
128. Hauber, W., and Sommer, S. (2009). Prefrontostriatal circuitry regulates effort-related decision making. Cereb. Cortex 19, 2240-2247.
129. Heimer, L., Zahm, D. S., Churchill, L., Kalivas, P. W., and Wohltmann, C. (1991). Specificity in the pro-jection patterns of accumbal core and shell in the rat. Neuroscience 41, 89-125.
130. Herman, J. P., Ostrander, M. M., Mueller, N. K., and Figueiredo, H. (2005). Limbic system mechanisms of stress regulation: hypothalamo-pituitary-adrenocortical axis. Prog. Neuropsychopharmacol. Biol. Psychiatry29, 1201-1213.
131. Hikosaka, O. (1998). Neural systems for control of voluntary action-a hypothesis. Adv. Biophys. 35, 81-102.
132. Hilton, S. M. (1982). The defence-arousal system and its relevance for circulatory and respiratory control. J. Exp. Biol. 100, 159-174.
133. Hiroi, N., and White, N. M. (1991a). The amphetamine conditioned place preference: differential involvement of dopamine receptor subtypes and two dopaminergic terminal areas. Brain Res. 552, 141-152.
134. Hiroi, N., and White, N. M. (1991b). The lateral nucleus of the amyg-dala mediates expression of the amphetamine-produced condi-tioned place preference. J. Neurosci. 11,2107-2116.
135. Hirsh, R. (1974). The hippocampus and contextual retrieval of informa-tion from memory: a theory. Behav. Biol. 12,421-444.
136. Hock, B. J. Jr., and Bunsey, M. D. (1998). Differential effects of dor-sal and ventral hippocampal lesions. J. Neurosci. 18, 7027-7032.
137. Holland, P. C. (1977). Conditioned stimulus as a determinant of the form of the Pavlovian conditioned response. J. Exp. Psychol. Anim. Behav. Process. 3, 77-104.
138. Holland, P. C. (2004). Relations between Pavlovian-instrumental transfer and reinforcer devaluation. J. Exp. Psychol. Anim. Behav. Process. 30, 104-117.
139. Holland, P. C., and Gallagher, M. (2003). Double dissociation of the effects of lesions of basolateral and central amygdala on condi-tioned stimulus-potentiated feeding and Pavlovian-instrumental trans-fer. Eur. J. Neurosci. 17, 1680-1694.
140. Honey, R. C., and Good, M. (1993). Selective hippocampal lesions abol-ish the contextual specificity of latent inhibition and conditioning. Behav. Neurosci. 107, 23-33.
141. Honey, R. C., and Hall, G. (1989). Attenuation of latent inhibition after compound pre-exposure: asso-ciative and perceptual explanations. Q. J. Exp. Psychol. B 41, 355-368.
142. Hoover, W. B., and Vertes, R. P. (2011). Projections of the medial orbital and ventral orbital cortex in the rat. J. Comp. Neurol. 519, 3766-3801.
143. Howland, J. G., Harrison, R. A., Hannesson, D. K., and Phillips, A. G. (2008). Ventral hippocampal involvement in temporal order, but not recognition, memory for spatial information. Hippocampus 18,251-257.
144. Howland, J. G., Taepavarapruk, P., and Phillips, A. G. (2002). Glutamate receptor-dependent modulation of dopamine efflux in the nucleus accumbens by basolateral, but not central, nucleus of the amygdala in rats. J. Neurosci. 22, 1137-1145.
145. Hull, C. L. (1943). Principles of Behaviour. New York, NY: Appleton-Century-Crofts.
146. Humphries, M. D., Khamassi, M., and Gurney, K. (2012). Dopaminergic control of the exploration-exploitation trade-off via the basal ganglia. Front. Neurosci. 6:9. doi: 10.3389/fnins.2012.00009
147. Hyman, J. M., Zilli, E. A., Paley, A. M., and Hasselmo, M. E. (2010). Working memory performance cor-relates with prefrontal-hippocampal theta interactions but not with prefrontal neuron firing rates. Front. Integr. Neurosci. 4:2. doi: 10.3389/neuro.07.002.2010
148. Ishikawa, A., Ambroggi, F., Nicola, S. M., and Fields, H. L. (2008). Dorsomedial prefrontal cortex con-tribution to behavioral and nucleus accumbens neuronal responses to incentive cues. J. Neurosci. 28, 5088-5098.
149. Ito, M., and Doya, K. (2009). Validation of decision-making models and analysis of decision variables in the rat basal ganglia. J. Neurosci. 29, 9861-9874.
150. Jezek, K., Henriksen, E. J., Treves, A., Moser, E. I., and Moser, M. B. (2011). Theta-paced flickering between place-cell maps in the hip-pocampus. Nature 478, 246-249.
151. Joel, D., and Weiner, I. (1994). The organization of the basal ganglia-thalamocortical circuits: open inter-connected rather than closed segre-gated. Neuroscience 63, 363-379.
152. Joel, D., and Weiner, I. (2000). The con-nections of the dopaminergic sys-tem with the striatum in rats and primates: an analysis with respect to the functional and compartmen-tal organization of the striatum. Neuroscience 96, 451-474.
153. Joel, D., Weiner, I., and Feldon, J. (1997). Electrolytic lesions of the medial prefrontal cortex in rats dis-rupt performance on an analog of the Wisconsin Card Sorting Test, but do not disrupt latent inhibition: implications for animal models of schizophrenia. Behav. Brain Res. 85, 187-201.
154. Johnson, A., and Redish, A. D. (2007). Neural ensembles in CA3 tran-siently encode paths forward of the animal at a decision point. J. Neurosci. 27, 12176-12189.
155. Jones, J. L., Day, J. J., Aragona, B. J., Wheeler, R. A., Wightman, R. M., and Carelli, R. M. (2010). Basolateral amygdala modulates terminal dopamine release in the nucleus accumbens and condi-tioned responding. Biol. Psychiatry 67, 737-744.
156. Jones, M. W., and Wilson, M. A. (2005). Theta rhythms coor-dinate hippocampal-prefrontal interactions in a spatial memory task. PLoS Biol. 3:e402. doi: 10.1371/journal.pbio.0030402
157. Kapp, B. S., Frysinger, R. C., Gallagher, M., and Haselton, J. R. (1979). Amygdala central nucleus lesions: effect on heart rate conditioning in the rabbit. Physiol. Behav. 23, 1109-1117.
158. Kapp, B. S., Wilson, A., Pascoe, J. P., Supple, W., and Whalen, P. J. (1990). "Neuroanatomical system analysis of bradycardia in the rabbit, " in Neurocomputation and Learning: Foundations of Adaptive Networks, eds M. Gabriel and J. Moore (Cambridge, MA: MIT Press), 53-90.
159. Kawaguchi, Y. (1993). Physiological, morphological, and histochemical characterization of three classes of interneurons in rat neostriatum. J. Neurosci. 13, 4908-4923.
160. Kelley, A. E., Baldo, B. A., and Pratt, W. E. (2005). A proposed hypothalamic-thalamic-striatal axis for the integration of energy bal-ance, arousal, and food reward. J. Comp. Neurol. 493, 72-85.
161. Kennedy, P. J., and Shapiro, M. L. (2004). Retrieving memories via internal context requires the hippocampus. J. Neurosci. 24, 6979-6985.
162. Kentridge, R. W., Shaw, C., and Aggleton, J. P. (1991). Amygdaloid lesions and stimulus-reward associ-ations in the rat. Behav. Brain Res. 42, 57-66.
163. Kesner, R. P., and Churchwell, J. C. (2011). An analysis of rat prefrontal cortex in mediating executive func-tion. Neurobiol. Learn. Mem. 96, 417-431.
164. Kim, H., Sul, J. H., Huh, N., Lee, D., and Jung, M. W. (2009). Role of striatum in updating values of chosen actions. J. Neurosci. 29, 14701-14712.
165. Kim, J. J., Clark, R. E., and Thompson, R. F. (1995). Hippocampectomy impairs the memory of recently, but not remotely, acquired trace eye-blink conditioned responses. Behav. Neurosci. 109, 195-203.
166. Kim, J. J., and Fanselow, M. S. (1992). Modality-specific retrograde amne-sia of fear. Science 256, 675-677.
167. Kim, J. J., Rison, R. A., and Fanselow, M. S. (1993). Effects of amyg-dala, hippocampus, and periaque-ductal gray lesions on short-and long-term contextual fear. Behav. Neurosci. 107, 1093-1098.
168. Kimchi, E. Y., and Laubach, M. (2009). Dynamic encoding of action selec-tion by the medial striatum. J. Neurosci. 29, 3148-3159.
169. Kincaid, A. E., Zheng, T., and Wilson, C. J. (1998). Connectivity and convergence of single corticostriatal axons. J. Neurosci. 18,4722-4731.
170. Kita, H. (1993). GABAergic circuits of the striatum. Prog. Brain Res. 99, 51-72.
171. Kita, H., and Kitai, S. T. (1994). The morphology of globus pallidus pro-jection neurons in the rat: an intra-cellular staining study. Brain Res. 636, 308-319.
172. Kluver, H., and Bucy, P. C. (1939). Preliminary analysis of functions of the temporal lobes in monkeys. J. Neuropsychiatry Clin. Neurosci. 9, 606-620.
173. Koch, M., and Schnitzler, H. U. (1997). The acoustic startle response in rats-circuits mediating evocation, inhibition and potentiation. Behav. Brain Res. 89, 35-49.
174. Kolb, B., Buhrmann, K., McDonald, R., and Sutherland, R. J. (1994). Dissociation of the medial pre-frontal, posterior parietal, and pos-terior temporal cortex for spatial navigation and recognition mem-ory in the rat. Cereb. Cortex 4, 664-680.
175. Koos, T., and Tepper, J. M. (1999). Inhibitory control of neostriatal projection neurons by GABAergic interneurons. Nat. Neurosci. 2, 467-472.
176. Koos, T., Tepper, J. M., and Wilson, C. J. (2004). Comparison of IPSCs evoked by spiny and fast-spiking neurons in the neostriatum. J. Neurosci. 24, 7916-7922.
177. Kravitz, A. V., Freeze, B. S., Parker, P. R., Kay, K., Thwin, M. T., Deisseroth, K., and Kreitzer, A. C. (2010). Regulation of parkinsonian motor behaviours by optogenetic control of basal ganglia circuitry. Nature 466, 622-626.
178. Kravitz, A. V., Tye, L. D., and Kreitzer, A. C. (2012). Distinct roles for direct and indirect pathway striatal neurons in reinforcement. Nat.
179. Krayniak, P. F., Meibach, R. C., and Siegel, A. (1981). A Projection from the entorhinal cortex to the nucleus accumbens in the rat. Brain Res. 209, 427-431.
180. Lammel, S., Ion, D. I., Roeper, J., and Malenka, R. C. (2011). Projection-specific modulation of dopamine neuron synapses by aversive and rewarding stimuli. Neuron 70, 855-862.
181. Lansink, C. S., Goltstein, P. M., Lankelma, J. V., Joosten, R. N., McNaughton, B. L., and Pennartz, C. M. (2008). Preferential reacti-vation of motivationally relevant information in the ventral striatum. J. Neurosci. 28, 6372-6382.
182. Lansink, C. S., Goltstein, P. M., Lankelma, J. V., McNaughton, B. L., and Pennartz, C. M. (2009). Hippocampus leads ventral stria-tum in replay of place-reward information. PLoS Biol. 7:e1000173. doi: 10.1371/journal.pbio.1000173
183. Lansink, C. S., Goltstein, P. M., Lankelma, J. V., and Pennartz, C. M. (2010). Fast-spiking interneurons of the rat ventral striatum: tempo-ral coordination of activity with principal cells and responsiveness to reward. Eur. J. Neurosci. 32, 494-508.
184. Lavenex, P., and Amaral, D. G. (2000). Hippocampal-neocortical interac-tion: a hierarchy of associativity. Hippocampus 10, 420-430.
185. Leaf, R. C., and Muller, S. A. (1965). Simple method for CER condition-ing and measurement. Psychol. Rep. 17,211-215.
186. Ledoux, J. (2007). The amygdala. Curr. Biol. 17, R868-R874.
187. Ledoux, J. E., Cicchetti, P., Xagoraris, A., and Romanski, L. M. (1990). The lateral amygdaloid nucleus: sen-sory interface of the amygdala in fear conditioning. J. Neurosci. 10, 1062-1069.
188. Leutgeb, S., Leutgeb, J. K., Barnes, C. A., Moser, E. I., McNaughton, B. L., and Moser, M. B. (2005). Independent codes for spatial and episodic memory in hippocampal neuronal ensembles. Science 309, 619-623.
189. Levesque, M., and Parent, A. (1998). Axonal arborization of corticostri-atal and corticothalamic fibers aris-ing from prelimbic cortex in the rat. Cereb. Cortex 8, 602-613.
190. Lex, A., and Hauber, W. (2008). Dopamine D1 and D2 receptors in the nucleus accumbens core and shell mediate Pavlovian-instrumental transfer. Learn. Mem. 15, 483-491.
191. Liu, X., Ramirez, S., Pang, P. T., Puryear, C. B., Govindarajan, A., Deisseroth, K., and Tonegawa, S. (2012). Optogenetic stimulation of a hippocampal engram activates fear memory recall. Nature 484, 381-385.
192. Lovibond, P. F. (1983). Facilitation of instrumental behavior by a Pavlovian appetitive conditioned stimulus. J. Exp. Psychol. Anim. Behav. Process. 9, 225-247.
193. Lubow, R. E. (1989). Latent Inhibition and Conditioned Attention Theory. Cambridge: Cambridge University Press.
194. Lynd-Balta, E., and Haber, S. N. (1994). The organization of mid-brain projections to the striatum in the primate: sensorimotor-related striatum versus ventral striatum. Neuroscience 59, 625-640.
195. Mallet, N., Le Moine, C., Charpier, S., and Gonon, F. (2005). Feedforward inhibition of projection neurons by fast-spiking GABA interneurons in the rat striatum in vivo. J. Neurosci. 25, 3857-3869.
196. Mantz, J., Thierry, A. M., and Glowinski, J. (1989). Effect of noxious tail pinch on the discharge rate of mesocortical and mesolim-bic dopamine neurons: selective activation of the mesocortical system. Brain Res. 476, 377-381.
197. Maren, S. (1999). Neurotoxic or elec-trolytic lesions of the ventral subicu-lum produce deficits in the acqui-sition and expression of Pavlovian fear conditioning in rats. Behav. Neurosci. 113, 283-290.
198. Maren, S. (2001). Neurobiology of Pavlovian fear conditioning. Annu. Rev. Neurosci. 24, 897-931.
199. Maren, S., Aharonov, G., and Fanselow, M. S. (1997). Neurotoxic lesions of the dorsal hippocampus and Pavlovian fear conditioning in rats. Behav. Brain Res. 88, 261-274.
200. Maren, S., and Holt, W. (2000). The hippocampus and contextual mem-ory retrieval in Pavlovian condition-ing. Behav. Brain Res. 110, 97-108.
201. Maren, S., and Quirk, G. J. (2004). Neuronal signalling of fear memory. Nat. Rev. Neurosci. 5, 844-852.
202. Matsumoto, M., and Hikosaka, O. (2009). Two types of dopamine neuron distinctly convey positive and negative motivational signals. Nature 459, 837-841.
203. McClelland, J. L., McNaughton, B. L., and O'reilly, R. C. (1995). Why there are complementary learning systems in the hippocampus and neocortex: insights from the suc-cesses and failures of connection-ist models of learning and memory. Psychol. Rev. 102, 419-457.
204. McDannald, M. A., Saddoris, M. P., Gallagher, M., and Holland, P. C. (2005). Lesions of orbitofrontal cortex impair rats' differential outcome expectancy learning but not conditioned stimulus-potentiated feeding. J. Neurosci. 25, 4626-4632.
205. McDonald, R. J., Foong, N., and Hong, N. S. (2004). Incidental information acquired by the amygdala during acquisition of a stimulus-response habit task. Exp. Brain Res. 159, 72-83.
206. McDonald, R. J., and Hong, N. S. (2004). A dissociation of dorso-lateral striatum and amygdala function on the same stimulus-response habit task. Neuroscience 124, 507-513.
207. McDonald, R. J., Jones, J., Richards, B., and Hong, N. S. (2006). A double dissociation of dorsal and ventral hippocampal function on a learn-ing and memory task mediated by the dorso-lateral striatum. Eur. J. Neurosci. 24, 1789-1801.
208. McDonald, R. J., King, A. L., Foong, N., Rizos, Z., and Hong, N. S. (2008a). Neurotoxic lesions of the medial prefrontal cortex or medial striatum impair multiple-location place learning in the water task: evidence for neural structures with complementary roles in behavioural flexibility. Exp. Brain Res. 187, 419-427.
209. McDonald, R. J., King, A. L., and Hong, N. S. (2008b). Neurotoxic damage to the dorsomedial striatum exag-gerates the behavioral influence of a context-specific inhibitory associ-ation mediated by the ventral hip-pocampus. Behav. Neurosci. 122, 27-35.
210. McDonald, R. J., King, A. L., and Hong, N. S. (2001). Context-specific interference on reversal learning of a stimulus-response habit. Behav. Brain Res. 121, 149-165.
211. McDonald, R. J., King, A. L., Wasiak, T. D., Zelinski, E. L., and Hong, N. S. (2007). A complex associative structure formed in the mammalian brain during acquisition of a simple visual discrimination task: dor-solateral striatum, amygdala, and hippocampus. Hippocampus 17, 759-774.
212. McDonald, R. J., Ko, C. H., and Hong, N. S. (2002). Attenuation of context-specific inhibition on rever-sal learning of a stimulus-response task in rats with neurotoxic hip-pocampal damage. Behav. Brain Res. 136, 113-126.
213. McDonald, R. J., Murphy, R. A., Guarraci, F. A., Gortler, J. R., White, N. M., and Baker, A. G. (1997). Systematic comparison of the effects of hippocampal and fornix-fimbria lesions on acquisi-tion of three configural discrimina-tions. Hippocampus 7, 371-388.
214. McDonald, R. J., and White, N. M. (1993). A triple dissociation of memory systems: hippocampus, amygdala, and dorsal striatum. Behav. Neurosci. 107, 3-22.
215. McDonald, R. J., and White, N. M. (1994). Parallel information pro-cessing in the water maze: evidence for independent memory systems involving dorsal striatum and hip-pocampus. Behav. Neural Biol. 61, 260-270.
216. McDonald, R. J., and White, N. M. (1995a). Hippocampal and non-hippocampal contributions to place learning in rats. Behav. Neurosci. 109, 579-593.
217. McDonald, R. J., and White, N. M. (1995b). Information acquired by the hippocampus interferes with acquisition of the amygdala-based conditioned-cue preference in the rat. Hippocampus 5, 189-197.
218. McEchron, M. D., Bouwmeester, H., Tseng, W., Weiss, C., and Disterhoft, J. F. (1998). Hippocampectomy dis-rupts auditory trace fear condition-ing and contextual fear conditioning in the rat. Hippocampus 8, 638-646.
219. McGeorge, A. J., and Faull, R. L. (1989). The organization of the projection from the cerebral cortex to the stria-tum in the rat. Neuroscience 29, 503-537.
220. McNaughton, B. L., Barnes, C. A., and O'keefe, J. (1983). The contri-butions of position, direction, and velocity to single unit activity in the hippocampus of freely-moving rats. Exp. Brain Res. 52, 41-49.
221. Millhouse, O. E. (1986). Pallidal neu-rons in the rat. J. Comp. Neurol. 254, 209-227.
222. Mink, J. W. (1996). The basal ganglia: focused selection and inhibition of competing motor programs. Prog. Neurobiol. 50, 381-425.
223. Mishkin, M., and Manning, F. J. (1978). Non-spatial memory after selective prefrontal lesions in monkeys. Brain Res. 143, 313-323.
224. Mizumori, S. J., Puryear, C. B., and Martig, A. K. (2009). Basal ganglia contributions to adaptive naviga-tion. Behav. Brain Res. 199, 32-42.
225. Mogenson, G. J., Jones, D. L., and Yim, C. Y. (1980). From motivation to action: functional interface between the limbic system and the motor system. Prog. Neurobiol. 14, 69-97.
226. Moita, M. A., Rosis, S., Zhou, Y., Ledoux, J. E., and Blair, H. T. (2003). Hippocampal place cells acquire location-specific responses to the conditioned stimulus during audi-tory fear conditioning. Neuron 37, 485-497.
227. Montague, P. R., Dayan, P., and Sejnowski, T. J. (1996). A frame-work for mesencephalic dopamine systems based on predictive Hebbian learning. J. Neurosci. 16, 1936-1947.
228. Morris, R. G., Garrud, P., Rawlins, J. N., and O'keefe, J. (1982). Place navigation impaired in rats with hippocampal lesions. Nature 297, 681-683.
229. Morrison, S. E., and Salzman, C. D. (2010). Re-valuing the amygdala. Curr. Opin. Neurobiol. 20, 221-230.
230. Moser, E., Moser, M. B., and Andersen, P. (1993). Spatial learning impair-ment parallels the magnitude of dorsal hippocampal lesions, but is hardly present following ventral lesions. J. Neurosci. 13, 3916-3925.
231. Mulder, A. B., Hodenpijl, M. G., and Lopes Da Silva, F. H. (1998). Electrophysiology of the hippocam-pal and amygdaloid projections to the nucleus accumbens of the rat: convergence, segregation, and inter-action of inputs. J. Neurosci. 18, 5095-5102.
232. Muller, R. (1996). A quarter of a century of place cells. Neuron 17, 813-822.
233. Muller, R. U., and Kubie, J. L. (1987). The effects of changes in the envi-ronment on the spatial firing of hippocampal complex-spike cells. J. Neurosci. 7, 1951-1968.
234. Muller, R. U., Kubie, J. L., and Ranck, J. B. Jr. (1987). Spatial firing patterns of hippocampal complex-spike cells in a fixed environment. J. Neurosci. 7, 1935-1950.
235. Nicola, S. M. (2010). The flexible approach hypothesis: unification of effort and cue-responding hypotheses for the role of nucleus accumbens dopamine in the acti-vation of reward-seeking behavior. J. Neurosci. 30, 16585-16600.
236. Nicola, S. M., Yun, I. A., Wakabayashi, K. T., and Fields, H. L. (2004). Cue-evoked firing of nucleus accum-bens neurons encodes motivational significance during a discriminative stimulus task. J. Neurophysiol. 91, 1840-1865.
237. Niv, Y., Daw, N. D., Joel, D., and Dayan, P. (2007). Tonic dopamine: opportunity costs and the control of response vigor. Psychopharmacology (Berl.) 191, 507-520.
238. O'Donnell, P., and Grace, A. A. (1995). Synaptic interactions among excita-tory afferents to nucleus accumbens neurons: hippocampal gating of prefrontal cortical input. J. Neurosci. 15, 3622-3639.
239. O'Keefe, J., and Dostrovsky, J. (1971). The hippocampus as a spatial map. Preliminary evidence from unit activity in the freely-moving rat. Brain Res. Brain Res. 34, 171-175.
240. O'Keefe, J., and Nadel, L. (1978). The Hippocampus as a Congnitive Map. Oxford: Oxford University Press.
241. O'Keefe, J., Nadel, L., Keightley, S., and Kill, D. (1975). Fornix lesions selec-tively abolish place learning in the rat. Exp. Neurol. 48, 152-166.
242. O'Keefe, J., and Speakman, A. (1987). Single unit activity in the rat hip-pocampus during a spatial memory task. Exp. Brain Res. 68, 1-27.
243. Olton, D. S., Walker, J. A., and Gage, F. H. (1978). Hippocampal con-nections and spatial discrimination. Brain Res. 139, 295-308.
244. Oorschot, D. E. (1996). Total num-ber of neurons in the neostriatal, pallidal, subthalamic, and substan-tia nigral nuclei of the rat basal ganglia: a stereological study using the cavalieri and optical disector methods. J. Comp. Neurol. 366, 580-599.
245. O'Reilly, R. C., and Frank, M. J. (2006). Making working memory work: a computational model of learning in the prefrontal cortex and basal gan-glia. Neural Comput. 18, 283-328.
246. O'Reilly, R. C., and Rudy, J. W. (2001). Conjunctive representations in learning and memory: principles of cortical and hippocampal func-tion. Psychol. Rev. 108, 311-345.
247. Packard, M. G. (1999). Glutamate infused posttraining into the hip-pocampus or caudate-putamen dif-ferentially strengthens place and response learning. Proc. Natl. Acad. Sci. U.S.A. 96, 12881-12886.
248. Packard, M. G., Hirsh, R., and White, N. M. (1989). Differential effects of fornix and caudate nucleus lesions on two radial maze tasks: evidence for multiple memory systems. J. Neurosci. 9, 1465-1472.
249. Packard, M. G., and McGaugh, J. L. (1996). Inactivation of hip-pocampus or caudate nucleus with lidocaine differentially affects expression of place and response learning. Neurobiol. Learn. Mem. 65, 65-72.
250. Pan, W. X., Schmidt, R., Wickens, J. R., and Hyland, B. I. (2005). Dopamine cells respond to pre-dicted events during classical con-ditioning: evidence for eligibility traces in the reward-learning net-work. J. Neurosci. 25, 6235-6242.
251. Parent, A., Sato, F., Wu, Y., Gauthier, J., Levesque, M., and Parent, M. (2000). Organization of the basal ganglia: the importance of axonal collateralization. Trends Neurosci. 23, S20-S27.
252. Parkinson, J. A., Dalley, J. W., Cardinal, R. N., Bamford, A., Fehnert, B., Lachenal, G., Rudarakanchana, N., Halkerston, K. M., Robbins, T. W., and Everitt, B. J. (2002). Nucleus accumbens dopamine depletion impairs both acquisition and per-formance of appetitive Pavlovian approach behaviour: implications for mesoaccumbens dopamine function. Behav. Brain Res. 137, 149-163.
253. Parkinson, J. A., Olmstead, M. C., Burns, L. H., Robbins, T. W., and Everitt, B. J. (1999). Dissociation in effects of lesions of the nucleus accumbens core and shell on appet-itive pavlovian approach behavior and the potentiation of conditioned reinforcement and locomotor activ-ity by D-amphetamine. J. Neurosci. 19, 2401-2411.
254. Parkinson, J. A., Robbins, T. W., and Everitt, B. J. (2000a). Dissociable roles of the central and basolat-eral amygdala in appetitive emo-tional learning. Eur. J. Neurosci. 12, 405-413.
255. Parkinson, J. A., Willoughby, P. J., Robbins, T. W., and Everitt, B. J. (2000b). Disconnection of the ante-rior cingulate cortex and nucleus accumbens core impairs Pavlovian approach behavior: further evi-dence for limbic cortical-ventral striatopallidal systems. Behav. Neurosci. 114,42-63.
256. Parmentier, R., Ohtsu, H., Djebbara-Hannas, Z., Valatx, J. L., Watanabe, T., and Lin, J. S. (2002). Anatomical, physiological, and pharmacological characteristics of histidine decar-boxylase knock-out mice: evidence for the role of brain histamine in behavioral and sleep-wake control. J. Neurosci. 22, 7695-7711.
257. Parush, N., Tishby, N., and Bergman, H. (2011). Dopaminergic balance between reward maximiza-tion and policy complexity. Front. Syst. Neurosci. 5:22. doi: 10.3389/fnsys.2011.00022
258. Pavlov, I. (1927). Conditioned Reflexes. Oxford: Oxford University Press.
259. Pawlak, V., and Kerr, J. N. (2008). Dopamine receptor activation is required for corticostriatal spike-timing-dependent plasticity. J. Neurosci. 28, 2435-2446.
260. Pennartz, C. M., Ito, R., Verschure, P. F., Battaglia, F. P., and Robbins, T. W. (2011). The hippocampal-striatal axis in learning, prediction and goal-directed behavior. Trends Neurosci. 34, 548-559.
261. Pennartz, C. M., and Kitai, S. T. (1991). Hippocampal inputs to identified neurons in an in vitro slice prepara-tion of the rat nucleus accumbens: evidence for feed-forward inhibi-tion. J. Neurosci. 11, 2838-2847.
262. Peters, J., Kalivas, P. W., and Quirk, G. J. (2009). Extinction circuits for fear and addiction overlap in prefrontal cortex. Learn. Mem. 16, 279-288.
263. Peters, J., Lalumiere, R. T., and Kalivas, P. W. (2008). Infralimbic prefrontal cortex is responsible for inhibiting cocaine seeking in extinguished rats. J. Neurosci. 28, 6046-6053.
264. Petrovich, G. D., Canteras, N. S., and Swanson, L. W. (2001). Combinatorial amygdalar inputs to hippocampal domains and hypothalamic behavior systems. Brain Res. Brain Res. Rev. 38, 247-289.
265. Peyrache, A., Khamassi, M., Benchenane, K., Wiener, S. I., and Battaglia, F. P. (2009). Replay of rule-learning related neural pat-terns in the prefrontal cortex during sleep. Nat. Neurosci. 12, 919-926.
266. Plenz, D. (2003). When inhibition goes incognito: feedback interaction between spiny projection neurons in striatal function. Trends Neurosci. 26, 436-443.
267. Ponzi, A., and Wickens, J. (2010). Sequentially switching cell assem-blies in random inhibitory networks of spiking neurons in the striatum. J. Neurosci. 30, 5894-5911.
268. Price, J. L., and Drevets, W. C. (2012). Neural circuits underlying the pathophysiology of mood disorders. Trends Cogn. Sci. 16, 61-71.
269. Ragozzino, M. E. (2007). The contribu-tion of the medial prefrontal cortex, orbitofrontal cortex, and dorsome-dial striatum to behavioral flexi-bility. Ann. N.Y. Acad. Sci. 1121, 355-375.
270. Ragozzino, M. E., Detrick, S., and Kesner, R. P. (1999a). Involvement of the prelimbic-infralimbic areas of the rodent prefrontal cortex in behavioral flexibility for place and response learning. J. Neurosci. 19, 4585-4594.
271. Ragozzino, M. E., Wilcox, C., Raso, M., and Kesner, R. P. (1999b). Involvement of rodent prefrontal cortex subregions in strategy switching. Behav. Neurosci. 113, 32-41.
272. Ragozzino, M. E., Ragozzino, K. E., Mizumori, S. J., and Kesner, R. P. (2002). Role of the dorsomedial striatum in behavioral flexibility for response and visual cue discrimina-tion learning. Behav. Neurosci. 116, 105-115.
273. Rasmussen, M., Barnes, C. A., and McNaughton, B. L. (1989). A sys-tematic test of cognitive mapping, working memory, and temporal discontiguity theories of hippocam-pal function. Psychobiology 17, 335-348.
274. Reading, P. J., Dunnett, S. B., and Robbins, T. W. (1991). Dissociable roles of the ventral, medial and lateral striatum on the acquisi-tion and performance of a com-plex visual stimulus-response habit. Behav. Brain Res. 45, 147-161.
275. Rebec, G. V., and Curtis, S. D. (1988). Reciprocal zones of excitation and inhibition in the neostriatum. Synapse 2, 633-635.
276. Reilly, S., Harley, C., and Revusky, S. (1993). Ibotenate lesions of the hippocampus enhance latent inhibition in conditioned taste aversion and increase resistance to extinction in conditioned taste preference. Behav. Neurosci. 107, 996-1004.
277. Reiman, E. M., Lane, R. D., Ahern, G. L., Schwartz, G. E., Davidson, R. J., Friston, K. J., Yun, L. S., and Chen, K. (1997). Neuroanatomical corre-lates of externally and internally generated human emotion. Am. J. Psychiatry154, 918-925.
278. Rescorla, R. A. (2004). Spontaneous recovery varies inversely with the training-extinction interval. Learn. Behav. 32, 401-408.
279. Reynolds, J. N., Hyland, B. I., and Wickens, J. R. (2001). A cellular mechanism of reward-related learn-ing. Nature 413, 67-70.
280. Risold, P. Y., and Swanson, L. W. (1996). Structural evidence for functional domains in the rat hippocampus. Science272, 1484-1486.
281. Roesch, M. R., Esber, G. R., Li, J., Daw, N. D., and Schoenbaum, G. (2012). Surprise! Neural correlates of Pearce-Hall and Rescorla-Wagner coexist within the brain. Eur. J. Neurosci. 35, 1190-1200.
282. Rudy, J. W., Huff, N. C., and Matus-Amat, P. (2004). Understanding contextual fear conditioning: insights from a two-process model. Neurosci. Biobehav. Rev. 28, 675-685.
283. Rudy, J. W., and Sutherland, R. J. (1989). The hippocampal formation is necessary for rats to learn and remember configural discrimina-tions. Behav. Brain Res. 34, 97-109.
284. Sadek, A. R., Magill, P. J., and Bolam, J. P. (2007). A single-cell analy-sis of intrinsic connectivity in the rat globus pallidus. J. Neurosci. 27, 6352-6362.
285. Salamone, J. D., Correa, M., Farrar, A., and Mingote, S. M. (2007). Effort-related functions of nucleus accum-bens dopamine and associated fore-brain circuits. Psychopharmacology (Berl.) 191, 461-482.
286. Salamone, J. D., Correa, M., Farrar, A. M., Nunes, E. J., and Pardo, M. (2009). Dopamine, behav-ioral economics, and effort. Front. Behav. Neurosci. 3:13. doi: 10.3389/neuro.08.013.2009
287. Samejima, K., Ueda, Y., Doya, K., and Kimura, M. (2005). Representation of action-specific reward val-ues in the striatum. Science 310, 1337-1340.
288. Saper, C. B. (2003). "The hypothala-mus, " in In The Human Nervous System, ed G. Paxinos (San Diego, CA: Academic Press), 513-550.
289. Satvat, E., Schmidt, B., Argraves, M., Marrone, D. F., and Markus, E. J. (2011). Changes in task demands alter the pattern ofzif268 expression in the dentate gyrus. J. Neurosci. 31, 7163-7167.
290. Schenk, F., and Morris, R. G. (1985). Dissociation between components of spatial memory in rats after recovery from the effects of retro-hippocampal lesions. Exp. Brain Res. 58, 11-28.
291. Schoenbaum, G., Chiba, A. A., and Gallagher, M. (1998). Orbitofrontal cortex and basolateral amygdala encode expected outcomes during learning. Nat. Neurosci. 1, 155-159.
292. Schoenbaum, G., Nugent, S. L., Saddoris, M. P., and Setlow, B. (2002). Orbitofrontal lesions in rats impair reversal but not acquisition of go, no-go odor discriminations. Neuroreport 13, 885-890.
293. Schultz, W. (1998). Predictive reward signal of dopamine neurons. J. Neurophysiol. 80, 1-27.
294. Schultz, W., Apicella, P., and Ljungberg, T. (1993). Responses of monkey dopamine neurons to reward and conditioned stimuli during suc-cessive steps of learning a delayed response task. J. Neurosci. 13, 900-913.
295. Schwartzbaum, J. S. (1960). Changes in reinforcing properties of stimuli fol-lowing ablation of the amygdaloid complex in monkeys. J. Comp. Physiol. Psychol. 53, 388-395.
296. Schwindel, C. D., and McNaughton, B. L. (2011). Hippocampal-cortical interactions and the dynamics of memory trace reactivation. Prog. Brain Res. 193, 163-177.
297. Selden, N. R., Everitt, B. J., Jarrard, L. E., and Robbins, T. W. (1991). Complementary roles for the amyg-dala and hippocampus in aversive conditioning to explicit and contex-tual cues. Neuroscience 42, 335-350.
298. Shapiro, M. L., Kennedy, P. J., and Ferbinteanu, J. (2006). Representing episodes in the mammalian brain. Curr. Opin. Neurobiol. 16, 701-709.
299. Shen, W., Flajolet, M., Greengard, P., and Surmeier, D. J. (2008). Dichotomous dopaminergic control of striatal synaptic plasticity. Science 321, 848-851.
300. Sidman, M., and Fletcher, F. G. (1968). A demonstration of auto-shaping with monkeys. J. Exp. Anal. Behav. 11, 307-309.
301. Simon, H., Le Moal, M., and Calas, A. (1979). Efferents and affer-ents of the ventral tegmental-A10 region studied after local injection of [3H]leucine and horseradish peroxidase. Brain Res. 178, 17-40.
302. Sims, R. E., Woodhall, G. L., Wilson, C. L., and Stanford, I. M. (2008). Functional characterization of GABAergic pallidopallidal and striatopallidal synapses in the rat globus pallidus in vitro. Eur. J. Neurosci. 28, 2401-2408.
303. Skaggs, W. E., and McNaughton, B. L. (1996). Replay of neuronal fir-ing sequences in rat hippocampus during sleep following spatial expe-rience. Science 271, 1870-1873.
304. Smith, Y., Bevan, M. D., Shink, E., and Bolam, J. P. (1998). Microcircuitry of the direct and indirect pathways of the basal ganglia. Neuroscience 86, 353-387.
305. Somogyi, P., Bolam, J. P., and Smith, A. D. (1981). Monosynaptic corti-cal input and local axon collaterals of identified striatonigral neurons. A light and electron microscopic study using the Golgi-peroxidase transport-degeneration procedure. J. Comp. Neurol. 195, 567-584.
306. Sparks, F. T., Lehmann, H., and Sutherland, R. J. (2011). Between-systems memory interference during retrieval. Eur. J. Neurosci. 34, 780-786.
307. Spiegler, B. J., and Mishkin, M. (1981). Evidence for the sequential partici-pation of inferior temporal cortex and amygdala in the acquisition of stimulus-reward associations. Behav. Brain Res. 3, 303-317.
308. Stote, D. L., and Fanselow, M. S. (2004). NMDA receptor modu-lation of incidental learning in Pavlovian context conditioning. Behav. Neurosci. 118, 253-257.
309. Stuber, G. D., Sparta, D. R., Stamatakis, A. M., Van Leeuwen, W. A., Hardjoprajitno, J. E., Cho, S., Tye, K. M., Kempadoo, K. A., Zhang, F., Deisseroth, K., and Bonci, A. (2011). Excitatory transmission from the amygdala to nucleus accumbens facilitates reward seeking. Nature 475, 377-380.
310. Suri, R. E., and Schultz, W. (1998). Learning of sequential move-ments by nerual network model with dopamine-like reinforce-ment signal. Exp. Brain Res. 121, 350-354.
311. Surmeier, D. J., Day, M., Gertler, T., Chan, S., and Shen, W. (2010). "D1 and D2 dopamine receptor modu-lation of glutamatergic signaling in striatual medium spiny neurons, " in Handbook of Basal Ganglia Structure and Function, eds H. Steiner and K. Y. Tseng (London: Academic Press), 113-129.
312. Surmeier, D. J., Song, W.-J., and Yan, Z. (1996). Coordinated expression of dopamine receptors in neostriatal medium spiny neurons. J. Neurosci. 16, 6579-6591.
313. Sutcliffe, J. G., and De Lecea, L. (2002). The hypocretins: setting the arousal threshold. Nat. Rev. Neurosci. 3, 339-349.
314. Sutherland, R. J., Kolb, B., and Whishaw, I. Q. (1982). Spatial mapping: definitive disruption by hippocampal or medial frontal cortical damage in the rat. Neurosci. Lett. 31,271-276.
315. Sutherland, R. J., and McDonald, R. J. (1990). Hippocampus, amygdala, and memory deficits in rats. Behav. Brain Res. 37, 57-79.
316. Sutherland, R. J., McDonald, R. J., Hill, C. R., and Rudy, J. W. (1989). Damage to the hippocampal forma-tion in rats selectively impairs the ability to learn cue relationships. Behav. Neural Biol. 52, 331-356.
317. Sutherland, R. J., Whishaw, I. Q., and Kolb, B. (1988). Contributions of cingulate cortex to two forms of spatial learning and memory. J. Neurosci. 8, 1863-1872.
318. Sutton, R. S., and Barto, A. G. (1998). Reinforcement Learning: An Introduction. Cambridge, MA: MIT Press.
319. Swanson, L. W., and Kohler, C. (1986). Anatomical evidence for direct pro-jections from the entorhinal area to the entire cortical mantle in the rat. J. Neurosci. 6, 3010-3023.
320. Takahashi, K., Lin, J. S., and Sakai, K. (2006). Neuronal activity of histaminergic tuberomammillary neurons during wake-sleep states in the mouse. J. Neurosci. 26, 10292-10298.
321. Tepper, J. M. (2010). "GABAergic interneurons of the striatum, " in Handbook of Basal Ganglia Structure and Function, eds H. Steiner and K. Y. Tseng (London: Academic Press), 151-166.
322. Thorn, C. A., Atallah, H., Howe, M., and Graybiel, A. M. (2010). Differential dynamics of activity changes in dorsolateral and dorso-medial striatal loops during learn-ing. Neuron 66, 781-795.
323. Thorndike, E. L. (1911). Animal Intelligence. New York, NY: Macmillan Co.
324. Tolman, E. C. (1932). Purposive Behavior in Animals and Man. New York, NY: Appleton.
325. Tolman, E. C., Ritchie, B. F., and Kalish, D. (1946). Studies in spa-tial learning; place learning versus response learning. J. Exp. Psychol. 36, 221-229.
326. Tulving, E., and Markowitsch, H. J. (1998). Episodic and declarative memory: role of the hippocampus. Hippocampus 8, 198-204.
327. Tunstall, M. J., Oorschot, D. E., Kean, A., and Wickens, J. R. (2002). Inhibitory interactions between spiny projection neurons in the rat striatum. J. Neurophysiol. 88, 1263-1269.
328. Van Den Bos, W., Li, J., Lau, T., Maskin, E., Cohen, J. D., Montague, P. R., and McClure, S. M. (2008). The value of victory: social origins of the winner's curse in common value auctions. Judgm. Decis. Mak. 3, 483-492.
329. Van Der Meer, M. A., and Redish, A. D. (2009). Covert expectation-of-reward in rat ventral striatum at decision points. Front. Integr. Neurosci. 3:1. doi: 10.3389/neuro.07.001.2009
330. Van Der Meer, M. A., and Redish, A. D. (2011). Theta phase precession in rat ventral striatum links place and reward information. J. Neurosci. 31, 2843-2854.
331. Veening, J. G. (1978). Subcortical affer-ents of the amygdaloid complex in the rat: an HRP study. Neurosci. Lett. 8, 197-202.
332. Viviani, D., Charlet, A., Van Den Burg, E., Robinet, C., Hurni, N., Abatis, M., Magara, F., and Stoop, R. (2011). Oxytocin selectively gates fear responses through distinct out-puts from the central amygdala. Science 333, 104-107.
333. Voorn, P., Vanderschuren, L. J., Groenewegen, H. J., Robbins, T. W., and Pennartz, C. M. (2004). Putting a spin on the dorsal-ventral divide of the striatum. Trends Neurosci. 27, 468-474.
334. Wan, F. J., Caine, S. B., and Swerdlow, N. R. (1996). The ventral subiculum modulation of prepulse inhibition is not mediated via dopamine D2 or nucleus accumbens non-NMDA glutamate receptor activity. Eur. J. Pharmacol. 314, 9-18.
335. Wan, F. J., and Swerdlow, N. R. (1996). Sensorimotor gating in rats is regulated by different dopamine-glutamate interactions in the nucleus accumbens core and shell subregions. Brain Res. 722, 168-176.
336. Wan, F. J., and Swerdlow, N. R. (1997). The basolateral amygdala regulates sensorimotor gating of acoustic startle in the rat. Neuroscience 76, 715-724.
337. Wan, X., and Peoples, L. L. (2006). Firing patterns of accumbal neurons during a pavlovian-conditioned approach task. J. Neurophysiol. 96, 652-660.
338. Weiner, I., Gal, G., Rawlins, J. N., and Feldon, J. (1996). Differential involvement of the shell and core subterritories of the nucleus accumbens in latent inhibition and amphetamine-induced activity. Behav. Brain Res. 81, 123-133.
339. Weiner, I., Tarrasch, R., and Feldon, J. (1995). Basolateral amygdala lesions do not disrupt latent inhibition. Behav. Brain Res. 72, 73-81.
340. Weiskrantz, L. (1956). Behavioral changes associated with ablation of the amygdaloid complex in monkeys. J. Comp. Physiol. Psychol. 49, 381-391.
341. Whalen, P. J., Rauch, S. L., Etcoff, N. L., McInerney, S. C., Lee, M. B., and Jenike, M. A. (1998). Masked presentations of emotional facial expressions modulate amygdala activity without explicit knowledge. J. Neurosci. 18, 411-418.
342. Whishaw, I. Q., Piecharka, D. M., Zeeb, F., and Stein, D. G. (2004). Unilateral frontal lobe contusion and forelimb function: chronic quantitative and qualitative impair-ments in reflexive and skilled forelimb movements in rats. J. Neurotrauma 21, 1584-1600.
343. White, I. M., and Rebec, G. V. (1993). Responses of rat striatal neurons during performance of a lever-release version of the conditioned avoidance response task. Brain Res. 616, 71-82.
344. White, N. M., and McDonald, R. J. (2002). Multiple parallel mem-ory systems in the brain of the rat. Neurobiol. Learn. Mem. 77, 125-184.
345. White, N. M., Packard, M. G., and Hiroi, N. (1991). Place conditioning with dopamine D1 and D2 agonists injected peripherally or into nucleus accumbens. Psychopharmacology (Berl.) 103,271-276.
346. Wickens, J. R., Kotter, R., and Alexander, M. E. (1995). Effects of local connectivity on striatal function: stimulation and analysis of a model. Synapse 20, 281-298.
347. Wiener, S. I. (1993). Spatial and behav-ioral correlates of striatal neurons in rats performing a self-initiated navigation task. J. Neurosci. 13, 3802-3817.
348. Wilcove, W. G., and Miller, J. C. (1974). CS-USC presentations and a lever: human autoshaping. J. Exp. Psychol. 103, 868-877.
349. Wiltgen, B. J., Sanders, M. J., Anagnostaras, S. G., Sage, J. R., and Fanselow, M. S. (2006). Context fear learning in the absence of the hippocampus. J. Neurosci. 26, 5484-5491.
350. Winstanley, C. A., Eagle, D. M., and Robbins, T. W. (2006). Behavioral models of impulsivity in relation to ADHD: translation between clin-ical and preclinical studies. Clin. Psychol. Rev. 26, 379-395.
351. Wise, S. P., and Murray, E. A. (2000). Arbitrary associations between antecedents and actions. Trends Neurosci. 23, 271-276.
352. Witten, I. B., Steinberg, E. E., Lee, S. Y., Davidson, T. J., Zalocusky, K. A., Brodsky, M., Yizhar, O., Cho, S. L., Gong, S., Ramakrishnan, C., Stuber, G. D., Tye, K. M., Janak, P. H., and Deisseroth, K. (2011). Recombinase-driver rat lines: tools, techniques, and optogenetic appli-cation to dopamine-mediated reinforcement. Neuron 72, 721-733.
353. Wood, E. R., Dudchenko, P. A., Robitsek, R. J., and Eichenbaum, H. (2000). Hippocampal neurons encode information about different types of memory episodes occur-ring in the same location. Neuron 27, 623-633.
354. Wright, C. I., and Groenewegen, H. J. (1995). Patterns of convergence and segregation in the medial nucleus accumbens of the rat: relation-ships of prefrontal cortical, mid-line thalamic, and basal amygdaloid afferents. J. Comp. Neurol. 361, 383-403.
355. Wyvell, C. L., and Berridge, K. C. (2000). Intra-accumbens amphetamine increases the condi-tioned incentive salience of sucrose reward: enhancement of reward "wanting" without enhanced "lik-ing" or response reinforcement. J. Neurosci. 20, 8122-8130.
356. Yin, H. H., and Knowlton, B. J. (2006). The role of the basal ganglia in habit formation. Nat. Rev. Neurosci. 7, 464-476.
357. Yin, H. H., Knowlton, B. J., and Balleine, B. W. (2004). Lesions of dorsolateral striatum preserve outcome expectancy but disrupt habit formation in instrumen-tal learning. Eur. J. Neurosci. 19, 181-189.
358. Yin, H. H., Knowlton, B. J., and Balleine, B. W. (2006). Inactivation of dorsolateral striatum enhances sensitivity to changes in the action-outcome contingency in instrumen-tal conditioning. Behav. Brain Res. 166, 189-196.
359. Yin, H. H., Ostlund, S. B., Knowlton, B. J., and Balleine, B. W. (2005). The role of the dorsomedial stria-tum in instrumental conditioning. Eur. J. Neurosci. 22, 513-523.
360. Young, A. M. (2004). Increased extra-cellular dopamine in nucleus accumbens in response to uncon-ditioned and conditioned aversive stimuli: studies using 1 min micro-dialysis in rats. J. Neurosci. Methods 138, 57-63.
361. Yun, I. A., Wakabayashi, K. T., Fields, H. L., and Nicola, S. M. (2004). The ventral tegmental area is required for the behavioral and nucleus accumbens neuronal firing responses to incentive cues. J. Neurosci. 24, 2923-2933.
362. Zhang, W. N., Bast, T., and Feldon, J. (2001). The ventral hippocampus and fear conditioning in rats: different anterograde amne-sias of fear after infusion of N-methyl-D-aspartate or its noncompetitive antagonist MK-801 into the ventral hip-pocampus. Behav. Brain Res. 126, 159-174.
363. Zheng, T., and Wilson, C. J. (2002). Corticostriatal combi-natorics: the implications of corticostriatal axonal arborizations. J. Neurophysiol. 87, 1007-1017.
364. Zilli, E. A., and Hasselmo, M. E. (2008). Modeling the role of working memory and episodic memory in behavioral tasks. Hippocampus 18, 193-209.
365. Zorawski, M., and Killcross, S. (2003). Glucocorticoid receptor agonist enhances pavlovian appeti-tive conditioning but disrupts outcome-specific associations. Behav. Neurosci. 117, 1453-1457.