A neural network model of hippocampal-striatal-prefrontal interactions in contextual conditioning

Brain Research

Volumn 1202, Issue , 2008, Pages 87-98

  Turnock, Matthew ^a   Becker, Suzanna ^a  

^a MCMASTER UNIVERSITY   (Canada)

Author keywords

Conditioned behavior; Context; Hippocampus; Nucleus accumbens; Prefrontal cortex

Indexed keywords

ARTICLE; ARTIFICIAL NEURAL NETWORK; ASSOCIATION; BEHAVIOR; COGNITION; CONDITIONING; CORPUS STRIATUM; EPISODIC MEMORY; HIPPOCAMPUS; LEARNING; MATHEMATICAL MODEL; NUCLEUS ACCUMBENS; PREFRONTAL CORTEX; PRIORITY JOURNAL;

ANIMALS; COMPUTER SIMULATION; CONDITIONING (PSYCHOLOGY); CUES; HIPPOCAMPUS; HUMANS; LEARNING; MEMORY; NERVE NET; NEURAL NETWORKS (COMPUTER); NUCLEUS ACCUMBENS; PREFRONTAL CORTEX;

EID: 40749118880     PISSN: 00068993     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.brainres.2007.06.078     Document Type: Article

References (83)

1. Anglada-Figueroa D., and Quirk G.J. Lesions of the basal amygdala block expression of conditioned fear but not extinction. J. Neurosci. 25 (2005) 9680-9685
2. Badre D., and Wagner A.D. Selection, integration, and conflict monitoring: assessing the nature and generality of prefrontal cognitive control mechanisms. Neuron 41 (2004) 473-487
3. Becker S. A computational principle for hippocampal learning and neurogenesis. Hippocampus 15 (2005) 722-738
4. Birrell J.M., and Brown V.J. Medial frontal cortex mediates perceptual attentional set shifting in the rat. J. Neurosci. 20 (2000) 4320-4324
5. Boss B.D., Peterson G.M., and Cowan W.M. On the numbers of neurons in the dentate gyrus of the rat. Brain Res. 338 (1985) 144-150
6. Boss B.D., Turlejski K., Stanfield B.B., and Cowen W.M. On the numbers of neurons in fields CA1 and CA3 of the hippocampus of Sprague-Dawley and Wistar rats. Brain Res. 406 (1987) 280-287
7. Bouton M.E. Context, time, and memory retrieval in the interference paradigms of pavlovian learning. Psychol. Bull. 114 (1993) 80-99
8. Bouton M.E. Context and behavioral processes in extinction. Learn. Mem. 11 (2004) 485-494
9. Bouton M.E., and Bolles R.C. Role of conditioned contextual stimuli in reinstatement of extinguished fear. J. Exp. Psychol., Anim. Behav. Processes 5 (1979) 368-378
10. Bridle J.S. Training stochastic model recognition algorithms as networks can lead to maximum mutual information estimation of parameters. In: Touretzky D.S. (Ed). Advances in Neural Information Processing Systems vol. 2 (1990), Morgan Kaufmann, San Mateo 211-217
11. Broersen L.M., Heinsbroek R.P.W., Debruin J.P.C., Uylings H.B.M., and Olivier B. The role of the medial prefrontal cortex of rats in short-term-memory functioning-further support for involvement of cholinergic, rather than dopaminergic mechanisms. Brain Res. 674 (1995) 221-229
12. Burgess N., Maguire E.A., and O'Keefe J. The human hippocampus and spatial and episodic memory. Neuron 35 (2002) 625-641
13. Burish M.J., Kueh H.Y., and Wang S.S.H. Brain architecture and social complexity in modern and ancient birds. Brain Behav. Evol. 63 (2004) 107-124
14. Carelli R.M., and Ijames S.G. Nucleus accumbens cell firing during maintenance, extinction, and reinstatement of cocaine self-administration behavior in rats. Brain Res. 866 (2000) 44-54
15. Carmichael S.T., and Price J.L. Limbic connections of the orbital and medial prefrontal cortex in macaque monkeys. J. Comp. Neurol. 363 (1995) 615-641
16. Channell S., and Hall G. Contextual effects in latent inhibition with an appetitive conditioning procedure. Anim. Learn. Behav. 11 (1983) 67-74
17. Cohen J., and Servan-Schreiber D. Context, cortex, and dopamine: a connectionist approach to behavior and biology in schizophrenia. Psychol. Rev. 99 (1992) 45-77
18. Dalley J.W., Cardinal R.N., and Robbins T.W. Prefrontal executive and cognitive functions in rodents: neural and neurochemical substrates. Neurosci. Biobehav. Rev. 28 (2004) 771
19. Daw N.D., and Touretzky D.S. Behavioral considerations suggest an average reward TD model of the dopamine system. Neurocomputing 32 (2000) 679-684
20. Daw N.D., Kakade S., and Dayan P. Opponent interactions between serotonin and dopamine. Neural Netw. 15 (2002) 603-616
21. Devan B.D., Goad E.H., and Petri H.L. Dissociation of hippocampal and striatal contributions to spatial navigation in the water maze. Neurobiol. Learn. Mem. 66 (1996) 305-323
22. De Wit S., Kosaki Y., Balleine B.W., and Dickinson A. Dorsomedial prefrontal cortex resolves response conflict in rats. J. Neurosci. 26 (2006) 5224-5229
23. Diamond M.C., Ingham C.A., Johnson R.E., Bennett E.L., and Rosenzweig M.R. Effects of environment on morphology of rat cerebral-cortex and hippocampus. J. Neurobiol. 7 (1976) 75-85
24. Dunnett S.B., Meldrum A., and Muir J.L. Frontal-striatal disconnection disrupts cognitive performance of the frontal-type in the rat. Neuroscience 135 (2005) 1055-1065
25. Eich J.E. State-dependent accessibility of retrieval cues in retention of a categorized list. J. Verbal Learn. Verbal Behav. 14 (1975) 408-417
26. Feigenbaum J.D., and Rolls E.T. Allocentric and egocentric spatial information-processing in the hippocampal-formation of the behaving primate. Psychobiology 19 (1991) 21-40
27. Fletcher P.J., and Korth K.M. Activation of 5-HT1B receptors in the nucleus accumbens reduces amphetamine induced enhancement of responding for conditioned reward. Psychopharmacology 142 (1999) 165-174
28. Frank M.J., Rudy J.W., and O'Reilly R.C. Transitivity, Flexibility, Conjunctive Representations and the Hippocampus: II. A Computational Analysis. Hippocampus 13 (2003) 341-354
29. Gagliardo A., Bonadonna F., and Divac I. Behavioural effects of ablations of the presumed 'prefrontal cortex' or the corticoid in pigeons. Behav. Brain Res. 78 (1996) 155-162
30. Gewirtz J.C., McNish K.A., and Davis M. Is the hippocampus necessary for contextual fear conditioning?. Behav. Brain Res. 110 (2000) 83-95
31. Gisquet-Verrier P., Dutrieux G., Richer P., and Doyere V. Effects of lesions to the hippocampus on contextual fear: evidence for a disruption of freezing and avoidance behaviour but not context conditioning. Behav. Neurosci. 113 (1999) 507-522
32. Goto Y., and Grace A.A. Dopaminergic modulation of limbic and cortical drive of nucleus accumbens in goal-directed behavior. Nat. Neurosci. 8 (2005) 805-812
33. Goto Y., and Grace A.A. Dopamine-dependent interactions between limbic and prefrontal cortical plasticity in the nucleus accumbens: disruption by cocaine sensitization. Neuron 47 (2005) 255-266
34. Grace A.A. Gating of information flow within the limbic system and the pathophysiology of schizophrenia. Brains Res. Rev. 31 (2000) 330-341
35. Hall G., and Channell S. Context specificity of latent inhibition in taste-aversion learning. Q. J. Exp. Psychol., B Comp. Physiol. Psychol. 38 (1986) 121-139
36. Hall G., Purves D., and Bonardi C. Contextual control of conditioned responding in rats with dorsal hippocampallesions. Behav. Neurosci. 110 (1996) 933-945
37. Holcman D., and Tsodyks M. The emergence of up and down states in cortical networks. PLOS Comput. Biol. 2 (2006) 174-181
38. Ikemoto S., and Panksepp J. The role of nucleus accumbens dopamine in motivated behavior: a unifying interpretation with special reference to reward-seeking. Brains Res. Rev. 31 (1999) 6-41
39. Lovibond P.F., Preston G.C., and Mackintosh N.J. Context specificity of conditioning, extinction, and latent inhibition. J. Exp. Psychol., Anim. Behav. Processes 10 (1984) 360-375
40. Maguire E.A., Frackowiak R.S.J., and Frith C.D. Recalling routes around London: activation of the right hippocampus in taxi drivers. J. Neurosci. 17 (1997) 7103-7110
41. Maguire E.A., Burgess N., Donnett J.G., Frackowiak R.S.J., Frith C.D., and O'Keefe J. Knowing where and getting there: a human navigation network. Science 280 (1998) 921-924
42. Mark L.P., Daniels D.L., Naidich T.P., and Hendrix L.E. Limbic connections. Am. J. Neuroradiol. 16 (1995) 1303-1306
43. Marr D. Simple memory: a theory for archicortex. Philos. trans. R. Soc. Lond., B 262 (1971) 23-81
44. Matsumoto K., Suzuki W., and Tanaka K. Neuronal correlates of goal-based motor selection in the prefrontal cortex. Science 301 (2003) 229-232
45. Mogenson G.J., Jones D.L., and Yim C.Y. From motivation to action: functional interface between limbic system and the motor system. Prog. Neurobiol. 14 (1980) 69-97
46. Muller R.U. The effects of changes in the environment on the spatial firing of hippocampal complex-spike cells. J. Neurosci. 7 (1987) 1951-1968
47. O'Donnell P., and Grace A.A. Synaptic-interactions among excitatory afferents to nucleus-accumbens neurons-hippocampal gating of prefrontal cortical input. J. Neurosci. 15 (1995) 3622-3639
48. O'Donnell P., Greene J., Pabello N., Lewis B.L., and Grace A.A. Modulation of cell firing in the nucleus accumbens. Ann. N.Y. Acad. Sci. 877 (1999) 157-175
49. O'Keefe J. Review of the hippocampal place cells. Prog. Neurobiol. 13 (1979) 419-439
50. O'Reilly R.C., and Frank M.J. Making working memory work: a computational model of learning in the prefrontal cortex and basal ganglia. Neural Comput. 18 (2006) 283-328
51. O'Reilly R.C., and McClelland J.L. Hippocampal conjunctive encoding, storage, and recall: avoiding a tradeoff. Hippocampus 4 (1994) 661-682
52. O'Reilly R.C., and Rudy J.W. Computational principles of learning in the neocortex and hippocampus. Hippocampus 10 (2000) 389-397
53. O'Reilly R.C., and Rudy J.W. Conjunctive representations in learning and memory: principles of cortical and hippocampal function. Psychol. Rev. 108 (2001) 311-345
54. O'Reilly R.C., Noelle D.C., Braver T.S., and Cohen J.D. Prefrontal cortex and dynamic categorization tasks: representational organization and neuromodulatory control. Cereb. Cortex 12 (2002) 246-257
55. Pennartz C.M.A., Groenewegen H.J., and Lopes da Silva F.H. The nucleus-accumbens as a complex of functionally distinct neuronal ensembles-an integration of behavioral, electrophysiological and anatomical data. Prog. Neurobiol. 42 (1994) 719-761
56. Phillips R.G., and LeDoux J.E. Lesions of the dorsal hippocampal-formation interfere with background but not foreground contextual fear conditioning. Learn. Memory 1 (1994) 34-44
57. Prado-Alcalar R., and Wise R.A. Brain-stimulation reward and dopamine terminal fields: 1. Caudate-putamen, nucleus accumbens and amygdala. Brain Res. 297 (1984) 265-273
58. Reynolds S.M., and Berridge K.C. Fear and feeding in the nucleus accumbens shell: rostrocaudal segregation of GABA-elicited defensive behaviour versus eating behaviour. J. Neurosci. 21 (2001) 3261-3270
59. Rolls E.T., and Williams G.V. Neuronal activity in the ventral striatum of the primate. In: Carpenter M.B., and Jayamaran A. (Eds). The basal ganglia II- structure and function - current concepts (1987), Plenum, New York 349-356
60. Rougier N.P., and O'Reilly R.C. Learning representations in a gated prefrontal cortex model of dynamic task switching. Cogn. Sci. 26 (2002) 503-520
61. Rudy J.W., and O'Reilly R.C. Contextual fear conditioning, conjunctive representations, pattern completion, and the hippocampus. Behav. Neurosci. 113 (1999) 867-880
62. Rudy J.W., Barrientos R.M., and O'Reilly R.C. Hippocampal formation supports conditioning to memory of a context. Behav. Neurosci. 116 (2002) 530-538
63. Rudy J.W., Huff N.C., and Matus-Amat P. Understanding contextual fear conditioning: insights from a two-process model. Neurosci. Biobehav. Rev. 28 (2004) 675-685
64. Schmajuk N.A., and DiCarlo J.J. Stimulus configuration, classical-conditioning, and hippocampal function. Psychol. Rev. 99 (1992) 268-305
65. Schoenbaum G., Chiba A.A., and Gallagher M. Orbitofrontal cortex and basolateral amygdala encode expected outcomes during learning. Nat. Neurosci. 1 (1998) 155-159
66. Schoenbaum G., Chiba A.A., and Gallagher M. Neural encoding in orbitofrontal cortex and basolateral amygdala during olfactory discrimination learning. J. Neurosci. 19 (1999) 1876-1884
67. Schultz W. Predictive reward signal of dopamine neurons. J. Neurophysiol. 80 (1998) 1-27
68. Schultz W., Dayan P., and Montague P.R. A neural substrate of prediction and reward. Science 275 (1997) 1593-1599
69. Selden N.R.W., Everitt B.J., Jarrard L.E., and Robbins T.W. Complementary roles for the amygdala and hippocampus in aversive-conditioning to explicit and contextual cues. Neuroscience 42 (1991) 335-350
70. Smith A., Li M., Becker S., and Kapur S. A model of antipsychotic action in conditioned avoidance: a computational approach. Neuropsychopharmacology 29 (2004) 1040-1049
71. Solomon P.R., Solomon S.D., Vander Schaaf E., and Perry H.E. Altered activity in the hippocampus is more detrimental to classical-conditioning than removing the structure. Science 220 (1983) 329-331
72. Solomon P.R., Vander Schaaf E.R., Thompson R.F., and Weisz D.J. Hippocampus and trace conditioning of the rabbit's classically conditioned nictitating membrane response. Behav. Neurosci. 100 (1986) 729-744
73. Squire L.R. Memory and the hippocampus-a synthesis from findings with rats, monkeys, and humans. Psychol. Rev. 99 (1992) 195-231
74. Squire L.R., Shimamura A.P., and Amaral D.G. Memory and the hippocampus. In: Byrne J.H., and Berry W.O. (Eds). Neural Models of Plasticity: Experimental and Theoretical Approaches (1989), Academic Press, San Diego 208-239
75. Suri R. TD models of reward predictive responses in dopamine neurons. Neural Netw. 15 (2002) 523-533
76. Suri R.E., Bargas J., and Arbib M.A. Modeling functions of striatal dopamine modulation in learning and planning. Neuroscience 103 (2001) 65-85
77. Sutton R.S., and Barto A.G. A temporal-difference model of classical conditioning. Proceedings of the Ninth Conference of the Cognitive Science Society (1987) 355-378
78. Tulving E., and Markowitsch H.J. Episodic and declarative memory: role of the hippocampus. Hippocampus 8 (1998) 198-204
79. Ungless M.A. Dopamine: the salient issue. Trends Neurosci. 27 (2004) 702-706
80. Watkins, C., 1989. Learning from delayed rewards. PhD thesis, University of Cambridge, Psychology Department.
81. Winocur G. Hippocampal lesions alter conditioning to conditional and contextual stimuli. Behav. Brain Res. 88 (1997) 219-299
82. Winocur G., and Moscovitch M. Hippocampal and prefrontal cortex contributions to learning and memory: analysis of lesion and aging effects on maze learning in rats. Behav. Neurosci. 104 (1990) 544-551
83. Yap C.S.L., and Richardson R. Latent inhibition in the developing rat: an examination of context-specific effects. Dev. Psychobiol. 47 (2005) 55-65