The role of the anterior, mediodorsal, and parafascicular thalamus in instrumental conditioning

Frontiers in Systems Neuroscience

Volumn 7, Issue OCT, 2013, Pages

  Bradfield, Laura A ^a   Hart, Genevra ^a   Balleine, Bernard W ^a  

^a UNIVERSITY OF SYDNEY   (Australia)

Author keywords

Anterior thalamic nuclei; Corticothalamic disconnection; Instrumental conditioning; Mediodorsal thalamic nucleus; Parafascicular thalamic nuclei; Prelimbic cortex

Indexed keywords

AMYGDALOID NUCLEUS; ANIMAL BEHAVIOR; BRAIN CORTEX; FRONTAL CORTEX; GOAL ATTAINMENT; INSTRUMENTAL CONDITIONING; NONHUMAN; PRELIMBIC CORTEX; REGULATORY MECHANISM; RESEARCH; REVIEW; TASK PERFORMANCE; THALAMUS ANTERIOR NUCLEUS; THALAMUS DORSOMEDIAL NUCLEUS; THALAMUS PARAFASCICULAR NUCLEUS;

EID: 84887060777     PISSN: 16625137     EISSN: None     Source Type: Journal    
DOI: 10.3389/fnsys.2013.00051     Document Type: Review

References (64)

1. Adams, C. D. (1982). Variations in the sensitivity of instrumental responding to reinforcer devaluation. Q. J. Exp. Psychol. B 34, 77-98. doi: 10.1080/14640748208400878
2. Adams, C. D., and Dickinson, A. (1981). Instrumental responding following reinforcer devaluation. Q. J. Exp. Psychol. B 33, 109-122. doi: 10.1080/14640748108400816
3. Balleine, B. W., and Dickinson, A. (1998). Goal-directed instrumental action: contingency and incentive learning and their cortical substrates. Neuropharmacology 37, 407-419. doi: 10.1016/s0028-3908(98)00033-1
4. Balleine, B. W., Leung, B. K., and Ostlund, S. B. (2011). The orbitofrontal cortex, predicted value, and choice. Ann. N Y Acad. Sci. 1239, 43-50. doi: 10.1111/j.1749-6632.2011.06270.x
5. Balleine, B. W., and O'Doherty, J. P. (2010). Human and rodent homologies in action control: corticostriatal determinants of goal-directed and habitual action. Neuropsychopharmacology35, 48-69. doi: 10.1038/npp.2009.131
6. Balleine, B. W., and Ostlund, S. B. (2007). Still at the choicepoint: action selection and initiation in instrumental conditioning. Ann. N Y Acad. Sci. 1104, 147-171. doi: 10.1196/annals.1390.006
7. Bertran-Gonzalez, J., Chieng, B. C., Laurent, V., Valjent, E., and Balleine, B. W. (2012). Striatal cholinergic interneurons display activity-related phosphorylation of ribosomal protein S6. PLoS One 7:e53195. doi: 10.1371/journal.pone.0053195
8. Bolles, R. C., Holtz, R., Dunn, T., and Hill, W. (1980). Comparisons of stimulus-learning and response learning in a punishment situation. Learn. Motiv. 11, 78-96. doi: 10.1016/0023-9690(80)90022-3
9. Bradfield, L. A., and Balleine, B. W. (2013). Hierarchical and binary relations compete for behavioural control during instrumental biconditional discrimination. J. Exp. Psychol. Anim. Behav. Process. 39, 2-13. doi: 10.1037/a0030941
10. Bradfield, L. A., Bertran-Gonzalez, J., Chieng, B., and Balleine, B. W. (2013). The thalamostriatal pathway and cholinergic control of goal-directed action: interlacing new with existing learning in the striatum. Neuron 79, 153-166. doi: 10.1016/j.neuron.2013.04.039
11. Brown, H. D., Baker, P. M., and Ragozzino, M. E. (2010). The parafascicular thalamic nucleus concomitantly influences behavioural flexibility and dorsomedial striatal acetylcholine output in rats. J. Neurosci. 30, 14390-14398. doi: 10.1523/jneurosci.2167-10.2010
12. Buchanan, S. L. (1994). Mediodorsal thalamic lesions impair acquisition of an eyeblink avoidance response in rabbits. Behav. Brain Res. 65, 173-179. doi: 10.1016/0166-4328(94)90103-1
13. Colwill, R. M., and Rescorla, R. A. (1985). Postconditioning devaluation of a reinforcer affects instrumental responding. J. Exp. Psychol. Anim. Behav. Process. 11, 120-132. doi: 10.1037//0097-7403.11.1.120
14. Colwill, R. M., and Rescorla, R. A. (1988). Relations between the discriminative stimulus and the reinforcer in instrumental learning. J. Exp. Psychol. Anim. Behav. Process. 14, 155-164.
15. Conejo, N. M., Gonzalez-Padro, H., Lopez, M., Cantora, R., and Arias, J. L. (2007). Induction of c-Fos expression in the mammillary bodies, anterior thalamus and dorsal hippocampus after fear conditioning. Brain Res. Bull. 74, 172-177. doi: 10.1016/j.brainresbull.2007.06.006
16. Corbit, L. H., and Balleine, B. W. (2003). The role of prelimbic cortex in instrumental conditioning. Behav. Brain Res. 146, 145-157. doi: 10.1016/j.bbr.2003.09.023
17. Corbit, L. H., Janak, P. H., and Balleine, B. W. (2007). General and outcome-specific forms of Pavlovian-instrumental transfer: the effect of shifts in motivational state and inactivation of the ventral tegmental area. Eur. J. Neurosci. 26, 3141-3149. doi: 10.1111/j.1460-9568.2007.05934.x
18. Corbit, L. H., Muir, J. L., and Balleine, B. W. (2003). Lesions of mediodorsal thalamus and anterior thalamic nuclei produce dissociable effects on instrumental conditioning in rats. Eur. J. Neurosci. 18, 1286-1294. doi: 10.1046/j.1460-9568.2003.02833.x
19. Coutureau, E., Marchand, A. R., and Di Scala, G. (2009). Goal-directed responding is sensitive to lesions to the prelimbic cortex or basolateral nucleus of the amygdala but not to their disconnection. Behav. Neurosci. 123, 443-448. doi: 10.1037/a0014818
20. Davis, J., and Bitterman, M. E. (1971). Differential reinforcement of other behaviour (DRO)-yoked-control comparison. J. Exp. Anal. Behav. 15, 237-241. doi: 10.1901/jeab.1971.15-237
21. Daw, N. D., Niv, Y., and Dayan, P. (2005). Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nat. Neurosci. 8, 1704-1711. doi: 10.1038/nn1560
22. Delacour, J. (1969). Role of a medial thalamic structure in various types of instrumental defensive conditioning. Physiol. Behav. 4, 969-974. doi: 10.1016/0031-9384(69)90051-1
23. Dickinson, A. (1994). "Instrumental conditioning, " in Animal Learning and Cognition, ed N. J. Mackintosh (San Diego, CA: Academic Press), 45-79.
24. Dickinson, A., and Balleine, B. (1994). Motivational control of goal-directed action. Anim. Learn. Behav. 22, 1-18. doi: 10.3758/bf03199951
25. Dickinson, A., Balleine, B., Watt, A., Gonzalez, F., and Boakes, R. A. (1995). Motivational control after extended instrumental training. Anim. Learn. Behav. 23, 197-206. doi: 10.3758/bf03199935
26. Dickinson, A., Campos, J., Varga, Z., and Balleine, B. W. (1996). Bidirectional control of instrumental conditioning. Q. J. Exp. Psychol. 49, 289-306. doi: 10.1080/713932637
27. Gabriel, M., Cuppernell, C., Shenker, J. I., Kubota, Y., Henzi, V., and Swanson, D. (1995). Mamillothalamic tract transection blocks anterior thalamic training-induced neuronal plasticity and impairs discriminative avoidance-behaviour in rabbits. J. Neurosci. 15, 1437-1445.
28. Gabriel, M., Lambert, R. W., Foster, K., Orona, E., Sparenborg, S., and Maiorca, R. R. (1983). Anterior thalamic lesions and neuronal-activity in the cingulate and retrosplenial cortices during discriminative avoidance-behaviour in rabbits. Behav. Neurosci. 97, 675-695. doi: 10.1037//0735-7044.97.5.675
29. Gabriel, M., Miller, J. D., and Saltwick, S. E. (1977). Unit-activity in cingulate cortex and anteroventral thalamus of rabbit during differential conditioning and reversal. J. Comp. Physiol. Psychol. 91, 423-433. doi: 10.1037/h0077321
30. Gabriel, M., Sparenborg, S., and Kubota, Y. (1989). Anterior medial thalamic lesions, discriminative avoidance-learning, and cingulate cortical neuronal-activity in rabbits. Exp. Brain Res. 76, 441-457. doi: 10.1007/bf00247901
31. Grindley, G. C. (1932). The formation of a simple habit in guinea pigs. Br. J. Psychol. 23, 127-147. doi: 10.1111/j.2044-8295.1932.tb00655.x
32. Groenewegen, H. J. (1988). Organisation of the afferent connections of the mediodorsal thalamic nucleus in the rat, related to the mediodorsal prefrontal topography. Neuroscience24, 379-431. doi: 10.1016/0306-4522(88)90339-9
33. Hershberger, W. A. (1986). An approach through the looking-glass. Anim. Learn. Behav. 14, 443-451. doi: 10.3758/BF03200092
34. Holland, P. C. (1979). Differential effects of omission contingencies on various components of Pavlovian appetitive conditioned responding in rats. J. Exp. Psychol. Anim. Behav. Process.5, 178-193. doi: 10.1037//0097-7403.5.2.178
35. Hunt, P. R., and Aggleton, J. P. (1998). An examination of the spatial working memory deficit following neurotoxic medial dorsal thalamic lesions in rats. Behav. Brain Res. 97, 129-141. doi: 10.1016/s0166-4328(98)00033-3
36. Krettek, J. E., and Price, J. L. (1977). Cortical projections of the mediodorsal nucleus and adjacent thalamic nuclei in the rat. J. Comp. Neurol. 171, 157-91. doi: 10.1002/cne.901710204
37. Kuroda, M., Murakami, K., Oda, S., Shinkai, M., and Kishi, K. (1993). Direct synaptic connections between thalamocortical axon terminals from the mediodorsal thalamic nucleus (MD) and corticothalamic neurons to MD in the prefrontal cortex. Brain Res. 612, 339-344. doi: 10.1016/0006-8993(93)91683-j
38. Lingawi, N. W., and Balleine, B. W. (2012). Amygdala central nucleus interacts with dorsolateral striatum to regulate the acquisition of habits. J. Neurosci. 32, 1073-1081. doi: 10.1523/jneurosci.4806-11.2012
39. Matsumoto, N., Minamimoto, T., Graybiel, A. M., and Kimura, M. (2001). Neurons in the thalamic CM-Pf complex supply striatal neurons with information about behaviorally significant sensory events. J. Neurophysiol. 85, 960-976.
40. Minamimoto, T., Hori, Y., and Kimura, M. (2009). Roles of the thalamic CM-PF complex-basal ganglia circuit in externally driven rebias of action. Brain Res. Bull. 78, 75-79. doi: 10.1016/j.brainresbull.2008.08.013
41. Negyessy, L., Hamori, J., and Bentivolglio, M. (1998). Contralateral cortical projection to the mediodorsal thalamic nucleus: origin and synaptic organisation in the rat. Neuroscience 84, 741-753. doi: 10.1016/s0306-4522(97)00559-9
42. Ostlund, S. B., and Balleine, B. W. (2005). Lesions of medial prefrontal cortex disrupt the acquisition but not the expression of goal-directed learning. J. Neurosci. 25, 7763-7770. doi: 10.1523/jneurosci.1921-05.2005
43. Ostlund, S. B., and Balleine, B. W. (2007). Orbitofrontal cortex mediates outcome encoding in Pavlovian but not instrumental conditioning. J. Neurosci. 27, 4819-4825. doi: 10.1523/jneurosci.5443-06.2007
44. Ostlund, S. B., and Balleine, B. W. (2008). Differential involvement of the BLA and MD in instrumental action selection. J. Neurosci. 28, 4398-4405. doi: 10.1523/jneurosci.5472-07.2008
45. Pavlov, I. P. (1927). Conditioned Reflexes: An Investigation of the Physiological Activity of the Cerebral Cortex. Oxford: Oxford University Press.
46. Paxinos, G., and Watson, C. (1998). The Rat Brain in Stereotaxic Co-Ordinates. 3rd Edn. New York: Elsevier.
47. Schoenbaum, G., and Roesch, M. (2005). Orbitofrontal cortex, associative learning, and expectancies. Neuron 47, 633-636. doi: 10.1016/j.neuron.2005.07.018
48. Schoenbaum, G., Stalnaker, T. A., and Niv, Y. (2013). How did the chicken cross the road? With her striatal interneurons of course. Neuron 79, 3-6. doi: 10.1016/j.neuron.2013.06.033
49. Schultz, W., and Dickinson, A. (2000). Neuronal coding of prediction errors. Ann. Rev. Neurosci. 23, 473-500. doi: 10.1146/annurev.neuro.23.1.473
50. Sheffield, F. D. (1965). "Relation between classical and instrumental conditioning, " inClassical Conditioning, ed W. F. Prokasy (New York, NY: Appelton-Century-Crofts), 302-322.
51. Skinner, B. F. (1932). On the rate of formation of a conditioned reflex. J. Gen. Psychol. 7, 274-285. doi: 10.1080/00221309.1932.9918467
52. Smith, D. M., Freeman, J. H., Nicholson, D., and Gabriel, M. (2002). Limbic thalamic lesions, appetitively motivated discrimination learning, and training-induced neuronal activity in rabbits. J. Neurosci. 22, 8212-8221.
53. Sparenborg, S., and Gabriel, M. (1992). Local norepinephrine depletion and learning-related neuronal-activity in cingulate cortex and anterior thalamus of rabbits. Exp. Brain Res. 92, 267-285. doi: 10.1007/bf00227970
54. Steinberg, E. E., Keiflin, R., Boivin, J. R., Witten, I. B., Deisseroth, K., and Janak, P. H. (2013). A causal link between prediction errors, dopamine neurons and learning. Nat. Neurosci. 16, 966-973. doi: 10.1038/nn.3413
55. Waelti, P., Dickinson, A., and Schultz, W. (2001). Dopamine responses comply with basic assumptions of formal learning theory. Nature 412, 43-48. doi: 10.1038/35083500
56. Warburton, E. C., and Aggleton, J. P. (1999). Differential deficits in the Morris water maze following cytotoxic lesions of the anterior thalamus and fornix transection. Behav. Brain Res.98, 27-38. doi: 10.1016/s0166-4328(98)00047-3
57. Williams, D. R., and Williams, H. (1969). Auto-maintenance in the pigeon: sustained pecking despite contingent non-reinforcement. J. Exp. Anal. Behav. 12, 511-520. doi: 10.1901/jeab.1969.12-511
58. Wilson, P. N., Boakes, R. A., and Swan, J. (1987). Instrumental learning as a result of omission training on wheel running. Q. J. Exp. Psychol. B 39, 161-171. doi: 10.1080/14640748708402260
59. Yin, H. H., and Knowlton, B. J. (2002). Reinforcer devaluation abolishes conditioned place preference: evidence for stimulus-stimulus relations. Behav. Neurosci. 116, 174-177. doi: 10.1037/0735-7044.116.1.174
60. Yin, H. H., Knowlton, B. J., and Balleine, B. W. (2004). Lesions of dorsolateral striatum preserve outcome expectancy but disrupt habit formation in instrumental learning. Eur. J. Neurosci. 19, 181-189. doi: 10.1111/j.1460-9568.2004.03095.x
61. Yin, H. H., Knowlton, B. J., and Balleine, B. W. (2005a). Blockade of NMDA receptors in the dorsomedial striatum prevents action-outcome learning in instrumental conditioning. Eur. J. Neurosci. 22, 505-512. doi: 10.1111/j.1460-9568.2005.04219.x
62. Yin, H. H., Knowlton, B. J., and Balleine, B. W. (2006). Inactivation of dorsolateral striatum enhances sensitivity to changes in action-outcome contingency in instrumental conditioning. Behav. Brain Res. 166, 189-196. doi: 10.1016/j.bbr.2005.07.012
63. Yin, H. H., Ostlund, S. B., and Balleine, B. W. (2008). Reward-guided learning beyond dopamine in the nucleus accumbens: the integrative functions of cortico-basal ganglia networks. Eur. J. Neurosci. 28, 1437-1448. doi: 10.1111/j.1460-9568.2008.06422.x
64. Yin, H. H., Ostlund, S. B., Knowlton, B. J., and Balleine, B. W. (2005b). The role of the dorsomedial striatum in instrumental conditioning. Eur. J. Neurosci. 22, 513-523. doi: 10.1111/j.1460-9568.2005.04218.x