Enhanced performance of aged rats in contingency degradation and instrumental extinction tasks

Behavioral Neuroscience

Volumn 128, Issue 2, 2014, Pages 122-133

  Samson, Rachel D ^a   Venkatesh, Anu ^a   Patel, Dhara H ^a   Lipa, Peter ^a   Barnes, Carol A ^a  

^a UNIVERSITY OF ARIZONA   (United States)

Author keywords

Cost; Effort; Operant learning; Reinforcer devaluation; Reward

Indexed keywords

MALTODEXTRIN; SUCROSE;

ADAPTIVE BEHAVIOR; AGED; AGING; ANIMAL BEHAVIOR; ANIMAL EXPERIMENT; ARTICLE; BEHAVIOR CHANGE; CONTROLLED STUDY; GROUPS BY AGE; INFANT; INSTRUMENTAL CONDITIONING; MALE; NONHUMAN; OPERANT BEHAVIORAL TEST; RAT; REINFORCEMENT; REWARD; SPATIAL MEMORY TEST; STATE DEPENDENT LEARNING; TASK PERFORMANCE; ANIMAL; CONDITIONED REFLEX; MAZE TEST; PHYSIOLOGY; PSYCHOLOGY;

AGING; ANIMALS; CONDITIONING, CLASSICAL; CONDITIONING, OPERANT; EXTINCTION, PSYCHOLOGICAL; MALE; MAZE LEARNING; RATS; REINFORCEMENT SCHEDULE; REWARD;

EID: 84921437770     PISSN: 07357044     EISSN: 19390084     Source Type: Journal    
DOI: 10.1037/a0035986     Document Type: Article

References (67)

1. Baldwin, A. E., Holahan, M. R., Sadeghian, K., & Kelley, A. E. (2000). N-methyl-D-aspartate receptor-dependent plasticity within a distributed corticostriatal network mediates appetitive instrumental learning. Behavioral Neuroscience, 114, 84-98. doi:10.1037/0735-7044.114.1.84
2. Balleine, B. W., Killcross, A. S., & Dickinson, A. (2003). The effect of lesions of the basolateral amygdala on instrumental conditioning. The Journal of Neuroscience, 23, 666-675.
3. Bates, D., Maechler, M., & Bolker, B. (2011). lme4: Linear mixed-effects models using S4 classes (Version 0.999375- 42). Retrieved from http://CRAN.R-project.org/package_lme4
4. Bevilaqua, L. R. M., Rossato, J. I., Bonini, J. S., Myskiw, J. C., Clarke, J. R., Monteiro, S.,... Izquierdo, I. (2008). The role of the entorhinal cortex in extinction: Influences of aging. Neural Plasticity, 2008, 595282. doi:10.1155/2008/595282
5. Bizon, J. L., Foster, T. C., Alexander, G. E., & Glisky, E. L. (2012). Characterizing cognitive aging of working memory and executive function in animal models. Frontiers in Aging Neuroscience, 4, 19. doi:10.3389/fnagi.2012.00019
6. Braun, S., & Hauber, W. (2012). Striatal dopamine depletion in rats produces variable effects on contingency detection: Task: related influences. European Journal of Neuroscience, 35, 486-495. doi:10.1111/j .1460-9568.2011.07969.x
7. Cizza, G., Gold, P. W., & Chrousos, G. P. (1995). Aging is associated in the 344/N Fischer rat with decreased stress responsivity of central and peripheral catecholaminergic systems and impairment of the hypothalamic-pituitary-adrenal axis. Annals of the New York Academy of Sciences, 771, 491-511. doi:10.1111/j.1749-6632.1995.tb44705.x
8. Corbit, L. H., Muir, J. L., & Balleine, B. W. (2001). The role of the nucleus accumbens in instrumental conditioning: Evidence of a functional dissociation between accumbens core and shell. The Journal of Neuroscience, 21, 3251-3260.
9. Corbit, L. H., & Balleine, B. W. (2003). The role of prelimbic cortex in instrumental conditioning. Behavioural Brain Research, 146, 145-157. doi:10.1016/j.bbr.2003.09.023
10. Corbit, L. H., Ostlund, S. B., & Balleine, B. W. (2002). Sensitivity to instrumental contingency degradation is mediated by the entorhinal cortex and its efferents via the dorsal hippocampus. The Journal of Neuroscience, 22, 10976-10984.
11. Coutureau, E., Marchand, A. R., & Di Scala, G. (2009). Goal-directed responding is sensitive to lesions to the prelimbic cortex or basolateral nucleus of the amygdala but not to their disconnection. Behavioral Neuroscience, 123, 443-448. doi:10.1037/a0014818
12. Cruz-Muros, I., Afonso-Oramas, D., Abreu, P., Barroso-Chinea, P., Rodríguez, M., González, M. C., & González Hernández, T. (2007). Aging of the rat mesostriatal system: Differences between the nigrostriatal and the mesolimbic compartments. Experimental Neurology, 204, 147-161. doi:10.1016/j.expneurol.2006.10.004
13. Dickstein, D. L., Weaver, C. M., Luebke, J. I., & Hof, P. R. (2012). Dendritic spine changes associated with normal aging. Neuroscience, 251, 21-32. doi:10.1016/j.neuroscience.2012.09.077
14. Eppinger, B., Hämmerer, D., & Li, S.-C. (2011). Neuromodulation of reward-based learning and decision making in human aging. Annals of the New York Academy of Sciences, 1235, 1-17. doi:10.1111/j.1749-6632.2011.06230.x
15. Frutos, M. G-S., Pistell, P. J., Ingram, D. K., & Berthoud, H-R. (2012). Feed efficiency, food choice, and food reward behaviors in young and old Fischer rats. Neurobiology of Aging, 33, 206.e41-206.e53.
16. Gallagher, M., Burwell, R., & Burchinal, M. R. (1993). Severity of spatial learning impairment in aging: Development of a learning index for performance in the Morris water maze. Behavioral Neuroscience, 107, 618-626. doi:10.1037/0735-7044.107.4.618
17. Gámiz, F., & Gallo, M. (2011). Taste learning and memory: A window on the study of brain aging. Frontiers in Systems Neuroscience, 5, 91. doi:10.3389/fnsys.2011.00091
18. Ghazizadeh, A., Ambroggi, F., Odean, N., & Fields, H. L. (2012). Prefrontal cortex mediates extinction of responding by two distinct neural mechanisms in accumbens shell. The Journal of Neuroscience, 32, 726-737. doi:10.1523/JNEUROSCI.3891-11.2012
19. Gilbert, R. J., Mitchell, M. R., Simon, N. W., Banuelos, C., Setlow, B., & Bizon, J. L. (2012). Risk, reward, and decision-making in a rodent model of cognitive aging. Frontiers in Decision Neuroscience, 5, 144.
20. Goosens, K. A., & Sapolsky, R. M. (2007). Stress and glucocorticoid contributions to normal and pathological aging. In Brain aging: Models, methods, and mechanisms (pp. 305-322). Boca Raton, FL: CRC Press.
21. Goswami, S., Cascardi, M., Rodríguez-Sierra, O. E., Duvarci, S., & Paré, D. (2010). Impact of predatory threat on fear extinction in Lewis rats. Learning & Memory, 17, 494-501. doi:10.1101/lm.1948910
22. Haddon, J. E., & Killcross, A. S. (2005). Medial prefrontal cortex lesions abolish contextual control of competing responses. Journal of the Experimental Analysis of Behavior, 84, 485-504. doi:10.1901/jeab.2005.81-04
23. Haddon, J. E., & Killcross, S. (2007). Contextual control of choice performance:Behavioral, neurobiological, and neurochemical influences. Annals of the New York Academy of Sciences, 1104, 250-269. doi:10.1196/annals.1390.000
24. Haddon, J. E., & Killcross, S. (2011). Rat prefrontal dopamine and cognitive control: Impaired and enhanced conflict performance. Behavioral Neuroscience, 125, 344-349. doi:10.1037/a0023572
25. Harloe, J. P., Thorpe, A. J., & Lichtman, A. H. (2008). Differential endocannabinoid regulation of extinction in appetitive and aversive Barnes maze tasks. Learning & Memory, 15, 806-809. doi:10.1101/lm .1113008
26. Hebert, M. A., & Gerhardt, G. A. (1998). Normal and drug-induced locomotor behavior in aging: Comparison to evoked DA release and tissue content in Fischer 344 rats. Brain Research, 797, 42-54. doi:10.1016/S0006-8993(98)00370-9
27. Holmes, N. M., Marchand, A. R., & Coutureau, E. (2010). Pavlovian to instrumental transfer: A neurobehavioural perspective. Neuroscience and Biobehavioral Reviews, 34, 1277-1295. doi:10.1016/j.neubiorev .2010.03.007
28. Horner, A. M., Russ, D. W., & Biknevicius, A. R. (2011). Effects of early-stage aging on locomotor dynamics and hindlimb muscle force production in the rat. The Journal of Experimental Biology, 214, 3588-3595. doi:10.1242/jeb.055087
29. Insel, N., Patron, L. A., Hoang, L. T., Nematollahi, S., Schimanski, L. A., Lipa, P., & Barnes, C. A. (2012). Reduced gamma frequency in the medial frontal cortex of aged rats during behavior and rest: Implications for age-related behavioral slowing. The Journal of neuroscience, 32, 16331-16344. doi:10.1523/JNEUROSCI.1577-12.2012
30. Lex, B., & Hauber, W. (2010). The role of nucleus accumbens dopamine in outcome encoding in instrumental and Pavlovian conditioning. Neurobiology of Learning and Memory, 93, 283-290. doi:10.1016/j.nlm .2009.11.002
31. Long, V. A., & Fanselow, M. S. (2012). Stress-enhanced fear learning in rats is resistant to the effects of immediate massed extinction. Stress, 15, 627-636. doi:10.3109/10253890.2011.650251
32. Marquis, J-P., Killcross, S., & Haddon, J. E. (2007). Inactivation of the prelimbic, but not infralimbic, prefrontal cortex impairs the contextual control of response conflict in rats. The European Journal of Neuroscience, 25, 559-566. doi:10.1111/j.1460-9568.2006.05295.x
33. Marschner, A., Mell, T., Wartenburger, I., Villringer, A., Reischies, F. M., & Heekeren, H. R. (2005). Reward-based decision-making and aging. Brain Research Bulletin, 67, 382-390. doi:10.1016/j.brainresbull.2005.06.010
34. McKee, B. L., Kelley, A. E., Moser, H. R., & Andrzejewski, M. E. (2010). Operant learning requires NMDA-receptor activation in the anterior cingulate cortex and dorsomedial striatum, but not in the orbitofrontal cortex. Behavioral Neuroscience, 124, 500-509. doi:10.1037/a0020270
35. Míguez, J. M., Aldegunde, M., Paz-Valiñas, L., Recio, J., & Sánchez-Barceló, E. (1999). Selective changes in the contents of noradrenaline, dopamine and serotonin in rat brain areas during aging. Journal of Neural Transmission, 106, 1089-1098. doi:10.1007/s007020050225
36. Mizoguchi, K., Shoji, H., Tanaka, Y., Maruyama, W., & Tabira, T. (2009). Age-related spatial working memory impairment is caused by prefrontal cortical dopaminergic dysfunction in rats. Neuroscience, 162, 1192-1201. doi:10.1016/j.neuroscience.2009.05.023
37. Mizoguchi, K., Shoji, H., Tanaka, Y., & Tabira, T. (2010). Orbitofrontal dopaminergic dysfunction causes age-related impairment of reversal learning in rats. Neuroscience, 170, 1110-1119. doi:10.1016/j .neuroscience.2010.08.037
38. Mohr, P. N. C., Li, S-C., & Heekeren, H. R. (2010). Neuroeconomics and aging: Neuromodulation of economic decision making in old age. Neuroscience and Biobehavioral Reviews, 34, 678-688. doi:10.1016/j .neubiorev.2009.05.010
39. Mora, F., Segovia, G., & del Arco, A. (2008). Glutamate-dopamine-GABA interactions in the aging basal ganglia. Brain Research Reviews, 58, 340-353. doi:10.1016/j.brainresrev.2007.10.006
40. Morris, R. (1984). Developments of a water-maze procedure for studying spatial learning in the rat. Journal of Neuroscience Methods, 11, 47-60. doi:10.1016/0165-0270(84)90007-4
41. Morrison, J. H., & Baxter, M. G. (2012). The ageing cortical synapse:Hallmarks and implications for cognitive decline. Nature Reviews Neuroscience, 13, 240-250. doi:10.1038/nrn3200
42. Nomura, M., Izaki, Y., Takita, M., Tanaka, J., & Hori, K. (2004). Extracellular level of basolateral amygdalar dopamine responding to reversal of appetitive-conditioned discrimination in young and old rats. Brain Research, 1018, 241-246. doi:10.1016/j.brainres.2004.05.077
43. Oliveira-Silva, I. F., Pinto, L., Pereira, S. R. C., Ferraz, V. P., Barbosa, A. J. A., Coelho, V. A. A.,... Ribeiro, A. M. (2007). Age-related deficit in behavioural extinction is counteracted by long-term ethanol consumption:Correlation between 5-HIAA/5HT ratio in dorsal raphe nucleus and cognitive parameters. Behavioural Brain Research, 180, 226-234. doi:10.1016/j.bbr.2007.03.012
44. Ostlund, S. B., & Balleine, B. W. (2007). Orbitofrontal cortex mediates outcome encoding in Pavlovian but not instrumental conditioning. The Journal of Neuroscience, 27, 4819-4825. doi:10.1523/JNEUROSCI .5443-06.2007
45. Pêgo, J. M., Morgado, P., Cerqueira, J. J., Almeida, O. F. X., & Sousa, N. (2006). Mismatch between anxiety status and morphometric parameters in the amygdala and bed nucleus of the stria terminalis. Behavioural Brain Research, 173, 320-325. doi:10.1016/j.bbr.2006.06.035
46. Pinheiro, J., & Bates, D. (2000). Mixed-effects models in S and S-PLUS. New York, NY: Springer.
47. Port, R. L., Murphy, H. A., & Magee, R. A. (1996). Age-related impairment in instrumental conditioning is restricted to initial acquisition. Experimental Aging Research, 22, 73-81. doi:10.1080/03610739608253998
48. Quirk, G. J., & Mueller, D. (2008). Neural mechanisms of extinction learning and retrieval. Neuropsychopharmacology, 33, 56-72. doi:10.1038/sj.npp.1301555
49. R Development Core Team. (2011). R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing. Retrieved from http://www.R-project.org/
50. Riceberg, J. S., & Shapiro, M. L. (2012). Reward stability determines the contribution of orbitofrontal cortex to adaptive behavior. The Journal of Neuroscience, 32, 16402-16409. doi:10.1523/JNEUROSCI.0776-12.2012
51. Sapolsky, R. M. (1992). Do glucocorticoid concentrations rise with age in the rat? Neurobiology of Aging, 13, 171-174. doi:10.1016/0197-4580(92)90025-S
52. Sapolsky, R. M., Krey, L. C., & McEwen, B. S. (1983). Corticosterone receptors decline in a site-specific manner in the aged rat brain. Brain Research, 289, 235-240. doi:10.1016/0006-8993(83)90024-0
53. Schneider-Rivas, S., Paredes-Carbajal, C., Mascher, D., Angoa-Pérez, M., Jaramillo-Gonzaléz, E., Borgonio-Pérez, G., & Rivas-Arancibia, S. (2007). Effects of testosterone and growth hormone on long-term retention and extinction of a passive avoidance response in young and aged rats. International Journal of Neuroscience, 117, 1443-1456. doi:10.1080/00207450601125782
54. Schneider-Rivas, S., Rivas-Arancibia, S., Vazquez-Pereyra, F., Vázquez-Sandoval, R., & Borgonio-Pérez, G. (1995). Modulation of long-term memory and extinction responses induced by growth hormone (GH) and growth hormone releasing hormone (GHRH) in rats. Life Sciences, 56, PL433-PL441.
55. Schoenbaum, G., Nugent, S., Saddoris, M. P., & Gallagher, M. (2002). Teaching old rats new tricks: Age-related impairments in olfactory reversal learning. Neurobiology of Aging, 23, 555-564. doi:10.1016/S0197-4580(01)00343-8
56. Segar, T. M., Kasckow, J. W., Welge, J. A., & Herman, J. P. (2009). Heterogeneity of neuroendocrine stress responses in aging rat strains. Physiology & Behavior, 96, 6-11. doi:10.1016/j.physbeh.2008.07.024
57. Segovia, G., del Arco, A., & Mora, F. (2009). Environmental enrichment, prefrontal cortex, stress, and aging of the brain. Journal of Neural Transmission, 116, 1007-1016. doi:10.1007/s00702-009-0214-0
58. Shen, J., & Barnes, C. A. (1996). Age-related decrease in cholinergic synaptic transmission in three hippocampal subfields. Neurobiology of Aging, 17, 439-451. doi:10.1016/0197-4580(96)00020-6
59. Shi, S-S., Shao, S-H., Yuan, B-P., Pan, F., & Li, Z.-L. (2010). Acute stress and chronic stress change brain-derived neurotrophic factor (BDNF) and tyrosine kinase-coupled receptor (TrkB) expression in both young and aged rat hippocampus. Yonsei Medical Journal, 51, 661-671. doi:10.3349/ymj.2010.51.5.661
60. Simon, N. W., Gilbert, R. J., Mayse, J. D., Bizon, J. L., & Setlow, B. (2009). Balancing risk and reward: A rat model of risky decision making. Neuropsychopharmacology, 34, 2208-2217. doi:10.1038/npp .2009.48
61. Singh, T., Jones, J. L., McDannald, M. A., Haney, R. Z., Cerri, D. H., & Schoenbaum, G. (2011). Normal aging does not impair orbitofrontaldependent reinforcer devaluation effects. Frontiers in Aging Neuroscience, 3, 4. doi:10.3389/fnagi.2011.00004
62. Stephens, D. N., Weidmann, R., Quartermain, D., & Sarter, M. (1985). Reversal learning in senescent rats. Behavioural Brain Research, 17, 193-202. doi:10.1016/0166-4328(85)90043-9
63. Topic, B., Dere, E., Schulz, D., de Souza Silva, M. A., Jocham, G., Kart, E., & Huston, J. P. (2005). Aged and adult rats compared in acquisition and extinction of escape from the water maze: Focus on individual differences. Behavioral Neuroscience, 119, 127-144. doi:10.1037/0735-7044.119.1.127
64. Topic, B., Huston, J. P., Namestkova, K., Zhu, S-W., Mohammed, A. H., & Schulz, D. (2008). Extinction-induced "despair" in aged and adult rats: Links to neurotrophins in frontal cortex and hippocampus. Neurobiology of Learning and Memory, 90, 519-526. doi:10.1016/j.nlm.2008.06.011
65. Wassum, K. M., Ostlund, S. B., Balleine, B. W., & Maidment, N. T. (2011). Differential dependence of Pavlovian incentive motivation and instrumental incentive learning processes on dopamine signaling. Learning & Memory, 18, 475-483. doi:10.1101/lm.2229311
66. Yin, H. H., Knowlton, B. J., & Balleine, B. W. (2004). Lesions of dorsolateral striatum preserve outcome expectancy but disrupt habit formation in instrumental learning. European Journal of Neuroscience, 19, 181-189. doi:10.1111/j.1460-9568.2004.03095.x
67. Yin, H. H., Ostlund, S. B., Knowlton, B. J., & Balleine, B. W. (2005). The role of the dorsomedial striatum in instrumental conditioning. European Journal of Neuroscience, 22, 513-523. doi:10.1111/j.1460-9568.2005.04218.x