Stimulus-outcome learnability differentially activates anterior cingulate and hippocampus at feedback processing

Learning and Memory

Volumn 16, Issue 5, 2009, Pages 324-331

  Rodriguez, Paul F ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; CINGULATE GYRUS; CORPUS STRIATUM; DECLARATIVE MEMORY; EFFECT SIZE; FEEDBACK SYSTEM; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HIPPOCAMPUS; HUMAN; HUMAN EXPERIMENT; LEARNING; MEMORY; MESENCEPHALON; MODEL; NORMAL HUMAN; NUCLEUS ACCUMBENS; POSITIVE FEEDBACK; PREDICTION; PRIORITY JOURNAL; PROBABILITY; REINFORCEMENT; RESCORLA WAGNER MODEL; REWARD;

ADULT; ASSOCIATION LEARNING; FEEDBACK, PSYCHOLOGICAL; FEMALE; GYRUS CINGULI; HIPPOCAMPUS; HUMANS; MAGNETIC RESONANCE IMAGING; MALE; MEMORY; MODELS, NEUROLOGICAL;

EID: 66149084847     PISSN: 10720502     EISSN: 15495485     Source Type: Journal    
DOI: 10.1101/lm.1191609     Document Type: Article

References (58)

1. Abler, B., Walter, H., Erk, S., Kammerer, H., and Spitzer, M. 2006. Prediction error as a linear function of reward probability is coded in human nucleus accumbens. Neuroimage 31: 790-795. (Pubitemid 43776671)
2. Adcock, R.A., Thangavel, A., Whitfield-Gabrieli, S., Knutson, B., and Gabrieli, J.D. 2006. Reward-motivated learning: Mesolimbic activation precedes memory formation. Neuron 50: 507-517.
3. Aron, A.R., Shohamy, D., Clark, J., Myers, C., Gluck, M.A., and Poldrack, R.A. 2004.Human midbrain sensitivity to cognitive feedback and uncertainty during classification learning. J. Neurophysiol. 92: 1144-1152. (Pubitemid 38931973)
4. Behrens, T.E., Woolrich, M.W., Walton, M.E., and Rushworth, M.F. 2007. Learning the value of information in an uncertain world. Nat. Neurosci. 10: 1214-1221. (Pubitemid 47339952)
5. Beninger, R.J., Wasserman, J., Zanibbi, K., Charbonneau, D., Mangels, J., and Beninger, B.V. 2003. Typical and atypical antipsychotic medications differentially affect two nondeclarative memory tasks in schizophrenic patients: A double-dissociation. Schizophr. Res. 61: 281-292. (Pubitemid 36513941)
6. Berns, G.S., McClure, S.M., Pagnoni, G., and Montague, P.R. 2001. Predictability modulates human brain response to reward. J. Neurosci. 21: 2793-2798. (Pubitemid 32298220)
7. Binder, J.R., Bellgowan, P.S., Hammeke, T.A., Possing, E.T., and Frost, J.A. 2005. A comparison of two fMRI protocols for eliciting hippocampal activation. Epilepsia 46: 1061-1070. (Pubitemid 40962151)
8. Botvinick, M.M., Cohen, J.D., and Carter, C.S. 2004. Conflict monitoring and anterior cingulate cortex: An update. Trends Cogn. Sci. 8: 539-546. (Pubitemid 39536251)
9. Brown, J.W. and Braver, T.S. 2005. Learned predictions of error likelihood in the anterior cingulate cortex. Science 307: 1118-1121. (Pubitemid 40262119)
10. Carter, C.S., Braver, T.S., Barch, D.M., Botvinick, M.M., Noll, D., and Cohen, J.D. 1998. Anterior cingulate cortex, error detection, and the online monitoring of performance. Science 280: 747-749. (Pubitemid 28243351)
11. Cincotta, C.M. and Seger, C.A. 2007. Dissociation between striatal regions while learning to categorize via feedback and via observation. J. Cogn. Neurosci. 19: 249-265. (Pubitemid 46220707)
12. Cohen, N.J. and Squire, L.R. 1980. Preserved learning and retention of pattern-analyzing skill in amnesia: Dissociation of knowing how and knowing that. Science 210: 207-210. (Pubitemid 11210996)
13. Critchley, H.D., Tang, J., Glaser, D., Butterworth, B., and Dolan, R.J. 2005. Anterior cingulate activity during error and autonomic response. Neuroimage 27: 885-895. (Pubitemid 41317257)
14. Dale, A.M. 1999. Optimal experimental design for event-related fMRI. Hum. Brain Mapp. 8: 109-114. (Pubitemid 29480297)
15. Davachi, L. 2006. Item, context and relational episodic encoding in humans. Curr. Opin. Neurobiol. 16: 693-700.
16. Daw, N.D., Niv, Y., and Dayan, P. 2005. Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nat. Neurosci. 8: 1704-1711. (Pubitemid 41683198)
17. Delgado, M.R., Miller, M.M., Inati, S., and Phelps, E.A. 2005. An fMRI study of reward-related probability learning. Neuroimage 24: 862-873. (Pubitemid 40094568)
18. Eichenbaum, H., Otto, T., and Cohen, N.J. 1994. Two component functions of the hippocampal memory system. Behav. Brain Sci. 17: 449-517. (Pubitemid 24976826)
19. Fletcher, P.C., Anderson, J.M., Shanks, D.R., Honey, R., Carpenter, T.A., Donovan, T., Papadakis, N., and Bullmore, E.T. 2001. Responses of human frontal cortex to surprising events are predicted by formal associative learning theory. Nat. Neurosci. 4: 1043-1048. (Pubitemid 32924146)
20. Fiorillo, C.D., Tobler, P.N., and Schultz, W. 2003. Discrete coding of reward probability and uncertainty by dopamine neurons. Science 299: 1898-1902. (Pubitemid 36356659)
21. Foerde, K., Knowlton, B.J., and Poldrack, R.A. 2006. Modulation of competing memory systems by distraction. Proc. Natl. Acad. Sci. 103: 11778-11783. (Pubitemid 44182527)
22. Gabrieli, J.D.E., Brewer, J.B., Desmond, J.E., and Glover, G.H. 1997. Separate neural bases of two fundamental memory processes in the human medial temporal lobe. Science 276: 264-266. (Pubitemid 27172686)
23. Glascher, J. and Buchel, C. 2006. Formal learning theory dissociates brain regions with different temporal integration. Neuron 47: 295-306.
24. Gluck, M.A. and Bower, G.H. 1988. Evaluating an adaptive network model of human learning. J. Mem. Lang. 27: 166-195.
25. Haruno, M., Kuroda, T., Doya, K., Toyama, K., Kimura, M., Samejima, K., Imamizu, H., and Kawato, M. 2004. A neural correlate of reward-based behavioral learning in caudate nucleus: A functional magnetic resonance imaging study of a stochastic decision task. J. Neurosci. 24: 1660-1665. (Pubitemid 38240962)
26. Holroyd, C.B. and Coles, M.G. 2002. The neural basis of human error processing: Reinforcement learning, dopamine, and the error-related negativity. Psychol. Rev. 109: 679-709.
27. Kerns, J.G., Cohen, J.D., MacDonald, A.W., Cho, R.Y., Stenger, V.A., and Carter, C.S. 2004. Anterior cingulate conflict monitoring and adjustments in control. Science 303: 1023-1026. (Pubitemid 38209708)
28. Kirwan, C.B. and Stark, C.E. 2004. Medial temporal lobe activation during encoding and retrieval of novel face-name pairs. Hippocampus 14: 919-930. (Pubitemid 39517467)
29. Knowlton, B.J., Mangels, J.A., and Squire, L.R. 1996. A neostriatal habit learning system in humans. Science 273: 1399-1402. (Pubitemid 26296530)
30. Lisman, J.E. and Grace, A.A. 2005. The hippocampal-VTA loop: Controlling the entry of information into long-term memory. Neuron 46: 703-713. (Pubitemid 40733126)
31. Lisman, J.E. and Otmakhova, N.A. 2001. Storage, recall, and novelty detection of sequences by the hippocampus: Elaborating on the SOCRATIC model to account for normal and aberrant effects of dopamine. Hippocampus 11: 551-568. (Pubitemid 33100376)
32. Lucerna, S., Salpietro, F.M., Alafaci, C., and Tomasello, F. 2002. In vivo atlas of deep brain structures. Springer-Verlag, Berlin, Germany.
33. Maldjian, J.A., Laurienti, P.J., Kraft, R.A., and Burdette, J.H. 2003. An automated method for neuroanatomic and cytoarchitectonic atlas-based interrogation of fMRI data sets. Neuroimage 19: 1233-1239. (Pubitemid 36918259)
34. Montague, P.R., Hyman, S.E., and Cohen, J.D. 2004. Computational roles for dopamine in behavioural control. Nature 431: 760-767. (Pubitemid 39434064)
35. Moody, T.D., Bookheimer, S.Y., Vanek, Z., and Knowlton, B.J. 2004. An implicit learning task activates medial temporal lobe in patients with Parkinson's disease. Behav. Neurosci. 118: 438-442. (Pubitemid 38445622)
36. O'Doherty, J.P., Dayan, P., Friston, K., Critchley, H., and Dolan, R.J. 2003. Temporal difference models and reward-related learning in the human brain. Neuron 38: 329-337. (Pubitemid 36555657)
37. Packard, M.G. and Knowlton, B.J. 2002. Learning and memory functions of the Basal Ganglia. Ann. Rev. Neurosci. 25: 563-593. (Pubitemid 34748029)
38. Picard, N. and Strick, P.L. 2001. Imaging the premotor areas. Curr. Opin. Neurobiol. 11: 663-672. (Pubitemid 34014913)
39. Poldrack, R.A., Clark, J., Pare-Blagoev, J., Shohamy, D., Creso Moyano, J., and Myers, C. 2001. Interactive memory systems in the human brain. Nature 414: 546-550. (Pubitemid 33131537)
40. Rescorla, R. and Wagner, A. 1972. A theory of Pavlovian conditioning: Variations in the effectiveness of reinforcement and nonreinforcement. In Classical conditioning II: Current research and theory (eds. A. Black and W. Prokasy), pp. 64-99. Appleton Century Crofts, New York.
41. Rodriguez, P.F., Aron, A.R., and Poldrack, R.A. 2006. Ventral-striatal/nucleus-accumbens sensitivity to prediction errors during classification learning. Hum. Brain Mapp. 27: 306-313.
42. Rushworth, M.F., Walton, M.E., Kennerley, S.W., and Bannerman, D.M. 2004. Action sets and decisions in the medial frontal cortex. Trends Cogn. Sci. 8: 410-417. (Pubitemid 39179904)
43. Rushworth, M.F., Buckley, M.J., Behrens, T.E., Walton, M.E., and Bannerman, D.M. 2007. Functional organization of the medial frontal cortex. Curr. Opin. Neurobiol. 17: 220-227. (Pubitemid 46575241)
44. Sarter, M., Gehring, W.J., and Kozak, R. 2006. More attention must be paid: The neurobiology of attentional effort. Brain Res. Brain Res. Rev. 2: 145-160. (Pubitemid 43902969)
45. Schott, B.H., Sellner, D.B., Lauer, C.J., Habib, R., Frey, J.U., Guderian, S., Heinze, H.J., and Duzel, E. 2004. Activation of midbrain structures by associative novelty and the formation of explicit memory in humans. Learn. Mem. 1: 383-387. (Pubitemid 39079696)
46. Schultz, W. 2002. Getting formal with dopamine and reward. Neuron 36: 241-263. (Pubitemid 35217890)
47. Seger, C.A. and Cincotta, C.M. 2005. The roles of the caudate nucleus in human classification learning. J. Neurosci. 25: 2941-2951. (Pubitemid 40389252)
48. Seymour, B., Daw, N., Dayan, P., Singer, T., and Dolan, R.J. 2007. Differential encoding of losses and gains in the human striatum. J. Neurosci. 27: 4826-4831. (Pubitemid 46699059)
49. Shanks, D.R., Tunney, R.J., and McCarthy, J.D. 2002. A re-examination of probability matching and rational choice. J. Behav. Decis. Making 15: 233-250. (Pubitemid 37282701)
50. Shohamy, D., Myers, C.E., Grossman, S., Sage, J., Gluck, M.A., and Poldrack, R.A. 2004. Cortico striatal contributions to feedback based learning: Converging data from neuroimaging and neuropsychology. Brain 127: 851-859. (Pubitemid 38478530)
51. Squire, L.R. 1992. Memory and the hippocampus: A synthesis from findings with rats, monkeys, and humans. Psychol. Rev. 99: 195-231.
52. Stark, C.E. and Squire, L.R. 2001. When zero is not zero: The problem of ambiguous baseline conditions in fMRI. Proc. Natl. Acad. Sci. 98: 12760-12766. (Pubitemid 33020018)
53. Volz, K.G., Schubotz, R.I., and von Cramon, D.Y. 2003. Predicting events of varying probability: Uncertainty investigated by fMRI. Neuroimage 19: 271-280. (Pubitemid 39665679)
54. White, N.M. and McDonald, R.J. 2002. Multiple parallel memory systems in the brain of the rat. Neurobiol. 77: 125-184.
55. Wittman, B.C., Schott, B.H., Guderian, S., Frey, J.U., Heinze, H.J., and Duzel, E. 2005. Reward-related fMRI activation of dopaminergic midbrain is associated with enhanced hippocampus-dependent long-term memory formation. Neuron 45: 459-467. (Pubitemid 40188212)
56. Worsley, K.J., Poline, J.B., Vandal, A.C., and Friston, K.J. 1995. Tests for distributed, nonfocal brain activation. Neuroimage 2: 183-194.
57. Yacubian, J., Glascher, J., Schroeder, K., Sommer, T., Braus, D.F., and Buchel, C. 2006. Dissociable systems for gain- and loss-related value predictions and errors of prediction in the human brain. J. Neurosci. 26: 9530-9537. (Pubitemid 44396866)
58. Yechiam, E. and Busemeyer, J.R. 2005. Comparison of basic assumptions embedded in learning models for experience-based decision making. Psychon. Bull. Rev. 12: 387-402. (Pubitemid 41382742)