The neural basis of predicting the outcomes of imagined actions

Frontiers in Neuroscience

Volumn , Issue NOV, 2011, Pages

  Jahn, Andrew ^a   Nee, Derek Evan ^a   Brown, Joshua W ^a  

^a INDIANA UNIVERSITY   (United States)

Author keywords

Action values; Anterior cingulate cortex; Cognitive control; Prospection

Indexed keywords

EID: 84861878919     PISSN: 16624548     EISSN: 1662453X     Source Type: Journal    
DOI: 10.3389/fnins.2011.00128     Document Type: Article

References (49)

1. Aarts, E., and Roelofs, A. (2011). Atten-tional control in anterior cingulate cortex based on probabilistic cueing. J. Cogn. Neurosci. 23, 716-727.
2. Aarts, E., Roelofs, A., and Van Turen-nout, M. (2008). Anticipatory activity in anterior cingulate cortex can be independent of conflict and error likelihood. J. Neurosci. 28, 4671-4678.
3. Alexander, W., and Brown, J. (2010). Computational models of performance monitoring and cognitive control. Top. Cogn. Sci. 2, 658-677.
4. Alexander, W. H., and Brown, J. W. (2011). Medial prefrontal cortex as an action-outcome predictor. Nat. Neurosci. 14, 1338-1344.
5. Bechara, A., Dolan, S., and Hindes, A. (2002). Decision-making and addiction (part II): myopia for the future or hypersensitivity to reward? Neu-ropsychologia 40, 1690-1705.
6. Botvinick, M. M., Braver, T. S., Barch, D. M., Carter, C. S., and Cohen, J. D. (2001). Conflict monitoring and cognitive control. Psychol. Rev. 108, 624-652.
7. Brown, J., and Braver, T. S. (2007). Risk prediction and aversion by anterior cingulate cortex. Cogn. Affect. Behav. Neurosci. 7,266-277.
8. Brown, J. W. (2009). Conflict effects without conflict in anterior cingulate cortex: multiple response effects and context specific representations. Neuroimage 47, 334-341.
9. Brown, J. W., and Braver, T. S. (2005). Learned predictions of error likelihood in the anterior cingulate cortex. Science 307, 1118-1121.
10. Colwill, R., and Rescorla, R. (1990). Evidence for the hierarchical structure of instrumental learning. Anim. Learn. Behav. 18, 71-82.
11. Courtney, S. M., Petit, L., Maisog, J. M., Ungerleider, L. G., and Haxby, J. V. (1998). An area specialized for spatial working memory in human frontal cortex. Science 279, 1347-1351.
12. Dale, A. M. (1999). Optimal experimental design for event-related fMRI. Hum. Brain Mapp. 8, 109-114.
13. Daw, N. D., Niv, Y., and Dayan, P. (2005). Uncertainty-based competition between prefrontal and dorso-lateral striatal systems for behavioral control. Nat. Neurosci. 8,1704-1711.
14. Dayan, P., and Niv, Y. (2008). Reinforcement learning: the good, the bad and the ugly. Curr. Opin. Neurobiol. 18, 185-196.
15. Deichmann, R., Gottfried, J. A., Hut-ton, C., and Turner, R. (2003). Optimized EPI for fMRI studies of the orbitofrontal cortex. Neuroimage 19, 430-441.
16. Gehring, W. J., Coles, M. G. H., Meyer, D. E., and Donchin, E. (1990). The error-related negativity: an event-related potential accompanying errors. Psychophysiology 27, S34.
17. Gehring, W. J., Goss, B., Coles, M. G. H., Meyer,D.E.,andDonchin,E. (1993). A neural system for error-detection and compensation. Psychol. Sci. 4, 385-390.
18. Gerardin, E., Sirigu, A., Lehericy, S., Poline, J. B., Gaymard, B., Marsault, C., Agid, Y., and Le Bihan, D. (2000). Partially overlapping neural networks for real and imagined hand movements. Cereb. Cortex 10, 1093-1104.
19. Glascher, J., Daw, N., Dayan, P., and O'Doherty, J. P. (2010). States versus rewards: dissociable neural prediction error signals underlying model-based and model-free reinforcement learning. Neuron 66, 585-595.
20. Glascher, J., Hampton, A. N., and O'Doherty, J. P. (2009). Determining a role for ventromedial pre-frontal cortex in encoding action-based value signals during reward-related decision making. Cereb. Cortex 19,483-495.
21. Goldman-Rakic, P. S. (1996). The pre-frontal landscape: implications of functional architecture for understanding human mentation and the central executive, in The Pre-frontal Cortex: Executive and Cognitive Functions, eds A. C. Roberts, T. W. Robbins, and L. Weiskrantz (Oxford: Oxford University Press), 87-103.
22. Grinband, J., Savitskaya, J., Wager, T. D., Teichert, T., Ferrera, V. P., and Hirsch, J. (2010). The dorsal medial frontal cortex is sensitive to time on task, not response conflict or error likelihood. Neuroimage 57, 303-311.
23. Hanakawa, T., Immisch, I., Toma, K., Dimyan, M. A., Van Gelderen, P., and Hallett, M. (2003). Functional properties of brain areas associated with motor execution and imagery. J. Neurophysiol. 89, 989-1002.
24. Hassabis, D., Kumaran, D., Vann, S. D., and Maguire, E. A. (2007). Patients with hippocampal amnesia cannot imagine new experiences. Proc. Natl. Acad. Sci. U.S.A. 104, 1726-1731.
25. Hayden, B. Y., Heilbronner, S. R., Pearson, J. M., and Platt, M. L. (2011).Surprise signals in anterior cingu-late cortex: neuronal encoding of unsigned reward prediction errors driving adjustment in behavior. J. Neurosci. 31,4178-4187.
26. Henson, R. N., Shallice, T., and Dolan, R. J. (1999). Right prefrontal cortex and episodic memory retrieval: a functional MRI test of the monitoring hypothesis. Brain J. Neurol. 122(Pt 7), 1367-1381.
27. Hohnsbein, J., Falkenstein, M., and Hoorman, J. (1989). Error processing in visual and auditory choice reaction tasks. J. Psychophysiol. 3, 32.
28. Ito, S., Stuphorn, V., Brown, J., and Schall, J. D. (2003). Performance monitoring by anterior cingulate cortex during saccade countermanding. Science 302, 120-122.
29. Jessup, R. K., Busemeyer, J. R., and Brown, J. W. (2010). Error effects in anterior cingulate cortex reverse when error likelihood is high. J. Neurosci. 30, 3467-3472.
30. Johnson, S. H. (2000). Thinking ahead: the case for motor imagery in prospective judgements of prehension. Cognition 74, 33-70.
31. Kaelbling, L. P., Littman, M. L., and Moore, A. W. (1996). Reinforcement learning: a survey. J. Artif. Intell. Res. 4, 237-285.
32. Kennerley, S. W., Walton, M. E., Behrens, T. E., Buckley, M. J., and Rushworth, M. F. (2006). Optimal decision making and the anterior cingulate cortex. Nat. Neurosci. 9, 940-947.
33. Kircher, T. T., Senior, C., Phillips, M. L., Benson, P. J., Bullmore, E. T., Bram-mer, M., Simmons, A., Williams, S. C., Bartels, M., and David, A. S. (2000). Towards a functional neu-roanatomy of self processing: effects of faces and words. Brain Res. Cogn. Brain Res. 10, 133-144.
34. Krawitz, A., Braver, T. S., Barch, D. M., and Brown, J. W. (2011). Impaired error-likelihood prediction in medial prefrontal cortex in schizophrenia. Neuroimage 54, 1506-1517.
35. Machlin, S. R., Harris, G. J., Pearlson, G. D., Hoehn-Saric, R., Jeffery, P.,and Camargo, E. E. (1991). Elevated medial-frontal cerebral blood flow in obsessive-compulsive patients: a SPECT study. Am. J. Psychiatry 148, 1240-1242.
36. Magno, E., Foxe, J. J., Molholm, S., Robertson, I. H., and Garavan, H. (2006). The anterior cingulate and error avoidance. J. Neurosci. 26, 4769-4773.
37. Nee, D. E., Kastner, S., and Brown, J. W (2011). Functional heterogeneity of conflict, error, task-switching, and unexpectedness effects within medial prefrontal cortex. Neuroimage 54, 528-540.
38. Newman, S. D., Greco, J. A., and Lee, D. (2009). An fMRI study of the Tower of London: a look at problem structure differences. Brain Res. 1286,123-132.
39. Petry, N. M., and Casarella, T. (1999). Excessive discounting of delayed rewards in substance abusers with gambling problems. Drug Alcohol Depend. 56,25-32.
40. Rushworth, M. F., Buckley, M. J., Behrens, T. E., Walton, M. E., and Bannerman, D. M. (2007). Functional organization of the medial frontal cortex. Curr. Opin. Neurobiol. 17, 220-227.
41. Schoenbaum, G., Setlow, B., Saddoris, M. P., and Gallagher, M. (2003). Encoding predicted outcome and acquired value in orbitofrontal cortex during cue sampling depends upon input from basolateral amygdala. Neuron 39, 855-867.
42. Selemon, L. D., and Goldman-Rakic, P. S. (1988). Common cortical and subcortical targets of the dorsolat-eral prefrontal and posterior parietal cortices in the rhesus monkey: evidence for a distributed neural network subserving spatially guided behavior. J. Neurosci. 8, 4049-4068.
43. Shadmehr, R., and Wise, S. P. (2004). Motor learning and memory for reaching and pointing, in The Cognitive Neurosciences III, 3rd Edn, ed. M. Gazzaniga (Cambridge: MIT Press), 511-524.
44. Sohn, M. H., Albert, M. V., Jung, K., Carter, C. S., and Anderson, J. R. (2007). Anticipation of conflict monitoring in the anterior cingulate cortex and the prefrontal cortex. Proc. Natl. Acad. Sci. U.S.A. 104, 10330-10334.
45. Sutton, R. S., and Barto, A. G. (1998). Reinforcement Learning. Cambridge: MIT Press.
46. Thorndike, E. L. (1911). Animal Intelligence: Experimental Studies. New York: MacMillan.
47. Tremblay, L., and Schultz, W (1999). Relative reward preference in primate orbitofrontal cortex. Nature 398, 704-708.
48. Valentin, V V, Dickinson, A., and O'Doherty, J. P. (2007). Determining the neural substrates of goal-directed learning in the human brain. J. Neurosci. 27, 4019-4026.
49. Van Der Meer, M. A., and Redish, A. D. (2010). Expectancies in decision making, reinforcement learning, and ventral striatum. Front. Neurosci. 4:6. doi:10.3389/neuro.01.006.2010