Bayesian prediction and evaluation in the anterior cingulate cortex

Journal of Neuroscience

Volumn 33, Issue 5, 2013, Pages 2039-2047

  Ide, Jaime S ^a   Shenoy, Pradeep ^b   Yu, Angela J ^b   Li, Chiang Shan R ^a  

^a YALE UNIVERSITY SCHOOL OF MEDICINE   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ACCURACY; ADULT; ANTERIOR CINGULATE; ARTICLE; BAYESIAN LEARNING; BEHAVIOR; DECISION MAKING; ERROR; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; MALE; NORMAL HUMAN; PERCEPTION; PREDICTION; PRIORITY JOURNAL; RESPONSE TIME; REWARD; TASK PERFORMANCE;

ADOLESCENT; ADULT; BAYES THEOREM; COGNITION; FEMALE; GYRUS CINGULI; HUMANS; MALE; MIDDLE AGED; MODELS, NEUROLOGICAL; PSYCHOMOTOR PERFORMANCE; REACTION TIME;

EID: 84873051331     PISSN: 02706474     EISSN: 15292401     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.2201-12.2013     Document Type: Article

References (62)

1. Aarts E, Roelofs A, van Turennout M (2008) Anticipatory activity in anterior cingulate cortex can be independent of conflict and error likelihood. J Neurosci 28:4671-4678. CrossRef Medline
2. Alexander WH, Brown JW (2010) Competition between learned reward and error outcome predictions in anterior cingulate cortex. Neuroimage 49:3210-3218. CrossRef Medline
3. Andersson JL, Hutton C, Ashburner J, Turner R, Friston K (2001) Modeling geometric deformations in EPI time series. Neuroimage 13:903-919. CrossRef Medline
4. Ashburner J, Friston KJ (2005) Unified segmentation. Neuroimage 26:839-851. CrossRef Medline
5. Aston-Jones G, Cohen JD (2005) An integrative theory of locus coeruleusnorepinephrine function: adaptive gain and optimal performance. Annu Rev Neurosci 28:403-450. CrossRef Medline
6. Battaglia PW, Jacobs RA, Aslin RN (2003) Bayesian integration of visual and auditory signals for spatial localization. J Opt Soc Am A Opt Image Sci Vis 20:1391-1397. CrossRef Medline
7. Behrens TE, Woolrich MW, Walton ME, Rushworth MF (2007) Learning the value of information in an uncertain world. Nat Neurosci 10:1214-1221. CrossRef Medline
8. Botvinick MM, Braver TS, Barch DM, Carter CS, Cohen JD (2001) Conflict monitoring and cognitive control. Psychol Rev 108:624-652. CrossRef Medline
9. Brett M, Anton JL, Valabregue R, Poline JB (2002) Region of interest analysis using an SPM toolbox (abstract). In: 8th International Conference on Functional Mapping of the Human Brain, June 2-6, 2002, Sendai, Japan.
10. Brown JW, Braver TS (2005) Learned predictions of error likelihood in the anterior cingulate cortex. Science 307:1118-1121. CrossRef Medline
11. Buchel C, Holmes AP, Rees G, Friston KJ (1998) Characterizing stimulus-response functions using nonlinear regressors in parametric fMRI experiments. Neuroimage 8:140-148. CrossRef Medline
12. Cho RY, Nystrom LE, Brown ET, Jones AD, Braver TS, Holmes PJ, Cohen JD (2002) Mechanisms underlying dependencies of performance on stimulus history in a two-alternative forced-choice task. Cogn Affect Behav Neurosci 2:283-299. CrossRef Medline
13. Cordova CA, Yu AJ, Chiba AA (2004) Attention, uncertainty, and acetylcholine: effects of nucleus basalis cholinergic lesions on probabilistic inference. Soc Neurosci Abstr 30:779.13.
14. Daw ND, O'Doherty JP, Dayan P, Seymour B, Dolan RJ (2006) Cortical substrates for exploratory decisions in humans. Nature 441:876-879. CrossRef Medline
15. Dayan P, Daw ND (2008) Connections between computational and neurobiological perspectives on decision making. Cogn Affect Behav Neurosci 8:429-453. CrossRef Medline
16. Dayan P, Yu AJ (2006) Phasic norepinephrine: a neural interrupt signal for unexpected events. Network 17:335-350. CrossRef Medline
17. Dayan P, Kakade S, Montague PR (2000) Learning and selective attention. Nat Neurosci 3 [Suppl]:1218-1223.
18. Duvernoy HM (2003) The human brain, Ed 2. Wien, Austria: Springer.
19. Emeric EE, Brown JW, Boucher L, Carpenter RH, Hanes DP, Harris R, Logan GD, Mashru RN, Paré M, Pouget P, Stuphorn V, Taylor TL, Schall JD (2007) Influence of history on saccade countermanding performance in humans and macaque monkeys. Vision Res 47:35-49. CrossRef Medline
20. Ernst MO, Banks MS (2002) Humans integrate visual and haptic information in a statistically optimal fashion. Nature 415:429-433. CrossRef Medline
21. Friston KJ, Ashburner J, Frith CD, Poline JB, Heather JD, Frackowiak RSJ (1995) Spatial registration and normalization of images. Hum Brain Mapp 3:165-189. CrossRef
22. Gläscher J (2009) Visualization of group inference data in functional neuroimaging. Neuroinformatics 7:73-82. CrossRef Medline
23. Gläscher J, Daw N, Dayan P, O'Doherty JP (2010) States versus rewards: dissociable neural prediction error signals underlying model-based and model-free reinforcement learning. Neuron 66:585-595. CrossRef Medline
24. Hayden BY, Heilbronner SR, Pearson JM, Platt ML (2011) Surprise signals in anterior cingulate cortex: neuronal encoding of unsigned reward prediction errors driving adjustment in behavior. J Neurosci 31:4178-4187. CrossRef Medline
25. Holroyd CB, Nieuwenhuis S, Yeung N, Nystrom L, Mars RB, Coles MG, Cohen JD (2004) Dorsal anterior cingulate cortex shows fMRI response to internal and external error signals. Nat Neurosci 7:497-498. CrossRef Medline
26. Hutton C, Bork A, Josephs O, Deichmann R, Ashburner J, Turner R (2002) Image distortion correction in fMRI: a quantitative evaluation. Neuroimage 16:217-240. CrossRef Medline
27. Ide JS, Li CS (2011) A cerebellar thalamic cortical circuit for error-related cognitive control. Neuroimage 54:455-464. CrossRef Medline
28. Ito S, Stuphorn V, Brown JW, Schall JD (2003) Performance monitoring by the anterior cingulate cortex during saccade countermanding. Science 302:120-122. CrossRef Medline
29. Jessup RK, Busemeyer JR, Brown JW (2010) Error effects in anterior cingulate cortex reverse when error likelihood is high. J Neurosci 30:3467-3472. CrossRef Medline
30. Kennerley SW, Walton ME, Behrens TE, Buckley MJ, Rushworth MF (2006) Optimal decision making and the anterior cingulate cortex. Nat Neurosci 9:940-947. CrossRef Medline
31. Kennerley SW, Behrens TE, Wallis JD (2011) Double dissociation of value computations in orbitofrontal and anterior cingulate neurons. Nat Neurosci 14:1581-1589. CrossRef Medline
32. Körding KP, Wolpert DM (2004) Bayesian integration in sensorimotor learning. Nature 427:244-247. CrossRef Medline
33. Laming D (1979) Autocorrelation of choice-reaction times. Acta Psychol (Amst) 43:381-412. CrossRef
34. Leotti LA, Wager TD (2010) Motivational influences on response inhibition measures. J Exp Psychol Hum Percept Perform 36:430-447. Medline
35. Levitt H (1971) Transformed up-down methods in psychoacoustics. J Acoust Soc Am 49 [Suppl 2]:467
36. Li CS, Huang C, Constable RT, Sinha R (2006) Imaging response inhibition in a stop-signal task: neural correlates independent of signal monitoring and post-response processing. J Neurosci 26:186-192. CrossRef Medline
37. Li CS, Huang C, Yan P, Paliwal P, Constable RT, Sinha R (2008a) Neural correlates of post-error slowing during a stop signal task: a functional magnetic resonance imaging study. J Cogn Neurosci 20:1021-1029. CrossRef Medline
38. Li CS, Yan P, Chao HH, Sinha R, Paliwal P, Constable RT, Zhang S, Lee TW (2008b) Error-specific medial cortical and subcortical activity during the stop signal task: a functional magnetic resonance imaging study. Neuroscience 155:1142-1151. CrossRef Medline
39. Li CS, Chao HH, Lee TW (2009) Neural correlates of speeded as compared with delayed responses in a stop signal task: An indirect analog of risk taking and association with an anxiety trait. Cereb Cortex 19:839-848. Medline
40. Logan GD, Cowan WB, Davis KA (1984) On the ability to inhibit simple and choice reaction time responses: a model and a method. J Exp Psychol Hum Percept Perform 10:276-291. CrossRef Medline
41. Mai JK, Paxinos G, Voss T (2008) Atlas of the human brain, Ed 3. New York: Academic.
42. Mansouri FA, Tanaka K, Buckley MJ (2009) Conflict-induced behavioural adjustment: a clue to the executive functions of the prefrontal cortex. Nat Rev Neurosci 10:141-152. CrossRef Medline
43. Martin LE, Potts GF, Burton PC, Montague PR (2009) Electrophysiological and hemodynamic responses to reward prediction violation. Neuroreport 20:1140-1143. CrossRef Medline
44. Nassar MR, Rumsey KM, Wilson RC, Parikh K, Heasly B, Gold JI (2012) Rational regulation of learning dynamics by pupil-linked arousal systems. Nat Neurosci 15:1040-1046. CrossRef Medline
45. O'Doherty JP, Dayan P, Friston K, Critchley H, Dolan RJ (2003) Temporal difference models and reward-related learning in the human brain. Neuron 38:329-337. CrossRef Medline
46. O'Doherty J, Dayan P, Schultz J, Deichmann R, Friston K, Dolan RJ (2004) Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science 304:452-454. CrossRef Medline
47. Poldrack RA, Mumford JA (2009) Independence in ROI analysis: where is the voodoo? Soc Cogn Affect Neurosci 4:208-213. CrossRef Medline
48. Preuschoff K, t Hart BM, Einhäuser W (2011) Pupil dilation signals surprise: evidence for noradrenaline's role in decision making. Front Neurosci 5:115. CrossRef Medline
49. Rushworth MF, Walton ME, Kennerley SW, Bannerman DM (2004) Action sets and decisions in the medial frontal cortex. Trends Cogn Sci 8:410-417. CrossRef Medline
50. Schultz W, Dayan P, Montague PR (1997) A neural substrate of prediction and reward. Science 275:1593-1599. CrossRef Medline
51. Seo H, Lee D (2007) Temporal filtering of reward signals in the dorsal anterior cingulate cortex during a mixed-strategy game. J Neurosci 27: 8366-8377. CrossRef Medline
52. Seymour B, O'Doherty JP, Dayan P, Koltzenburg M, Jones AK, Dolan RJ, Friston KJ, Frackowiak RS (2004) Temporal difference models describe higher-order learning in humans. Nature 429:664-667. CrossRef Medline
53. Shenoy P, Yu AJ (2011) Rational decision-making in inhibitory control. Front Hum Neurosci 5:48. Medline
54. Shenoy P, Rao R, Yu A (2010) A rational decision making framework for inhibitory control. In: Advances in Neural Information Processing Systems (NIPS), Ed 23 (Lafferty J, Williams CKI, Shawe-Taylor J, Zemel RS, Culotta A, eds), pp 2146-2154. Boston: MIT.
55. Soetens E, Boer LC, Hueting JE (1985) Expectancy or automatic facilitation? Separating sequential effects in two-choice reaction time. J Exp Psychol Hum Percept Perform 11:598. CrossRef
56. Thiel CM, Fink GR (2008) Effects of the cholinergic agonist nicotine on reorienting of visual spatial attention and top-down attentional control. Neuroscience 152:381-390. CrossRef Medline
57. Ullsperger M, Nittono H, von Cramon DY (2007) When goals are missed: dealing with self-generated and externally induced failure. Neuroimage 35:1356-1364. CrossRef Medline
58. Yu AJ (2012) Change is in the eye of the beholder. Nat Neurosci 15:933-935. CrossRef Medline
59. Yu A, Cohen J (2009) Sequential effects: superstition or rational behavior? In: NIPS 2008, Advances in Neural Information Processing Systems, Ed 21 (Koller D, Schuurmans D, Bengio Y, Bottou L, eds), pp 1873-1880. Vancouver: MIT.
60. Yu AJ, Dayan P (2002) Acetylcholine in cortical inference. Neural Netw 15:719-730. CrossRef Medline
61. Yu AJ, Dayan P (2005) Uncertainty, neuromodulation, and attention. Neuron 46:681-692. CrossRef Medline
62. Yu AJ, Dayan P, Cohen JD (2009) Dynamics of attentional selection under conflict: toward a rational Bayesian account. J Exp Psychol Hum Percept Perform 35:700-717. CrossRef Medline