Activity in Inferior Parietal and Medial Prefrontal Cortex Signals the Accumulation of Evidence in a Probability Learning Task

PLoS Computational Biology

Volumn 9, Issue 1, 2013, Pages

  d'Acremont, Mathieu ^a   Fornari, Eleonora ^b   Bossaerts, Peter ^a  

^a CALIFORNIA INSTITUTE OF TECHNOLOGY   (United States)

^b UNIVERSITY OF LAUSANNE   (Switzerland)

Author keywords

[No Author keywords available]

Indexed keywords

FUNCTIONAL NEUROIMAGING; MAGNETIC RESONANCE IMAGING; RISK PERCEPTION;

FUNCTIONAL MAGNETIC RESONANCE IMAGING; LEARN+; LEARNING TASKS; LOSS-AVERSION; PREFRONTAL CORTEX; PROBABILITY LEARNING; RISK AVERSION; UNBIASED ESTIMATION; UNCERTAIN ENVIRONMENTS; YOUNG ADULTS;

UNCERTAINTY ANALYSIS;

ADAPTATION; ADULT; ANGULAR GYRUS; ARTICLE; BOLD SIGNAL; CONTROLLED STUDY; CORPUS STRIATUM; DECISION MAKING; EVOKED CORTICAL RESPONSE; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; INFERIOR PARIETAL LOBULE; INTROSPECTION; LEARNING; MALE; MATHEMATICAL ANALYSIS; MEDIAL PREFRONTAL CORTEX; MEMORY; NERVE CELL NETWORK; PREDICTION; PREFRONTAL CORTEX; TASK PERFORMANCE; UNCERTAINTY;

EID: 84873495487     PISSN: 1553734X     EISSN: 15537358     Source Type: Journal    
DOI: 10.1371/journal.pcbi.1002895     Document Type: Article

References (75)

1. Hertwig R, Erev I, (2009) The description-experience gap in risky choice. Trends in Cognitive Sciences 13: 517-523.
2. Sutton R, Barto A (1998) Reinforcement learning: An introduction. The MIT Press. 322 p.
3. Savage L (1954) The Foundations of Statistics. Canada: John Wiley & Sons.
4. Machina M, Schmeidler D, (1992) A more robust definition of subjective probability. Econometrica 60: 745-780.
5. Beach L, Shoenberger R, (1965) Event salience and response frequency on a ten-alternative probability-learning situation. Journal of Experimental Psychology 69: 312-316.
6. Cotton J, Rechtschaffen A, (1958) Replication report: Two-and three-choice verbal-conditioning phenomena. Journal of Experimental Psychology 56: 96.
7. Gardner R, (1957) Probability-learning with two and three choices. The American Journal of Psychology 70: 174-185.
8. Knowlton B, Squire L, Gluck M, (1994) Probabilistic classification learning in amnesia. Learning & Memory 1: 106-120.
9. Poldrack R, Prabhakaran V, Seger C, Gabrieli J, (1999) Striatal activation during acquisition of a cognitive skill. Neuropsychology 13: 564-574.
10. Fera F, Weickert T, Goldberg T, Tessitore A, Hariri A, et al. (2005) Neural mechanisms underlying probabilistic category learning in normal aging. The Journal of Neuroscience 25: 11340-11348.
11. Weickert T, Goldberg T, Callicott J, Chen Q, Apud J, et al. (2009) Neural correlates of probabilistic category learning in patients with schizophrenia. The Journal of Neuroscience 29: 1244-1254.
12. Tobler P, O'Doherty J, Dolan R, Schultz W, (2007) Reward value coding distinct from risk attitude-related uncertainty coding in human reward systems. Journal of Neurophysiology 97: 1621-1632.
13. Behrens T, Hunt L, Woolrich M, Rushworth M, (2008) Associative learning of social value. Nature 456: 245-249.
14. Hsu M, Krajbich I, Zhao C, Camerer C, (2009) Neural response to reward anticipation under risk is nonlinear in probabilities. The Journal of Neuroscience 29: 2231-2237.
15. Berns G, Capra C, Chappelow J, Moore S, Noussair C, (2008) Nonlinear neurobiological probability weighting functions for aversive outcomes. Neuroimage 39: 2047-2057.
16. Yacubian J, Glascher J, Schroeder K, Sommer T, Braus D, et al. (2006) Dissociable systems for gain-and loss-related value predictions and errors of prediction in the human brain. Journal of Neuroscience 26: 9530-9537.
17. Strange B, Duggins A, Penny W, Dolan R, Friston K, (2005) Information theory, novelty and hippocampal responses: Unpredicted or unpredictable? Neural Networks 18: 225-230.
18. Glascher J, Daw N, Dayan P, O'Doherty J, (2010) States versus rewards: Dissociable neural pre-diction error signals underlying model-based and model-free reinforcement learning. Neuron 66: 585-595.
19. Fletcher P, Anderson J, Shanks D, Honey R, Carpenter T, et al. (2001) Responses of human frontal cortex to surprising events are predicted by formal associative learning theory. Nature Neuroscience 4: 1043-1048.
20. Duncan-Johnson C, Donchin E, (1977) On quantifying surprise: The variation of event-related potentials with subjective probability. Psychophysiology 14: 456-467.
21. Mars R, Debener S, Gladwin T, Harrison L, Haggard P, et al. (2008) Trial-by-trial fluctuations in the event-related electroencephalogram reflect dynamic changes in the degree of surprise. The Journal of Neuroscience 28: 12539-12545.
22. Friston K, (2010) The free-energy principle: A unified brain theory? Nature reviews Neuroscience 11: 127-138.
23. Ratcliff R, McKoon G, (2008) The diffusion decision model: Theory and data for two-choice decision tasks. Neural computation 20: 873-922.
24. Heekeren H, Marrett S, Ungerleider L, (2008) The neural systems that mediate human perceptual decision making. Nature Reviews Neuroscience 9: 467-479.
25. Huk A, Shadlen M, (2005) Neural activity in macaque parietal cortex reects temporal integration of visual motion signals during perceptual decision making. The Journal of Neuroscience 25: 10420-10436.
26. Shadlen M, Newsome W, (2001) Neural basis of a perceptual decision in the parietal cortex (area LIP) of the rhesus monkey. Journal of Neurophysiology 86: 1916-1936.
27. Beck J, Ma W, Kiani R, Hanks T, Churchland A, et al. (2008) Probabilistic population codes for Bayesian decision making. Neuron 60: 1142-1152.
28. Yang T, Shadlen M, (2007) Probabilistic reasoning by neurons. Nature 447: 1075-1080.
29. Ratcliff R, (1978) A theory of memory retrieval. Psychological review 85: 59-108.
30. Murdock B, (1993) TODAM2: A model for the storage and retrieval of item, associative, and serial-order information. Psychological Review 100: 183-203.
31. Wagner A, Shannon B, Kahn I, Buckner R, (2005) Parietal lobe contributions to episodic memory retrieval. Trends in Cognitive Sciences 9: 445-453.
32. Sestieri C, Shulman GL, Corbetta M, (2010) Attention to memory and the environment: Func-tional specialization and dynamic competition in human posterior parietal cortex. The Journal of Neuroscience 30: 8445-8456.
33. Shimamura A, (2011) Episodic retrieval and the cortical binding of relational activity. Cognitive, Affective, & Behavioral Neuroscience 11: 277-291.
34. Bar M, (2007) The proactive brain: Using analogies and associations to generate predictions. Trends in Cognitive Sciences 11: 280-289.
35. Bar M, Aminoff E, Mason M, Fenske M, (2007) The units of thought. Hippocampus 17: 420-428.
36. Yacubian J, Sommer T, Schroeder K, Glascher J, Braus D, et al. (2007) Subregions of the ventral striatum show preferential coding of reward magnitude and probability. Neuroimage 38: 557-563.
37. Boorman E, Behrens T, Woolrich M, Rushworth M, (2009) How green is the grass on the other side? Frontopolar cortex and the evidence in favor of alternative courses of action. Neuron 62: 733-743.
38. Tversky A, Kahneman D, (1992) Advances in prospect theory: Cumulative representation of un-certainty. Journal of Risk and Uncertainty 5: 297-323.
39. Hau R, Pleskac T, Kiefer J, Hertwig R, (2008) The description-experience gap in risky choice: The role of sample size and experienced probabilities. Journal of Behavioral Decision Making 21: 493-518.
40. Nieuwenhuis S, Forstmann B, Wagenmakers E, (2011) Erroneous analyses of interactions in neuro-science: A problem of significance. Nature Neuroscience 14: 1105-1107.
41. Paulus M, Rogalsky C, Simmons A, Feinstein J, Stein M, (2003) Increased activation in the right insula during risk-taking decision making is related to harm avoidance and neuroticism. Neuroimage 19: 1439-1448.
42. Buckner R, Andrews-Hanna J, (2008) The brain's default network: Anatomy, function, and rele-vance to disease. Annals of the New York Academy of Sciences 1124: 1-38.
43. Dayan P, Niv Y, (2008) Reinforcement learning: The good, the bad and the ugly. Current Opinion in Neurobiology 18: 185-196.
44. Kaelbling L, Littman M, Moore A, (1996) Reinforcement learning: A survey. Journal of Artiffcial Intelligence Research 4: 237-285.
45. O'Doherty JP, (2012) Beyond simple reinforcement learning: The computational neurobiology of reward-learning and valuation. The European Journal of Neuroscience 35: 987-990.
46. Michelon P, Snyder A, Buckner R, McAvoy M, Zacks J, et al. (2003) Neural correlates of incon-gruous visual information: An event-related fMRI study. Neuroimage 19: 1612-1626.
47. Corbetta M, Kincade MJ, Lewis C, Snyder AZ, Sapir A, (2005) Neural basis and recovery of spatial attention deficits in spatial neglect. Nature Neuroscience 8: 1603-1610.
48. Penfield W, Milner B, (1958) Memory deficit produced by bilateral lesions in the hippocampal zone. Archives of Neurology and Psychiatry 79: 475-497.
49. Hirshman E, Whelley M, Palij M, (1989) An investigation of paradoxical memory effects. Journal of Memory and Language 28: 594-609.
50. Andrews-Hanna J, (2011) The brain's default network and its adaptive role in internal mentation. The Neuroscientist 18: 251-270.
51. Hassabis D, Kumaran D, Maguire E, (2007) Using imagination to understand the neural basis of episodic memory. The Journal of Neuroscience 27: 14365-14374.
52. Raichle M, Gusnard D, (2002) Appraising the brain's energy budget. Proceedings of the National Academy of Sciences 99: 10237-10239.
53. Ratcliff R, Smith P, (2004) A comparison of sequential sampling models for two-choice reaction time. Psychological Review 111: 333-367.
54. Hintzman D, (1988) Judgments of frequency and recognition memory in a multiple-trace memory model. Psychological Review 95: 528-551.
55. Rugg M, Fletcher P, Frith C, Frackowiak R, Dolan R, (1996) Differential activation of the prefrontal cortex in successful and unsuccessful memory retrieval. Brain 119: 2073-2083.
56. Addis DR, Pan L, Vu MA, Laiser N, Schacter DL, (2009) Constructive episodic simulation of the future and the past: Distinct subsystems of a core brain network mediate imagining and remembering. Neuropsychologia 47: 2222-2238.
57. Kim H, (2012) A dual-subsystem model of the brain's default network: Self-referential processing, memory retrieval processes, and autobiographical memory retrieval. Neuroimage 61: 966-977.
58. Cabeza R, Ciaramelli E, Olson I, Moscovitch M, (2008) The parietal cortex and episodic memory: An attentional account. Nature Reviews Neuroscience 9: 613-625.
59. Fellows L, Farah M, (2007) The role of ventromedial prefrontal cortex in decision making: Judgment under uncertainty or judgment per se? Cerebral Cortex 17: 2669-2674.
60. Kable J, Glimcher P, (2007) The neural correlates of subjective value during intertemporal choice. Nature Neuroscience 10: 1625-1633.
61. Chib VS, Rangel A, Shimojo S, O'Doherty JP, (2009) Evidence for a common representation of decision values for dissimilar goods in human ventromedial prefrontal cortex. The Journal of Neuroscience 29: 12315-12320.
62. Lebreton M, Jorge S, Michel V, Thirion B, Pessiglione M, (2009) An automatic valuation system in the human brain: Evidence from functional neuroimaging. Neuron 64: 431-439.
63. Krajbich I, Armel C, Rangel A, (2010) Visual fixations and the computation and comparison of value in simple choice. Nature Neuroscience 13: 1292-1298.
64. Weber E, Johnson E (2006) Constructing preferences from memory. In: Lichtenstein S, Slovic P, editors. The Construction of Preference. New-York: Cambridge University Press. pp. 397-410.
65. Zink CF, Pagnoni G, Martin-Skurski ME, Chappelow JC, Berns GS, (2004) Human striatal re-sponses to monetary reward depend on saliency. Neuron 42: 509-517.
66. Shenhav A, Barrett L, Bar M, (2012) Affective value and associative processing share a cortical substrate. Cognitive, Affective, & Behavioral Neuroscience pp. 1-14.
67. Gonzalez R, Wu G, (1999) On the shape of the probability weighting function. Cognitive Psychology 38: 129-166.
68. Fox C, Hadar L, (2006) Decisions from experience = sampling error+prospect theory: Reconsid-ering Hertwig, Barron, Weber & Erev (2004). Judgment and Decision Making 1: 159-161.
69. Payzan-LeNestour E, Bossaerts P, (2010) Risk, estimation uncertainty, and unexpected uncertainty: Bayesian learning in unstable settings. PLoS Computational Biology 6: 29-30.
70. Huettel S, Song A, McCarthy G, (2005) Decisions under uncertainty: Probabilistic context inu-ences activation of prefrontal and parietal cortices. Journal of Neuroscience 25: 3304-3311.
71. Bossaerts P, (2010) Risk and risk prediction error signals in anterior insula. Brain Structure and Function 214: 1-9.
72. Critchley HD, Mathias CJ, Dolan RJ, (2001) Neural activity in the human brain relating to uncer-tainty and arousal during anticipation. Neuron 29: 537-545.
73. Carter C, Veen VV, (2007) Anterior cingulate cortex and conflict detection: An update of theory and data. Cognitive, Affective, & Behavioral Neuroscience 7: 367-379.
74. Yu A, Dayan P, (2003) Expected and unexpected uncertainty: ACh and NE in the neocortex. Advances in neural information processing systems 15: 173-180.
75. d'Acremont M, Bossaerts P, (2008) Neurobiological studies of risk assessment: A comparison of expected utility and mean-variance approaches. Cognitive, Affective, & Behavioral Neuroscience 8: 363-374.