Mesolimbic confidence signals guide perceptual learning in the absence of external feedback

eLife

Volumn 5, Issue MARCH2016, 2016, Pages

  Guggenmos, Matthias ^a,b   Wilbertz, Gregor ^b   Hebart, Martin N ^c   Sterzer, Philipp ^a,b  

^a BERNSTEIN CENTER FOR COMPUTATIONAL NEUROSCIENCE   (Germany)

^b CHARITÉ UNIVERSITÄTSMEDIZIN BERLIN   (Germany)

^c UNIVERSITY MEDICAL CENTER HAMBURG EPPENDORF   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

BRAIN; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; LEARNING; MODEL; MODULATION; MONITORING; PREDICTION; REINFORCEMENT; REWARD; SPATIAL LEARNING; ADULT; ANTICIPATION; BIOLOGICAL MODEL; COMPUTER SIMULATION; FEEDBACK SYSTEM; FEMALE; LIMBIC SYSTEM; NUCLEAR MAGNETIC RESONANCE IMAGING; PHYSIOLOGY; YOUNG ADULT;

ADULT; ANTICIPATION, PSYCHOLOGICAL; COMPUTER SIMULATION; FEEDBACK; FEMALE; HUMANS; LEARNING; LIMBIC SYSTEM; MAGNETIC RESONANCE IMAGING; MODELS, NEUROLOGICAL; REINFORCEMENT (PSYCHOLOGY); YOUNG ADULT;

EID: 84964267750     PISSN: None     EISSN: 2050084X     Source Type: Journal    
DOI: 10.7554/eLife.13388     Document Type: Article

References (44)

1. Allefeld C, Haynes JD. 2014. Searchlight-based multi-voxel pattern analysis of fMRI by cross-validated MANOVA. NeuroImage 89:345–357. doi: 10.1016/j.neuroimage.2013.11.043
2. Ashby FG, Ennis JM, Spiering BJ. 2007. A neurobiological theory of automaticity in perceptual categorization. Psychological Review 114:632–656. doi: 10.1037/0033-295X.114.3.632
3. Barto AG, Sutton RS, Brouwer PS. 1981. Associative search network: A reinforcement learning associative memory. Biological Cybernetics 40:201–211. doi: 10.1007/BF00453370
4. Berns GS, McClure SM, Pagnoni G, Montague PR. 2001. Predictability modulates human brain response to reward. Journal of Neuroscience 21:2793–2798.
5. Busey TA, Tunnicliff J, Loftus GR, Loftus EF. 2000. Accounts of the confidence-accuracy relation in recognition memory. Psychonomic Bulletin & Review 7:26–48. doi: 10.3758/BF03210724
6. Cousineau D. 2005. Confidence intervals in within-subject designs: A simpler solution to Loftus and Masson’s method. Tutorial in Quantitative Methods for Psychology 1:42–45.
7. Daniel R, Pollmann S. 2012. Striatal activations signal prediction errors on confidence in the absence of external feedback. NeuroImage 59:3457–3467. doi: 10.1016/j.neuroimage.2011.11.058
8. Delgado MR, Nystrom LE, Fissell C, Noll DC, Fiez JA. 2000. Tracking the hemodynamic responses to reward and punishment in the striatum. Journal of Neurophysiology 84:3072–3077.
9. Duijvenvoorde AC, Op de Macks ZA, Overgaauw S, Gunther Moor B, Dahl RE, Crone EA. 2014. A cross-sectional and longitudinal analysis of reward-related brain activation: effects of age, pubertal stage, and reward sensitivity. Brain and Cognition 89:3–14. doi: 10.1016/j.bandc.2013.10.005
10. García-Pérez MA. 1998. Forced-choice staircases with fixed step sizes: asymptotic and small-sample properties. Vision Research 38:1861–1881. doi: 10.1016/S0042-6989(97)00340-4
11. Gibson EJ. 1963. Perceptual learning. Annual Review of Psychology 14:29–56. doi: 10.1146/annurev.ps.14.020163.000333
12. Gibson JJ, Gibson EJ. 1955. Perceptual learning; differentiation or enrichment? Psychological Review 62:32–41. doi: 10.1037/h0048826
13. Gläscher J. 2009. Visualization of group inference data in functional neuroimaging. Neuroinformatics 7:73–82. doi: 10.1007/s12021-008-9042-x
14. Hebart MN, Schriever Y, Donner TH, Haynes JD. 2016. The Relationship between Perceptual Decision Variables and Confidence in the Human Brain. Cerebral Cortex 26. doi: 10.1093/cercor/bhu181
15. Herzog MH, Fahle M. 1997. The role of feedback in learning a vernier discrimination task. Vision Research 37: 2133–2141. doi: 10.1016/S0042-6989(97)00043-6
16. Hulley S, Cummings S, Browner W, Grady D, Newman T. 2013. Designing clinical research: an epidemiologic approach, 4th eds. Philadelphia, PA: Lippincott Williams & Wilkins.
17. Hélie S, Ell SW, Ashby FG. 2015. Learning robust cortico-cortical associations with the basal ganglia: An integrative review. Cortex 64:123–135. doi: 10.1016/j.cortex.2014.10.011
18. Jaušovec N, Jaušovec K. 2010. Resting brain activity: differences between genders. Neuropsychologia 48:3918–3925. doi: 10.1016/j.neuropsychologia.2010.09.020
19. Kaernbach C. 1991. Simple adaptive testing with the weighted up-down method. Perception & Psychophysics 49:227–229. doi: 10.3758/BF03214307
20. Kahnt T, Grueschow M, Speck O, Haynes JD. 2011. Perceptual learning and decision-making in human medial frontal cortex. Neuron 70:549–559. doi: 10.1016/j.neuron.2011.02.054
21. Karni A, Sagi D. 1991. Where practice makes perfect in texture discrimination: evidence for primary visual cortex plasticity. Proceedings of the National Academy of Sciences of the United States of America 88:4966–4970. doi: 10.1073/pnas.88.11.4966
22. Karni A, Sagi D. 1993. The time course of learning a visual skill. Nature 365:250–252. doi: 10.1038/365250a0
23. Knutson B, Adams CM, Fong GW, Hommer D. 2001. Anticipation of increasing monetary reward selectively recruits nucleus accumbens. Journal of Neuroscience 21:RC159.
24. Kriegeskorte N, Goebel R, Bandettini P. 2006. Information-based functional brain mapping. Proceedings of the National Academy of Sciences of the United States of America 103:3863–3868. doi: 10.1073/pnas.0600244103
25. Kvam PD, Pleskac TJ, Yu S, Busemeyer JR. 2015. Interference effects of choice on confidence: Quantum characteristics of evidence accumulation. Proceedings of the National Academy of Sciences 112:10645–10650. doi: 10.1073/pnas.1500688112
26. Köhler W. 1925. The Mentality of Apes. New York, NY: Liveright.
27. Law CT, Gold JI. 2009. Reinforcement learning can account for associative and perceptual learning on a visual-decision task. Nature Neuroscience 12:655–663. doi: 10.1038/nn.2304
28. Mckee SP, Westhe G. 1978. Improvement in vernier acuity with practice. Perception & Psychophysics 24:258–262. doi: 10.3758/BF03206097
29. O’Doherty J, Dayan P, Schultz J, Deichmann R, Friston KJ, Dolan RJ. 2004. Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning. Science 304:452–454. doi: 10.1126/science.1094285
30. Petrov AA, Dosher BA, Lu ZL. 2005. The dynamics of perceptual learning: an incremental reweighting model. Psychological Review 112:715–743. doi: 10.1037/0033-295X.112.4.715
31. Petrov AA, Dosher BA, Lu ZL. 2006. Perceptual learning without feedback in non-stationary contexts: data and model. Vision Research 46:3177–3197. doi: 10.1016/j.visres.2006.03.022
32. Preuschoff K, Bossaerts P, Quartz SR. 2006. Neural differentiation of expected reward and risk in human subcortical structures. Neuron 51:381–390. doi: 10.1016/j.neuron.2006.06.024
33. Reynolds JN, Hyland BI, Wickens JR. 2001. A cellular mechanism of reward-related learning. Nature 413:67–70. doi: 10.1038/35092560
34. Ruigrok AN, Salimi-Khorshidi G, Lai MC, Baron-Cohen S, Lombardo MV, Tait RJ, Suckling J. 2014. A meta-analysis of sex differences in human brain structure. Neuroscience and Biobehavioral Reviews 39:34–50. doi: 10.1016/j.neubiorev.2013.12.004
35. Schlagenhauf F, Rapp MA, Huys QJ, Beck A, Wüstenberg T, Deserno L, Buchholz HG, Kalbitzer J, Buchert R, Bauer M, et al. 2013. Ventral striatal prediction error signaling is associated with dopamine synthesis capacity and fluid intelligence. Human Brain Mapping 34:1490–1499. doi: 10.1002/hbm.22000
36. Schultz W, Dayan P, Montague PR. 1997. A Neural Substrate of Prediction and Reward. Science 275:1593–1599. doi: 10.1126/science.275.5306.1593
37. Schultz W. 2002. Getting Formal with Dopamine and Reward. Neuron 36:241–263. doi: 10.1016/S0896-6273(02)00967-4
38. Schultz W. 2006. Behavioral theories and the neurophysiology of reward. Annual Review of Psychology 57:87–115. doi: 10.1146/annurev.psych.56.091103.070229
39. Schwarze U, Bingel U, Badre D, Sommer T. 2013. Ventral striatal activity correlates with memory confidence for old-and new-responses in a difficult recognition test. PloS One 8:e54324. doi: 10.1371/journal.pone.0054324
40. Sieck WR. 2003. Effects of choice and relative frequency elicitation on overconfidence: further tests of an exemplar-retrieval model. Journal of Behavioral Decision Making 16:127–145. doi: 10.1002/bdm.438
41. Sniezek JA, Paese PW, Switzer FS. 1990. The effect of choosing on confidence in choice. Organizational Behavior and Human Decision Processes 46:264–282. doi: 10.1016/0749-5978(90)90032-5
42. Sutton RS, Barto AG. 1998. Reinforcement Learning: An Introduction. Cambridge, MA: Bradford Books. doi: 10.1109/TNN.1998.712192
43. Tafarodi RW, Milne AB, Smith AJ. 1999. The Confidence of Choice: Evidence for an Augmentation Effect on Self-Perceived Performance. Personality and Social Psychology Bulletin 25:1405–1416. doi: 10.1177/0146167299259006
44. Tzourio-Mazoyer N, Landeau B, Papathanassiou D, Crivello F, Etard O, Delcroix N, Mazoyer B, Joliot M. 2002. Automated anatomical labeling of activations in SPM using a macroscopic anatomical parcellation of the MNI MRI single-subject brain. NeuroImage 15:273–289. doi: 10.1006/nimg.2001.0978