The Sense of Confidence during Probabilistic Learning: A Normative Account

PLoS Computational Biology

Volumn 11, Issue 6, 2015, Pages

  Meyniel, Florent ^a,b   Schlunegger, Daniel ^a,b   Dehaene, Stanislas ^a,b,c  

^a INSERM ^*  (France)

^b DIF   (France)

^c Centre de Recherche Interdisciplinaire en Biologie   (France)

Author keywords

[No Author keywords available]

Indexed keywords

LEARNING SYSTEMS; STOCHASTIC MODELS; STOCHASTIC SYSTEMS;

CLASSICAL MODELING; LEARNING PROCESS; NOISY DATA; PARAMETERS ESTIMATES; PROBABILISTIC LEARNING; PROPERTY; STOCHASTIC CHARACTERISTIC; STOCHASTIC ENVIRONMENT; TRANSITION PROBABILITIES; UNCERTAINTY;

OPTIMIZATION;

HUMAN; LEARNING; MODEL; STIMULUS; STOCHASTIC MODEL; UNCERTAINTY; ADULT; ALGORITHM; BIOLOGICAL MODEL; BIOLOGY; FEMALE; MALE; PHYSIOLOGY; STATISTICAL MODEL; TASK PERFORMANCE; YOUNG ADULT;

ADULT; ALGORITHMS; COMPUTATIONAL BIOLOGY; FEMALE; HUMANS; LEARNING; MALE; MODELS, NEUROLOGICAL; MODELS, STATISTICAL; TASK PERFORMANCE AND ANALYSIS; UNCERTAINTY; YOUNG ADULT;

EID: 84943300081     PISSN: 1553734X     EISSN: 15537358     Source Type: Journal    
DOI: 10.1371/journal.pcbi.1004305     Document Type: Article

References (47)

1. Téglás E, Vul E, Girotto V, Gonzalez M, Tenenbaum JB, Bonatti LL, Pure Reasoning in 12-Month-Old Infants as Probabilistic Inference. Science. 2011;332: 1054–1059. doi: 10.1126/science.1196404 21617069
2. Bach DR, Dolan RJ, Knowing how much you don’t know: a neural organization of uncertainty estimates. Nat Rev Neurosci. 2012;13: 572–586. doi: 10.1038/nrn3289 22781958
3. Dolan RJ, Dayan P, Goals and Habits in the Brain. Neuron. 2013;80: 312–325. doi: 10.1016/j.neuron.2013.09.007 24139036
4. Behrens TEJ, Woolrich MW, Walton ME, Rushworth MFS, Learning the value of information in an uncertain world. Nat Neurosci. 2007;10: 1214–1221. doi: 10.1038/nn1954 17676057
5. Nassar MR, Wilson RC, Heasly B, Gold JI, An Approximately Bayesian Delta-Rule Model Explains the Dynamics of Belief Updating in a Changing Environment. J Neurosci. 2010;30: 12366–12378. doi: 10.1523/JNEUROSCI.0822-10.2010 20844132
6. Summerfield C, Behrens TE, Koechlin E, Perceptual Classification in a Rapidly Changing Environment. Neuron. 2011;71: 725–736. doi: 10.1016/j.neuron.2011.06.022 21867887
7. Gallistel CR, Krishan M, Liu Y, Miller R, Latham PE, The perception of probability. Psychol Rev. 2014;121: 96–123. doi: 10.1037/a0035232 24490790
8. Koriat A, Sheffer L, Ma’ayan H, Comparing objective and subjective learning curves: Judgments of learning exhibit increased underconfidence with practice. J Exp Psychol Gen. 2002;131: 147–162. doi: 10.1037/0096-3445.131.2.147 12049237
9. Kepecs A, Uchida N, Zariwala HA, Mainen ZF, Neural correlates, computation and behavioural impact of decision confidence. Nature. 2008;455: 227–231. doi: 10.1038/nature07200 18690210
10. Barthelmé S, Mamassian P, Evaluation of objective uncertainty in the visual system. PLoS Comput Biol. 2009;5: e1000504. doi: 10.1371/journal.pcbi.1000504 19750003
11. Kiani R, Shadlen MN, Representation of confidence associated with a decision by neurons in the parietal cortex. Science. 2009;324: 759–764. doi: 10.1126/science.1169405 19423820
12. Rescorla Robert A, Wagner Allan R, Black AH., Prokasy WF, Back AH, A theory of Pavlovian conditioning: Variations in the effectiveness of reinforcement and nonreinforcement. In: Classical conditioning II: Current research and theory. New York Appleton-Century Crofts; 1972. pp. 64–99.
13. Payzan-LeNestour E, Bossaerts P, Risk, Unexpected Uncertainty, and Estimation Uncertainty: Bayesian Learning in Unstable Settings. PLoS Comput Biol. 2011;7: e1001048. doi: 10.1371/journal.pcbi.1001048 21283774
14. Knill DC, Pouget A, The Bayesian brain: the role of uncertainty in neural coding and computation. Trends Neurosci. 2004;27: 712–719. doi: 10.1016/j.tins.2004.10.007 15541511
15. Pouget A, Beck JM, Ma WJ, Latham PE, Probabilistic brains: knowns and unknowns. Nat Neurosci. 2013;16: 1170–1178. doi: 10.1038/nn.3495 23955561
16. Bonawitz E, Denison S, Griffiths TL, Gopnik A, Probabilistic models, learning algorithms, and response variability: sampling in cognitive development. Trends Cogn Sci. 2014;18: 497–500. doi: 10.1016/j.tics.2014.06.006 25001609
17. Legenstein R, Maass W, Ensembles of Spiking Neurons with Noise Support Optimal Probabilistic Inference in a Dynamically Changing Environment. PLoS Comput Biol. 2014;10: e1003859. doi: 10.1371/journal.pcbi.1003859 25340749
18. Jaynes ET, Probability Theory: The Logic of Science. Cambridge University Press; 2003.
19. Yeung N, Summerfield C, Metacognition in human decision-making: confidence and error monitoring. Philos Trans R Soc B Biol Sci. 2012;367: 1310–1321. doi: 10.1098/rstb.2011.0416 22492749
20. Kahneman D, Tversky A, Prospect Theory: An Analysis of Decision under Risk. Econometrica. 1979;47: 263. doi: 10.2307/1914185
21. Rouder JN, Speckman PL, Sun D, Morey RD, Iverson G, Bayesian t tests for accepting and rejecting the null hypothesis. Psychon Bull Rev. 2009;16: 225–237. doi: 10.3758/PBR.16.2.225 19293088
22. Gelman A, Carlin JB, Stern HS, Dunson DB, Vehtari A, Rubin DB, Bayesian Data Analysis, Third Edition. CRC Press; 2013.
23. Kahneman D, Tversky A, Variants of uncertainty. Cognition. 1982;11: 143–157. doi: 10.1016/0010-0277(82)90023-3 7198958
24. Timmermans B, Schilbach L, Pasquali A, Cleeremans A, Higher order thoughts in action: consciousness as an unconscious re-description process. Philos Trans R Soc B Biol Sci. 2012;367: 1412–1423. doi: 10.1098/rstb.2011.0421 22492757
25. Kepecs A, Mainen ZF, A computational framework for the study of confidence in humans and animals. Philos Trans R Soc B Biol Sci. 2012;367: 1322–1337. doi: 10.1098/rstb.2012.0037 22492750
26. Hsu M, Bhatt M, Adolphs R, Tranel D, Camerer CF, Neural systems responding to degrees of uncertainty in human decision-making. Science. 2005;310: 1680–1683. doi: 10.1126/science.1115327 16339445
27. Juslin P, Olsson H, Thurstonian and Brunswikian origins of uncertainty in judgment: A sampling model of confidence in sensory discrimination. Psychol Rev. 1997;104: 344–366. doi: 10.1037/0033-295X.104.2.344 9162950
28. Sergent C, Baillet S, Dehaene S, Timing of the brain events underlying access to consciousness during the attentional blink. Nat Neurosci. 2005;8: 1391–1400. doi: 10.1038/nn1549 16158062
29. Charles L, Van Opstal F, Marti S, Dehaene S, Distinct brain mechanisms for conscious versus subliminal error detection. NeuroImage. 2013;73: 80–94. doi: 10.1016/j.neuroimage.2013.01.054 23380166
30. Gigerenzer G, Hoffrage U, Kleinbölting H, Probabilistic mental models: A Brunswikian theory of confidence. Psychol Rev. 1991;98: 506–528. doi: 10.1037/0033-295X.98.4.506 1961771
31. Koriat A, The self-consistency model of subjective confidence. Psychol Rev. 2012;119: 80–113. doi: 10.1037/a0025648 22022833
32. Fleming SM, Lau HC, How to measure metacognition. Front Hum Neurosci. 2014;8: 443. doi: 10.3389/fnhum.2014.00443 25076880
33. De Gardelle V, Mamassian P, Does Confidence Use a Common Currency Across Two Visual Tasks? Psychol Sci. 2014;25: 1286–1288. doi: 10.1177/0956797614528956 24699845
34. Bahrami B, Olsen K, Latham PE, Roepstorff A, Rees G, Frith CD, Optimally interacting minds. Science. 2010;329: 1081–1085. doi: 10.1126/science.1185718 20798320
35. Kahneman D, Tversky A, Subjective probability: A judgment of representativeness. Cognit Psychol. 1972;3: 430–454. doi: 10.1016/0010-0285(72)90016-3
36. Kareev Y, Not that bad after all: Generation of random sequences. J Exp Psychol Hum Percept Perform. 1992;18: 1189.
37. Falk R, Konold C, Making sense of randomness: Implicit encoding as a basis for judgment. Psychol Rev. 1997;104: 301.
38. Kareev Y, Positive bias in the perception of covariation. Psychol Rev. 1995;102: 490–502. doi: 10.1037/0033-295X.102.3.490
39. Barthelme S, Mamassian P, Flexible mechanisms underlie the evaluation of visual confidence. Proc Natl Acad Sci. 2010;107: 20834–20839. doi: 10.1073/pnas.1007704107 21076036
40. Fleming SM, Dolan RJ, The neural basis of metacognitive ability. Philos Trans R Soc B Biol Sci. 2012;367: 1338–1349. doi: 10.1098/rstb.2011.0417 22492751
41. De Martino B, Fleming SM, Garrett N, Dolan RJ, Confidence in value-based choice. Nat Neurosci. 2013;16: 105–110. doi: 10.1038/nn.3279 23222911
42. King J- R, Dehaene S, A model of subjective report and objective discrimination as categorical decisions in a vast representational space. Philos Trans R Soc B Biol Sci. 2014;369: 20130204. doi: 10.1098/rstb.2013.0204
43. Bejjanki VR, Beck JM, Lu Z- L, Pouget A, Perceptual learning as improved probabilistic inference in early sensory areas. Nat Neurosci. 2011;14: 642–648. doi: 10.1038/nn.2796 21460833
44. Persaud N, McLeod P, Cowey A, Post-decision wagering objectively measures awareness. Nat Neurosci. 2007;10: 257–261. doi: 10.1038/nn1840 17237774
45. Komura Y, Nikkuni A, Hirashima N, Uetake T, Miyamoto A, Responses of pulvinar neurons reflect a subject’s confidence in visual categorization. Nat Neurosci. 2013;16: 749–755. doi: 10.1038/nn.3393 23666179
46. Mamassian P, Overconfidence in an objective anticipatory motor task. Psychol Sci. 2008;19: 601–606. doi: 10.1111/j.1467-9280.2008.02129.x 18578851
47. Fiser J, Berkes P, Orbán G, Lengyel M, Statistically optimal perception and learning: from behavior to neural representations. Trends Cogn Sci. 2010;14: 119–130. doi: 10.1016/j.tics.2010.01.003 20153683