Confidence estimation as a stochastic process in a neurodynamical system of decision making

Journal of Neurophysiology

Volumn 114, Issue 1, 2015, Pages 99-113

  Wei, Ziqiang ^a,b   Wang, Xiao Jing ^c,d  

^a HOWARD HUGHES MEDICAL INSTITUTE   (United States)

^b JOHNS HOPKINS UNIVERSITY SCHOOL OF MEDICINE   (United States)

^c NEW YORK UNIVERSITY   (United States)

^d NEW YORK UNIVERSITY SHANGHAI   (China)

Author keywords

Decision confidence; Lateral intraparietal cortex; Line attractor neural model

Indexed keywords

ANIMAL EXPERIMENT; ARTICLE; BEHAVIOR; COMPUTER SIMULATION; DECISION MAKING; HAPLORHINI; INTERNEURON; NERVE CELL; NONHUMAN; PRIORITY JOURNAL; PROBABILITY; STATISTICS; ACTION POTENTIAL; ANIMAL; ARTIFICIAL NEURAL NETWORK; BIOLOGICAL MODEL; HUMAN; MARKOV CHAIN; PERCEPTIVE DISCRIMINATION; PHYSIOLOGY; PYRAMIDAL NERVE CELL;

ACTION POTENTIALS; ANIMALS; DECISION MAKING; DISCRIMINATION (PSYCHOLOGY); HAPLORHINI; HUMANS; INTERNEURONS; MODELS, NEUROLOGICAL; NEURAL NETWORKS (COMPUTER); PYRAMIDAL CELLS; STOCHASTIC PROCESSES;

EID: 84939794227     PISSN: 00223077     EISSN: 15221598     Source Type: Journal    
DOI: 10.1152/jn.00793.2014     Document Type: Article

References (60)

1. Albantakis L, Deco G. Changes of mind in an attractor network of decisionmaking. PLoS Comput Biol 7: e1002086, 2011.
2. Barthelmé S, Mamassian P. Flexible mechanisms underlie the evaluation of visual confidence. Proc Natl Acad Sci USA 107: 20834-20839, 2010.
3. Beck JM, Ma WJ, Kiani R, Hanks T, Churchland AK, Roitman J, Shadlen MN, Latham PE, Pouget A. Probabilistic population codes for Bayesian decision making. Neuron 60: 1142-1152, 2008.
4. Brunton BW, Botvinick MM, Brody CD. Rats and humans can optimally accumulate evidence for decision-making. Science 340: 95-98, 2013.
5. Churchland AK, Kiani R, Shadlen MN. Decision-making with multiple alternatives. Nat Neurosci 11: 693-702, 2008.
6. Compte A, Brunel N, Goldman-Rakic PS, Wang XJ. Synaptic mechanisms and network dynamics underlying spatial working memory in a cortical network model. Cereb Cortex 10: 910-923, 2000.
7. Cook EP, Maunsell JHR. Dynamics of neuronal responses in macaque MT and VIP during motion detection. Nat Neurosci 5: 985-994, 2002.
8. Curtis CE, Lee D. Beyond working memory: the role of persistent activity in decision making. Trends Cogn Sci 14: 216-222, 2010.
9. Del Cul A, Dehaene S, Reyes P, Bravo E, Slachevsky A. Causal role of prefrontal cortex in the threshold for access to consciousness. Brain 132: 2531-2540, 2009.
10. Dienes Z, Seth A. Gambling on the unconscious: a comparison of wagering and confidence ratings as measures of awareness in an artificial grammar task. Conscious Cogn 19: 674-681, 2010.
11. Drugowitsch J, Moreno-Bote R, Churchland AK, Shadlen MN, Pouget A. The cost of accumulating evidence in perceptual decision making. J Neurosci 32: 3612-3628, 2012.
12. Fetsch CR, Kiani R, Newsome WT, Shadlen MN. Effects of cortical microstimulation on confidence in a perceptual decision. Neuron 83: 797- 804, 2014.
13. Flavell JH. Metacognition and cognitive monitoring: A new area of cognitivedevelopmental inquiry. Am J Psychol 34: 906-911, 1979.
14. Fleming SM, Dolan RJ. Effects of loss aversion on post-decision wagering: implications for measures of awareness. Conscious Cogn 19: 352-363, 2010.
15. Fleming SM, Weil RS, Nagy Z, Dolan RJ, Rees G. Relating introspective accuracy to individual differences in brain structure. Science 329: 1541- 1543, 2010.
16. Furman M, Wang XJ. Similarity effect and optimal control of multiplechoice decision making. Neuron 60: 1153-1168, 2008.
17. Gold JI, Shadlen MN. The neural basis of decision making. Annu Rev Neurosci 30: 535-574, 2007.
18. Graziano M, Sigman M. The spatial and temporal construction of confidence in the visual scene. PLoS One 4: e4909, 2009.
19. Graziano M, Parra LC, Sigman M. Neurophysiology of perceived confidence. Conf Proc IEEE Eng Med Biol Soc 2010: 2818-2821, 2010.
20. Hanks TD, Ditterich J, Shadlen MN. Microstimulation of macaque area LIP affects decision-making in a motion discrimination task. Nat Neurosci 9: 682-689, 2006.
21. Hansel D, Mato G, Meunier C, Neltner L. On numerical simulations of integrate-and-fire neural networks. Neural Comput 10: 467-483, 1998.
22. Heeger DJ. Normalization of cell responses in cat striate cortex. Vis Neurosci 9: 181-197, 1992.
23. Insabato A, Pannunzi M, Rolls ET, Deco G. Confidence-related decision making. J Neurophysiol 104: 539-547, 2010.
24. Juslin P, Olsson H. Thurstonian and Brunswikian origins of uncertainty in judgment: a sampling model of confidence in sensory discrimination. Psychol Rev 104: 344-366, 1997.
25. Kepecs A, Mainen ZF. A computational framework for the study of confidence in humans and animals. Philos Trans R Soc B Biol Sci 367: 1322- 1337, 2012.
26. Kepecs A, Uchida N, Zariwala HA, Mainen ZF. Neural correlates, computation and behavioural impact of decision confidence. Nature 455: 227-231, 2008.
27. Kiani R, Shadlen MN. Representation of confidence associated with a decision by neurons in the parietal cortex. Science 324: 759-764, 2009.
28. Kiani R, Shadlen MN, Newsome WT. Belief and time: Response dynamics of lateral intraparietal neurons represent choice certainty. In: Neuroscience Meeting. Washington, DC: Society for Neuroscience, 2011, 17.06
29. Kiani R, Corthell L, Shadlen MN. Choice certainty is informed by both evidence and decision time. Neuron 86: 1329-1342, 2014.
30. Komura Y, Nikkuni A, Hirashima N, Uetake T, Miyamoto A. Responses of pulvinar neurons reflect a subject's confidence in visual categorization. Nat Neurosci 16: 749-755, 2013.
31. Lak A, Costa GM, Romberg E, Koulakov AA, Mainen ZF, Kepecs A. Orbitofrontal cortex is required for optimal waiting based on decision confidence. Neuron 84: 190-201, 2014.
32. Liu F, Wang XJ. A common cortical circuit mechanism for perceptual categorical discrimination and veridical judgment. PLoS Comput Biol 4: e1000253, 2008.
33. Middlebrooks PG, Sommer MA. Metacognition in monkeys during an oculomotor task. J Exp Psychol Learn Mem Cogn 37: 325-337, 2011.
34. Middlebrooks PG, Sommer MA. Neuronal correlates of metacognition in primate frontal cortex. Neuron 75: 517-530, 2012.
35. Moreno-Bote R. Decision confidence and uncertainty in diffusion models with partially correlated neuronal integrators. Neural Comput 22: 1786-1811, 2010.
36. Persaud N, Mcleod P, Cowey A. Post-decision wagering objectively measures awareness. Nat Neurosci 10: 257-261, 2007.
37. Pierrel R, Murray CS. Some relationships between comparative judgment, confidence, and decision-time in weight-lifting. Am J Psychol 76: 28-38, 1963.
38. Platt ML, Glimcher PW. Neural correlates of decision variables in parietal cortex. Nature 400: 233-238, 1999.
39. Pleskac TJ, Busemeyer JR. Two-stage dynamic signal detection: a theory of choice, decision time, and confidence. Psychol Rev 117: 864-901, 2010.
40. Ratcliff R, Smith PL. A comparison of sequential sampling models for two-choice reaction time. Psychol Rev 111: 333-367, 2004.
41. Ratcliff R, Starns JJ. Modeling confidence and response time in recognition memory. Psychol Rev 116: 59-83, 2009.
42. Resulaj A, Kiani R, Wolpert DM, Shadlen MN. Changes of mind in decision-making. Nature 461: 263-266, 2009.
43. Roitman JD, Shadlen MN. Response of neurons in the lateral intraparietal area during a combined visual discrimination reaction time task. J Neurosci 22: 9475-9489, 2002.
44. Rolls ET, Grabenhorst F, Deco G. Choice, difficulty, and confidence in the brain. NeuroImage 53: 694-706, 2010a.
45. Rolls ET, Grabenhorst F, Deco G. Decision-making, errors, and confidence in the brain. J Neurophysiol 104: 2359-2374, 2010b.
46. Shadlen MN, Newsome WT. Neural basis of a perceptual decision in the parietal cortex (area LIP) of the rhesus monkey. J Neurophysiol 86: 1916-1936, 2001.
47. Smith JD. The study of animal metacognition. Trends Cogn Sci 13: 389-396, 2009.
48. Smith JD, Shields WE, Washburn DA. The comparative psychology of uncertainty monitoring and metacognition. Behav Brain Sci 26: 317-339, 2003.
49. Soltani A, Wang XJ. A biophysically based neural model of matching law behavior: melioration by stochastic synapses. J Neurosci 26: 3731-3744, 2006.
50. Sugrue LP, Corrado GS, Newsome WT. Matching behavior and the representation of value in the parietal cortex. Science 304: 1782-1787, 2004.
51. Tobler PN, Fiorillo CD, Schultz W. Adaptive coding of reward value by dopamine neurons. Science 307: 1642-1645, 2005.
52. Treue S, Hol K, Rauber HJ. Seeing multiple directions of motion-physiology and psychophysics. Nat Neurosci 3: 270-276, 2000.
53. Van Zandt T. ROC curves and confidence judgments in recognition memory. J Exp Psychol Learn Mem Cogn 26: 582-600, 2000.
54. Vickers D. Decision Processes in Visual Perception. New York, NY: Academic, 1979.
55. Volkmann J. The relation of the time of judgment to the certainty of judgment. Psychol Bull 31: 672-673, 1934.
56. Wang XJ. Probabilistic decision making by slow reverberation in neocortical circuits. Neuron 36: 955-968, 2002.
57. Wang XJ. Decision making in recurrent neuronal circuits. Neuron 60: 215- 234, 2008.
58. Whiteley L, Sahani M. Implicit knowledge of visual uncertainty guides decisions with asymmetric outcomes. J Vis 8: 2.1-2.15, 2008.
59. Wong KF, Wang XJ. A recurrent network mechanism of time integration in perceptual decisions. J Neurosci 26: 1314-1328, 2006.
60. Wong KF, Huk AC, Shadlen MN, Wang XJ. Neural circuit dynamics underlying accumulation of time-varying evidence during perceptual decision making. Front Comput Neurosci 1: 6, 2007.