Hierarchical decision processes that operate over distinct timescales underlie choice and changes in strategy

Proceedings of the National Academy of Sciences of the United States of America

Volumn 113, Issue 31, 2016, Pages E4531-E4540

  Purcell, Braden A ^a   Kiani, Roozbeh ^a  

^a NEW YORK UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ACCURACY; ADAPTIVE BEHAVIOR; BEHAVIOR CHANGE; CONFERENCE PAPER; CONTROLLED STUDY; DECISION MAKING; ENVIRONMENTAL CHANGE; FEEDBACK SYSTEM; FEMALE; FOLLOW UP; HUMAN; HUMAN EXPERIMENT; INTEGRATION; MALE; MOTION; NEGATIVE FEEDBACK; NORMAL HUMAN; POSITIVE FEEDBACK; PRIORITY JOURNAL; RESPONSE TIME; SACCADIC EYE MOVEMENT; STIMULUS; TIME; ALGORITHM; BRAIN; COPING BEHAVIOR; MOVEMENT PERCEPTION; NERVE CELL NETWORK; PHYSIOLOGY; PSYCHOLOGICAL FEEDBACK; PSYCHOMOTOR PERFORMANCE; STATISTICAL MODEL; UNCERTAINTY;

ADAPTATION, PSYCHOLOGICAL; ALGORITHMS; BRAIN; CHOICE BEHAVIOR; DECISION MAKING; FEEDBACK, PSYCHOLOGICAL; FEMALE; HUMANS; LOGISTIC MODELS; MALE; MOTION PERCEPTION; NERVE NET; PSYCHOMOTOR PERFORMANCE; UNCERTAINTY;

EID: 84982685000     PISSN: 00278424     EISSN: 10916490     Source Type: Journal    
DOI: 10.1073/pnas.1524685113     Document Type: Article

References (62)

1. Logan GD, Gordon RD (2001) Executive control of visual attention in dual-Task situations. Psychol Rev 108(2):393-434.
2. Botvinick MM, Niv Y, Barto AC (2009) Hierarchically organized behavior and its neural foundations: A reinforcement learning perspective. Cognition 113(3):262-280.
3. Kiani R, Shadlen MN (2009) Representation of confidence associated with a decision by neurons in the parietal cortex. Science 324(5928):759-764.
4. Kiani R, Corthell L, Shadlen MN (2014) Choice certainty is informed by both evidence and decision time. Neuron 84(6):1329-1342.
5. Middlebrooks PG, Sommer MA (2012) Neuronal correlates of metacognition in primate frontal cortex. Neuron 75(3):517-530.
6. Kepecs A, Uchida N, Zariwala HA, Mainen ZF (2008) Neural correlates, computation and behavioural impact of decision confidence. Nature 455(7210):227-231.
7. Fleming SM, Lau HC (2014) How to measure metacognition. Front Hum Neurosci 8: 443.
8. Pleskac TJ, Busemeyer JR (2010) Two-stage dynamic signal detection: A theory of choice, decision time, and confidence. Psychol Rev 117(3):864-901.
9. Moran R, Teodorescu AR, Usher M (2015) Post choice information integration as a causal determinant of confidence: Novel data and a computational account. Cognit Psychol 78:99-147.
10. Ratcliff R, Starns JJ (2013) Modeling confidence judgments, response times, and multiple choices in decision making: Recognition memory and motion discrimination. Psychol Rev 120(3):697-719.
11. Drugowitsch J, Moreno-Bote R, Pouget A (2014) Relation between belief and performance in perceptual decision making. PLoS One 9(5):e96511.
12. Donoso M, Collins AG, Koechlin E (2014) Human cognition. Foundations of human reasoning in the prefrontal cortex. Science 344(6191):1481-1486.
13. Seo H, Cai X, Donahue CH, Lee D (2014) Neural correlates of strategic reasoning during competitive games. Science 346(6207):340-343.
14. Nassar MR, et al. (2012) Rational regulation of learning dynamics by pupil-linked arousal systems. Nat Neurosci 15(7):1040-1046.
15. Courville AC, Daw ND (2007) The rat as particle filter. Adv Neural Inf Process Syst 20: 369-376.
16. Gallistel CR, Krishan M, Liu Y, Miller R, Latham PE (2014) The perception of probability. Psychol Rev 121(1):96-123.
17. Behrens TE, Woolrich MW, Walton ME, Rushworth MF (2007) Learning the value of information in an uncertain world. Nat Neurosci 10(9):1214-1221.
18. Yu AJ, Dayan P (2005) Uncertainty, neuromodulation, and attention. Neuron 46(4): 681-692.
19. Costa VD, Tran VL, Turchi J, Averbeck BB (2015) Reversal learning and dopamine: A Bayesian perspective. J Neurosci 35(6):2407-2416.
20. Meyniel F, Schlunegger D, Dehaene S (2015) The sense of confidence during probabilistic learning: A normative account. PLOS Comput Biol 11(6):e1004305.
21. Brown SD, Steyvers M (2009) Detecting and predicting changes. Cognit Psychol 58(1): 49-67.
22. Kiani R, Hanks TD, Shadlen MN (2008) Bounded integration in parietal cortex underlies decisions even when viewing duration is dictated by the environment. J Neurosci 28(12): 3017-3029.
23. Shadlen MN, Newsome WT (2001) Neural basis of a perceptual decision in the parietal cortex (area LIP) of the rhesus monkey. J Neurophysiol 86(4):1916-1936.
24. Hayden BY, Pearson JM, Platt ML (2011) Neuronal basis of sequential foraging decisions in a patchy environment. Nat Neurosci 14(7):933-939.
25. Ossmy O, et al. (2013) The timescale of perceptual evidence integration can be adapted to the environment. Curr Biol 23(11):981-986.
26. Purcell BA, et al. (2010) Neurally constrained modeling of perceptual decision making. Psychol Rev 117(4):1113-1143.
27. Link SW (1992) The Wave Theory of Difference and Similarity (Lawrence Erlbaum Assoc, Hillsdale, NJ).
28. Bogacz R, Brown E, Moehlis J, Holmes P, Cohen JD (2006) The physics of optimal decision making: A formal analysis of models of performance in two-Alternative forced-choice tasks. Psychol Rev 113(4):700-765.
29. Ditterich J (2006) Evidence for time-variant decision making. Eur J Neurosci 24(12): 3628-3641.
30. Churchland AK, Kiani R, Shadlen MN (2008) Decision-making with multiple alternatives. Nat Neurosci 11(6):693-702.
31. Purcell BA, Kiani R (2016) Neural mechanisms of post-error adjustments of decision policy in parietal cortex. Neuron 89(3):658-671.
32. Hanks TD, et al. (2015) Distinct relationships of parietal and prefrontal cortices to evidence accumulation. Nature 520(7546):220-223.
33. Hanks T, Kiani R, Shadlen MN (2014) A neural mechanism of speed-Accuracy tradeoff in macaque area LIP. eLife 3:3.
34. Ding L, Gold JI (2010) Caudate encodes multiple computations for perceptual decisions. J Neurosci 30(47):15747-15759.
35. Ratcliff R, Cherian A, Segraves M (2003) A comparison of macaque behavior and superior colliculus neuronal activity to predictions from models of two-choice decisions. J Neurophysiol 90(3):1392-1407.
36. Shadlen MN, Kiani R (2013) Decision making as a window on cognition. Neuron 80(3): 791-806.
37. Tsetsos K, Gao J, McClelland JL, Usher M (2012) Using time-varying evidence to test models of decision dynamics: Bounded diffusion vs.The leaky competing accumulator model. Front Neurosci 6:79.
38. Yu S, Pleskac TJ, Zeigenfuse MD (2015) Dynamics of postdecisional processing of confidence. J Exp Psychol Gen 144(2):489-510.
39. Zylberberg A, Barttfeld P, Sigman M (2012) The construction of confidence in a perceptual decision. Front Integr Nuerosci 6:79.
40. Wald A, Wolfowitz J (1948) Optimum character of the sequential probability ratio test. Ann Math Stat 19(3):326-339.
41. Gold JI, Shadlen MN (2001) Neural computations that underlie decisions about sensory stimuli. Trends Cogn Sci 5(1):10-16.
42. Kira S, Yang T, Shadlen MN (2015) A neural implementation of Wald's sequential probability ratio test. Neuron 85(4):861-873.
43. Glaser C, Trommershäuser J, Mamassian P, Maloney LT (2012) Comparison of the distortion of probability information in decision under risk and an equivalent visual task. Psychol Sci 23(4):419-426.
44. Kahneman D, Tversky A (1979) Prospect theory: An analysis of decision under risk. Econometrica 47(2):263-291.
45. Corrado GS, Sugrue LP, Seung HS, Newsome WT (2005) Linear-nonlinear-Poisson models of primate choice dynamics. J Exp Anal Behav 84(3):581-617.
46. Peirce CS, Jastrow J (1885) On Small Differences of Sensation (US Gov Print Off, Washington, DC).
47. Henmon VAC (1911) The relation of the time of a judgment to its accuracy. Psychol Rev 18(3):186-201.
48. Vickers D (1979) Decision Processes in Visual Perception (Academic, New York).
49. Fetsch CR, Pouget A, DeAngelis GC, Angelaki DE (2011) Neural correlates of reliabilitybased cue weighting during multisensory integration. Nat Neurosci 15(1):146-154.
50. Daw ND, Niv Y, Dayan P (2005) Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nat Neurosci 8(12): 1704-1711.
51. Friedman D, Hakerem G, Sutton S, Fleiss JL (1973) Effect of stimulus uncertainty on the pupillary dilation response and the vertex evoked potential. Electroencephalogr Clin Neurophysiol 34(5):475-484.
52. Crone EA, Somsen RJ, Van Beek B, Van Der Molen MW (2004) Heart rate and skin conductance analysis of antecendents and consequences of decision making. Psychophysiology 41(4):531-540.
53. Law CT, Gold JI (2009) Reinforcement learning can account for associative and perceptual learning on a visual-decision task. Nat Neurosci 12(5):655-663.
54. Daniel R, Pollmann S (2012) Striatal activations signal prediction errors on confidence in the absence of external feedback. Neuroimage 59(4):3457-3467.
55. Guggenmos M, Wilbertz G, Hebart MN, Sterzer P (2016) Mesolimbic confidence signals guide perceptual learning in the absence of external feedback. eLife 5:e13388.
56. Lashley KS (1951) The problem of serial order in behavior. Cerebral Mechanisms in Behavior: The Hixon Symposium, ed Jeffress LA (Wiley, Oxford), pp 112?146.
57. Friston K (2008) Hierarchical models in the brain. PLOS Comput Biol 4(11):e1000211.
58. FitzGerald TH, Moran RJ, Friston KJ, Dolan RJ (2015) Precision and neuronal dynamics in the human posterior parietal cortex during evidence accumulation. Neuroimage 107:219-228.
59. Pearson JM, Heilbronner SR, Barack DL, Hayden BY, Platt ML (2011) Posterior cingulate cortex: Adapting behavior to a changing world. Trends Cogn Sci 15(4):143-151.
60. Karlsson MP, Tervo DG, Karpova AY (2012) Network resets in medial prefrontal cortex mark the onset of behavioral uncertainty. Science 338(6103):135-139.
61. Glaze CM, Kable JW, Gold JI (2015) Normative evidence accumulation in unpredictable environments. eLife 4:308825.
62. Brainard DH (1997) The Psychophysics Toolbox. Spat Vis 10(4):433-436.