Normative evidence accumulation in unpredictable environments

eLife

Volumn 4, Issue AUGUST2015, 2015, Pages

  Glaze, Christopher M ^a   Kable, Joseph W ^a   Gold, Joshua I ^a  

^a UNIVERSITY OF PENNSYLVANIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; CLINICAL DECISION MAKING; CONTINUOUS TIME MODEL; DOTS REVERSAL TASK; DYNAMICS; FEMALE; HUMAN; HUMAN EXPERIMENT; LEARNING ENVIRONMENT; MALE; MENTAL TASK; MODEL; NORMAL HUMAN; NORMATIVE MODEL; PSYCHOPHYSICS; TRIANGLES TASK; WHITE NOISE; DECISION MAKING; LEARNING; MIDDLE AGED; PSYCHOLOGIC TEST; PSYCHOLOGICAL MODEL; YOUNG ADULT;

ADULT; DECISION MAKING; FEMALE; HUMANS; LEARNING; MALE; MIDDLE AGED; MODELS, PSYCHOLOGICAL; PSYCHOLOGICAL TESTS; YOUNG ADULT;

EID: 84943647259     PISSN: None     EISSN: 2050084X     Source Type: Journal    
DOI: 10.7554/eLife.08825     Document Type: Article

References (73)

1. Adams RP, MacKay DJ. 2007. Bayesian online changepoint detection. University of Cambridge Technical report.
2. Barnard GA. 1946. Sequential tests in industrial statistics. Journal of the Royal Statistical Society 8:1–26. doi: 10.2307/2983610.
3. Behrens TE, Woolrich MW, Walton ME, Rushworth MF. 2007. Learning the value of information in an uncertain world. Nature Neuroscience 10:1214–1221. doi: 10.1038/nn1954.
4. Bishop CM. 2006. Pattern recognition and machine learning. New York: Springer.
5. Boerlin M, Machens CK, Deneve S. 2013. Predictive coding of dynamical variables in balanced spiking networks. PLoS computational biology, 9(11):p. e1003258.
6. Bogacz R, Brown E, Moehlis J, Holmes P, Cohen JD. 2006. The physics of optimal decision making: a formal analysis of models of performance in two-alternative forced choice tasks. Psychological Review 113:700–765. doi: 10.1037/0033-295X.113.4.700.
7. Bogacz R, Wagenmakers EJ, Forstmann BU, Nieuwenhuis S. 2010. The neural basis of the speed-accuracy tradeoff. Trends in Neurosciences 33:10–16. doi: 10.1016/j.tins.2009.09.002.
8. Britten KH, Shadlen MN, Newsome WT, Movshon JA. 1992. The analysis of visual motion: a comparison of neuronal and psychophysical performance. The Journal of Neuroscience 12:4745–4765.
9. Brown SD, Steyvers M. 2009. Detecting and predicting changes. Cognitive Psychology 58:49–67. doi: 10.1016/j.cogpsych.2008.09.002.
10. Brunton BW, Botvinick MM, Brody CD. 2013. Rats and humans can optimally accumulate evidence for decisionmaking. Science 340:95–98. doi: 10.1126/science.1233912.
11. Busemeyer JR, Townsend JT. 1993. Decision field theory: a dynamic-cognitive approach to decision making in an uncertain environment. Psychological Review 100:432–459. doi: 10.1037/0033-295X.100.3.432.
12. Cisek P, Puskas GA, El-Murr S. 2009. Decisions in changing conditions: the urgency-gating model. The Journal of Neuroscience 29:11560–11571. doi: 10.1523/JNEUROSCI.1844-09.2009.
13. Clifford CW, Ibbotson MR. 2002. Fundamental mechanisms of visual motion detection: models, cells and functions. Progress in Neurobiology 68:409–437. doi: 10.1016/S0301-0082(02)00154-5.
14. Crisan D, Rozovskii B. 2011. The Oxford handbook of nonlinear filtering. New York: Oxford University Press.
15. Deneve S. 2012. Making decisions with unknown sensory reliability. Frontiers in Neuroscience 6:75. doi: 10.3389/fnins.2012.00075.
16. Ding L, Gold JI. 2013. The basal ganglia’s contributions to perceptual decision making. Neuron 79:640–649. doi: 10.1016/j.neuron.2013.07.042.
17. Ditterich J. 2006. Evidence for time-variant decision making. The European Journal of Neuroscience 24: 3628–3641. doi: 10.1111/j.1460-9568.2006.05221.x.
18. Drugowitsch J, DeAngelis GC, Klier EM, Angelaki DE, Pouget A. 2014. Optimal multisensory decision-making in a reaction-time task. eLife 3:e03005. doi: 10.7554/eLife.03005.
19. Drugowitsch J, Moreno-Bote R, Churchland AK, Shadlen MN, Pouget A. 2012. The cost of accumulating evidence in perceptual decision making. The Journal of Neuroscience 32:3612–3628. doi: 10.1523/JNEUROSCI.4010-11.2012.
20. Eckhoff P, Holmes P, Law C, Connolly PM, Gold JI. 2008. On diffusion processes with variable drift rates as models for decision making during learning. New Journal of Physics 10:nihpa49499. doi: 10.1088/1367-2630/10/1/015006.
21. Fearnhead P, Liu Z. 2007. On-line inference for multiple changepoint problems. Journal of the Royal Statistical Society: Series B 69:589–605. doi: 10.1111/j.1467-9868.2007.00601.x.
22. Gold JI, Shadlen MN. 2000. Representation of a perceptual decision in developing oculomotor commands. Nature 404:390–394. doi: 10.1038/35006062.
23. Gold JI, Shadlen MN. 2001. Neural computations that underlie decisions about sensory stimuli. Trends in Cognitive Sciences 5:10–16. doi: 10.1016/S1364-6613(00)01567-9.
24. Gold JI, Shadlen MN. 2002. Banburismus and the brain: decoding the relationship between sensory stimuli, decisions, and reward. Neuron 36:299–308. doi: 10.1016/S0896-6273(02)00971-6.
25. Gold JI, Shadlen MN. 2007. The neural basis of decision making. Annual Review of Neuroscience 30:535–574. doi: 10.1146/annurev.neuro.29.051605.113038.
26. Gonzalez Castro LN, Hadjiosif AM, Hemphill MA, Smith MA. 2014. Environmental consistency determines the rate of motor adaptation. Current Biology 24:1050–1061. doi: 10.1016/j.cub.2014.03.049.
27. Good IJ. 1979. Studies in the history of probability and statistics. XXXVI. AM Turing’s statistical work in World War II. Biometrika 66:393–396. doi: 10.1093/biomet/66.2.393.
28. Green DM, Swets JA. 1966. Signal detection theory and psychophysics. New York: John Wiley & Sons.
29. Hanks TD, Kopec CD, Brunton BW, Duan CA, Erlich JC, Brody CD. 2015. Distinct relationships of parietal and prefrontal cortices to evidence accumulation. Nature 520:220–223. doi: 10.1038/nature14066.
30. Hanks TD, Mazurek ME, Kiani R, Hopp E, Shadlen MN. 2011. Elapsed decision time affects the weighting of prior probability in a perceptual decision task. The Journal of Neuroscience 31:6339–6352. doi: 10.1523/JNEUROSCI.5613-10.2011.
31. Henning GB, Hertz BG, Broadbent DE. 1975. Some experiments bearing on the hypothesis that the visual system analyses spatial patterns in independent bands of spatial frequency. Vision Research 15:887–897. doi: 10.1016/0042-6989(75)90228-X.
32. Huk AC, Shadlen MN. 2005. Neural activity in macaque parietal cortex reflects temporal integration of visual motion signals during perceptual decision making. The Journal of Neuroscience 25:10420–10436. doi: 10.1523/JNEUROSCI.4684-04.2005.
33. Kepecs A, Uchida N, Zariwala HA, Mainen ZF. 2008. Neural correlates, computation and behavioural impact of decision confidence. Nature 455:227–231. doi: 10.1038/nature07200.
34. Kiani R, Shadlen MN. 2009. Representation of confidence associated with a decision by neurons in the parietal cortex. Science 324:759–764. doi: 10.1126/science.1169405.
35. King-Smith PE, Grigsby SS, Vingrys AJ, Benes SC, Supowit A. 1994. Efficient and unbiased modifications of the QUEST threshold method: theory, simulations, experimental evaluation and practical implementation. Vision Research 34:885–912. doi: 10.1016/0042-6989(94)90039-6.
36. Krugel LK, Biele G, Mohr PN, Li SC, Heekeren HR. 2009. Genetic variation in dopaminergic neuromodulation influences the ability to rapidly and flexibly adapt decisions. Proceedings of the National Academy of Sciences of USA 106:17951–17956. doi: 10.1073/pnas.0905191106.
37. Lasley DJ, Cohn T. 1981. Detection of a luminance increment: effect of temporal uncertainty. Journal of the Optical Society of America 71:845–850. doi: 10.1364/JOSA.71.000845.
38. Link SW. 1992. The wave theory of difference and similarity. Hillsdale, NJ: Erlbaum.
39. Liptser RS, Shiryaev AN. 1977. Statistics of random processes: 1. General theory. New York: Springer-Verlag.
40. Luce RD. 1986. Response times: their role in inferring elementary mental organization. New York: Oxford University Press.
41. Ludwig CJ, Gilchrist ID, McSorley E, Baddeley RJ. 2005. The temporal impulse response underlying saccadic decisions. The Journal of Neuroscience 25:9907–9912. doi: 10.1523/JNEUROSCI.2197-05.2005.
42. Ma WJ, Jazayeri M. 2014. Neural coding of uncertainty and probability. Annual Review of Neuroscience 37: 205–220. doi: 10.1146/annurev-neuro-071013-014017.
43. Macmillan NA, Creelman CD. 2004. Detection theory: a user’s guide. Mahwah, NJ: Lawrence Erlbaum.
44. McGuire JT, Nassar MR, Gold JI, Kable JW. 2014. Functionally dissociable influences on learning rate in a dynamic environment. Neuron 84:870–881. doi: 10.1016/j.neuron.2014.10.013.
45. Nachmias J, Rogowitz BE. 1983. Masking by spatially-modulated gratings. Vision Research 23:1621–1629. doi: 10.1016/0042-6989(83)90176-1.
46. Nassar MR, Rumsey KM, Wilson RC, Parikh K, Heasly B, Gold JI. 2012. Rational regulation of learning dynamics by pupil-linked arousal systems. Nature Neuroscience 15:1040–1046. doi: 10.1038/nn.3130.
47. Nassar MR, Wilson RC, Heasly B, Gold JI. 2010. An approximately Bayesian delta-rule model explains the dynamics of belief updating in a changing environment. The Journal of Neuroscience 30:12366–12378. doi: 10.1523/JNEUROSCI.0822-10.2010.
48. O’Reilly JX, Schuffelgen U, Cuell SF, Behrens TE, Mars RB, Rushworth MF. 2013. Dissociable effects of surprise and model update in parietal and anterior cingulate cortex. Proceedings of the National Academy of Sciences of USA 110:E3660–E3669. doi: 10.1073/pnas.1305373110.
49. Ossmy O, Moran R, Pfeffer T, Tsetsos K, Usher M, Donner TH. 2013. The timescale of perceptual evidence integration can be adapted to the environment. Current Biology 23:981–986. doi: 10.1016/j.cub.2013.04.039.
50. Palmer J, Huk AC, Shadlen MN. 2005. The effect of stimulus strength on the speed and accuracy of a perceptual decision. Journal of Vision 5:376–404. doi: 10.1167/5.5.1.
51. Rabiner L. 1989. A tutorial on hidden Markov models and selected applications in speech recognition. Proceedings of the IEEE 77:257–286. doi: 10.1109/5.18626.
52. Reddi BA, Carpenter RH. 2000. The influence of urgency on decision time. Nature Neuroscience 3:827–830. doi: 10.1038/77739.
53. Resulaj A, Kiani R, Wolpert DM, Shadlen MN. 2009. Changes of mind in decision-making. Nature 461:263–266. doi: 10.1038/nature08275.
54. Roitman JD, Shadlen MN. 2002. Response of neurons in the lateral intraparietal area during a combined visual discrimination reaction time task. The Journal of Neuroscience 22:9475–9489.
55. Sato Y, Kording KP. 2014. How much to trust the senses: likelihood learning. Journal of Vision 14:13. doi: 10.1167/14.13.13.
56. Schrater PR, Knill DC, Simoncelli EP. 2000. Mechanisms of visual motion detection. Nature Neuroscience 3:64–68. doi: 10.1038/71134.
57. Simen P, Contreras D, Buck C, Hu P, Holmes P, Cohen JD. 2009. Reward rate optimization in two-alternative decision making: empirical tests of theoretical predictions. Journal of Experimental Psychology. Human Perception and Performance 35:1865–1897. doi: 10.1037/a0016926.
58. Smith PL. 1995. Psychophysically principled models of visual simple reaction time. Psychological Review 102:567. doi: 10.1037/0033-295X.102.3.567.
59. Smith PL. 1998. Bloch’s law predictions from diffusion process models of detection. Australian Journal of Psychology 50:139–147. doi: 10.1080/00049539808258790.
60. Smith PL, Ratcliff R. 2004. Psychology and neurobiology of simple decisions. Trends in Neurosciences 27:161–168. doi: 10.1016/j.tins.2004.01.006.
61. Sternberg S. 2001. Separate modifiability, mental modules, and the use of pure and composite measures to reveal them. Acta Psychologica 106:147–246. doi: 10.1016/S0001-6918(00)00045-7.
62. Thura D, Beauregard-Racine J, Fradet CW, Cisek P. 2012. Decision making by urgency gating: theory and experimental support. Journal of Neurophysiology 108:2912–2930. doi: 10.1152/jn.01071.2011.
63. Tsetsos K, Gao J, McClelland JL, Usher M. 2012. Using time-varying evidence to test models of decision dynamics: bounded diffusion vs. the leaky competing accumulator model. Frontiers in Neuroscience 6:79. doi: 10.3389/fnins.2012.00079.
64. Uchida N, Kepecs A, Mainen ZF. 2006. Seeing at a glance, smelling in a whiff: rapid forms of perceptual decision making. Nature Reviews. Neuroscience 7:485–491. doi: 10.1038/nrn1933.
65. Usher M, McClelland JL. 2001. The time course of perceptual choice: the leaky, competing accumulator model. Psychological Review 108:550–592. doi: 10.1037/0033-295X.108.3.550.
66. Verghese P, Watamaniuk SN, McKee SP, Grzywacz NM. 1999. Local motion detectors cannot account for the detectability of an extended trajectory in noise. Vision Research 39:19–30. doi: 10.1016/S0042-6989(98)00033-9.
67. Wald A. 1947. Sequential analysis. New York: Wiley.
68. Watson AB, Pelli DG. 1983. QUEST: a Bayesian adaptive psychometric method. Percept Psychophys 33:113–120. doi: 10.3758/BF03202828.
69. Wilson R, Finkel L. 2009. Advances in neural information processing systems 22. A neural implementation of the Kalman filter p. 2062–2070.
70. Wilson RC, Nassar MR, Gold JI. 2010. Bayesian online learning of the hazard rate in change-point problems. Neural Computation 22:2452–2476. doi: 10.1162/NECO_a_00007.
71. Wilson RC, Nassar MR, Gold JI. 2013. A mixture of delta-rules approximation to bayesian inference in changepoint problems. PLoS computational biology 9(7):p. e1003150.
72. Yu AJ, Dayan P. 2005. Uncertainty, neuromodulation, and attention. Neuron 46:681–692. doi: 10.1016/j.neuron.2005.04.026.
73. Zakai M. 1965. The optimal filtering of Markov jump processes in additive white noise. Research Note No. 563, Sylvania Electronic System.