Perceptual decision making: Drift-diffusion model is equivalent to a Bayesian model

Frontiers in Human Neuroscience

Volumn 8, Issue 1 FEB, 2014, Pages

  Bitzer, Sebastian ^a   Park, Hame ^a   Blankenburg, Felix ^b,c   Kiebel, Stefan J ^a,d  

^a MAX PLANCK INSTITUTE FOR HUMAN COGNITIVE AND BRAIN SCIENCES   (Germany)

^b CHARITÉ UNIVERSITÄTSMEDIZIN BERLIN   (Germany)

^c FREIE UNIVERSITÄT BERLIN   (Germany)

^d JENA UNIVERSITY HOSPITAL   (Germany)

Author keywords

Bayesian models; Decision variable; Drift diffusion model; Parameter fitting; Perceptual decision making; Reaction time; Uncertainty

Indexed keywords

ACCURACY; ARTICLE; BAYES THEOREM; DECISION MAKING; DRIFT DIFFUSION MODEL; FUNCTIONAL ASSESSMENT; MATHEMATICAL COMPUTING; MATHEMATICAL MODEL; MENTAL CAPACITY; MENTAL TASK; NERVE STIMULATION; PREDICTION; SIGNAL NOISE RATIO; SIGNAL PROCESSING; STIMULUS RESPONSE;

EID: 84939887612     PISSN: None     EISSN: 16625161     Source Type: Journal    
DOI: 10.3389/fnhum.2014.00102     Document Type: Article

References (62)

1. Ball, K., and Sekuler, R. (1982). A specific and enduring improvement in visual motion discrimination. Science 218, 697-698. doi: 10.1126/science.7134968
2. Bastos, A. M., Usrey, W. M., Adams, R. A., Mangun, G. R., Fries, P., and Friston, K. J. (2012). Canonical microcircuits for predictive coding. Neuron 76, 695-711. doi: 10.1016/j.neuron.2012.10.038
3. Beck, J. M., Ma, W. J., Kiani, R., Hanks, T., Churchland, A. K., Roitman, J., et al. (2008). Probabilistic population codes for Bayesian decision making. Neuron 60, 1142-1152. doi: 10.1016/j.neuron.2008.09.021
4. Bitzer, S., and Kiebel, S. (2012). Recognizing recurrent neural networks (rRNN): Bayesian inference for recurrent neural networks. Biol. Cybern. 106, 201-217. doi: 10.1007/s00422-012-0490-x
5. Bogacz, R., Brown, E., Moehlis, J., Holmes, P., and Cohen, J. D. (2006). The physics of optimal decision making: a formal analysis of models of performance in two-alternative forced-choice tasks. Psychol. Rev. 113, 700-765. doi: 10.1037/0033-295X.113.4.700
6. Bogacz, R., and Gurney, K. (2007). The basal ganglia and cortex implement optimal decision making between alternative actions. Neural Comput. 19, 442-477. doi: 10.1162/neco.2007.19.2.442
7. Brown, S., Steyvers, M., and Wagenmakers, E.-J. (2009). Observing evidence accumulation during multi-alternative decisions. J. Math. Psychol. 53, 453-462. doi: 10.1016/j.jmp.2009.09.002
8. Brunton, B. W., Botvinick, M. M., and Brody, C. D. (2013). Rats and humans can optimally accumulate evidence for decision-making. Science 340, 95-98. doi: 10.1126/science.1233912
9. Chater, N., and Oaksford, M. (eds.). (2008). The Probabilistic Mind: Prospects for Bayesian Cognitive Science. Oxford: Oxford University Press. doi: 10.1093/acprof:oso/9780199216093.001.0001
10. Cisek, P., Puskas, G. A., and El-Murr, S. (2009). Decisions in changing conditions: the urgency-gating model. J. Neurosci. 29, 11560-11571. doi: 10.1523/JNEUROSCI.1844-09.2009
11. Daunizeau, J., Den Ouden, H. E. M., Pessiglione, M., Kiebel, S. J., Friston, K. J., and Stephan, K. E. (2010). Observing the observer (II): deciding when to decide. PLoS ONE 5:e15555. doi: 10.1371/journal.pone.0015555
12. Dayan, P. (2012). Twenty-five lessons from computational neuromodulation. Neuron 76, 240-256. doi: 10.1016/j.neuron.2012.09.027
13. Dayan, P., and Daw, N. D. (2008). Decision theory, reinforcement learning, and the brain. Cogn. Affect. Behav. Neurosci. 8, 429-453. doi: 10.3758/CABN.8.4.429
14. Denève, S. (2008). Bayesian spiking neurons I: inference. Neural Comput. 20, 91-117. doi: 10.1162/neco.2008.20.1.91
15. Denève, S. (2012). Making decisions with unknown sensory reliability. Front. Neurosci. 6:75. doi: 10.3389/fnins.2012.00075
16. Ditterich, J. (2006). Stochastic models of decisions about motion direction: behavior and physiology. Neural Netw. 19, 981-1012. doi: 10.1016/j.neunet.2006.05.042
17. Ditterich, J. (2010). A comparison between mechanisms of multi-alternative perceptual decision making: ability to explain human behavior, predictions for neurophysiology, and relationship with decision theory. Front. Neurosci. 4:184. doi: 10.3389/fnins.2010.00184
18. Doya, K., Ishii, S., Pouget, A., and Rao, R. P. N. (eds.). (2007). Bayesian Brain. Cambridge, MA: MIT Press.
19. Dragalin, V. P., Tartakovsky, A. G., and Veeravalli, V. V. (1999). Multihypothesis sequential probability ratio tests-Part I: asymptotic optimality. IEEE Trans. Inf. Theory 45, 2448-2461. doi: 10.1109/18.796383
20. Drugowitsch, J., Moreno-Bote, R., Churchland, A. K., Shadlen, M. N., and Pouget, A. (2012). The cost of accumulating evidence in perceptual decision making. J. Neurosci. 32, 3612-3628. doi: 10.1523/JNEUROSCI.4010-11.2012
21. Feldman, H., and Friston, K. J. (2010). Attention, uncertainty, and free-energy. Front. Hum. Neurosci. 4:215. doi: 10.3389/fnhum.2010.00215
22. Fiser, J. O., Berkes, P., Orban, G., and Lengyel, M. A. E. (2010). Statistically optimal perception and learning: from behavior to neural representations. Trends Cogn. Sci. 14, 119-130. doi: 10.1016/j.tics.2010.01.003
23. Friston, K. (2010). The free-energy principle: a unified brain theory? Nat. Rev. Neurosci. 11, 127-138. doi: 10.1038/nrn2787
24. Gold, J. I., and Shadlen, M. N. (2001). Neural computations that underlie decisions about sensory stimuli. Trends Cogn. Sci. 5, 10-16. doi: 10.1016/S1364-6613(00)01567-9
25. Gold, J. I., and Shadlen, M. N. (2002). Banburismus and the brain: decoding the relationship between sensory stimuli, decisions, and reward. Neuron 36, 299-308. doi: 10.1016/S0896-6273(02)00971-6
26. Gold, J. I., and Shadlen, M. N. (2007). The neural basis of decision making. Annu. Rev. Neurosci. 30, 535-574. doi: 10.1146/annurev.neuro.29.051605.113038
27. Haario, H., Laine, M., Mira, A., and Saksman, E. (2006). DRAM: efficient adaptive MCMC. Stat. Comput. 16, 339-354. doi: 10.1007/s11222-006-9438-0
28. Heekeren, H. R., Marrett, S., Bandettini, P. A., and Ungerleider, L. G. (2004). A general mechanism for perceptual decision-making in the human brain. Nature 431, 859-862. doi: 10.1038/nature02966
29. Huang, Y., Friesen, A., Hanks, T., Shadlen, M., and Rao, R. (2012). "How prior probability influences decision making: a unifying probabilistic model, " in Advances in Neural Information Processing Systems 25 (Lake Tahoe, NV).
30. Knill, D. C., and Richards, W. (eds.). (1996). Perception as Bayesian Inference. Cambridge: Cambridge University Press. doi: 10.1017/CBO9780511984037
31. Lee, M. D., Fuss, I. G., and Navarro, D. J. (2007). "A Bayesian approach to diffusion models of decision-making and response time, " in Advances in Neural Information Processing Systems 19 (Cambridge, MA).
32. Ma, W. J., Beck, J. M., Latham, P. E., and Pouget, A. (2006). Bayesian inference with probabilistic population codes. Nat. Neurosci. 9, 1432-1438. doi: 10.1038/nn1790
33. Mulder, M. J., Wagenmakers, E.-J., Ratcliff, R., Boekel, W., and Forstmann, B. U. (2012). Bias in the brain: a diffusion model analysis of prior probability and potential payoff. J. Neurosci. 32, 2335-2343. doi: 10.1523/JNEUROSCI.4156-11.2012
34. Murphy, K. P. (2012). Machine Learning: A Probabilistic Perspective. Cambridge, MA: MIT Press.
35. Newsome, W. T., Britten, K. H., and Movshon, J. A. (1989). Neuronal correlates of a perceptual decision. Nature341, 52-54. doi: 10.1038/341052a0
36. Newsome, W. T., and Paré, E. B. (1988). A selective impairment of motion perception following lesions of the middle temporal visual area MT. J. Neurosci. 8, 2201-2211.
37. O'Connell, R. G., Dockree, P. M., and Kelly, S. P. (2012). A supramodal accumulation-to-bound signal that determines perceptual decisions in humans. Nat. Neurosci. 15, 1729-1735. doi: 10.1038/nn.3248
38. Philiastides, M. G., Auksztulewicz, R., Heekeren, H. R., and Blankenburg, F. (2011). Causal role of dorsolateral prefrontal cortex in human perceptual decision making. Curr. Biol. 21, 980-983. doi: 10.1016/j.cub.2011.04.034
39. Pouget, A., Beck, J. M., Ma, W. J., and Latham, P. E. (2013). Probabilistic brains: knowns and unknowns. Nat. Neurosci. 16, 1170-1178. doi: 10.1038/nn.3495
40. Purcell, B. A., Heitz, R. P., Cohen, J. Y., Schall, J. D., Logan, G. D., and Palmeri, T. J. (2010). Neurally constrained modeling of perceptual decision making. Psychol. Rev. 117, 1113-1143. doi: 10.1037/a0020311
41. Rao, R. P. N. (2004). Bayesian computation in recurrent neural circuits. Neural Comput. 16, 1-38. doi: 10.1162/08997660460733976
42. Rao, R. P. N. (2010). Decision making under uncertainty: a neural model based on partially observable Markov decision processes. Front. Comput. Neurosci. 4:146. doi: 10.3389/fncom.2010.00146
43. Ratcliff, R. (1978). A theory of memory retrieval. Psychol. Rev. 85, 59-108. doi: 10.1037/0033-295X.85.2.59
44. Ratcliff, R., and McKoon, G. (2008). The diffusion decision model: theory and data for two-choice decision tasks. Neural Comput. 20, 873-922. doi: 10.1162/neco.2008.12-06-420
45. Shenoy, P., and Yu, A. J. (2011). Rational decision-making in inhibitory control. Front. Hum. Neurosci. 5:48. doi: 10.3389/fnhum.2011.00048
46. Smith, P. L., and Ratcliff, R. (2004). Psychology and neurobiology of simple decisions. Trends Neurosci. 27, 161-168. doi: 10.1016/j.tins.2004.01.006
47. Solway, A., and Botvinick, M. M. (2012). Goal-directed decision making as probabilistic inference: a computational framework and potential neural correlates. Psychol. Rev. 119, 120-154. doi: 10.1037/a0026435
48. Summerfield, C., Egner, T., Greene, M., Koechlin, E., Mangels, J., and Hirsch, J. (2006). Predictive codes for forthcoming perception in the frontal cortex. Science 314, 1311-1314. doi: 10.1126/science.1132028
49. Summerfield, C., and Tsetsos, K. (2012). Building bridges between perceptual and economic decision-making: neural and computational mechanisms. Front. Neurosci. 6:70. doi: 10.3389/fnins.2012.00070
50. Tsetsos, K., Gao, J., McClelland, J. L., and Usher, M. (2012). Using time-varying evidence to test models of decision dynamics: bounded diffusion vs. the leaky competing accumulator model. Front. Neurosci. 6:79. doi: 10.3389/fnins.2012.00079
51. Turner, B. M., and Zandt, T. V. (2012). A tutorial on approximate Bayesian computation. J. Math. Psychol. 56, 69-85. doi: 10.1016/j.jmp.2012.02.005
52. Vandekerckhove, J., and Tuerlinckx, F. (2007). Fitting the Ratcliff diffusion model to experimental data. Psychon. Bull. Rev. 14, 1011-1026. doi: 10.3758/BF03193087
53. Vandekerckhove, J., Tuerlinckx, F., and Lee, M. D. (2008). "A Bayesian approach to diffusion process models of decision-making, " in Proceedings of the 30th Annual Conference of the Cognitive Science Society (Washington, DC).
54. Voss, A., Nagler, M., and Lerche, V. (2013). Diffusion models in experimental psychology: a practical introduction. Exp. Psychol. 60, 385-402. doi: 10.1027/1618-3169/a000218
55. Wagenmakers, E.-J., van der Maas, H. L. J., and Grasman, R. P. P. P. (2007). An EZ-diffusion model for response time and accuracy. Psychon. Bull. Rev. 14, 3-22. doi: 10.3758/BF03194023
56. Wald, A. (1947). Foundations of a general theory of sequential decision functions. Econometrica 15, 279-313. doi: 10.2307/1905331
57. Wald, A., and Wolfowitz, J. (1950). Bayes solutions of sequential decision problems. Ann. Math. Stat. 21, 82-99. doi: 10.1214/aoms/1177729887
58. Wiecki, T. V., Sofer, I., and Frank, M. J. (2013). HDDM: hierarchical Bayesian estimation of the drift-diffusion model in Python. Front. Neuroinform. 7:14. doi: 10.3389/fninf.2013.00014
59. Yang, T., and Shadlen, M. N. (2007). Probabilistic reasoning by neurons. Nature 447, 1075-1080. doi: 10.1038/nature05852
60. Yu, A. J., and Dayan, P. (2005). Uncertainty, neuromodulation, and attention. Neuron 46, 681-692. doi: 10.1016/j.neuron.2005.04.026
61. Zariwala, H. A., Kepecs, A., Uchida, N., Hirokawa, J., and Mainen, Z. F. (2013). The limits of deliberation in a perceptual decision task. Neuron 78, 339-351. doi: 10.1016/j.neuron.2013.02.010
62. Zhang, J., and Bogacz, R. (2010). Optimal decision making on the basis of evidence represented in spike trains. Neural Comput. 22, 1113-1148. doi: 10.1162/neco.2009.05-09-1025