Optimal multisensory decision-making in a reaction-time task

eLife

Volumn 2014, Issue 3, 2014, Pages

  Drugowitsch, Jan ^a,b,d   Deangelis, Gregory C ^a   Klier, Eliana M ^c   Angelaki, Dora E ^c   Pouget, Alexandre ^a,d  

^a UNIVERSITY OF ROCHESTER   (United States)

^b ECOLE NORMALE SUPÉRIEURE   (France)

^c BAYLOR COLLEGE OF MEDICINE   (United States)

^d UNIVERSITY OF GENEVA   (Switzerland)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; ASSOCIATION; BAYES THEOREM; BEHAVIOR; DECISION MAKING; FEMALE; HUMAN; MALE; OPTIC FLOW; PERCEPTIVE DISCRIMINATION; PREDICTION; RESPONSE TIME; TASK PERFORMANCE; TRAINING; VESTIBULAR STIMULATION; VISUAL STIMULATION;

EID: 84905046212     PISSN: None     EISSN: 2050084X     Source Type: Journal    
DOI: 10.7554/elife.03005     Document Type: Article

References (50)

1. Battaglia PW, Jacobs RA, Aslin RN. 2003. Bayesian integration of visual and auditory signals for spatial localization. Journal of the Optical Society of America A, Optics, Image Science, and Vision 20:1391-1397. doi: 10.1364/ JOSAA.20.001391.
2. Beck JM, Ma WJ, Kiani R, Hanks T, Churchland AK, Roitman J, Shadlen MN, Latham PE, Pouget A. 2008. Probabilistic population codes for Bayesian decision making. Neuron 60:1142-1152. doi: 10.1016/j. neuron.2008.09.021.
3. Bogacz R, Brown E, Moehlis J, Holmes P, Cohen JD. 2006. The physics of optimal decision making: a formal analysis of models of performance in two-alternative forced-choice tasks. Psychological Review 113:700-765. doi: 10.1037/0033-295X.113.4.700.
4. Britten KH, van Wezel RJ. 1998. Electrical microstimulation of cortical area MST biases heading perception in monkeys. Nature Neuroscience 1:59-63. doi: 10.1038/259.
5. Britten KH, Van Wezel RJ. 2002. Area MST and heading perception in macaque monkeys. Cerebral Cortex 12:692-701. doi: 10.1093/cercor/12.7.692.
6. Chen A, DeAngelis GC, Angelaki DE. 2011a. A comparison of vestibular spatiotemporal tuning in macaque parietoinsular vestibular cortex, ventral intraparietal area, and medial superior temporal area. The Journal of Neuroscience 31:3082-3094. doi: 10.1523/JNEUROSCI.4476-10.2011.
7. Chen A, DeAngelis GC, Angelaki DE. 2011b. Representation of vestibular and visual cues to self-motion in ventral intraparietal cortex. The Journal of Neuroscience 31:12036-12052. doi: 10.1523/JNEUROSCI.0395-11.2011.
8. Clark JJ, Yuille AL. 1990. Data fusion for sensory information processing systems. Boston: Kluwer Academic.
9. Colonius H, Arndt P. 2001. A two-stage model for visual-auditory interaction in saccadic latencies. Perception & Psychophysics 63:126-147. doi: 10.3758/BF03200508.
10. Corneil BD, Van Wanrooij M, Munoz DP, Van Opstal AJ. 2002. Auditory-visual interactions subserving goal-directed saccades in a complex scene. Journal of Neurophysiology 88:438-454.
11. Ernst MO, Banks MS. 2002. Humans integrate visual and haptic information in a statistically optimal fashion. Nature 415:429-433. doi: 10.1038/415429a.
12. Fernandez C, Goldberg JM. 1976. Physiology of peripheral neurons innervating otolith organs of the squirrel monkey. III. Response dynamics. Journal of Neurophysiology 39:996-1008.
13. Fetsch CR, Pouget A, DeAngelis GC, Angelaki DE. 2011. Neural correlates of reliability-based cue weighting during multisensory integration. Nature Neuroscience 15:146-154. doi: 10.1038/nn.2983.
14. Fetsch CR, Rajguru SM, Karunaratne A, Gu Y, Angelaki DE, Deangelis GC. 2010. Spatiotemporal properties of vestibular responses in area MSTd. Journal of Neurophysiology 104:1506-1522. doi: 10.1152/jn.91247.2008.
15. Fetsch CR, Turner AH, DeAngelis GC, Angelaki DE. 2009. Dynamic reweighting of visual and vestibular cues during self-motion perception. The Journal of Neuroscience 29:15601-15612. doi: 10.1523/ JNEUROSCI.2574-09.2009.
16. Goodman SN. 1999. Toward evidence-based medical statistics. 2: the Bayes factor. Annals of Internal Medicine 130:1005-1013. doi: 10.7326/0003-4819-130-12-199906150-00019.
17. Graf AB, Kohn A, Jazayeri M, Movshon JA. 2011. Decoding the activity of neuronal populations in macaque primary visual cortex. Nature Neuroscience 14:239-245. doi: 10.1038/nn.2733.
18. Grice GR, Canham L, Boroughs JM. 1984. Combination rule for redundant information in reaction time tasks with divided attention. Perception & Psychophysics 35:451-463. doi: 10.3758/BF03203922.
19. Gu Y, DeAngelis GC, Angelaki DE. 2007. A functional link between area MSTd and heading perception based on vestibular signals. Nature Neuroscience 10:1038-1047. doi: 10.1038/nn1935.
20. Gu Y, Angelaki DE, Deangelis GC. 2008. Neural correlates of multisensory cue integration in macaque MSTd. Nature Neuroscience 11:1201-1210. doi: 10.1038/nn.2191.
21. Gu Y, Deangelis GC, Angelaki DE. 2012. Causal links between dorsal medial superior temporal area neurons and multisensory heading perception. The Journal of Neuroscience 32:2299-2313. doi: 10.1523/ JNEUROSCI.5154-11.2012.
22. Gu Y, Fetsch CR, Adeyemo B, Deangelis GC, Angelaki DE. 2010. Decoding of MSTd population activity accounts for variations in the precision of heading perception. Neuron 66:596-609. doi: 10.1016/j.neuron.2010.04.026.
23. Gu Y, Watkins PV, Angelaki DE, DeAngelis GC. 2006. Visual and nonvisual contributions to three-dimensional heading selectivity in the medial superior temporal area. The Journal of Neuroscience 26:73-85. doi: 10.1523/ JNEUROSCI.2356-05.2006.
24. Heuer HW, Britten KH. 2007. Linear responses to stochastic motion signals in area MST. Journal of Neurophysiology 98:1115-1124. doi: 10.1152/jn.00083.2007.
25. Jeffreys H. 1998. Theory of probability. Oxford: Clarendon Press.
26. Kiani R, Hanks TD, Shadlen MN. 2008. Bounded integration in parietal cortex underlies decisions even when viewing duration is dictated by the environment. The Journal of Neuroscience 28:3017-3029. doi: 10.1523/ JNEUROSCI.4761-07.2008.
27. Knill DC, Saunders JA. 2003. Do humans optimally integrate stereo and texture information for judgments of surface slant? Vision Research 43:2539-2558. doi: 10.1016/S0042-6989(03)00458-9.
28. Laming DRJ. 1968. Information theory of choice-reaction times. London: Academic Press.
29. Lisberger SG, Movshon JA. 1999. Visual motion analysis for pursuit eye movements in area MT of macaque monkeys. The Journal of Neuroscience 19:2224-2246.
30. Ma WJ, Beck JM, Latham PE, Pouget A. 2006. Bayesian inference with probabilistic population codes. Nature Neuroscience 9:1432-1438. doi: 10.1038/nn1790.
31. Mazurek ME, Roitman JD, Ditterich J, Shadlen MN. 2003. A role for neural integrators in perceptual decision making. Cerebral Cortex 13:1257-1269. doi: 10.1093/cercor/bhg097.
32. Miller J. 1982. Divided attention: evidence for coactivation with redundant signals. Cognitive Psychology 14:247-279. doi: 10.1016/0010-0285(82)90010-X.
33. Morgan ML, Deangelis GC, Angelaki DE. 2008. Multisensory integration in macaque visual cortex depends on cue reliability. Neuron 59:662-673. doi: 10.1016/j.neuron.2008.06.024.
34. Onken A, Drugowitsch J, Kanitscheider I, DeAngelis GC, Beck JM, Pouget A. 2012. Near optimal multisensory integration with nonlinear probabilistic population codes using divisive normalization. The Society for Neuroscience annual meeting 2012.
35. Otto TU, Mamassian P. 2012. Noise and correlations in parallel perceptual decision making. Current Biology 22:1391-1396. doi: 10.1016/j.cub.2012.05.031.
36. Palmer J, Huk AC, Shadlen MN. 2005. The effect of stimulus strength on the speed and accuracy of a perceptual decision. Journal of Vision 5:376-404. doi: 10.1167/5.5.1.
37. Papoulis A. 1991. Probability, random variables, and stochastic processes. New York, London: McGraw-Hill.
38. Price NS, Ono S, Mustari MJ, Ibbotson MR. 2005. Comparing acceleration and speed tuning in macaque MT: physiology and modeling. Journal of Neurophysiology 94:3451-3464. doi: 10.1152/jn.00564.2005.
39. Raab DH. 1962. Statistical facilitation of simple reaction times. Transactions of the New York Academy of Sciences 24:574-590. doi: 10.1111/j.2164-0947.1962.tb01433.x.
40. Ratcliff R. 1978. Theory of memory retrieval. Psychological Review 85:59-108. doi: 10.1037/0033-295X.85.2.59.
41. Ratcliff R, Smith PL. 2004. A comparison of sequential sampling models for two-choice reaction time. Psychological Review 111:333-367. doi: 10.1037/0033-295X.111.2.333.
42. Schlack A, Sterbing-D'Angelo SJ, Hartung K, Hoffmann KP, Bremmer F. 2005. Multisensory space representations in the macaque ventral intraparietal area. The Journal of Neuroscience 25:4616-4625. doi: 10.1523/ JNEUROSCI.0455-05.2005.
43. Smith PL. 2000. Stochastic dynamic models of response time and accuracy: a foundational primer. Journal of Mathematical Psychology 44:408-463. doi: 10.1006/jmps.1999.1260.
44. Stanford TR, Shankar S, Massoglia DP, Costello MG, Salinas E. 2010. Perceptual decision making in less than 30 milliseconds. Nature Neuroscience 13:379-385. doi: 10.1038/nn.2485.
45. Stephan KE, Penny WD, Daunizeau J, Moran RJ, Friston KJ. 2009. Bayesian model selection for group studies. NeuroImage 46:1004-1017. doi: 10.1016/j.neuroimage.2009.03.025.
46. Tolhurst DJ, Movshon JA, Dean AF. 1983. The statistical reliability of signals in single neurons in cat and monkey visual cortex. Vision Research 23:775-785. doi: 10.1016/0042-6989(83)90200-6.
47. Townsend JT, Wenger MJ. 2004. A theory of interactive parallel processing: new capacity measures and predictions for a response time inequality series. Psychological Review 111:1003-1035. doi: 10.1037/0033-295X.111.4.1003.
48. van Beers RJ, Sittig AC, Denier van der Gon JJ. 1996. How humans combine simultaneous proprioceptive and visual position information. Experimental Brain Research 111:253-261. doi: 10.1016/S0079-6123(08)60413-6.
49. Whitchurch EA, Takahashi TT. 2006. Combined auditory and visual stimuli facilitate head saccades in the barn owl (Tyto alba). Journal of Neurophysiology 96:730-745. doi: 10.1152/jn.00072.2006.
50. Wichmann FA, Hill NJ. 2001. The psychometric function: II. Bootstrap-based confidence intervals and sampling. Perception & Psychophysics 63:1314-1329. doi: 10.3758/BF03194545.