Optimal Integration of Auditory and Vibrotactile Information for Judgments of Temporal Order

Journal of Experimental Psychology: Human Perception and Performance

Volumn 35, Issue 4, 2009, Pages 1005-1019

  Ley, Ian ^a   Haggard, Patrick ^b   Yarrow, Kielan ^a  

^a CITY UNIVERSITY   (United Kingdom)

^b UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

audition; multisensory integration; statistical optimality; temporal order judgment; touch

Indexed keywords

ADULT; ARTICLE; ASSOCIATION; CLINICAL TRIAL; CONTROLLED CLINICAL TRIAL; CONTROLLED STUDY; DECISION MAKING; FEMALE; HEARING; HUMAN; MALE; PSYCHOLOGICAL MODEL; RANDOMIZED CONTROLLED TRIAL; STATISTICAL MODEL; TIME PERCEPTION; TOUCH; VIBRATION;

ADULT; AUDITORY PERCEPTION; CUES; FEMALE; HUMANS; JUDGMENT; LIKELIHOOD FUNCTIONS; MALE; MODELS, PSYCHOLOGICAL; TIME PERCEPTION; TOUCH PERCEPTION; VIBRATION;

EID: 69049106429     PISSN: 00961523     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0015021     Document Type: Article

References (46)

1. Alais D., and Burr D. The ventriloquist effect results from near-optimal bimodal integration. Current Biology 14 (2004) 257-262
2. Andersen T.S., Tiippana K., and Sams M. Factors influencing audiovisual fission and fusion illusions. Brain Research: Cognitive Brain Research 21 (2004) 301-308
3. Andersen T.S., Tiippana K., and Sams M. Maximum likelihood integration of rapid flashes and beeps. Neuroscience Letters 380 (2005) 155-160
4. Bertelson P., and de Gelder B.E.M. The psychology of multimodal perception. In: Spence C., and Driver J. (Eds). Crossmodal space and crossmodal attention (2004), Oxford University Press, Oxford, England 141-178
5. Bertelson P., and Radeau M. Cross-modal bias and perceptual fusion with auditory-visual spatial discordance. Perception and Psychophysics 29 (1981) 578-584
6. Bresciani J.P., Dammeier F., and Ernst M.O. Vision and touch are automatically integrated for the perception of sequences of events. Journal of Vision 6 (2006) 554-564
7. Bresciani J.P., and Ernst M.O. Signal reliability modulates auditory-tactile integration for event counting. NeuroReport 18 (2007) 1157-1161
8. Bresciani J.P., Ernst M.O., Drewing K., Bouyer G., Maury V., and Kheddar A. Feeling what you hear: Auditory signals can modulate tactile tap perception. Experimental Brain Research 162 (2005) 172-180
9. de Lange H. Research into the dynamic nature of the human fovea-cortex systems with intermittent and modulated light: I. Attenuation characteristics with white and colored light. Journal of the Optical Society of America 48 (1958) 777-784
10. Dennett D.C., and Kinsbourne M. Time and the observer: The where and when of consciousness in the brain. Behavioral and Brain Sciences 15 (1992) 183-247
11. Ernst M.O., and Banks M.S. Humans integrate visual and haptic information in a statistically optimal fashion. Nature 415 (2002) 429-433
12. Ernst M.O., and Bülthoff H.H. Merging the senses into a robust percept. Trends in Cognitive Sciences 8 (2004) 162-169
13. Fujisaki W., Shimojo S., Kashino M., and Nishida S. Recalibration of audiovisual simultaneity. Nature Neuroscience 7 (2004) 773-778
14. Hanson J.V., Heron J., and Whitaker D. Recalibration of perceived time across sensory modalities. Experimental Brain Research 185 (2008) 347-352
15. Hawken M.J., Shapley R.M., and Grosof D.H. Temporal frequency selectivity in monkey visual cortex. Visual Neuroscience 13 (1996) 477-492
16. Heron J., Whitaker D., and McGraw P.V. Sensory uncertainty governs the extent of audio-visual interaction. Vision Research 44 (2004) 2875-2884
17. Hillis J.M., Watt S.J., Landy M.S., and Banks M.S. Slant from texture and disparity cues: Optimal cue combination. Journal of Vision 4 (2004) 967-992
18. Kitazawa S., Moizumi S., Okuzumi A., Saito F., Shibuya S., et al. Reversal of subjective temporal order due to sensory and motor integrations. In: Haggard P., Kawato M., and Rossetti Y. (Eds). Attention and performance XXII: Sensorimotor foundations of higher cognition (2007), Oxford University Press, Oxford, England 73-97
19. Knill D.C., and Pouget A. The Bayesian brain: The role of uncertainty in neural coding and computation. Trends in Neurosciences 27 (2004) 712-719
20. Miyazaki M., Nozaki D., and Nakajima Y. Testing Bayesian models of human coincidence timing. Journal of Neurophysiology 94 (2005) 395-399
21. Miyazaki M., Yamamoto S., Uchida S., and Kitazawa S. Bayesian calibration of simultaneity in tactile temporal order judgment. Nature Neuroscience 9 (2006) 875-877
22. Morein-Zamir S., Soto-Faraco S., and Kingstone A. Auditory capture of vision: Examining temporal ventriloquism. Brain Research: Cognitive Brain Research 17 (2003) 154-163
23. Müller J. Handbook der Physiologie des Menschen [Handbook of human physiology] 2 (1838), J. Hölscher, Koblenz, Germany
24. Navarra J., Soto-Faraco S., and Spence C. Adaptation to audiotactile asynchrony. Neuroscience Letters 413 (2007) 72-76
25. Pick H.L., Warren D.H., and Hay J.C. Sensory conflict in judgments of spatial direction. Perception and Psychophysics 6 (1969) 203-205
26. Recanzone G.H. Auditory influences on visual temporal rate perception. Journal of Neurophysiology 89 (2003) 1078-1093
27. Roach N.W., Heron J., and McGraw P.V. Resolving multisensory conflict: A strategy for balancing the costs and benefits of audio-visual integration. Proceedings of the Royal Society of London, Series B: Biological Sciences 273 (2006) 2159-2168
28. Rock I., and Victor J. Vision and touch: An experimentally created conflict between the two senses. Science 143 (1964) 594-596
29. Rosenberger W.F., and Grill S.E. A sequential design for psychophysical experiments: An application to estimating timing of sensory events. Statistics in Medicine 16 (1997) 2245-2260
30. Scheier C.R., Nijhawan R., and Shimojo S. Sound alters visual temporal resolution. Investigative Ophthalmology and Visual Science 40 (1999) 169
31. Shams L., Kamitani Y., and Shimojo S. Illusions. What you see is what you hear. Nature 408 (2000) 788
32. Shams L., Kamitani Y., and Shimojo S. Visual illusion induced by sound. Brain Research: Cognitive Brain Research 14 (2002) 147-152
33. Shams L., Ma W.J., and Beierholm U. Sound-induced flash illusion as an optimal percept. NeuroReport 16 (2005) 1923-1927
34. Sherrick C.E. The antagonisms of hearing and touch. In: Hirsh S.K., Eldredge D.H., Hirsh I.J., and Silverman S.R. (Eds). Hearing and Davis: Essays honoring Hallowell Davis (1976), Washington University Press, Saint Louis, MI 149-158
35. Spence C., Shore D.I., and Klein R.M. Multisensory prior entry. Journal of Experimental Psychology: General 130 (2001) 799-832
36. Sternberg S., and Knoll R.L. The perception of temporal order: Fundamental issues and a general model. In: Kornblum S. (Ed). Attention and performance IV (1973), Academic Press, London 629-686
37. Ulrich R. Threshold models of temporal-order judgments evaluated by a ternary response task. Perception and Psychophysics 42 (1987) 224-239
38. Van Beers R.J., Sittig A.C., and Gon J.J. Integration of proprioceptive and visual position information: An experimentally supported model. Journal of Neurophysiology 81 (1999) 1355-1364
39. Viemeister N.F. Temporal modulation transfer functions based upon modulation thresholds. Journal of the Acoustical Society of America 66 (1979) 1364-1380
40. Wada Y., Kitagawa N., and Noguchi K. Audio-visual integration in temporal perception. International Journal of Psychophysiology 50 (2003) 117-124
41. Weisenberger J.M. Sensitivity to amplitude-modulated vibrotactile signals. Journal of the Acoustical Society of America 80 (1986) 1707-1715
42. Welch R.B., DuttonHurt L.D., and Warren D.H. Contributions of audition and vision to temporal rate perception. Perception and Psychophysics 39 (1986) 294-300
43. Welch R.B., and Warren D.H. Immediate perceptual response to intersensory discrepancy. Psychological Bulletin 88 (1980) 638-667
44. Welch R.B., Widawski M.H., Harrington J., and Warren D.H. An examination of the relationship between visual capture and prism adaptation. Perception and Psychophysics 25 (1979) 126-132
45. Wichmann F.A., and Hill N.J. The psychometric function: I. Fitting, sampling, and goodness of fit. Perception and Psychophysics 63 (2001) 1293-1313
46. Wozny D.R., Beierholm U.R., and Shams L. Human trimodal perception follows optimal statistical inference. Journal of Vision 8 3 (2008) 1-11