Auditory temporal modulation of the visual Ternus effect: The influence of time interval

Experimental Brain Research

Volumn 203, Issue 4, 2010, Pages 723-735

  Shi, Zhuanghua ^a   Chen, Lihan ^a,b   Müller, Hermann J ^a,c  

^a UNIVERSITY OF MUNICH   (Germany)

^b PEKING UNIVERSITY   (China)

^c UNIVERSITY OF LONDON   (United Kingdom)

Author keywords

Audition; Temporal ventriloquism effect; Ternus display; Time perception; Vision

Indexed keywords

ADULT; ARTICLE; FEMALE; HEARING; HUMAN; HUMAN EXPERIMENT; MALE; MOTION; MOVEMENT PERCEPTION; NORMAL HUMAN; PRIORITY JOURNAL; TIME PERCEPTION; VISION; VISUAL STIMULATION; VISUAL THRESHOLD; ANALYSIS OF VARIANCE; AUDITORY STIMULATION; DECISION MAKING; ILLUSION; METHODOLOGY; PERCEPTIVE THRESHOLD; PHOTOSTIMULATION; PHYSIOLOGY; PSYCHOMETRY; REACTION TIME; SOUND; TIME;

ACOUSTIC STIMULATION; ADULT; ANALYSIS OF VARIANCE; AUDITORY PERCEPTION; FEMALE; HUMANS; ILLUSIONS; JUDGMENT; MALE; MOTION PERCEPTION; PHOTIC STIMULATION; PSYCHOMETRICS; REACTION TIME; SENSORY THRESHOLDS; SOUND; TIME FACTORS; YOUNG ADULT;

EID: 77956223650     PISSN: 00144819     EISSN: 14321106     Source Type: Journal    
DOI: 10.1007/s00221-010-2286-3     Document Type: Article

References (53)

1. Alais D, Burr D (2004) The ventriloquist effect results from near-optimal bimodal integration. Curr Biol 14(3):257-262 (Pubitemid 38215356)
2. Allen PG, Kolers PA (1981) Sensory specificity of apparent motion. J Exp Psychol Hum Percept Perform 7(6):1318-1328
3. Battaglia PW, Jacobs RA, Aslin RN (2003) Bayesian integration of visual and auditory signals for spatial localization. J Opt Soc Am A Opt Image Sci Vis 20(7):1391-1397
4. Bermant RI, Welch RB (1976) Effect of degree of separation of visual-auditory stimulus and eye position upon spatial interaction of vision and audition. Percept Mot Skills 42(43):487-493
5. Bertelson P, Radeau M (1981) Cross-modal bias and perceptual fusion with auditory-visual spatial discordance. Percept Psycho-phys 29(6):578-584
6. Brainard DH (1997) The psychophysics toolbox. Spat Vis 10(4):433- 436 (Pubitemid 127582520)
7. Bruns P, Getzmann S (2008) Audiovisual influences on the perception of visual apparent motion: exploring the effect of a single sound. Acta Psychol 129(2):273-283
8. Burr D, Banks MS, Morrone MC (2009) Auditory dominance over vision in the perception of interval duration. Exp Brain Res 198(1):49-57
9. Calvert G, Spence C, Stein BE (2004) The handbook of multisensory processes. MIT Press, Cambridge
10. Dixon NF, Spitz L (1980) The detection of auditory visual desynchrony. Perception 9(6):719-721 (Pubitemid 11114821)
11. Ernst MO, Banks MS (2002) Humans integrate visual and haptic information in a statistically optimal fashion. Nature 415(6870):429-433 (Pubitemid 34100953)
12. Ernst MO, Bülthoff HH (2004) Merging the senses into a robust percept. Trends Cogn Sci 8(4):162-169 (Pubitemid 38429926)
13. Fendrich R, Corballis PM (2001) The temporal cross-capture of audition and vision. Percept Psychophy 63(4):719-725 (Pubitemid 33603924)
14. Fraisse P (1984) Perception and estimation of time. Annu Rev Psychol 35:1-36
15. Freeman E, Driver J (2008) Direction of visual apparent motion driven by timing of a static sound. Curr Biol 18:1262-1266
16. Getzmann S (2007) The effect of brief auditory stimuli on visual apparent motion. Perception 36(7):1089-1103
17. Goldstone S, Goldfarb JL (1964a) Auditory and visual time judgment. J Gen Psychol 70:369-387
18. Goldstone S, Goldfarb JL (1964b) Direct comparison of auditory and visual durations. J Exp Psychol 67:483-485
19. Goldstone S, Lhamon WT (1974) Studies of auditory-visual differences in human time judgment. 1. Sounds are judged longer than lights. Percept Mot Skills 39(1):63-82
20. Harrar V, Harris LR (2007) Multimodal Ternus: visual, tactile, and multisensory grouping in apparent motion. Perception 36:1455-1464
21. Howard IP, Templeton WB (1966) Human spatial orientation. Wiley, New York
22. Jaekl PM, Harris LR (2007) Auditory-visual temporal integration measured by shifts in perceived temporal location. Neurosci Lett 417(3):219-224 (Pubitemid 46589776)
23. Keetels M, Stekelenburg J, Vroomen J (2007) Auditory grouping occurs prior to intersensory pairing: evidence from temporal ventriloquism. Exp Brain Res 180(3):449-456 (Pubitemid 46955594)
24. Kramer P, Yantis S (1997) Perceptual grouping in space and time: evidence from the Ternus display. Percept Psychophys 59(1):87-99 (Pubitemid 127456371)
25. Levitin DJ, MacLean K, Mathews M, Chu L (2000) The perception of cross-modal simultaneity. Int J Comput Anticip Syst 323-329
26. Ley I, Haggard P, yarrow K (2009) Optimal integration of auditory and vibrotactile information for judgments of temporal order. J Exp Psychol Hum Percept Perform 35(4):1005-1019
27. Morein-Zamir S, Soto-Faraco S, Kingstone A (2003) Auditory capture of vision: examining temporal ventriloquism. Cogn Brain Res 17(1):154-163 (Pubitemid 36577550)
28. Pantle AJ, Petersik JT (1980) Effects of spatial parameters on the perceptual organization of a bistable motion display. Percept Psychophys 27(4):307-312 (Pubitemid 10031972)
29. Pantle AJ, Picciano L (1976) A multistable movement display: evidence for two separate motion systems in human vision. Science 193(4252):500-502
30. Pelli DG (1997) The VideoToolbox software for visual psychophys-ics: transforming numbers into movies. Spat Vis 10:437-442 (Pubitemid 127582521)
31. Petersik JT, Rice CM (2006) The evolution of explanations of a perceptual phenomenon: a case history using the Ternus effect. Perception 35(6):807-821 (Pubitemid 44022037)
32. Pick HL, Warren DH, Hay JC (1969) Sensory conflict in judgments of spatial direction. Percept Psychophys 6(4):203-205
33. Posner MI, Nissen MJ, Klein RM (1976) Visual dominance: an information-processing account of its origins and significance. Psychol Rev 83(2):157-171
34. Radeau M, Bertelson P (1987) Auditory-visual interaction, the timing of inputs. Thomas (1941) revisited. Psychol Res 49(1):17-22
35. Sanabria D, Soto-Faraco S, Chan JS, Spence C (2004) When does visual perceptual grouping affect multisensory integration? Cogn Affect Behav Neurosci 4(2):218-229 (Pubitemid 39167164)
36. Scheier C, Nijhawan R, Shimojo S (1999) Sound alters visual temporal resolution. Invest Ophthalmol Vis Sci 40(Suppl. 4):4169
37. Shimojo S, Scheier C, Nijhawan R, Shams L, Kamitani Y, Watanabe K (2001) Beyond perceptual modality: auditory effects on visual perception. Acoust Sci Technol 22(2):61-67 (Pubitemid 32514387)
38. Soto-Faraco S, Kingstone A (2004) Multisensory integration of dynamic information. In: Calvert G, Spence C, Stein BE (eds) The handbook of multisensory processes. MIT Press, Cambridge
39. Spence C (2007) Audiovisual multisensory integration. Acoust Sci Technol 28:61-70 (Pubitemid 46457224)
40. Spence C, Sanabria D, Soto-Faraco S (2007) Intersensory Gestalten and crossmodal scene perception. In: Noguchi K (ed) Psychology of beauty and Kansei: new horizons of Gestalt perception. Fuzanbo International, Tokyo, pp 519-579
41. Stone JV, Hunkin NM, Porrill J, Wood R, Keeler V, Beanland M et al (2001) When is now? Perception of simultaneity. Proc R Soc Lond B Biol Sci 268(1462):31-38 (Pubitemid 32127950)
42. Ternus J (1926) Experimentelle Untersuchungen über phänomenale Identität. Psychologische Forschung 7:81-136
43. Treutwein B, Strasburger H (1999) Fitting the psychometric function. Percept Psychophys 61(1):87-106
44. van Erp JBF, Werkhoven PJ (2004) Vibro-tactile and visual asynchronies: sensitivity and consistency. Perception 33:103-111 (Pubitemid 38389684)
45. Vroomen J, de Gelder B (2004) Temporal ventriloquism: sound modulates the flash-lag effect. J Exp Psychol Hum Percept Perform 30:513-518 (Pubitemid 38726721)
46. Vroomen J, Keetels M (2006) The spatial constraint in intersensory pairing: no role in temporal ventriloquism. J Exp Psychol Hum Percept Perform 32(4):1063-1071 (Pubitemid 44157620)
47. Walker JT, Scott KJ (1981) Auditory-visual conflicts in the perceived duration of lights, tones and gaps. J Exp Psychol Hum Percept Perform 7(6):1327-1339
48. Wearden JH (2006) When do auditory/visual differences in duration judgments occur? Q J Exp Psychol 59(10):1709-1724 (Pubitemid 44359075)
49. Wearden JH, Edwards H, Fakhri M, Percival A (1998) Why "sounds are judged longer than lights": application of a model of the internal clock in humans. Q J Exp Psychol 51(2):97-120
50. Welch RB (1999) Meaning, attention, and the 'unity assumption' in the intersensory bias of spatial and temporal perceptions. In: Aschersleben G, Bachmann T, Müsseler J (eds) Cognitive contribution to the perception of spatial and temporal events. Elsevier, Amsterdam, pp 317-387
51. Welch RB, Warren DH (1980) Immediate perceptual response to intersensory discrepancy. Psychol Bull 88(3):638-667
52. Welch RB, Warren DH (1986) Intersensory interactions. In: Boff KR, Kaufman L, Thomas JP (eds) Handbook of perception and human performance: sensory processes and perception, vol 1. Wiley, New York, pp 1-36
53. Witten IB, Knudsen EI (2005) Why seeing is believing: merging auditory and visual worlds. Neuron 48(3):489-496 (Pubitemid 41551953)