Crossmodal duration perception involves perceptual grouping, temporal ventriloquism, and variable internal clock rates

Attention, Perception, and Psychophysics

Volumn 73, Issue 1, 2011, Pages 219-236

  Klink, P Christiaan ^a   Montijn, Jorrit S ^a   van Wezel, Richard J A ^a,b  

^a UTRECHT UNIVERSITY   (Netherlands)

^b UNIVERSITY OF TWENTE   (Netherlands)

Author keywords

Audiovisual; Crossmodal integration; Interval perception; Scalar timing; Temporal ventriloquism; Time perception

Indexed keywords

ADULT; ARTICLE; ASSOCIATION; ATTENTION; DECISION MAKING; DIFFERENTIAL THRESHOLD; FEMALE; HEARING; HUMAN; MALE; PATTERN RECOGNITION; PERCEPTION DISORDER; PSYCHOPHYSICS; TIME PERCEPTION;

ADULT; ASSOCIATION; ATTENTION; DECISION MAKING; DIFFERENTIAL THRESHOLD; FEMALE; HUMANS; JUDGMENT; MALE; PATTERN RECOGNITION, VISUAL; PERCEPTUAL DISTORTION; PITCH PERCEPTION; PSYCHOPHYSICS; TIME PERCEPTION; YOUNG ADULT;

EID: 79951943386     PISSN: 19433921     EISSN: None     Source Type: Journal    
DOI: 10.3758/s13414-010-0010-9     Document Type: Article

References (66)

1. Alais, D., & Burr, D. (2004). The ventriloquist effect results from near-optimal bimodal integration. Current Biology, 14, 257-262. doi:10.1016/j.cub.2004.01.029.
2. Angrilli, A., Cherubini, P., Pavese, A., & Mantredini, S. (1997). The influence of affective factors on time perception. Perception & Psychophysics, 59, 972-982.
3. Bertelson, P., & Aschersleben, G. (2003). Temporal ventriloquism: Crossmodal interaction on the time dimension: 1. evidence from auditory-visual temporal order judgment. International Journal of Psychophysiology, 50, 147-155. doi:10.1016/S0167-8760(03)00130-2.
4. Boltz, M. G. (2005). Duration judgments of naturalistic events in the auditory and visual modalities. Perception & Psychophysics, 67, 1362-1375.
5. Brainard, D. H. (1997). The psychophysics toolbox. Spatial Vision, 10, 433-436. doi:10.1163/156856897X00357.
6. Bruns, P., & Getzmann, S. (2008). Audiovisual influences on the perception of visual apparent motion: Exploring the effect of a single sound. Acta Psychologica, 129, 273-283. doi:10.1016/j.actpsy.2008.08.002.
7. Buhusi, C. V., & Meck, W. H. (2005). What makes us tick? Functional and neural mechanisms of interval timing. Nature Reviews. Neuroscience, 6, 755-765. doi:10.1038/nrn1764.
8. Burr, D., & Alais, D. (2006). Combining visual and auditory information. Progress in Brain Research, 155, 243-258. doi:10.1016/S0079-6123(06)55014-9.
9. Burr, D., Banks, M., & Morrone, M. C. (2009). Auditory dominance over vision in the perception of interval duration. Experimental Brain Research, 198, 49-57. doi:10.1007/s00221-009-1933-z.
10. Chen, K., & Yeh, S. (2009). Asymmetric cross-modal effects in time perception. Acta Psychologica, 130, 225-234. doi:10.1016/j.actpsy.2008.12.008.
11. Donovan, C. L., Lindsay, D. S., & Kingstone, A. (2004). Flexible and abstract resolutions to crossmodal conflicts. Brain and Cognition, 56, 1-4. doi:10.1016/j.bandc.2004.02.019.
12. Driver, J., & Spence, C. (1998). Cross-modal links in spatial attention. Philosophical Transactions of the Royal Society B, 353, 1319-1331. doi:10.1098/rstb.1998.0286.
13. Driver, J., & Spence, C. (2000). Multisensory perception: Beyond modularity and convergence. Current Biology, 10, 731-735. doi:10.1016/S0960-9822(00)00740-5.
14. Eagleman, D. M. (2008). Human time perception and its illusions. Current Opinion in Neurobiology, 18, 131-136. doi:10.1016/j.conb.2008.06.002.
15. Ernst, M. O., & Bülthoff, H. H. (2004). Merging the senses into a robust percept. Trends in Cognitive Sciences, 8, 162-169. doi:10.1016/j.tics.2004.02.002.
16. Freeman, E., & Driver, J. (2008). Direction of visual apparent motion driven solely by timing of a static sound. Current Biology, 18, 1262-1266. doi:10.1016/j.cub.2008.07.066.
17. Getzmann, S. (2007). The effect of brief auditory stimuli on visual apparent motion. Perception, 36, 1089-1103.
18. Gibbon, J. (1977). Scalar expectancy theory and Weber's law in animal timing. Psychological Review, 84, 279-325.
19. Gibbon, J., Church, R. M., & Meck, W. H. (1984). Scalar timing in memory. Annals of the New York Acadamy of Sciences, 423, 52-77. doi:10.1111/j.1749-6632.1984.tb23417.x.
20. Grondin, S. (2003). Sensory modalities and temporal processing. In H. Helfrich (Ed.), Time and mind: II. Information processing perspectives (pp. 61-77). Toronto: Hogrefe & Huber.
21. Grondin, S., & McAuley, J. D. (2009). Duration discrimination in crossmodal sequences. Perception, 38, 1542-1559.
22. Guttman, S. E., Gilroy, L. A., & Blake, R. (2005). Hearing what the eyes see: Auditory encoding of visual temporal sequences. Psychological Science, 16, 228-235. doi:10.1111/j.0956-7976.2005.00808.x.
23. Jaekl, P. M., & Harris, L. R. (2007). Auditory-visual temporal integration measured by shifts in perceived temporal location. Neuroscience Letters, 417, 219-224. doi:10.1016/j.neulet.2007.02.029.
24. Jones, M. R., & McAuley, J. D. (2005). Time judgments in global temporal contexts. Perception & Psychophysics, 67, 398-417.
25. Kanai, R., & Watanabe, M. (2006). Visual onset expands subjective time. Perception & Psychophysics, 68, 1113-1123.
26. Kanai, R., Paffen, C. L. E., Hogendoorn, H., & Verstraten, F. A. J. (2006). Time dilation in dynamic visual display. Journal of Vision, 6(12), 1421-1430. doi:10.1167/6.12.8.
27. Kanai, R., Sheth, B. R., Verstraten, F. A. J., & Shimojo, S. (2007). Dynamic perceptual changes in audiovisual simultaneity. PLoS ONE, 2, e1253. doi:10.1371/journal.pone.0001253.
28. Keetels, M., & Vroomen, J. (2007). No effect of auditory-visual spatial disparity on temporal recalibration. Experimental Brain Research, 182, 559-565. doi:10.1007/s00221-007-1012-2.
29. Keetels, M., Stekelenburg, J., & Vroomen, J. (2007). Auditory grouping occurs prior to intersensory pairing: Evidence from temporal ventriloquism. Experimental Brain Research, 180, 449-456. doi:10.1007/s00221-007-0881-8.
30. Klink, P. C., Noest, A. J., Holten, V., van den Berg, A. V., & van Wezel, R. J. A. (2009). Occlusion-related lateral connections stabilize kinetic depth stimuli through perceptual coupling. Journal of Vision, 9(10), 20-21. doi:10.1167/9.10.20.
31. Landy, M. S., Maloney, L. T., Johnston, E. B., & Young, M. (1995). Measurement and modeling of depth cue combination: In defense of weak fusion. Vision Research, 35, 389-412. doi:10.1016/0042-6989(94)00176-M.
32. Lyons, G., Sanabria, D., Vatakis, A., & Spence, C. (2006). The modulation of crossmodal integration by unimodal perceptual grouping: A visuotactile apparent motion study. Experimental Brain Research, 174, 510-516. doi:10.1007/s00221-006-0485-8.
33. Maij, F., Brenner, E., & Smeets, J. B. J. (2009). Temporal information can influence spatial localization. Journal of Neurophysiology, 102, 490-495. doi:10.1152/jn.91253.2008.
34. Mauk, M. D., & Buonomano, D. V. (2004). The neural basis of temporal processing. Annual Review of Neuroscience, 27, 307-340. doi:10.1146/annurev.neuro.27.070203.144247.
35. Morein-Zamir, S., Soto-Faraco, S., & Kingstone, A. (2003). Auditory capture of vision: Examining temporal ventriloquism. Cognitive Brain Research, 17, 154-163. doi:10.1016/S0926-6410(03)00089-2.
36. Morrone, M. C., Ross, J., & Burr, D. (2005). Saccadic eye movements cause compression of time as well as space. Nature Neuroscience, 8, 950-954. doi:10.1038/nn1488.
37. Pariyadath, V., & Eagleman, D. M. (2008). Brief subjective durations contract with repetition. Journal of Vision, 8(16), 11.1-16. doi:10.1167/8.16.11.
38. Park, J., Schlag-Rey, M., & Schlag, J. (2003). Voluntary action expands perceived duration of its sensory consequence. Experimental Brain Research, 149, 527-529. doi:10.1007/s00221-003-1376-x.
39. Pelli, D. G. (1997). The VideoToolbox software for visual psychophysics: Transforming numbers into movies. Spatial Vision, 10, 437-442. doi:10.1163/156856897X00366.
40. Penney, T. B., Gibbon, J., & Meck, W. H. (2000). Differential effects of auditory and visual signals on clock speed and temporal memory. Journal of Experimental Psychology: Human Perception and Performance, 26, 1770-1787. doi:10.1037/0096-1523.26.6.1770.
41. Penney, T. B., Meck, W. H., Roberts, S. A., Gibbon, J., & Erlenmeyer-Kimling, L. (2005). Interval-timing deficits in individuals at high risk for schizophrenia. Brain and Cognition, 58, 109-118. doi:10.1016/j.bandc.2004.09.012.
42. Penton-Voak, I. S., Edwards, H., Percival, A., & Wearden, J. H. (1996). Speeding up an internal clock in humans? Effects of click trains on subjective duration. Journal of Experimental Psychology: Animal Behavior Processes, 22, 307-320. doi:10.1037/0097-7403.22.3.307.
43. Recanzone, G. H. (2003). Auditory influences on visual temporal rate perception. Journal of Neurophysiology, 89, 1078-1093. doi:10.1152/jn.00706.2002.
44. Repp, B. H., & Penel, A. (2002). Auditory dominance in temporal processing: New evidence from synchronization with simultaneous visual and auditory sequences. Journal of Experimental Psychology: Human Perception and Performance, 28, 1085-1099. doi:10.1037/0096-1523.28.5.1085.
45. Rose, D., & Summers, J. (1995). Duration illusions in a train of visual stimuli. Perception, 24, 1177-1187.
46. Rousseau, L., & Rousseau, R. (1996). Stop-reaction time and the internal clock. Perception & Psychophysics, 58, 434-448.
47. Sanabria, D., Soto-Faraco, S., Chan, J. S., & Spence, C. (2004). When does visual perceptual grouping affect multisensory integration? Cognitive, Affective & Behavioral Neuroscience, 4, 218-229.
48. Sanabria, D., Soto-Faraco, S., Chan, J. S., & Spence, C. (2005). Intramodal perceptual grouping modulates multisensory integration: Evidence from the crossmodal dynamic capture task. Neuroscience Letters, 377, 59-64. doi:10.1016/j.neulet.2004.11.069.
49. Shams, L., Kamitani, Y., & Shimojo, S. (2002). Visual illusion induced by sound. Cognitive Brain Research, 14, 147-152. doi:10.1016/S0926-6410(02)00069-1.
50. Sugita, Y., & Suzuki, Y. (2003). Audiovisual perception: Implicit estimation of sound-arrival time. Nature, 421, 911. doi:10.1038/421911a.
51. van Wassenhove, V., Buonomano, D. V., Shimojo, S., & Shams, L. (2008). Distortions of subjective time perception within and across senses. PLoS ONE, 3, e1437. doi:10.1371/journal.pone.0001437.
52. Vatakis, A., & Spence, C. (2007). Crossmodal binding: Evaluating the 'unity assumption' using audiovisual speech stimuli. Perception & Psychophysics, 69, 744-756.
53. Vatakis, A., & Spence, C. (2008). Evaluating the influence of the 'unity assumption' on the temporal perception of realistic audiovisual stimuli. Acta Psychologica, 127, 12-23. doi:10.1016/j.actpsy.2006.12.002.
54. Vroomen, J., & de Gelder, B. (2000). Sound enhances visual perception: Cross-modal effects of auditory organization on vision. Journal of Experimental Psychology: Human Perception and Performance, 26, 1583-1590. doi:10.1037/0096-1523.26.5.1583.
55. Vroomen, J., Keetels, M., de Gelder, B., & Bertelson, P. (2004). Recalibration of temporal order perception by exposure to audiovisual asynchrony. Cognitive Brain Research, 22, 32-35. doi:10.1016/j.cogbrainres.2004.07.003.
56. Wada, Y., Kitagawa, N., & Noguchi, K. (2003). Audio-visual integration in temporal perception. International Journal of Psychophysiology, 50, 117-124. doi:10.1016/S0167-8760(03)00128-4.
57. Walker, J. T., & Scott, K. J. (1981). Auditory-visual conflicts in the perceived duration of lights, tones and gaps. Journal of Experimental Psychology: Human Perception and Performance, 7, 1327-1339.
58. Wallace, M. T., Roberson, G. E., Hairston, W. D., Stein, B. E., Vaughan, J. W., & Schirillo, J. A. (2004). Unifying multisensory signals across time and space. Experimental Brain Research, 158, 252-258. doi:10.1007/s00221-004-1899-9.
59. Watanabe, K., Nijhawan, R., Khurana, B., & Shimojo, S. (2001). Perceptual organization of moving stimuli modulates the flashlag effect. Journal of Experimental Psychology: Human Perception and Performance, 27, 879-894. doi:10.1037/0096-1523.27.4.879.
60. Watson, A. B., & Pelli, D. G. (1983). QUEST: A Bayesian adaptive psychometric method. Perception & Psychophysics, 33, 113-120.
61. Wearden, J. H., Edwards, H., Fakhri, M., & Percival, A. (1998). Why "sounds are judged longer than lights": Application of a model of the internal clock in humans. The Quarterly Journal of Experimental Psychology, 51B, 97-120.
62. Welch, R. B., & Warren, D. H. (1980). Immediate perceptual response to intersensory discrepancy. Psychological Bulletin, 88, 638-667.
63. Wichmann, F., & Hill, N. (2001). The psychometric function: I. Fitting, sampling, and goodness of fit. Perception & Psychophysics, 63, 1293-1313.
64. Witten, I. B., & Knudsen, E. I. (2005). Why seeing is believing: Merging auditory and visual worlds. Neuron, 48, 489-496. doi:10.1016/j.neuron.2005.10.020.
65. Xuan, B., Zhang, D., He, S., & Chen, X. (2007). Larger stimuli are judged to last longer. Journal of Vision, 7(10), 2.1-5. doi:10.1167/7.10.2.
66. Yarrow, K., Haggard, P., Heal, R., Brown, P., & Rothwell, J. C. (2001). Illusory perceptions of space and time preserve crosssaccadic perceptual continuity. Nature, 414, 302-305. doi:10.1038/35104551.