Auditory Dominance in Temporal Processing: New Evidence from Synchronization with Simultaneous Visual and Auditory Sequences

Journal of Experimental Psychology: Human Perception and Performance

Volumn 28, Issue 5, 2002, Pages 1085-1099

  Repp, Bruno H ^a   Penel, Amandine ^a  

^a HASKINS LABORATORIES   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ANALYSIS OF VARIANCE; ARTICLE; CLINICAL TRIAL; CONTROLLED CLINICAL TRIAL; CONTROLLED STUDY; DEPTH PERCEPTION; HEARING; HUMAN; PERCEPTIVE DISCRIMINATION; PSYCHOMOTOR PERFORMANCE; RANDOMIZED CONTROLLED TRIAL; TIME PERCEPTION; VISION;

ANALYSIS OF VARIANCE; AUDITORY PERCEPTION; DISCRIMINATION (PSYCHOLOGY); HUMANS; PSYCHOMOTOR PERFORMANCE; SPACE PERCEPTION; TIME PERCEPTION; VISUAL PERCEPTION;

EID: 85047671613     PISSN: 00961523     EISSN: None     Source Type: Journal    
DOI: 10.1037/0096-1523.28.5.1085     Document Type: Article

References (89)

1. Aschersleben, G., & Prinz, W. (1995). Synchronizing actions with events: The role of sensory information. Perception & Psychophysics, 57, 305-317.
2. Aschersleben, G., & Prinz, W. (1997). Delayed auditory feedback in synchronization. Journal of Motor Behavior, 29, 35-46.
3. Aschersleben, G., Stenneken, P., Cole, J., & Prinz, W. (2002). Timing mechanisms in sensorimotor synchronization. In W. Prinz & B. Hommel (Eds.), Common mechanisms in perception and action: Attention and performance XIX (pp. 227-244). Oxford, England: Oxford University Press.
4. Bartlett, N. R., & Bartlett, S. C. (1959). Synchronization of a motor response with an anticipated sensory event. Psychological Review, 66, 203-218.
5. Behar, I., & Bevan, W. (1961). The perceived duration of auditory and visual intervals: Cross-modal comparison and interaction. American Journal of Psychology, 74, 17-26.
6. Bermant, R. I., & Welch, R. B. (1976). Effect of degree of separation of visual-auditory stimulus and eye position upon spatial interaction of vision and audition. Perceptual and Motor Skills, 43, 487-493.
7. Bertelson, P., & Aschersleben, G. (1998). Automatic visual bias of perceived auditory location. Psychonomic Bulletin & Review, 5, 482-489.
8. Bertelson, P., & Radeau, M. (1981). Cross-modal bias and perceptual fusion with auditory-visual spatial discordance. Perception & Psychophysics, 29, 578-584.
9. Bertelson, P., Vroomen, J., de Gelder, B., & Driver, J. (2000). The ventriloquist effect does not depend on the direction of deliberate visual attention. Perception & Psychophysics, 62, 321-332.
10. Canon, L. K. (1970). Intermodality inconsistency of input and directed attention as determinants of the nature of adaptation. Journal of Experimental Psychology, 84, 141-147.
11. Canon, L. K. (1971). Directed attention and maladaptive adaptation to displacement of the visual field. Journal of Experimental Psychology, 88, 403-408.
12. Creem, S. H., & Proffitt, D. R. (1998). Two memories for geographical slant: Separation and interdependence of action and awareness. Psychonomic Bulletin & Review, 5, 22-36.
13. de Gelder, B., & Vroomen, J. (2000). The perception of emotions by ear and by eye. Cognition and Emotion, 14, 289-311.
14. Dunlap, K. (1910). Reactions to rhythmic stimuli, with attempt to synchronize. Psychological Review, 17, 399-416.
15. Fendrich, R., & Corballis, P. M. (2001). The temporal cross-capture of audition and vision. Perception & Psychophysics, 63, 719-725.
16. Fraisse, P. (1948). Rythmes auditifs et rythmes visuels [Auditory rhythms and visual rhythms]. L'Année Psychologique, 49, 21-41.
17. Freides, D. (1974). Human information processing and sensory modality: Cross-modal functions, information complexity, memory, and deficit. Psychological Bulletin, 81, 284-310.
18. Gault, R. H., & Goodfellow, L. D. (1938). An empirical comparison of audition, vision, and touch in the discrimination of temporal patterns and ability to reproduce them. Journal of General Psychology, 18, 41-47.
19. Gebhard, J. W., & Mowbray, G. H. (1959). On discriminating the rate of visual flicker and auditory flutter. American Journal of Psychology, 72, 521-528.
20. Geldard, F. A. (1970). Vision, audition, and beyond. In W. D. Neff (Ed.), Contributions to sensory physiology (pp. 1-17). New York: Academic.
21. Gibson, J. J. (1975). Events are perceivable but time is not. In J. T. Fraser & N. Lawrence (Eds.), The study of time (Vol. 2, pp. 29-58). Berlin, Germany: Springer.
22. Goldstone, S., Boardman, W. K., & Lhamon, W. T. (1959). Intersensory comparisons of temporal judgments. Journal of Experimental Psychology, 57, 243-248.
23. Goldstone, S., & Lhamon, W. T. (1971). Levels of cognitive functioning and the auditory-visual differences in human timing behavior. In M. H. Appley (Ed.), Adaptation level theory (symposium) (pp. 263-280). New York: Academic Press.
24. Goldstone, S., & Lhamon, W. T. (1974). Studies of auditory-visual differences in human time judgments: 1. Sounds are judged longer than lights. Perceptual and Motor Skills, 39, 63-82.
25. Goldstone, S., Lhamon, W. T., & Sechzer, J. (1978). Light intensity and judged duration. Bulletin of the Psychonomic Society, 12, 83-84.
26. Goodale, M. A., & Humphrey, G. K. (1998). The objects of action and perception. Cognition, 67, 181-207.
27. Goodfellow, L. D. (1934). An empirical comparison of audition, vision, and touch in the discrimination of short intervals of time. American Journal of Psychology, 46, 243-258.
28. Grondin, S. (1993). Duration discrimination of empty and filled intervals marked by auditory and visual signals. Perception & Psychophysics, 54, 383-394.
29. Grondin, S., Meilleur-Wells, G., Ouellette, C., & Macar, F. (1998). Sensory effects on judgments of short time-intervals. Psychological Research, 61, 261-268.
30. Grondin, S., Ouellet, B., & Roussel, M.-E. (2001). About optimal timing and stability of Weber fraction for duration discrimination. Acoustical Science and Technology, 22, 370-372.
31. Grondin, S., & Rousseau, R. (1991). Judging the relative duration of multimodal short empty time intervals. Perception & Psychophysics, 49, 245-256.
32. Hary, D., & Moore, G. P. (1985). Temporal tracking and synchronization strategies. Human Neurobiology, 4, 73-77.
33. Hary, D., & Moore, G. P. (1987). Synchronizing human movement with an external clock source. Biological Cybernetics, 56, 305-311.
34. Jack, C. E., & Thurlow, W. R. (1973). Effects of degree of visual association and angle of displacement on the "ventriloquism" effect. Perceptual and Motor Skills, 37, 967-969.
35. Jackson, C. V. (1953). Visual factors in auditory localization. Quarterly Journal of Experimental Psychology, 5, 52-65.
36. Jaśkowski, P. (1999). Reaction time and temporal-order judgment as measures of perceptual latency: The problem of dissociations. In G. Aschersleben, T. Bachmann, & J. Müsseler (Eds.), Cognitive contributions to the perception of spatial and temporal events (pp. 265-291). Amsterdam: Elsevier.
37. Jaśkowski, P., Jaroszyk, F., & Hojan-Jezierska, D. (1990). Temporal-order judgments and reaction time for stimuli of different modalities. Psychological Research, 52, 35-38.
38. Klemmer, E. T. (1967). Sequences of responses to signals encoded in time only. Acta Psychologica, 27, 197-203.
39. Klotz, W., & Neumann, O. (1999). Motor activation without conscious discrimination in metacontrast masking. Journal of Experimental Psychology: Human Perception and Performance, 25, 976-992.
40. Kolers, P. A., & Brewster, J. M. (1985). Rhythms and responses. Journal of Experimental Psychology: Human Perception and Performance, 11, 150-167.
41. Kubovy, M. (1988). Should we resist the seductiveness of the space:time::vision:audition analogy? Journal of Experimental Psychology: Human Perception and Performance, 14, 318-320.
42. Large, E. W., & Jones, M. R. (1999). The dynamics of attending: How we track time-varying events. Psychological Review, 106, 119-159.
43. Lhamon, W. T., & Goldstone, S. (1974). Studies in auditory-visual differences in human time judgment: 2. More transmitted information with sounds than lights. Perceptual and Motor Skills, 39, 295-307.
44. Massaro, D. W. (1987). Speech perception by ear and eye: A paradigm for psychological inquiry. Hillsdale, NJ: Erlbaum.
45. Massaro, D. W., & Egan, P. B. (1996). Perceiving affect from the voice and the face. Psvchonomic Bulletin & Review, 3, 215-221.
46. Mates, J. (1994a). A model of synchronization of motor acts to a stimulus sequence: I. Timing and error corrections. Biological Cybernetics, 70, 463-473.
47. Mates, J. (1994b). A model of synchronization of motor acts to a stimulus sequence: II. Stability analysis, error estimation, and simulations. Biological Cybernetics, 70, 475-484.
48. McGurk, H., & MacDonald, J. (1976, December 23/30). Hearing lips and seeing voices. Nature, 264, 746-748.
49. Michon, J. A. (1967). Timing in temporal tracking. Assen, the Netherlands: van Gorcum.
50. Myers, A. K., Cotton, B., & Hilp, H. A. (1981). Matching the rate of concurrent tone bursts and light flashes as a function of flash surround luminance. Perception & Psychophysics, 30, 33-38.
51. Näätänen, R., & Winkler, I. (1999). The concept of auditory stimulus representation in cognitive neuroscience. Psychological Bulletin, 125, 826-859.
52. Neumann, O. (1990). Direct parameter specification and the concept of perception. Psychological Research, 52, 207-215.
53. O'Connor, N., & Hermelin, B. (1972). Seeing and hearing and space and time. Perception & Psychophysics, 11, 46-48.
54. Penney, T. B., Gibbon, J., & Meck, W. H. (2000). Differential effects of auditory and visual signals on clock speed and temporal memory. Journal of Experimental Psychology: Human Perception and Performance, 26, 1770-1787.
55. Pick, H. L., Jr., Warren, D. H., & Hay, J. C. (1969). Sensory conflicts in judgments of spatial direction. Perception & Psychophysics, 6, 203-205.
56. Posner, M. I., Nissen, M. J., & Klein, R. M. (1976). Visual dominance: An information-processing account of its origin and significance. Psychological Review, 83, 157-171.
57. Pressing, J. (1998). Error correction processes in temporal pattern production. Journal of Mathematical Psychology, 42, 63-101.
58. Pressing, J. (1999). The referential dynamics of cognition and action. Psychological Review, 106, 714-747.
59. Prinz, W. (1997). Perception and action planning. European Journal of Cognitive Psychology, 9, 129-154.
60. Radeau, M. (1985). Signal intensity, task context, and auditory-visual interaction. Perception, 14, 517-577.
61. Radeau, M., & Bertelson, P. (1976). The effect of a textured visual field on modality dominance in a ventriloquism situation. Perception & Psychophysics, 20, 227-235.
62. Radeau, M., & Bertelson, P. (1977). Adaptation to auditory-visual discordance and ventriloquism in semirealistic situations. Perception & Psychophysics, 22, 137-146.
63. Radeau, M., & Bertelson, P. (1987). Auditory-visual interaction and the timing of inputs: Thomas (1941) revisited. Psychological Research, 49, 17-22.
64. Repp, B. H. (2000). Compensation for subliminal timing perturbations in perceptual-motor synchronization. Psychological Research, 63, 106-128.
65. Repp, B. H. (2001a). Phase correction, phase resetting, and phase shifts after subliminal timing perturbations in sensorimotor synchronization. Journal of Experimental Psychology: Human Perception and Performance, 27, 600-621.
66. Repp, B. H. (2001b). Processes underlying adaptation to tempo changes in sensorimotor synchronization. Human Movement Science, 20, 277-312.
67. Repp, B. H. (2002a). Automaticity and voluntary control of phase correction following event onset shifts in sensorimotor synchronization. Journal of Experimental Psychology: Human Perception and Performance, 28, 410-430.
68. Repp, B. H. (2002b). Perception of timing is more context-sensitive than sensorimotor synchronization. Perception & Psychophysics, 64, 703-716.
69. Repp, B. H. (2002c). Phase correction in sensorimotor synchronization: Nonlinearities in voluntary and involuntary responses to perturbations. Human Movement Science, 21, 1-37.
70. Rousseau, R., Poirier, J., & Lemyre, L. (1983). Duration discrimination of empty time intervals marked by intermodal pulses. Perception & Psychophysics, 34, 541-548.
71. Semjen, A., Schulze, H.-H., & Vorberg, D. (2000). Timing precision in continuation and synchronization tapping. Psychological Research, 63, 137-147.
72. Semjen, A., Vorberg, D., & Schulze, H.-H. (1998). Getting synchronized with the metronome: Comparisons between phase and period correction. Psychological Research, 61, 44-55.
73. Shipley, T. (1964. September). Auditory flutter-driving of visual flicker. Science, 145, 1328-1330.
74. Spence, C., & Driver, J. (1997). Audiovisual links in exogenous covert spatial orienting. Perception & Psychophysics, 59, 1-22.
75. Stratton, G. M. (1897). Vision without inversion of the retinal image. Psychological Review, 4, 341-360 and 463-481.
76. Tanner, T. A., Patton, R. M., & Atkinson, R. C. (1965). Intermodality judgments of signal duration. Psychonomic Science, 2, 271-272.
77. Thaut, M. H., Miller, R. A., & Schauer, L. M. (1998). Multiple synchronization strategies in rhythmic sensorimotor tasks: Phase vs. period correction. Biological Cybernetics, 79, 241-250.
78. Thaut, M. H., Tian, B., & Azimi-Sadjadi, M. R. (1998). Rhythmic finger tapping to cosine-wave modulated metronome sequences: Evidence of subliminal entrainment. Human Movement Science, 17, 839-863.
79. Thomas, G. J. (1941). Experimental study of the influence of vision on sound localization. Journal of Experimental Psychology, 28, 163-177.
80. Vorberg, D., & Schulze, H.-H. (2002). A two-level timing model for synchronization. Journal of Mathematical Psychology, 46, 56-87.
81. Vorberg, D., & Wing, A. (1996). Modelling variability and dependence in timing. In H. Heuer & S. W. Keele (Eds.), Handbook of perception and action (Vol. 2, pp. 181-262). London: Academic Press.
82. Vroomen, J., Bertelson, P., & de Gelder, B. (2001). The ventriloquist effect does not depend on the direction of automatic visual attention. Perception & Psychophysics, 63, 651-659.
83. Walker, J. T., & Scott, K. J. (1981). Auditory-visual conflicts in the perceived duration of lights, tones, and gaps. Journal of Experimental Psychology: Human Perception and Performance, 7, 1327-1339.
84. Warren, D. H. (1979). Spatial localization under conflict conditions: Is there a single explanation? Perception, 8, 323-337.
85. Warren, D. H. (1980). Response factors in intermodality localization under conflict situation. Perception & Psychophysics, 27, 28-32.
86. Warren, D. H., Welch, R. B., & McCarthy, T. J. (1981). The role of visual-auditory compellingness in the ventriloquist effect: Implications for transitivity among the spatial senses. Perception & Psychophysics, 30, 557-564.
87. Welch, R. B. (1999). Meaning, attention, and the unity assumption in the intersensory bias of spatial and temporal perceptions. In G. Aschersleben, G. Bachmann, & J. Müsseler (Eds.), Cognitive contributions to the perception of spatial and temporal events (pp. 371-387). Amsterdam: Elsevier.
88. Welch, R. B., & Warren, D. H. (1980). Immediate perceptual response to intersensory discrepancy. Psychological Bulletin, 88, 638-667.
89. Witkin, H. A., Wapner, S., & Leventhal, T. (1952). Sound localization with conflicting visual and auditory cues. Journal of Experimental Psychology, 43, 58-67.