Visual determinants of a cross-modal illusion

Attention, Perception, and Psychophysics

Volumn 71, Issue 7, 2009, Pages 1618-1627

  Armontrout, James A ^a   Schutz, Michael ^b   Kubovy, Michael ^a  

^a UNIVERSITY OF VIRGINIA   (United States)

^b MCMASTER UNIVERSITY   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

ACCELERATION; ARTICLE; ASSOCIATION; ATTENTION; COMPUTER PROGRAM; DISTANCE PERCEPTION; GESTURE; HEARING; HUMAN; LEARNING; MOVEMENT PERCEPTION; ORIENTATION; PATTERN RECOGNITION; PSYCHOMOTOR PERFORMANCE; PSYCHOPHYSICS; STATISTICAL MODEL; TIME PERCEPTION; VISUAL ILLUSION;

ACCELERATION; ASSOCIATION LEARNING; ATTENTION; CUES; DISTANCE PERCEPTION; GESTURES; HUMANS; LINEAR MODELS; MOTION PERCEPTION; OPTICAL ILLUSIONS; ORIENTATION; PATTERN RECOGNITION, VISUAL; PITCH PERCEPTION; PSYCHOACOUSTICS; PSYCHOMOTOR PERFORMANCE; PSYCHOPHYSICS; SOFTWARE; TIME PERCEPTION;

EID: 73449124836     PISSN: 19433921     EISSN: 1943393X     Source Type: Journal    
DOI: 10.3758/APP.71.7.1618     Document Type: Article

References (65)

1. ALAIS, D. BURR, D. 2004. The ventriloquist effect results from nearoptimal bimodal integration. Current Biology, 14, 257-262.
2. ARIEH, Y. MARKS, L. E. 2008. Cross-modal interaction between vision and hearing: A speed-accuracy analysis. Perception & Psychophysics, 70, 412-421.
3. ARRIGHI, R., ALAIS, D. BURR, D. 2006. Perceptual synchrony of audiovisual streams for natural and artificial motion sequences. Journal of Vision, 6, 260-268.
4. BAAYEN, R. H. 2008. Analyzing linguistic data: A practical introduction to statistics using R. Cambridge: Cambridge University Press.
5. BAAYEN, R. H., DAVIDSON, D. J. BATES, D. M. 2008. Mixed-effects modeling with crossed random effects for subjects and items. Journal of Memory & Language, 59, 390-412.
6. BATES, D. M. SARKAR, D. 2007. Ime4: Linear mixed-effects models using S4 classes (R package Version 0.9975-13.
7. BATTAGLIA, P. W., JACOBS, R. A. ASLIN, R. N. 2003. Bayesian integration of visual and auditory signals for spatial localization. Journal of the Optical Society of America, 20, 1391-1397.
8. BEDFORD, F. L. 2001a. Object identity theory and the nature of general laws: Commentary reply. Cahiers de Psychologie Cognitive/Current Psychology of Cognition, 20, 277-293.
9. BEDFORD, F. L. 2001b. Towards a general law of numerical/object identity. Cahiers de Psychologie Cognitive/Current Psychology of Cognition, 20, 113-175.
10. BEDFORD, F. L. 2004. Analysis of a constraint on perception, cognition, and development: One object, one place, one time. Journal of Experimental Psychology: Human Perception & Performance, 30, 907-912.
11. BERTELSON, P. RADEAU, M. 1981. Cross-modal bias and perceptual fusion with auditory-visual spatial discordance. Perception & Psychophysics, 29, 578-584.
12. BERTELSON, P., VROOMEN, J., DE GELDER, B. DRIVER, J. 2000. The ventriloquist effect does not depend on the direction of deliberate visual attention. Perception & Psychophysics, 62, 321-332.
13. BROUGHTON, M. STEVENS, C. 2009. Music, movement and marimba: An investigation of the role of movement and gesture in communicating musical expression to an audience. Psychology of Music, 37, 137-153.
14. CRAWLEY, M. J. 2007. The R book. Chichester, U.K.: Wiley.
15. DAHL, S. FRIBERG, A. 2007. Visual perception of expressiveness in musicians' body movements. Music Perception, 24, 433-454.
16. DAVIDSON, J. W 1993. Visual perception of performance manner in the movements of solo musicians. Psychology of Music, 21, 101-113.
17. DAVIDSON, J. W 1994. Which areas of a pianist's body convey information about expressive intention to an audience? Journal of Human Movement Studies, 26, 279-301.
18. ERNST, M. O. BANKS, M. S. 2002. Humans integrate visual and haptic information in a statistically optimal fashion. Nature, 415, 429-433.
19. FENDRICH, R. CORBALLIS, P. M. 2001. The temporal cross-capture of audition and vision. Perception & Psychophysics, 63, 719-725.
20. GILLESPIE, R. 1997. Ratings of violin and viola vibrato performance in audio-only and audiovisual presentations. Journal of Research in Music Education, 45, 212-220.
21. HIDALGO-BARNES, M. MASSARO, D. W 2007. Read my lips: An animated face helps communicate musical lyrics. Psychomusicology, 19, 3-12.
22. IHAKA, R. GENTLEMAN, R. 1996. R: A language for data analysis and graphics. Journal of Computational & Graphical Statistics, 5, 299-314.
23. JACK, C. E. THURLOW, W R. 1973. Effects of degree of visual association and angle of displacement on the "ventriloquism" effect. Perceptual & Motor Skills, 37, 967-979.
24. JACKSON, C. 1953. Visual factors in auditory localization. Quarterly Journal of Experimental Psychology, 5, 52-65.
25. JOHANSSON, G. 1973. Visual perception of biological motion and a model for its analysis. Perception & Psychophysics, 14, 201-211.
26. KÖRDING, K. P., BEIERHOLM, U., MA, W. J., QUARTZ, S., TENENBAUM, J. B. SHAMS, L. 2007. Causal inference in multisensory perception. PLoS ONE, 2,1-10. doi:10.1371/journal.pone.0000943
27. KREFT, I. G. G. DE LEEUW, J. 1998. Introducing multilevel modeling. London: Sage.
28. KRUMHANSL, C. SCHENCK, D. L. 1997. Can dance reflect the structural and expressive qualities of music? A perceptual experiment on Balanchine's choreography of Mozart's Divertimento No. 15. Musicae Scientiae, 1, 63-85.
29. KUBOVY, M. SCHUTZ, M. in press. Audio-visual objects. Review of Philosophy & Psychology.
30. LOFTUS, G. R. 2002. Analysis, interpretation, and visual presentation of experimental data. In H. Pashler (Series Ed.) & J. Wixted (Vol. Ed.), Stevens'handbook of experimental psychology: Vol. 4. Methodology in experimental psychology (pp. 339-390. New York: Wiley.
31. MAXWELL, S. E. DELANEY, H. D. 2004. Designing experiments and analyzing data: A model comparison perspective (2nd ed.. Mahwah, NJ: Erlbaum.
32. PETŘINI, K., RUSSELL, M. POLLICK, F. 2009. When knowing can replace seeing in audiovisual integration of actions. Cognition, 110, 432-439.
33. POLLICK, F. E., LESTOU, V., RYU, J. CHO, S.-B. 2002. Estimating the efficiency of recognizing gender and affect from biological motion. Vision Research, 42, 2345-2355.
34. POLLICK, F. E., PATERSON, H. M., BRUDERLIN, A. SANFORD, A. J. 2001. Perceiving affect from arm movement. Cognition, 82, B51-B61.
35. RAUDENBUSH, S. W. BRYK, A. S. 2002. Hierarchical linear models: Applications and data analysis methods. London: Sage.
36. ROSENBLUM, L. D. FOWLER, C. A. 1991. Audiovisual investigation of the loudness-effort effect for speech and nonspeech events. Journal of Experimental Psychology: Human Perception & Performance, 17, 976-985.
37. SALDAÑA, H. M. ROSENBLUM, L. D. 1993. Visual influences on auditory pluck and bow judgments. Perception & Psychophysics, 54, 406-416.
38. SAYGIN, A. P., DRIVER, J. DE SA, V. R. 2008. In the footsteps of biological motion and multisensory perception: Judgments of audiovisual temporal relations are enhanced for upright walkers. Psychological Science, 19, 469-475.
39. SCHUTZ, M. 2008. Seeing music? What musicians need to know about vision. Empirical Musicology Review, 3, 83-108.
40. SCHUTZ, M. KUBOVY, M. 2009. Deconstructing a musical illusion: Point-light representations capture salient properties of impact motions. Canadian Acoustics, 37, 23-28.
41. SCHUTZ, M. KUBOVY, M. in press. Causality and cross-modal integration. Journal of Experimental Psychology: Human Perception & Performance.
42. SCHUTZ, M. LIPSCOMB, S. 2007. Hearing gestures, seeing music: Vision influences perceived tone duration. Perception, 36, 888-897.
43. SEKULER, R., SEKULER, A. B. LAU, R. 1997. Sound alters visual motion perception. Nature, 385, 308.
44. SHIPLEY, T. 1964. Auditory flutter-driving of visual flicker. Science, 145, 1328-1330.
45. SNIJDERS, T. BOSKER, R. 1999. Multilevel analysis: An introduction to basic and advanced multilevel modeling. London: Sage.
46. SPENCE, C. 2007. Audiovisual multisensory integration. Acoustic Science & Technology, 28, 61-70.
47. THOMAS, G. J. 1941. Experimental study of the influence of vision on sound localization. Journal of Experimental Psychology, 28, 163-177.
48. THOMPSON, W. F., GRAHAM, P. RUSSO, F. A. 2005. Seeing music performance: Visual influences on perception and experience. Semiotica, 156, 203-227.
49. THOMPSON, W. F. RUSSO, F. A. 2007. Facing the music. Psychological Science, 18, 756-757.
50. THOMPSON, W. F., RUSSO, F. A. QUINTO, L. 2008. Audio-visual integration of emotional cues in song. Cognition & Emotion, 22, 1457-1470.
51. TREMOULET, P. D. FELDMAN, J. 2000. Perception of animacy from the motion of a single object. Perception, 29, 943-951.
52. VATAKIS, A. SPENCE, C. 2007. Crossmodal binding: Evaluating the "unity assumption" using audiovisual speech stimuli. Perception & Psychophysics, 69, 744-756.
53. VATAKIS, A. SPENCE, C. 2008. Evaluating the influence of the "unity assumption" on the temporal perception of realistic audiovisual stimuli. Acta Psychologica, 127, 12-23.
54. VINES, B. W., KRUMHANSL, C. L., WANDERLEY, M. M. LEVITIN, D. J. 2006. Cross-modal interactions in the perception of musical performances. Cognition, 101, 80-113.
55. VROOMEN, J. 1999. Ventriloquism and the nature of the unity decision: Commentary on Welch. In G. Aschersleben, T Bachmann J. Müsseier (Eds.), Cognitive contributions to the perception of spatial and temporal events (pp. 389-393. Amsterdam: Elsevier.
56. WADA, Y., KITAGAWA, N. NOGUCHI, K. 2003. Audio-visual integration in temporal perception. International Journal of Psychophysiology, 50, 117-124.
57. WALKER, J. T. SCOTT, K. J. 1981. Auditory-visual conflicts in the perceived duration of lights, tones, and gaps. Journal of Experimental Psychology: Human Perception & Performance, 7, 1327-1339.
58. WAPNICK, J., DARROW, A.-A., KOVACS, J. DALRYMPLE, L. 1997. Effects of physical attractiveness on evaluation of vocal performance. Journal of Research in Music Education, 45, 470-479.
59. WAPNICK, J., MAZZA, J. K. DARROW, A.-A. 1998. Effects of performer attractiveness, stage behavior, and dress on violin performance evaluation. Journal of Research in Music Education, 46, 510-521.
60. WELCH, R. B. 1972. The effect of experienced limb identity upon adaptation to simulated displacement of the visual field. Perception & Psychophysics, 12, 453-456.
61. WELCH, R. B. 1999. Meaning, attention, and the "unity assumption" in the intersensory bias of spatial and temporal perceptions. In G. Aschersleben, T Bachmann J. Müsseier (Eds.), Cognitive contributions to the perception of spatial and temporal events (pp. 371-387. Amsterdam: Elsevier.
62. WELCH, R. B., DUTTONHURT, L. D. WARREN, D. H. 1986. Contributions of audition and vision to temporal rate perception. Perception & Psychophysics, 39, 294-300.
63. WELCH, R. B. WARREN, D. H. 1980. Immediate perceptual response to intersensory discrepancy. Psychological Bulletin, 88, 638-667.
64. WILKINSON, L., & THE TASK FORCE ON STATISTICAL INFERENCE, AMERICAN PSYCHOLOGICAL ASSOCIATION ( 1999. Statistical methods in psychology journals: Guidelines and explanations. American Psychologist, 54, 594-604.
65. WITKIN, H. A., WAPNER, S. LEVENTHAL, T. 1952. Sound localization with conflicting visual and auditory cues. Journal of Experimental Psychology, 43, 58-67.