When knowing can replace seeing in audiovisual integration of actions

Cognition

Volumn 110, Issue 3, 2009, Pages 432-439

  Petrini, Karin ^a   Russell, Melanie ^a   Pollick, Frank ^a  

^a UNIVERSITY OF GLASGOW   (United Kingdom)

Author keywords

Action prediction; Audiovisual integration; Drumming; Synchrony perception

Indexed keywords

ADULT; ARTICLE; AUDIOVISUAL EQUIPMENT; AUDITORY STIMULATION; BEHAVIOR; COGNITION; COMPREHENSION; CONTROLLED STUDY; FEMALE; HUMAN; KNOWLEDGE; LOCOMOTION; MENTAL FUNCTION; NORMAL HUMAN; PERCEPTION; PRIORITY JOURNAL; SENSORIMOTOR INTEGRATION; VISUAL INFORMATION; VISUAL STIMULATION;

AUDITORY PERCEPTION; BIOMECHANICS; FEMALE; HUMANS; KNOWLEDGE; MUSIC; PERCEPTION; PHOTIC STIMULATION; VISUAL PERCEPTION; YOUNG ADULT;

EID: 59649115326     PISSN: 00100277     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.cognition.2008.11.015     Document Type: Article

References (44)

1. Alais D., and Burr D. The ventriloquist effect results from near-optimal cross-modal integration. Current Biology 14 (2004) 257-262
2. Arrighi R., Alais D., and Burr D. Perceptual synchrony of audiovisual streams for natural and artificial motion sequences. Journal of Vision 6 (2006) 260-268
3. Aschersleben G., and Prinz W. Synchronizing actions with events: The role of sensory information. Perception and Psychophysics 57 (1995) 305-317
4. Barraclough N.E., Xiao D., Baker C.I., Oram M.W., and Perrett D.I. Integration of visual and auditory information by superior temporal sulcus neurons responsive to the sight of actions. Journal of Cognitive Neuroscience 17 (2005) 377-391
5. Bigand E., and Poulin-Charronnat B. Are we "experienced listeners"? A review of the musical capacities that do not depend on formal musical training. Cognition 100 (2006) 100-130
6. Brainard D.H. The psychophysics toolbox. Spatial Vision 10 (1997) 433-436
7. Buccino G., Vogt S., Ritzl A., Fink G., Zilles K., Freund H., et al. Neural circuits underlying imitation learning of hand actions: An event-related fMRI study. Neuron 42 (2004) 323-334
8. Calvo-Merino B., Grèzes J., Glaser D.E., Passingham R.E., and Haggard P. Seeing or doing? Influence of visual and motor familiarity in action observation. Current Biology 16 (2006) 1905-1910
9. Chen, J. L., Penhune, V. B., & Zatorre, R. J. (2008). Listening to musical rhythms recruits motor regions of the brain. Cerebral Cortex (Advance access published online on April 3).
10. Clifford C.W.G., Arnold D.H., and Pearson J. A paradox of temporal perception revealed by a stimulus oscillating in colour and orientation. Vision Research 43 (2003) 2245-2253
11. Dahl S. Playing the accent - Comparing striking velocity and timing in an ostinato rhythm performed by four drummers. Acta Acustica United with Acustica 90 (2004) 762-776
12. Dixon N.F., and Spitz L. The detection of auditory visual desynchrony. Perception 9 (1980) 719-721
13. Flanagan J.R., and Wing A.M. The role of internal models in motion planning and control: Evidence from grip force adjustments during movements of hand-held loads. Journal of Neuroscience 17 (1997) 1519-1528
14. Fontana, F., Rocchesso, D., & Avanzini, F. (2004). Computation of nonlinear filter networks containing delay-free paths. In Proceedings of the 7th international conference on digital audio effects (DAFX-04) (pp. 113-118). Naples, Italy.
15. Fujisaki W., and Nishida S. Temporal frequency characteristics of synchrony-asynchrony discrimination of audio-visual signals. Experimental Brain Research 166 (2005) 455-464
16. Fujisaki W., and Nishida S. Feature-based processing of audio-visual synchrony perception revealed by random pulse trains. Vision Research 47 (2007) 1075-1093
17. Hauf P., Elsner B., and Aschersleben G. The role of action effects in infants' action control. Psychological Research 68 (2004) 115-125
18. Johansson G. Visual perception of biological motion and a model for its analysis. Perception and Psychophysics 14 (1973) 201-211
19. Kawato M. Internal models for motor control and trajectory planning. Current Opinion in Neurobiology 9 (1999) 718-727
20. Kopinska A., and Harris L. Simultaneity constancy. Perception 33 (2004) 1049-1060
21. King A.J. Multisensory integration: Strategies for synchronization. Current Biology 15 (2005) 339-341
22. Kohler E., Keysers C., Umilta' M.A., Fogassi L., Gallese V., and Rizzolatti G. Hearing sounds, understanding actions: Action representation in mirror neurons. Science 297 (2002) 846-848
23. Lewkowicz D.J. Learning and discrimination of audiovisual events in human infants: The hierarchical relation between intersensory temporal synchrony and rhythmic pattern cues. Developmental Psychology 39 (2003) 795-804
24. McGrath M., and Summerfield Q. Intermodal timing relations and audio-visual speech recognition by normal-hearing adults. The Journal of the Acoustical Society of America 77 (1985) 678-685
25. Miyake Y., Onishi Y., and Pöppel E. Two types of anticipation in synchronization tapping. Acta Neurobiologiae Experimentalis 64 (2004) 415-426
26. Pelli D.G. The VideoToolbox software for visual psychophysics: Transforming numbers into movies. Spatial Vision 10 (1997) 437-442
27. Pollick, F. E., Petrini, K., Russell, M., Rocchesso, D., Waadeland, C.H., Dahl, S., et al. (2007). Effects of musical expertise on perceived audiovisual synchrony. Perception, 36 (ECVP Abstract Supplement).
28. Rizzolatti G., Fogassi L., and Gallese V. Neurophysiological mechanisms underlying the understanding and imitation of action. Nature Reviews Neuroscience 2 (2001) 661-670
29. Saygin A.P., Driver J., and de Sa V.R. In the footsteps of biological motion and multisensory perception: Judgements of audio-visual temporal relations are enhanced for upright walkers. Psychological Science 19 (2008) 469-475
30. Schneider K.A., and Bavelier D. Components of visual prior entry. Cognitive Psychology 47 (2003) 333-366
31. Schutz M., and Lipscomb S. Hearing gestures, seeing music: Vision influences perceived tone duration. Perception 36 (2007) 888-897
32. Schutz, M., & Kubovy, M. (in press). Causality and cross-modal integration. Journal of Experimental Psychology: Human Perception and Performance.
33. Shiffrar M., and Freyd J.J. Apparent motion of the human body. Psychological Science 1 (1990) 257-264
34. Shiffrar M., and Freyd J.J. Timing and apparent motion path choice with human body photographs. Psychological Science 4 (1993) 379
35. Spence C., and Squire S. Multisensory integration: Maintaining the perception of synchrony. Current Biology 13 (2003) 519-521
36. Vatakis A., and Spence C. Audiovisual synchrony perception for speech and music using a temporal order judgment task. Neuroscience Letters 393 (2006) 40-44
37. Vatakis A., and Spence C. Audiovisual synchrony perception for music, speech, and object actions. Brain Research 1111 (2006) 134-142
38. Vatakis A., and Spence C. Crossmodal binding: Evaluating the "unity assumption" using audiovisual speech stimuli. Perception and Psychophysics 69 (2007) 744-756
39. Vatakis A., and Spence C. Evaluating the influence of the 'unity assumption' on the temporal perception of realistic audiovisual stimuli. Acta Psychologica 127 (2008) 12-23
40. Vatakis A., Navarra J., Soto-Faraco S., and Spence C. Audiovisual temporal adaptation of speech: Temporal order versus simultaneity judgments. Experimental Brain Research 185 (2008) 521-529
41. Waadeland C.H. Strategies in empirical studies of swing groove. Studia Musicologica Norvegica 32 (2006) 169-191
42. Watson, A. B., & Hu, J. (1999). ShowTime: A QuickTime-based infrastructure for vision research displays. Perception, 28 (ECVP Abstract Supplement, 45b).
43. Wolpert D.M., Ghahramani Z., and Jordan M.I. An internal model for sensorimotor integration. Science 269 (1995) 1880-1882
44. Wolpert D.M., and Flanagan J.R. Motor prediction. Current Biology 11 (2001) R729-732