Multisensory integration of drumming actions: Musical expertise affects perceived audiovisual asynchrony

Experimental Brain Research

Volumn 198, Issue 2-3, 2009, Pages 339-352

  Petrini, Karin ^a   Dahl, Sofia ^b   Rocchesso, Davide ^c   Waadeland, Carl Haakon ^d   Avanzini, Federico ^e   Puce, Aina ^f   Pollick, Frank E ^a  

^a UNIVERSITY OF GLASGOW   (United Kingdom)

^b AALBORG UNIVERSITY   (Denmark)

^c UNIVERSITY IUAV OF VENICE   (Italy)

^d NORWEGIAN UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Norway)

^e UNIVERSITY OF PADOVA   (Italy)

^f INDIANA UNIVERSITY   (United States)

Author keywords

Audiovisual congruency; Audiovisual integration; Drumming actions; Musical expertise; Synchrony perception

Indexed keywords

ADULT; ARTICLE; AUDIOVISUAL EQUIPMENT; BRAIN FUNCTION; CONTROLLED STUDY; DRUMMING; EXPERIMENTAL STUDY; FORCED CHOICE METHOD; HUMAN; HUMAN EXPERIMENT; INTEGRATION; MALE; MUSIC; NORMAL HUMAN; PRIORITY JOURNAL; PROFESSIONAL PRACTICE; SENSORY STIMULATION; SENSORY SYSTEM; STIMULUS;

ACOUSTIC STIMULATION; ADULT; ANALYSIS OF VARIANCE; AUDITORY PERCEPTION; EDUCATIONAL STATUS; HUMANS; JUDGMENT; LINEAR MODELS; MALE; MOTION PERCEPTION; MUSIC; NORMAL DISTRIBUTION; PHOTIC STIMULATION; PSYCHOPHYSICS; SIGNAL DETECTION, PSYCHOLOGICAL; SOUND SPECTROGRAPHY; TIME FACTORS; VIDEO RECORDING; YOUNG ADULT;

EID: 69549133531     PISSN: 00144819     EISSN: None     Source Type: Journal    
DOI: 10.1007/s00221-009-1817-2     Document Type: Article

References (64)

1. Arai T, Greenberg S (1997). The temporal properties of spoken Japanese are similar to those of English. In: Proceedings of Eurospeech, Rhodes, Greece, pp 1011-1014
2. R Arrighi D Alais D Burr 2006 Perceptual synchrony of audiovisual streams for natural and artificial motion sequences J Vision 6 260 268
3. SL Bengtsson Z Nagy S Skare L Forsman H Forssberg F Ullén 2005 Extensive piano practicing has regionally specific effects on white matter development Nature Neurosci 8 1148 1150
4. P Bermudez RJ Zatorre 2005 Differences in gray matter between musicians and nonmusicians Ann N Y Acad Sci 1060 395 399
5. DH Brainard 1997 The psychophysics toolbox Spatial Vision 10 433 436
6. A Brooks R van der Zwan A Billard B Petreska S Clarke O Blanke 2007 Auditory motion affects visual biological motion processing Neuropsychologia 45 523 530
7. CWG Clifford DH Arnold J Pearson 2003 A paradox of temporal perception revealed by a stimulus oscillating in colour and orientation Vision Res 43 2245 2253 (Pubitemid 37288954)
8. CE Collyer HA Broadbent RM Church 1994 Preferred rates of repetitive tapping and categorical time production Percept Psychophys 55 443 453
9. S Dahl 2004 Playing the accent-comparing striking velocity and timing in an ostinato rhythm performed by four drummers Acta Acustica United Acustica 90 762 776
10. NF Dixon L Spitz 1980 The detection of auditory visual desynchrony Perception 9 719 721
11. C Drake MC Botte 1993 Tempo sensitivity in auditory sequences: evidence for a multiple-look model Percept Psychophys 54 277 286
12. C Drake MR Jones C Baruch 2000 The development of rhythmic attending in auditory sequences: attunement, referent period, focal attending Cognition 77 251 288
13. Fain GL (2003) Sensory transduction. Sinauer Associates, Sunderland, MA
14. Fontana F, Rocchesso D, Avanzini F (2004) Computation of nonlinear filter networks containing delay-free paths. In Proceedings of the 7th international conference on digital audio effects (DAFX-04), Naples, Italy, pp 113-118
15. A Friberg J Sundberg 1995 Time discrimination in a monotonic, isochronous sequence J Acoust Soc Am 98 2524 2531
16. W Fujisaki S Nishida 2005 Temporal frequency characteristics of synchrony-asynchrony discrimination of audio-visual signals Exp Brain Res 166 455 464
17. C Gaser G Schlaug 2003 Brain structures differ between musicians and non-musicians J Neurosci 23 9240 9245
18. Grant KW, Greenberg S (2001) Speech intelligibility derived from asynchronous processing of auditory-visual speech information. In: Proceedings of AVSP 2001 international conference of auditory-visual speech processing, Scheelsminde, Denmark, pp 132-137
19. KW Grant V van Wassenhove D Poeppel 2004 Detection of auditory (cross-spectral) and auditory-visual (cross-modal) synchrony J Acoust Soc Am 108 1197 1208
20. DA Hodges WD Hairston JH Burdette 2005 Aspects of multisensory perception: the integration of visual and auditory information in musical experiences Ann N Y Acad Sci 1060 175 185
21. Hollier MP, Rimell AN (1998) An experimental investigation into multi-modal synchronisation sensitivity for perceptual model development. 105th AES Convention Preprint No. 4790
22. G Johansson 1973 Visual perception of biological motion and model for its analysis Percept Psychophys 14 201 211
23. MR Jones 1987 Dynamic pattern structure in music: recent theory and research Percept Psychophys 41 621 634
24. BA Kay JAS Kelso EL Saltzman G Schöner 1987 Space-time behavior of single and bimanual rhythmical movements: data and limit cycle model J Exp Psychol: Human Percept Perform 13 178 192
25. AJ King 2005 Multisensory integration: strategies for synchronization Curr Biol 15 R339 R341
26. AJ King AR Palmer 1985 Integration of visual and auditory information in bimodal neurones in the guinea-pig superior colliculus Exp Brain Res 60 492 500
27. G Luck S Nte 2008 An investigation of conductors' temporal gestures and conductor- musician synchronization, and a first experiment Psychol Music 36 81 99
28. G Luck JA Sloboda 2007 An investigation of musicians' synchronization with traditional conducting beat patterns Music Perform Res 1 26 46
29. J MacDonald H McGurk 1978 Visual influences on speech perception processes Percept Psychophys 24 253 257
30. HG MacDougall ST Moore 2005 Marching to the beat of the same drummer: the spontaneous tempo of human locomotion J Appl Physiol 99 1164 1173
31. DW Massaro MM Cohen PM Smeele 1996 Perception of asynchronous and conflicting visual and auditory speech J Acoust Soc Am 100 1777 1786
32. H McGurk J MacDonald 1976 Hearing lips and seeing voices Nature 264 746 748
33. N Miner T Caudell 1998 Computational requirements and synchronization issues for virtual acoustic displays Presence-Teleoperat Virtual Environ 7 4 396 409
34. Moelants D (2002) Preferred tempo reconsidered. In: Proceedings of the 7th international conference on music perception and cognition, Sydney, 2002, Stevens C, Burnham D, McPherson G, Schubert E, Renwick J (eds). Causal productions, Adelaide, pp 580-583
35. KG Munhall P Gribble L Sacco M Ward 1996 Temporal constraints on the McGurk effect Percept Psychophys 58 351 362
36. M Murray AB Drought RC Kory 1964 Walking patterns of normal men J Bone Joint Surgery 46 335 360
37. J Navarra A Vatakis M Zampini S Soto-Faraco W Humphreys C Spence 2005 Exposure to asynchronous audiovisual speech extends the temporal window for audiovisual integration Cognitive Brain Res 25 2 499 507
38. C Palmer CL Krumhansl 1990 Mental representations for musical meter J Exp Psychol Hum Percept Perform 16 728 741
39. DG Pelli 1997 The VideoToolbox software for visual psychophysics: transforming numbers into movies Spatial Vision 10 437 442
40. K Petrini M Russell F Pollick 2009 When knowing can replace seeing in audiovisual integration of actions Cognition 110 432 439
41. AP Saygin J Driver VR de Sa 2008 In the footsteps of biological motion and multisensory perception: judgements of audio-visual temporal relations are enhanced for upright walkers Psychol Sci 19 469 475
42. M Schutz M Kubovy 2008 The effect of tone envelope on sensory integration: support for the 'unity assumption' J Acoust Soc Am 123 3412
43. M Schutz S Lipscomb 2007 Hearing gestures, seeing music: vision influences perceived tone duration Perception 36 888 897
44. C Spence S Squire 2003 Multisensory integration: maintaining the perception of synchrony Curr Biol 13 519 521
45. C Spence M Walton 2005 On the inability to ignore touch when responding to vision in the crossmodal congruency task Acta Psychol 118 47 70
46. C Spence DI Shore RM Klein 2001 Multisensory prior entry J Exp Psychol: Gen 130 799 832
47. R Steinmetz 1996 Human perception of jitter and media synchronization IEEE 14 61 72
48. JV Stone NM Hunkin J Porrill R Wood V Keeler M Beanland M Port NR Porter 2001 When is now? Perception of simultaneity Proc R Soc, B 268 31 38
49. Y Sugita Y Suzuki 2003 Audiovisual perception: implicit estimation of sound-arrival time Nature 421 911
50. V van Wassenhove KW Grant D Poeppel 2007 Temporal window of integration in auditory-visual speech perception Neuropsychologia 45 598 607
51. A Vatakis C Spence 2006 Audiovisual synchrony perception for speech and music using a temporal order judgment task Neurosci Lett 393 40 44
52. A Vatakis C Spence 2006 Audiovisual synchrony perception for music, speech, and object actions Brain Res 1111 134 142
53. A Vatakis C Spence 2007 Crossmodal binding: evaluating the "unity assumption" using audiovisual speech stimuli Percept Psychophys 69 744 756
54. A Vatakis C Spence 2008 Evaluating the influence of the 'unity assumption' on the temporal perception of realistic audiovisual stimuli Acta Psychol 127 12 23
55. A Vatakis J Navarra S Soto-Faraco C Spence 2007 Audiovisual temporal adaptation of speech: temporal order versus simultaneity judgments Exp Brain Res 185 521 529
56. A Vatakis J Navarra S Soto-Faraco C Spence 2007 Temporal recalibration during asynchronous audiovisual speech perception Exp Brain Res 181 173 181
57. A Vatakis AA Ghazanfar C Spence 2008 Facilitation of multisensory integration by the "unity effect" reveals that speech is special J Vision 8 1 11
58. J Vroomen M Keetels B de Gelder P Bertelson 2004 Recalibration of temporal order perception by exposure to audio-visual asynchrony Cognitive Brain Res 22 32 35
59. Waadeland CH (2003) Analysis of jazz drummers' movements in performance of swing grooves-a preliminary report. In: Bresin R (ed) Proceedings of Stockholm music acoustic conference, volume II, Stockholm, pp 573-576
60. CH Waadeland 2006 Strategies in empirical studies of swing groove Studia Musicol Norvegica 32 169 191
61. Wagner A (2006) Analysis of drumbeats-interaction between Drummer, Drumstick and Instrument. Master's Thesis at the Department of Speech, Music and Hearing (TMH)
62. Watson AB, Hu J (1999) ShowTime: a QuickTime-based infrastructure for vision research displays. Perception 28 ECVP Abstract Supplement, 45b
63. M Zampini DI Shore C Spence 2003 Audiovisual temporal order judgments Exp Brain Res 152 198 210
64. F Zhou V Wong R Sekuler 2007 Multi-sensory integration of spatio-temporal segmentation cues: one plus one does not always equal two Exp Brain Res 180 641 654