Audiovisual integration of emotional signals from music improvisation does not depend on temporal correspondence

Brain Research

Volumn 1323, Issue , 2010, Pages 139-148

  Petrini, Karin ^a   McAleer, Phil ^a   Pollick, Frank ^a  

^a UNIVERSITY OF GLASGOW   (United Kingdom)

Author keywords

Audiovisual integration; Emotion; Music; Psychophysics

Indexed keywords

ADULT; ARTICLE; AUDITORY ORIENTATION; EMOTION; FACIAL EXPRESSION; FEMALE; GESTURE; HUMAN; MALE; MOVEMENT (PHYSIOLOGY); MUSIC; PERCEPTION; PRIORITY JOURNAL; SOUND; TEMPORAL LOBE; VISUAL INFORMATION; VISUAL ORIENTATION;

ACOUSTIC STIMULATION; ADULT; ANALYSIS OF VARIANCE; ATTENTION; AUDITORY PERCEPTION; EMOTIONS; FEMALE; HUMANS; MALE; MUSIC; PHOTIC STIMULATION; TIME FACTORS; VISUAL PERCEPTION;

EID: 77953137087     PISSN: 00068993     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.brainres.2010.02.012     Document Type: Article

References (33)

1. Arrighi R., Alais D., and Burr D. Perceptual synchrony of audiovisual streams for natural and artificial motion sequences. J. Vis. 6 (2006) 260-268
2. Behrens G.A., and Green S.B. The ability to identify emotional content of solo improvisations performed vocally and on three different instruments. Psychol. Music 21 (1993) 20-33
3. Bertelson P., and De Gelder B. The psychology of crossmodal attention. In: Spence C., and Driver J. (Eds). Crossmodal Space and Crossmodal Attention (2004), Oxford University Press Inc. 141-177
4. Broughton M., and Stevens C. Music, movement and marimba: an investigation of the role of movement and gesture in communicating musical expression to an audience. Psychol. Music 37 (2009) 137-153
5. Campanella S., and Belin P. Integrating face and voice in person perception. Trends Cogn. Sci. 11 (2007) 535-543
6. Castellano G., Mortillaro M., Camurri A., Volpe G., and Scherer K. Automated analysis of body movement in emotionally expressive piano performances. Music Percept. 26 (2008) 103-119
7. Collignon O., Girard S., Gosselin F., Roy S., Saint-Amour D., Lassonde M., and Lepore F. Audio-visual integration of emotion expression. Brain Res. 1242 (2008) 126-135
8. Dahl S., and Friberg A. Visual perception of expressiveness in musicians' body movements. Music Percept. 24 (2007) 433-454
9. Davidson J.W. Visual perception of performance manner in the movements of solo musicians. Psychol. Music 21 (1993) 103-113
10. Davidson J.W. Which areas of a pianist's body convey information about expressive intention to an audience?. J. Hum. Mov. Stud. 26 (1994) 279-301
11. De Gelder B., and Vroomen J. The perception of emotions by ear and by eye. Cogn. Emot. 14 (2000) 289-311
12. Ekman P., and Friesen W.V. Unmasking the Face (1975), Englewood Cliffs, NJ, Prentice-Hall
13. Ernst M.O., and Banks M.S. Humans integrate visual and haptic information in a statistically optimal fashion. Nature 415 (2002) 429-433
14. Ernst M.O., and Bülthoff H.H. Merging the senses into a robust percept. Trends Cogn. Sci. 8 (2004) 162-169
15. Hietanen J.K., Leppänen J.M., and Illi M. Evidence for the integration of audiovisual emotional information at the perceptual level of processing. Eur. J. Cogn. Psychol. 16 (2008) 769-790
16. Juslin P.N., and Laukka P. Communication of emotions in vocal expression and music performance: different channels, same code?. Psychol. Bull. 129 (2003) 770-814
17. Juslin P., and Sloboda J.A. Music and Emotion: Theory and Research (2001), Oxford Univ. Press, Oxford
18. Kreifelts B., Ethofer T., Grodd W., Erb M., and Wildgruber D. Audiovisual integration of emotional signals in voice and face: an event-related fMRI study. NeuroImage 37 (2007) 1445-1456
19. Landy M.S., Maloney L.T., Johnston E.B., and Young M. Measurement and modeling of depth cue combination: in defense of weak fusion. Vis. Res. 35 (1995) 389-412
20. Laukka P., and Gabrielsson A. Emotional expression in drumming performance. Psychol. Music 28 (2000) 181-189
21. Massaro D.W., and Egan P.B. Perceiving affect from the voice and the face. Psychon. Bull. Rev. 3 (1996) 215-221
22. McGurk H., and MacDonald J. Hearing lips and seeing voices. Nature 264 (1976) 746-748
23. Petrini K., Dahl S., Rocchesso D., Waadeland C.H., Avanzini F., Pollick F., and Puce A. Multisensory integration of drumming actions: musical expertise affects perceived audiovisual asynchrony. Exp. Brain Res. 198 (2009) 339-352
24. Petrini K., Russell M., and Pollick F. When knowing can replace seeing in audiovisual integration of actions. Cognition 110 (2009) 432-439
25. Scherer K.R. Expression of emotion in voice and music. J. Voice 9 (1995) 235-248
26. Schutz M., and Kubovy M. The effect of tone envelope on sensory integration: support for the 'unity assumption'. J. Acoust. Soc. Am. 123 (2008) 3412
27. Stein, B.E., Meredith, M.A., 1993. The Merging of the Senses. MIT, Cambridge (MA).
28. Thompson W.F., Russo F.A., and Quinto L. Audio-visual integration of emotional cues in song. Cogn. Emot. 22 (2008) 1457-1470
29. Vatakis A., and Spence C. Audiovisual synchrony perception for speech and music using a temporal order judgment task. Neurosci. Lett. 393 (2006) 40-44
30. Vatakis A., and Spence C. Audiovisual synchrony perception for music, speech, and object actions. Brain Res. 1111 (2006) 134-142
31. Vatakis A., and Spence C. Crossmodal binding: evaluating the "unity assumption" using audiovisual speech stimuli. Percept. Psychophys. 69 (2007) 744-756
32. Vatakis A., and Spence C. Evaluating the influence of the 'unity assumption' on the temporal perception of realistic audiovisual stimuli. Acta Psychol. 127 (2008) 2-23
33. Vines B.W., Krumhansl C.L., Wanderley M.M., and Levitin D.J. Cross-modal interactions in the perception of musical performance. Cognition 101 (2006) 80-113