Can you McGurk yourself? Self-face and self-voice in audiovisual speech

Psychonomic Bulletin and Review

Volumn 19, Issue 1, 2012, Pages 66-72

  Aruffo, Christopher ^a,b   Shore, David I ^a  

^a MCMASTER UNIVERSITY   (Canada)

^b and Behaviour ^*  (Canada)

Author keywords

Face perception and recognition; Psycholinguistics; Self speech; Speech perception

Indexed keywords

EID: 84856200823     PISSN: 10699384     EISSN: 15315320     Source Type: Journal    
DOI: 10.3758/s13423-011-0176-8     Document Type: Article

References (28)

1. Beauchemin, M., De Beaumont, L., Vannasing, P., Turcotte, A., Arcand, C., Belin, P., et al. (2006). Electrophysiological markers of voice familiarity. European Journal of Neuroscience, 23, 3081-3086. doi: 10. 1111/j. 1460-9568. 2006. 04856. x.
2. Brancazio, L. (2004). Lexical influences in audiovisual speech perception. Journal of Experimental Psychology: Human Perception and Performance, 30, 445-463. doi: 10. 1037/0096-1523. 30. 3. 445.
3. Bruce, V., & Young, A. (1986). Understanding face recognition. British Journal of Psychology, 77, 305-327.
4. Campbell, R., Landis, T., & Regard, M. (1986). Face recognition and lipreading. Brain, 109, 509-521. doi: 10. 1093/brain/109. 3. 509.
5. Colin, C., Radeau, M., & Deltenre, P. (2005). Top-down and bottom-up modulation of audiovisual integration in speech. European Journal of Cognitive Psychology, 17, 541-560. doi: 10. 1080/09541440440000168.
6. Diesch, E. (1995). Left and right hemifield advantages of fusions and combinations in audiovisual speech perception. Quarterly Journal of Experimental Psychology, 48A, 320-333.
7. Ernst, M., & Banks, M. (2002). Humans integrate visual and haptic information in a statistically optimal fashion. Nature, 415, 429-433. doi: 10. 1038/415429a.
8. Green, K., Kuhl, P., Meltzoff, A., & Stevens, E. (1991). Integrating speech information across talkers, sex, and sensory modality: Female faces and male voices in the McGurk effect. Perception & Psychophysics, 50, 524-536.
9. Hughes, S., & Nicholson, S. (2010). The processing of auditory and visual recognition of self-stimuli. Consciousness and Cognition, 19, 1124-1134. doi: 10. 1016/j. concog. 2010. 03. 001.
10. Kaplan, J., Aziz-Zadeh, L., Uddin, L., & Iacoboni, M. (2008). The self across the senses: An fMRI study of self-face and self-voice recognition. Social Cognitive and Affective Neuroscience, 3, 218-223. doi: 10. 1093/scan/nsn014.
11. Keyes, H., & Brady, N. (2010). Self-face recognition is characterized by "bilateral gain" and by faster, more accurate performance which persists when faces are inverted. Quarterly Journal of Experimental Psychology, 63, 840-847.
12. Keyes, H., Brady, N., Reilly, R., & Foxe, J. (2009). My face or yours? Event-related potential correlates of self-face processing. Brain and Cognition, 72, 244-254. doi: 10. 1016/j. bandc. 2009. 09. 006.
13. Knappmeyer, B., Thornton, I., & Bülthoff, H. (2003). The use of facial motion and facial form during the processing of identity. Vision Research, 43, 1921-1936. doi: 10. 1016/S0042-6989(03)00236-0.
14. Lander, K., & Davies, R. (2008). Does face familiarity influence speechreadability? Quarterly Journal of Experimental Psychology, 61, 961-967. doi: 10. 1080/17470210801908476.
15. MacDonald, J., & McGurk, H. (1978). Visual influences on speech perception processes. Perception & Psychophysics, 24, 253-257.
16. Massaro, D., & Cohen, M. (1990). Perception of synthesized audible and visible speech. Psychological Science, 1, 55-63. doi: 10. 1111/j. 1467-9280. 1990. tb00068. x.
17. McGurk, H., & MacDonald, J. (1976). Hearing lips and seeing voices. Nature, 264, 746-748. doi: 10. 1038/264746a0.
18. Mullennix, J., Pisoni, D., & Martin, C. (1989). Some effects of talker variability on spoken word recognition. Journal of the Acoustical Society of America, 85, 365-378. doi: 10. 1121/1. 397688.
19. Nakamura, K., Kawashima, R., Sugiura, M., Kato, T., Nakamura, A., Hatano, K., et al. (2001). Neural substrates for recognition of familiar voices: A PET study. Neuropsychologia, 39, 1047-1054.
20. Nygaard, L., & Pisoni, D. (1998). Talker-specific learning in speech perception. Perception & Psychophysics, 60, 355-376.
21. Relander, K., & Rämä, P. (2009). Separate neural processes for retrieval of voice identity and word content in working memory. Brain Research, 1252, 143-151. doi: 10. 1016/j. brainres. 2008. 11. 050.
22. Rosa, C., Lassonde, M., Pinard, C., Keenan, J., & Belin, P. (2008). Investigations of hemispheric specialization of self-voice recognition. Brain and Cognition, 68, 204-214. doi: 10. 1016/j. bandc. 2008. 04. 007.
23. Rosenblum, L., & Yakel, D. (2001). The McGurk effect from single and mixed speaker stimuli. Acoustics Research Letters Online, 2, 67-72. doi: 10. 1121/1. 1366356.
24. Sheffert, S., Pisoni, D., Fellowes, J., & Remez, R. (2002). Learning to recognize talkers from natural, sinewave, and reversed speech samples. Journal of Experimental Psychology: Human Perception and Performance, 28, 1447-1469. doi: 10. 1037//0096-1523. 28. 6. 1447.
25. van Wassenhove, V., Grant, K., & Poeppel, D. (2005). Visual speech speeds up the neural processing of auditory speech. Proceedings of the National Academy of Sciences of the United States of America, 102, 1181-1186. doi: 10. 1073/pnas. 0408949102.
26. von Kriegstein, K., Dogan, Ö., Grüter, M., Giraud, A., Kell, C., Grüter, T., et al. (2008). Simulation of talking faces in the human brain improves auditory speech recognition. Proceedings of the National Academy of Sciences, 105, 6747-6752.
27. Walker, S., Bruce, V., & O'Malley, C. (1995). Facial identity and facial speech processing: Familiar faces and voices in the McGurk effect. Perception & Psychophysics, 57, 1124-1133.
28. Yakel, D., Rosenblum, L., & Fortier, M. (2000). Effects of talker variability on speechreading. Perception & Psychophysics, 62, 1405-1412.