Superior temporal activation in response to dynamic audio-visual emotional cues

Brain and Cognition

Volumn 69, Issue 2, 2009, Pages 269-278

  Robins, Diana L ^a   Hunyadi, Elinora ^b   Schultz, Robert T ^b  

^a GEORGIA STATE UNIVERSITY   (United States)

^b CHILDREN S HOSPITAL OF PHILADELPHIA   (United States)

Author keywords

Audio visual integration; Cross modal; Emotion; Face perception; fMRI; Prosody

Indexed keywords

ADULT; AMYGDALOID NUCLEUS; ARTICLE; AUDITORY STIMULATION; ELECTROENCEPHALOGRAM; EMOTION; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; PERCEPTIVE DISCRIMINATION; PRIORITY JOURNAL; TEMPORAL CORTEX; VISUAL STIMULATION;

ACOUSTIC STIMULATION; ADOLESCENT; ADULT; AUDITORY PERCEPTION; CUES; EMOTIONS; FEMALE; HUMANS; MAGNETIC RESONANCE IMAGING; MALE; PHOTIC STIMULATION; SOCIAL PERCEPTION; SPEECH PERCEPTION; TEMPORAL LOBE; VISUAL PERCEPTION; YOUNG ADULT;

EID: 59349093820     PISSN: 02782626     EISSN: 10902147     Source Type: Journal    
DOI: 10.1016/j.bandc.2008.08.007     Document Type: Article

References (61)

1. Abdi Z., and Sharma T. Social cognition and its neural correlates in schizophrenia and autism. Cns Spectrums 9 5 (2004) 335-343
2. Adolphs R., Sears L., and Piven J. Abnormal processing of social information from faces in autism. Journal of Cognitive Neuroscience 13 2 (2001) 232-240
3. Beauchamp M.S., Lee K.E., Argall B.D., and Martin A. Integration of auditory and visual information about objects in superior temporal sulcus. Neuron 41 5 (2004) 809-823
4. Boucher J., Lewis V., and Collis G. Voice processing abilities in children with autism, children with specific language impairments, and young typically developing children. Journal of Child Psychology and Psychiatry and Allied Disciplines 41 7 (2000) 847-857
5. Buchanan T.W., Lutz K., Mizazade S., Specht K., Shah N.J., Zilles K., et al. Recognition of emotional prosody of verbal components of spoken language: An fMRI study. Cognitive Brain Research 9 (2000) 227-238
6. Buchel C., Morris J., Dolan R.J., and Friston K.J. Brain systems mediating aversive conditioning: An event-related fMRI study. Neuron 20 5 (1998) 947-957
7. Bushara K.O., Hanakawa T., Immisch I., Toma K., Kansaku K., and Hallett M. Neural correlates of cross-modal binding. Nature Neuroscience 6 2 (2003) 190-195
8. Calvert G.A., and Campbell R. Reading speech from still and moving faces: The neural substrates of visible speech. Journal of Cognitive Neuroscience 15 1 (2003) 57-70
9. Calvert G.A., Campbell R., and Brammer M.J. Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex. Current Biology 10 11 (2000) 649-657
10. Calvert G.A., Brammer M.J., and Iversen S.D. Crossmodal identification. Trends in Cognitive Sciences 2 7 (1998) 247-253
11. Calvert G.A., and Thesen T. Multisensory integration: Methodological approaches and emerging principles in the human brain. Journal of Physiology-Paris 98 1-3 (2004) 191-205
12. Celani G., Battacchi M.W., and Arcidiacono L. The understanding of the emotional meaning of facial expressions in people with autism. Journal of Autism and Developmental Disorders 29 1 (1999) 57-66
13. Cohen J.D., MacWhinney B., Flatt M., and Provost J. PsyScope: A new graphic interactive environment for designing psychology experiments. Behavioral Research Methods, Instruments, and Computers 25 2 (1993) 257-271
14. de Gelder B., and Bertelson P. Multisensory integration, perception and ecological validity. Trends in Cognitive Sciences 7 10 (2003) 460-467
15. de Gelder B., and Vroomen J. The perception of emotions by ear and by eye. Cognition and Emotion 14 3 (2000) 289-311
16. Dolan R.J., Morris J.S., and de Gelder B. Crossmodal binding of fear in voice and face. Proceedings of the National Academy of Sciences of the United States of America 98 17 (2001) 10006-10010
17. Edwards J., Jackson H., and Pattison P. Emotion recognition via facial expression and affective prosody in schizophrenia: A methodological review. Clinical Psychology Review 22 6 (2002) 789-832
18. Ethofer T., Anders S., Erb M., Droll C., Royen L., Saur R., et al. Impact of voice on emotional judgment of faces: An event-related fMRI study. Human Brain Mapping 27 9 (2006) 707-714
19. Ethofer T., Pourtois G., and Wildgruber D. Investigating audiovisual integration of emotional signals in the human brain. Progress in Brain Research 156 (2006) 345-361
20. Frost R., Repp B.H., and Katz L. Can speech perception be influenced by simultaneous presentation of print?. Journal of Memory and Language 27 6 (1989) 741-755
21. Fujiki M., Spackman M., Brinton B., and Illig T. Ability of children with language impairment to understand emotion conveyed by prosody in a narrative passage. International Journal of Language and Communication Disorders 43 3 (2008) 330-345
22. Gepner B., Deruelle C., and Grynfeltt S. Motion and emotion: A novel approach to the study of face processing by young autistic children. Journal of Autism and Developmental Disorders 31 1 (2001) 37-45
23. Glaescher J., Tuescher O., Weiller C., and Buechel C. Elevated responses to constant facial emotions in different faces in the human amygdala: An fMRI study of facial identity and expression. BMC Neuroscience 5 November 17 (2004)
24. Goebel R. Brain Voyager 2000 (2000), Brain Innovation, Maastricht, The Netherlands
25. Goebel R. Brain Voyager QX (2000), Brain Innovation, Maastricht, The Netherlands
26. Gur R.C., Schroeder L., Turner T., McGrath C., Chan R.M., Turetsky B.I., et al. Brain activation during facial emotion processing. Neuroimage 16 3 (2002) 651-662
27. Hariri A.R., Bookheimer S.Y., and Mazziotta J.C. Modulating emotional responses: Effects of a neocortical network on the limbic system. Neuroreport 11 1 (2000) 43-48
28. Harwood N.K., Hall L.J., and Shinkfield A.J. Recognition of facial emotional expressions from moving and static displays by individuals with mental retardation. American Journal on Mental Retardation 104 3 (1999) 270-278
29. Haviland J.M., Walker-Andrews A.S., Huffman L.R., Toci L., and Alton K. Intermodal perception of emotional expressions by children with autism. Journal of Developmental and Physical Disabilities 8 1 (1996) 77-88
30. Hobson R.P., Ouston J., and Lee A. Emotion recognition in autism-Coordinating faces and voices. Psychological Medicine 18 4 (1988) 911-923
31. Hofer A., Siedentopf C., and Ischebeck A.e.a. Sex differences in brain activation patterns during processing of positively and negatively valenced emotional words. Psychological Medicine 37 1 (2007) 109-119
32. Iidaka T., Omori M., Murata T., Kosaka H., Yonekura Y., Okada T., et al. Neural interaction of the amygdala with the prefrontal and temporal cortices in the processing of facial expressions as revealed by fMRI. Journal of Cognitive Neuroscience 13 8 (2001) 1035-1047
33. Jones J.A., and Callan D.E. Brain activity during audiovisual speech perception: An fMR1 study of the McGurk effect. Neuroreport 14 8 (2003) 1129-1133
34. Keightley M.L., Winocur G., Graham S.J., Mayberg H.S., Hevenor S.J., and Grady C.L. An fMRI study investigating cognitive modulation of brain regions associated with emotional processing of visual stimuli. Neuropsychologia 41 5 (2003) 585-596
35. Kesler M.L., Andersen A.H., Smith C.D., Avison M.J., Davis C.E., Kryscio R.J., et al. Neural substrates of facial emotion processing using fMRI. Cognitive Brain Research 11 2 (2001) 213-226
36. Kohler C., and Brennan A. Recognition of facial emotions in schizophrenia. Current Opinion in Psychiatry 17 2 (2004) 81-86
37. Kreifelts B., Ethofer T., Grodd W., Erb M., and Wildgruber D. Audiovisual integration of emotional signals in voice and face: An event-related fMRI study. Neuroimage 37 4 (2007) 1445-1456
38. Laurienti P.J., Perrault T.J., Stanford T.R., Wallace M.T., and Stein B.E. On the use of superadditivity as a metric for characterizing multisensory integration in functional neuroimaging studies. Experimental Brain Research 166 3-4 (2005) 289-297
39. Loveland K.A., Tunalikotoski B., Chen R., Brelsford K.A., Ortegon J., and Pearson D.A. Intermodal perception of affect in persons with autism or down-syndrome. Development and Psychopathology 7 3 (1995) 409-418
40. McGurk H., and MacDonald J.W. Hearing lips and seeing voices. Nature 264 (1976) 746-748
41. Mitchell R.L.C., Elliott R., Barry M., Cruttenden A., and Woodruff P.W.R. The neural response to emotional prosody, as revealed by functional magnetic resonance imaging. Neuropsychologia 41 10 (2003) 1410-1421
42. Nowicki S.J. A test and manual for the Diagnostic Analysis of Nonverbal Accuracy 2 (2004), Emory University
43. Olson I.R., Gatenby J.C., and Gore J.C. A comparison of bound and unbound audio-visual information processing in the human cerebral cortex. Cognitive Brain Research 14 (2002) 129-138
44. Olson I.R., Ploaker A., and Ezzyat Y. The enigmatic temporal pole: A review of findings on social and emotional processing. Brain 130 (2007) 1718-1731
45. Ozonoff S., Pennington B.F., and Rogers S.J. Are there emotion perception deficits in young autistic children?. Journal of Child Psychology and Psychiatry 31 3 (1990) 343-361
46. Peppe S., McCann J., Gibbon F., O'Hare A., and Rutherford M. Receptive and expressive prosodic ability in children with high-functioning autism. Journal of Speech Language and Hearing Research 50 4 (2007) 1015-1028
47. Pourtois G., de Gelder B., Bol A., and Crommelinck M. Perception of facial expressions and voices and of their combination in the human brain. Cortex 41 1 (2005) 49-59
48. Robins, D.L., & Schultz, R.T. (2004). Cross-modal integration of emotional information. Paper presented at the International Neuropsychological Society, February, 2004, Baltimore, MD.
49. Saito D.N., Yoshimura K., Kochiyama T., Okada T., Honda M., and Sadato N. Cross-modal binding and activated attentional networks during audio-visual speech integration: A functional MRI study. Cerebral Cortex 15 11 (2005) 1750-1760
50. Santorelli, N. T., & Robins, D. L. (2006). Perception of emotional cues from facial expression and affective prosody. Paper presented at the International Neuropsychological Society, Boston, MA.
51. Sato W., Kochiyama T., Yoshikawa S., Naito E., and Matsumura M. Enhanced neural activity in response to dynamic facial expressions of emotion: An fMRI study. Cognitive Brain Research 20 1 (2004) 81-91
52. Schultz R.T. Developmental deficits in social perception in autism: The role of the amygdala and fusiform face area. International Journal of Developmental Neuroscience 23 (2005) 125-141
53. Stefanacci L., and Amaral D.G. Some observations on cortical inputs to the macaque monkey amygdala: An anterograde tracing study. Journal of Comparative Neurology 451 4 (2002) 301-323
54. Sumby W.H., and Pollack I. Visual contribution to speech intelligibility in noise. Journal of the Acoustical Society of America 26 (1955) 212-215
55. Tranel D., Damasio A.R., and Damasio H. Intact recognition of facial expression, gender, and age in patients with impaired recognition of facial identity. Neurology 38 (1998) 690-696
56. Travis L., and Sigman M. Social deficits and interpersonal relationships in autism. Mental Retardation and Developmental Disabilities Research Reviews 4 2 (1998) 65-72
57. van Atteveldt N., Formisano E., Goebel R., and Blomert L. Integration of letters and speech sounds in the human brain. Neuron 43 2 (2004) 271-282
58. Wildgruber D., Hertrich I., Riecker A., Erb M., Anders S., Grodd W., et al. Distinct frontal regions subserve evaluation of linguistic and emotional aspects of speech intonation. Cerebral Cortex 14 12 (2004) 1384-1389
59. Wildgruber D., Riecker A., Hertrich I., Erb M., Grodd W., Ethofer T., et al. Identification of emotional intonation evaluated by fMRI. Neuroimage 24 4 (2005) 1233-1241
60. Wright T.M., Pelphrey K.A., Allison T., McKeown M.J., and McCarthy G. Polysensory interactions along lateral temporal regions evoked by audiovisual speech. Cerebral Cortex 13 10 (2003) 1034-1043
61. Yirmiya N., Sigman M., Kasari C., and Mundy P.C. Empathy and cognition in high-functioning children with autism. Child Development 63 1 (1992) 150-160