Dissociating task difficulty from incongruence in face-voice emotion integration

Frontiers in Human Neuroscience

Volumn , Issue NOV, 2013, Pages

  Watson, Rebecca ^a,b   Latinus, Marianne ^b,c   Noguchi, Takao ^b,d   Garrod, Oliver ^b   Crabbe, Frances ^b   Belin, Pascal ^b,c,e  

^a MAASTRICHT UNIVERSITY   (Netherlands)

^b UNIVERSITY OF GLASGOW   (United Kingdom)

^c AIX MARSEILLE UNIVERSITÉ   (France)

^d UNIVERSITY OF WARWICK   (United Kingdom)

^e UNIVERSITÉ DE MONTRÉAL   (Canada)

Author keywords

Affective conflict; Emotion perception; Functional magnetic resonance adaptation; Incongruence; Multisensory integration

Indexed keywords

ADAPTATION; ADULT; ANGER; ARTICLE; BOLD SIGNAL; CORRELATION ANALYSIS; EMOTIONALITY; EVOKED RESPONSE; FACE; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; FUNCTIONAL NEUROIMAGING; HAPPINESS; HUMAN; HUMAN EXPERIMENT; IMAGE ANALYSIS; IMAGE PROCESSING; LANGUAGE PROCESSING; MALE; NERVE CELL NETWORK; NEUROPHYSIOLOGY; NORMAL HUMAN; REACTION TIME; SENSORIMOTOR INTEGRATION; VIDEORECORDING; VOICE;

EID: 84888105447     PISSN: 16625161     EISSN: None     Source Type: Journal    
DOI: 10.3389/fnhum.2013.00744     Document Type: Article

References (49)

1. Aguirre, G. K. (2007). Continuous carry-over designs for fMRI. Neuroimage 35, 1480-1494. doi: 10.1016/j.neuroimage.2007.02.005
2. Bänziger, T., Grandjean, D., and Scherer, K. R. (2009). Emotion recognition from expressions in face, voice, and body: the multimodal emotion recognition test (MERT). Emotion 9, 691-704. doi: 10.1037/a0017088
3. Beauchamp, M. S. (2005). Statistical criteria in FMRI studies of multisensory integration. Neuroinformatics 3, 93-113. doi: 10.1385/NI:3:2:093
4. Besl, P. J., and McKay, N. D. (1992). A method for registration of 3-D shapes. IEEE Trans. Pattern Anal. Mach. Intell. 14, 239-255. doi: 10.1109/34.121791
5. Bolles, R. C., and Fischler, M. A. (1981). "A RANSAC-based approach to model fitting and its application to finding cylinders in range data, " in Proceedings of the 7th International Joint Conference on Artificial Intelligence (IJCAI), (Vancouver, BC), 637-643.
6. Botvinick, M., Cohen, J. D., and Carter, C. S. (2004). Conflict monitoring and anterior cingulate cortex: an update. Trends Cogn. Sci. 8, 539-546. doi: 10.1016/j.tics.2004.10.003
7. Calvert, G. A., Campbell, R., and Brammer, M. J. (2000). Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex. Curr. Biol. 10, 649-657. doi: 10.1016/S0960-9822(00)00513-3
8. Campanella, S., and Belin, P. (2007). Integrating face and voice in person perception. Trends Cogn. Sci. 11, 535-543. doi: 10.1016/j.tics.2007.10.001
9. Carter, C. S., Botvinick, M. M., and Cohen, J. D. (1999). The contribution of anterior cingulate cortex to executive processes in cognition. Rev. Neurosci. 10, 49-57. doi: 10.1515/REVNEURO.1999.10.1.49
10. Carter, C. S., Braver, T. S., Barch, D. M., Botvinick, M. M., Noll, D., and Cohen, J. D. (1998). Anterior cingulate cortex, error detection, and the online monitoring of performance. Science280, 747-749. doi: 10.1126/science.280.5364.747
11. Carter, C. S., and van Veen, V. (2007). Anterior cingulate and conflict detection An update of theory and data. Cogn. Affect. Behav. Neurosci. 7, 367-379. doi: 10.3758/CABN.7.4.367
12. Collignon, O., Girard, S., Gosselin, F., Roy, S., Saint-Amour, D., Lassonde, M., and Lepore, F. (2008). Audio-visual integration of emotion expression. Brain Res. 25, 126-135. doi: 10.1016/j.brainres.2008.04.023
13. de Gelder, B., and Vroomen, J. (2000). The perception of emotions by ear and by eye. Cogn. Emotion 14, 289-311. doi: 10.1080/026999300378824
14. Deneve, S., and Pouget, A. (2004). Bayesian multisensory integration and cross-modal spatial links. J. Physiol. 98, 249-258. doi: 10.1016/j.jphysparis.2004.03.011
15. Dolan, R. J., Morris, J. S., and de Gelder, B. (2001). Crossmodal binding of fear in voice and face. Proc. Natl. Acad. Sci. U.S.A. 98, 10006-10010. doi: 10.1073/pnas.171288598
16. Durston, S., Davidson, M. C., Thomas, K. M., Worden, M. S., Tottenham, N., Martinez, A., et al. (2003). Parametric manipulation of conflict and response competition using rapid mixed-trial event-related fMRI. Neuroimage 20, 2135-2141. doi: 10.1016/j.neuroimage.2003.08.004
17. Ernst, M. O., and Bulthoff, H. H. (2004). Merging the senses into a robust percept. Trends Cogn. Sci. 8, 162-169. doi: 10.1016/j.tics.2004.02.002
18. Ethofer, T., Pourtois, G., and Wildgruber, D. (2006a). Investigating audiovisual integration of emotional signals in the human brain. Prog. Brain Res. 156, 345-361. doi: 10.1016/S0079-6123(06)56019-4
19. Ethofer, T., Anders, S., Erb, M., Droll, C., Royen, L., Saur, R., et al. (2006b). Impact of voice on emotional judgment of faces: an event-related fMRI study. Hum. Brain Mapp. 27, 707-714. doi: 10.1002/hbm.20212
20. Grefkes, C., Eickhoff, S. B., Nowak, D. A., Dafotakis, M., and Fink, G. R. (2008). Dynamic intraand interhemispheric interactions during unilateral and bilateral hand movements assessed with fMRI and DCM. Neuroimage 41, 1382-1394. doi: 10.1016/j.neuroimage.2008.03.048
21. Haas, B. W., Omura, K., Constable, R. T., and Canli, T. (2006) Interference produced by emotional conflict associated with anterior cingulate activation. Cogn. Affect. Behav. Neurosci. 6, 152-156. doi: 10.3758/CABN.6.2.152
22. Hess, U., Kappas, A., and Scherer, K. (1988). "Multichannel communication of emotion: synthetic signal production, " in Facets of Emotion: Recent Research, ed K. Scherer (Hillsdale, NJ: Erlbaum), 161-182.
23. Hocking, J., and Price, C. J. (2008). The role of the posterior superior temporal sulcus in audiovisual processing. Cereb. Cortex 18, 2439-2449. doi: 10.1093/cercor/bhn007
24. Jones, J. A., and Callan, D. E. (2003). Brain activity during audiovisual speech perception: an fMRI study of the McGurk effect. Neuroreport 14, 1129-1133. doi: 10.1097/00001756-200306110-00006
25. Kasess, C. H., Windischberger, C., Cunnington, R., Lanzenberger, R., Pezawas, L., and Moser, E. (2008). The suppressive influence of SMA on M1 in motor imagery revealed by Fmri and dynamic causal modeling. Neuroimage 40, 828-837. doi: 10.1016/j.neuroimage.2007.11.040
26. Kawahara, H. (2003). "Exemplar-based voice quality analysis and control using a high quality auditory morphing procedure based on straight, " in VoQual 03: Voice Quality: Functions, Analysis, and Synthesis (Geneva: ISCA Tutorial and Research Workshop).
27. Kerns, J. G., Cohen, J. D., MacDonald, A. W., Cho, R. Y., Stenger, V. A., and Carter, C. S. (2004). Anterior cingulate conflict monitoring and adjustments in control. Science 303, 1023-1026. doi: 10.1126/science.1089910
28. Klasen, M., Kenworthy, C. A., Mathiak, K. A., Kircher, T. T., and Mathiak, K. (2011). Supramodal representation of emotions. J. Neurosci. 31, 13635-13643. doi: 10.1523/JNEUROSCI.2833-11.2011
29. Kreifelts, B., Ethofer, T., Grodd, W., Erb, M., and Wildgruber, D. (2007). Audiovisual integration of emotional signals in voice and face: an event-related fMRI study. Neuroimage37, 1445-1456. doi: 10.1016/j.neuroimage.2007.06.020
30. Kreifelts, B., Ethofer, T., Huberle, E., Grodd, W., and Wildgruber, D. (2010). Association of trait emotional intelligence and individual fMRI activation patterns during the perception of social signals from voice and face. Hum. Brain Mapp. 31, 979-991. doi: 10.1002/hbm.20913
31. Kreifelts, B., Ethofer, T., Shiozawa, T., Grodd, W., and Wildgruber, D. (2009). Cerebral representation of non-verbal emotional perception: fMRI reveals audiovisual integration area between voice-and face-sensitive regions in the superior temporal sulcus. Neuropsychologia47, 3059-3066. doi: 10.1016/j.neuropsychologia.2009.07.001
32. MacDonald, A. W. I., Cohen, J. D., Stenger, V. A., and Carter, C. S. (2000). Dissociating the role of the dorsolateral prefrontal and anterior cingulate cortex in cognitive control. Science288, 1835-1838. doi: 10.1126/science.288.5472.1835
33. Massaro, D. W., and Egan, P. B. (1996). Perceiving affect from the voice and the face. Psychon. Bull. Rev. 3, 215-221. doi: 10.3758/BF03212421
34. Miller, L. M., and D'Esposito, M. (2005). Perceptual fusion and stimulus coincidence in the cross-modal integration of speech. J. Neurosci. 25, 5884-5893. doi: 10.1523/JNEUROSCI.0896-05.2005
35. Müller, V. I., Habel, U., Derntl, B., Schneider, F., Zilles, K., Turetsky, B. I., et al. (2011). Incongruence effects in crossmodal emotional integration. Neuroimage 54, 2257-2266. doi: 10.1016/j.neuroimage.2010.10.047
36. Nachev, P., Kennard, C., and Husain, M. (2008). Functional role of the supplementary and presupplementary motor areas. Nat. Rev. Neurosci. 9, 856-869. doi: 10.1038/nrn2478
37. Nonyane, B. A. S., and Theobald, C. M. (2007). Design sequences for sensory studies: achieving balance for carry-over and position effects. Br. J. Math. Stat. Psychol. 60, 339-349. doi: 10.1348/000711006X114568
38. Ochsner, K. N., Hughes, B., Robertson, E. R., Cooper, J. C., and Gabrieli, J. D. (2009). Neural systems supporting the control of affective and cognitive conflicts. J. Cogn. Neurosci. 21, 1842-1855. doi: 10.1162/jocn.2009.21129
39. Paus, T., Koski, L., Caramanos, Z., and Westbury, C. (1998). Regional differences in the effects of task difficulty and motor output on blood flow response in the human anterior cingulate cortex: a review of 107 PET activation studies. Neuroreport 9, R37-R47. doi: 10.1097/00001756-199806220-00001
40. Pourtois, G., de Gelder, B., Bol, A., and Crommelinck, M. (2005). Perception of facial expressions and voices and of their combination in the human brain. Cortex 41, 49-59. doi: 10.1016/S0010-9452(08)70177-1
41. Robins, D. L., Hunyadi, E., and Schultz, R. T. (2009). Superior temporal activation in response to dynamic audio-visual emotional cues. Brain Cogn. 69, 269-278. doi: 10.1016/j.bandc.2008.08.007
42. Sekiyama, K., Kanno, I., Miura, S., and Sugita, Y. (2003). Auditory-visual speech perception examined by fMRI and PET. Neurosci. Res. 47, 277-287. doi: 10.1016/S0168-0102(03)00214-1
43. Sumner, P., Nachev, P., Morris, P., Peters, A. M., Jackson, S. R., Kennard, C., et al. (2007). Human medial frontal cortex mediates unconscious inhibition of voluntary action. Neuron54, 697-711. doi: 10.1016/j.neuron.2007.05.016
44. Talsma, D., Doty, T. J., and Woldorff, M. G. (2007). Selective attention and audiovisual integration: is attending to both modalities a prerequisite for early integration. Cereb. Cortex17, 679-690. doi: 10.1093/cercor/bhk016
45. Talsma, D., and Woldorff, M. G. (2005). Selective attention and multisensory integration: multiple phases of effects on the evoked brain activity. J. Cogn. Neurosci. 17, 1098-1114. doi: 10.1162/0898929054475172
46. Weissman, D. H., Warner, L. M., and Woldorff, M. G. (2004). The neural mechanisms for minimizing cross-modal distraction. J. Neurosci. 24, 10941-10949. doi: 10.1523/JNEUROSCI.3669-04.2004
47. Wendelken, C., Ditterich, J., Bunge, S. A., and Carter, C. S. (2009). Stimulus and response conflict processing during perceptual decision making. Cogn. Affect. Behav. Neurosci. 9, 434-447. doi: 10.3758/CABN.9.4.434
48. Winder, J., Darvann, T. A., McKnight, W., Magee, J. D. M., and Ramsay-Baggs, P. (2008). Technical validation of the Di3D stereophotogrammetry surface imaging system. Br. J. Oral Maxillofac. Surg. 46, 33-37. doi: 10.1016/j.bjoms.2007.09.005
49. Wittfoth, M., Schroder, C., Schardt, D. M., Dengler, R., Heinze, H. J., and Kotz, S. A. (2010). On emotional conflict: interference resolution of happy and angry prosody reveals valence-specific effects. Cereb. Cortex 20, 383-392. doi: 10.1093/cercor/bhp106