Neural processing of emotion in multimodal settings

Frontiers in Human Neuroscience

Volumn 8, Issue OCT, 2014, Pages

  Klasen, Martin ^a   Kreifelts, Benjamin ^b   Chen, Yu Han ^c   Seubert, Janina ^d   Mathiak, Klaus ^a  

^a RWTH AACHEN UNIVERSITY   (Germany)

^b UNIVERSITY HOSPITAL TÜBINGEN   (Germany)

^c UNIVERSITY OF NEW MEXICO SCHOOL OF MEDICINE   (United States)

^d KAROLINSKA INSTITUTE   (Sweden)

Author keywords

EEG; Emotion; fMRI; Multisensory integration; Social environment

Indexed keywords

BEHAVIOR; BRAIN REGION; EDITORIAL; EMOTION; HEARING; HUMAN; NERVOUS SYSTEM FUNCTION; NEURAL PROCESSING; ODOR; SIGNAL TRANSDUCTION; SOCIAL INTERACTION; TASTE; TOUCH; TRIGEMINAL NERVE; VISION;

EID: 84933677895     PISSN: None     EISSN: 16625161     Source Type: Journal    
DOI: 10.3389/fnhum.2014.00822     Document Type: Editorial

References (42)

1. Adolph, D., Meister, L., and Pause, B. M. (2013). Context counts! social anxiety modulates the processing of fearful faces in the context of chemosensory anxiety signals. Front. Hum. Neurosci. 7:283. doi: 10.3389/fnhum.2013.00283
2. Bensafi, M., Iannilli, E., Schriever, V. A., Poncelet, J., Seo, H. S., Gerber, J., et al. (2013). Cross-modal integration of emotions in the chemical senses. Front. Hum. Neurosci. 7:883. doi: 10.3389/fnhum.2013.00883
3. Bernstein, L. E., Auer, E. T. Jr., Wagner, M., and Ponton, C. W. (2008). Spatiotemporal dynamics of audiovisual speech processing. Neuroimage 39, 423-435. doi: 10.1016/j.neuroimage.2007.08.035
4. Brouwer, A. M., Van Wouwe, N., Muhl, C., Van Erp, J., and Toet, A. (2013). Perceiving blocks of emotional pictures and sounds: effects on physiological variables. Front. Hum. Neurosci. 7:295. doi: 10.3389/fnhum.2013.00295
5. Colavita, F. B. (1974). Human sensory dominance. Percept. Psychophys. 16, 409-412. doi: 10.3758/BF03203962
6. Craig, A. D. (2009). How do you feel-now? The anterior insula and human awareness. Nat. Rev. Neurosci. 10, 59-70. doi: 10.1038/nrn2555
7. Croy, I., Laqua, K., Suss, F., Joraschky, P., Ziemssen, T., and Hummel, T. (2013). The sensory channel of presentation alters subjective ratings and autonomic responses toward disgusting stimuli-Blood pressure, heart rate and skin conductance in response to visual, auditory, haptic and olfactory presented disgusting stimuli. Front. Hum. Neurosci. 7:510. doi: 10.3389/fnhum.2013.00510
8. De Gelder, B., and Vroomen, J. (2000). The perception of emotions by ear and by eye. Cogn. Emot. 14, 289-311. doi: 10.1080/026999300378824
9. Delle-Vigne, D., Kornreich, C., Verbanck, P., and Campanella, S. (2014). Subclinical alexithymia modulates early audio-visual perceptive and attentional event-related potentials. Front. Hum. Neurosci. 8:106. doi: 10.3389/fnhum.2014.00106
10. Dolan, R. J., Morris, J. S., and De Gelder, B. (2001). Crossmodal binding of fear in voice and face. Proc. Natl. Acad. Sci. U.S.A. 98, 10006-10010. doi: 10.1073/pnas.171288598
11. Elliott, R., Zahn, R., Deakin, J. F., and Anderson, I. M. (2011). Affective cognition and its disruption in mood disorders. Neuropsychopharmacology 36, 153-182. doi: 10.1038/npp.2010.77
12. Frank, S., Kullmann, S., and Veit, R. (2013). Food related processes in the insular cortex. Front. Hum. Neurosci. 7:499. doi: 10.3389/fnhum.2013.00499
13. Freiherr, J., Lundström, J. N., Habel, U., and Reetz, K. (2013). Multisensory integration mechanisms during aging. Front. Hum. Neurosci. 7:863. doi: 10.3389/fnhum.2013.00863
14. Gerdes, A. B., Wieser, M. J., Bublatzky, F., Kusay, A., Plichta, M. M., and Alpers, G. W. (2013). Emotional sounds modulate early neural processing of emotional pictures. Front. Psychol. 4:741. doi: 10.3389/fpsyg.2013.00741
15. Jabbi, M., Bastiaansen, J., and Keysers, C. (2008). A common anterior insula representation of disgust observation, experience and imagination shows divergent functional connectivity pathways. PLoS ONE 3:e2939. doi: 10.1371/journal.pone.0002939
16. Jessen, S., and Kotz, S. A. (2013). On the role of crossmodal prediction in audiovisual emotion perception. Front. Hum. Neurosci. 7:369. doi: 10.3389/fnhum.2013.00369
17. Kätsyri, J., Hari, R., Ravaja, N., and Nummenmaa, L. (2013). Just watching the game ain't enough: striatal fMRI reward responses to successes and failures in a video game during active and vicarious playing. Front. Hum. Neurosci. 7:278. doi: 10.3389/fnhum.2013.00278
18. Klasen, M., Chen, Y. H., and Mathiak, K. (2012a). Multisensory emotions: perception, combination and underlying neural processes. Rev. Neurosci. 23, 381-392. doi: 10.1515/revneuro-2012-0040
19. Klasen, M., Kenworthy, C. A., Mathiak, K. A., Kircher, T. T., and Mathiak, K. (2011). Supramodal representation of emotions. J. Neurosci. 31, 13635-13643. doi: 10.1523/JNEUROSCI.2833-11.2011
20. Klasen, M., Weber, R., Kircher, T. T., Mathiak, K. A., and Mathiak, K. (2012b). Neural contributions to flow experience during video game playing. Soc. Cogn. Affect. Neurosci. 7, 485-495. doi: 10.1093/scan/nsr021
21. Klasen, M., Zvyagintsev, M., Schwenzer, M., Mathiak, K. A., Sarkheil, P., Weber, R., et al. (2013). Quetiapine modulates functional connectivity in brain aggression networks. Neuroimage 75, 20-26. doi: 10.1016/j.neuroimage.2013.02.053
22. Kohler, C. G., Walker, J. B., Martin, E. A., Healey, K. M., and Moberg, P. J. (2010). Facial emotion perception in schizophrenia: a meta-analytic review. Schizophr. Bull. 36, 1009-1019. doi: 10.1093/schbul/sbn192
23. Kreifelts, B., Jacob, H., Bruck, C., Erb, M., Ethofer, T., and Wildgruber, D. (2013). Non-verbal emotion communication training induces specific changes in brain function and structure. Front. Hum. Neurosci. 7:648. doi: 10.3389/fnhum.2013.00648
24. Massaro, D. W., and Egan, P. B. (1996). Perceiving affect from the voice and the face. Psychon. Bull. Rev. 3, 215-221. doi: 10.3758/BF03212421
25. Mathiak, K. A., Klasen, M., Weber, R., Ackermann, H., Shergill, S. S., and Mathiak, K. (2011). Reward system and temporal pole contributions to affective evaluation during a first person shooter video game. BMC Neurosci. 12:66. doi: 10.1186/1471-2202-12-66
26. Mathiak, K. A., Klasen, M., Zvyagintsev, M., Weber, R., and Mathiak, K. (2013). Neural networks underlying affective states in a multimodal virtual environment: contributions to boredom. Front. Hum. Neurosci. 7:820. doi: 10.3389/fnhum.2013.00820
27. Mathiak, K., and Weber, R. (2006). Toward brain correlates of natural behavior: fMRI during violent video games. Hum. Brain Mapp. 27, 948-956. doi: 10.1002/hbm.20234
28. Maurage, P., and Campanella, S. (2013). Experimental and clinical usefulness of crossmodal paradigms in psychiatry: an illustration from emotional processing in alcohol-dependence. Front. Hum. Neurosci. 7:394. doi: 10.3389/fnhum.2013.00394
29. Maurage, P., Campanella, S., Philippot, P., Martin, S., and De Timary, P. (2008). Face processing in chronic alcoholism: a specific deficit for emotional features. Alcohol. Clin. Exp. Res. 32, 600-606. doi: 10.1111/j.1530-0277.2007.00611.x
30. Milesi, V., Cekic, S., Peron, J., Fruhholz, S., Cristinzio, C., Seeck, M., et al. (2014). Multimodal emotion perception after anterior temporal lobectomy (ATL). Front. Hum. Neurosci. 8:275. doi: 10.3389/fnhum.2014.00275
31. Müller, V. I., Cieslik, E. C., Laird, A. R., Fox, P. T., and Eickhoff, S. B. (2013). Dysregulated left inferior parietal activity in schizophrenia and depression: functional connectivity and characterization. Front. Hum. Neurosci. 7:268. doi: 10.3389/fnhum.2013.00268
32. Ohla, K., and Lundström, J. N. (2013). Sex differences in chemosensation: sensory or emotional? Front. Hum. Neurosci. 7:607. doi: 10.3389/fnhum.2013.00607
33. Regenbogen, C., Habel, U., and Kellermann, T. (2013). Connecting multimodality in human communication. Front. Hum. Neurosci. 7:754. doi: 10.3389/fnhum.2013.00754
34. Robins, D. L., Hunyadi, E., and Schultz, R. T. (2009). Superior temporal activation in response to dynamic audio-visual emotional cues. Brain Cogn. 69, 269-278. doi: 10.1016/j.bandc.2008.08.007
35. Schelenz, P. D., Klasen, M., Reese, B., Regenbogen, C., Wolf, D., Kato, Y., et al. (2013). Multisensory integration of dynamic emotional faces and voices: method for simultaneous EEG-fMRI measurements. Front. Hum. Neurosci. 7:729. doi: 10.3389/fnhum.2013.00729
36. Senkowski, D., Schneider, T. R., Foxe, J. J., and Engel, A. K. (2008). Crossmodal binding through neural coherence: implications for multisensory processing. Trends Neurosci. 31, 401-409. doi: 10.1016/j.tins.2008.05.002
37. Sestito, M., Umilta, M. A., De Paola, G., Fortunati, R., Raballo, A., Leuci, E., et al. (2013). Facial reactions in response to dynamic emotional stimuli in different modalities in patients suffering from schizophrenia: a behavioral and EMG study. Front. Hum. Neurosci. 7:368. doi: 10.3389/fnhum.2013.00368
38. Sripada, R. K., Garfinkel, S. N., and Liberzon, I. (2013). Avoidant symptoms in PTSD predict fear circuit activation during multimodal fear extinction. Front. Hum. Neurosci. 7:672. doi: 10.3389/fnhum.2013.00672
39. Watson, R., Latinus, M., Noguchi, T., Garrod, O., Crabbe, F., and Belin, P. (2013). Dissociating task difficulty from incongruence in face-voice emotion integration. Front. Hum. Neurosci. 7:744. doi: 10.3389/fnhum.2013.00744
40. Wilson-Mendenhall, C. D., Barrett, L. F., and Barsalou, L. W. (2013). Situating emotional experience. Front. Hum. Neurosci. 7:764. doi: 10.3389/fnhum.2013.00764
41. Wolf, D., Schock, L., Bhavsar, S., Demenescu, L. R., Sturm, W., and Mathiak, K. (2014). Emotional valence and spatial congruency differentially modulate crossmodal processing: an fMRI study. Front. Hum. Neurosci. 8:659. doi: 10.3389/fnhum.2014.00659
42. Zvyagintsev, M., Parisi, C., Chechko, N., Nikolaev, A. R., and Mathiak, K. (2013). Attention and multisensory integration of emotions in schizophrenia. Front. Hum. Neurosci. 7:674. doi: 10.3389/fnhum.2013.00674