Connecting multimodality in human communication

Frontiers in Human Neuroscience

Volumn , Issue NOV, 2013, Pages

  Regenbogen, Christina ^a,b   Habel, Ute ^a,b   Kellermann, Thilo ^a,b  

^a RWTH AACHEN UNIVERSITY   (Germany)

^b JARA TRANSLATIONAL BRAIN MEDICINE   (Germany)

Author keywords

Dynamic causal modeling; Emotion; Empathy; Facial expressions; Finite impulse response; Multimodality; Prosody; Speech content

Indexed keywords

ADULT; ANALYSIS OF VARIANCE; ANALYTIC METHOD; ANGULAR GYRUS; ARTICLE; AUDITORY CORTEX; BOLD SIGNAL; BRAIN FUNCTION; BRAIN MAPPING; COGNITION; EMPATHY; FACIAL EXPRESSION; FEMALE; FINITE IMPULSE RESPONSE ANALYSIS; FUNCTIONAL MAGNETIC RESONANCE IMAGING; FUSIFORM GYRUS; GRAY MATTER; HUMAN; HUMAN EXPERIMENT; IMAGE ANALYSIS; IMAGE PROCESSING; INTERPERSONAL COMMUNICATION; MALE; MATHEMATICAL MODEL; MOLECULAR DYNAMICS; NEUROIMAGING; NORMAL HUMAN; PREFRONTAL CORTEX; WHITE MATTER;

EID: 84888114363     PISSN: 16625161     EISSN: None     Source Type: Journal    
DOI: 10.3389/fnhum.2013.00754     Document Type: Article

References (38)

1. Ashburner, J., and Friston, K. J. (2005). Unified segmentation. Neuroimage 26, 839-851. doi: 10.1016/j.neuroimage.2005.02.018
2. Buckner, R. L., Koutstaal, W., Schacter, D. L., and Rosen, B. R. (2000). Functional MRI evidence for a role of frontal and inferior temporal cortex in amodal components of priming. Brain 123, 620-640. doi: 10.1093/brain/123.3.620
3. Campanella, S., and Belin, P. (2007). Integrating face and voice in person perception Trends Cogn. Sci.11, 535-543. doi: 10.1016/j.tics.2007.10.001
4. Colavita, F. B. (1974). Human sensory dominance. Percept. Psychophys. 16, 409-412. doi: 10.3758/BF03203962
5. D'Argembeau, A., Ruby, P., Collette, F., Degueldre, C., Balteau, E., Luxen, A., et al. (2007). Distinct regions of the medial prefrontal cortex are associated with self-referential processing and perspective taking. J. Cogn. Neurosci. 19, 935-944. doi: 10.1162/jocn.2007.19.6.935
6. De Vignemont, F., and Singer, T. (2006). The empathic brain: how, when and why? Trends Cogn. Sci.10, 435-441. doi: 10.1016/j.tics.2006.08.008
7. Desimone, R. (1996). Neural mechanisms for visual memory and their role in attention. Proc. Natl. Acad. Sci. U.S.A. 93, 13494-13499. doi: 10.1073/pnas.93.24.13494
8. Desimone, R., and Duncan, J. (1995). Neural mechanisms of selective visual attention. Annu. Rev. Neurosci. 18, 193-222. doi: 10.1146/annurev.ne.18.030195.001205
9. Feldman, H., and Friston, K. J. (2010). Attention, uncertainty and free-energy. Front. Hum. Neurosci. 4:215. doi: 10.3389/fnhum.2010.00215
10. Friston, K. (2005). A theory of cortical responses. Phil. Trans. R. Soc. B 360, 815-836. doi: 10.1098/rstb.2005.1622
11. Friston, K. (2010). The free energy principle: a unified brain theory? Nat. Rev. Neurosci. 11, 127-138. doi: 10.1038/nrn2787
12. Friston, K., and Penny, W. (2011). Post hoc Bayesian model selection. Neuroimage 56, 2089-2099. doi: 10.1016/j.neuroimage.2011.03.062
13. Itti, L., and Baldi, P. (2009). Bayesian surprise attracts human attention. Vision Res. 49, 1295-1306. doi: 10.1016/j.visres.2008.09.007
14. Kanwisher, N., McDermott, J., and Chun, M. M. (1997). The fusiform face area: a module in human extrastriate cortex specialized for face perception. J. Neurosci. 17, 4302-4311.
15. Kellermann, T., Regenbogen, C., De Vos, M., Mößnang, C., Finkelmeyer, A., and Habel, U. (2012). Effective connectivity of the human cerebellum during visual attention. J. Neurosci. 32, 11453-11460. doi: 10.1523/JNEUROSCI.0678-12.2012
16. Lamm, C., Meltzoff, A. N., and Decety, J. (2010). How do we empathize with someone who is not like us? A functional magnetic resonance imaging study. J. Cogn. Neurosci. 22, 362-376. doi: 10.1162/jocn.2009.21186
17. Langner, R., and Eickhoff, S. B. (2012). Sustaining attention to simple tasks: a meta-analytic review of the neural mechanisms of vigilant attention. Psychol. Bull. 139, 870-900. doi: 10.1037/a0030694
18. Lee, K. Y., Lee, T. H., Yoon, S. J., Cho, Y. S., Choi, J. S., and Kim, H. T. (2010). Neural correlates of top-down processing in emotion perception: an ERP study of emotional faces in white noise versus noise-alone stimuli. Brain Res. 1337, 56-63. doi: 10.1016/j.brainres.2010.03.094
19. Lohmann, G., Erfurth, K., Müller, K., and Turner, R. (2012). Critical comments on dynamic causal modelling. Neuroimage 59, 2322-2329. doi: 10.1016/j.neuroimage.2011.09.025
20. Maunsell, J. H., and Van Essen, D. C. (1983). The connections of the middle temporal visual area (MT) and their relationship to a cortical hierarchy in the macaque monkey. J. Neurosci. 3, 2563-2586.
21. Mühlberger, A., Neumann, R., Lozo, L., Muller, M., and Hettinger, M. (2012). Bottom-up and top-down influences of beliefs on emotional responses: fear of heights in a virtual environment. Stud. Health Technol. Inform. 181, 133-137. doi: 10.3233/978-1-61499-121-2-133
22. Mumford, D. (1992). On the computational architecture of the neocortex. II. The role of cortico-cortical loops. Biol. Cybern. 66, 241-251. doi: 10.1007/BF00198477
23. Nichols, T., Brett, M., Andersson, J., Wager, T., and Poline, J. B. (2005). Valid conjunction inference with the minimum statistic. Neuroimage 25, 653-660. doi: 10.1016/j.neuroimage.2004.12.005
24. Peelen, M. V., Atkinson, A. P., and Vuilleumier, P. (2010). Supramodal representations of perceived emotions in the human brain. J. Neurosci. 30, 10127-10134. doi: 10.1523/JNEUROSCI.2161-10.2010
25. Posner, M. I., and Petersen, S. E. (1990). The attention system of the human brain. Ann. Rev. Neurosci. 13, 25-42. doi: 10.1146/annurev.ne.13.030190.000325
26. Rao, R. P., and Ballard, D. H. (1999). Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive field effects. Nat. Neurosci. 2, 79-87. doi: 10.1038/4580
27. Regenbogen, C., Schneider, D. A., Gur, R. E., Schneider, F., Habel, U., and Kellermann, T. (2012a). Multimodal human communication-targeting facial expressions, speech content and prosody. Neuroimage 60, 2346-2356. doi: 10.1016/j.neuroimage.2012.02.043
28. Regenbogen, C., Schneider, D. A., Finkelmeyer, A., Kohn, N., Derntl, B., Kellermann, T., et al. (2012b). The differential contribution of facial expressions, prosody, and speech content to empathy. Cogn. Emot. 26, 995-1014. doi: 10.1080/02699931.2011.631296
29. Schnell, K., Bluschke, S., Konradt, B., and Walter, H. (2011). Functional relations of empathy and mentalizing: an fMRI study on the neural basis of cognitive empathy. Neuroimage 54, 1743-1754. doi: 10.1016/j.neuroimage.2010.08.024
30. Senkowski, D., Saint-Amour, D., Hofle, M., and Foxe, J. J. (2011). Multisensory interactions in early evoked brain activity follow the principle of inverse effectiveness. Neuroimage 56, 2200-2208. doi: 10.1016/j.neuroimage.2011.03.075
31. Seubert, J., Kellermann, T., Loughead, J., Boers, F., Brensinger, C., Schneider, F., et al. (2010). Processing of disgusted faces is facilitated by odor primes: a functional MRI study. Neuroimage 53, 746-756. doi: 10.1016/j.neuroimage.2010.07.012
32. Simon, J. R. (1969). Reaction towards the source of stimulation. J. Exp. Psychol. 81, 174-176. doi: 10.1037/h0027448
33. Stevenson, R. A., Bushmakin, M., Kim, S., Wallace, M. T., Puce, A., and James, T. W. (2012). Inverse effectiveness and multisensory interactions in visual event-related potentials with audiovisual speech. Brain Topogr. 25, 308-326. doi: 10.1007/s10548-012-0220-7
34. Stroop, J. R. (1935). Studies of interference in serial verbal reactions. J. Exp. Psychol. 18, 643-662. doi: 10.1037/h0054651
35. Vuilleumier, P., Armony, J. L., Driver, J., and Dolan, R. J. (2001). Effects of attention and emotion on face processing in the human brain: an event-related fMRI study. Neuron 30, 829-841. doi: 10.1016/S0896-6273(01)00328-2
36. Wertheimer, M. (1923). "Untersuchungen zur Lehre von der Gestalt II, " in Psychologische Forschung 4, 301-350. Translation published in Ellis, W. (1938). A Source Book of Gestalt Psychology (London: Routledge and Kegan Paul), 71-88.
37. Wolf, I., Dziobek, I., and Heekeren, H. R. (2010). Neural correlates of social cognition in naturalistic settings: a model-free analysis approach. Neuroimage 49, 894-904. doi: 10.1016/j.neuroimage.2009.08.060
38. Wright, P., Albarracin, D., Brown, R. D., Li, H., He, G., and Liu, Y. (2008). Dissociated responses in the amygdala and orbitofrontal cortex to bottom-up and top-down components of emotional evaluation. Neuroimage 39, 894-902. doi: 10.1016/j.neuroimage.2007.09.014