Perceiving emotions from bodily expressions and multisensory integration of emotion cues in schizophrenia

Social Neuroscience

Volumn 6, Issue 5-6, 2011, Pages 537-547

  van den Stock, Jan ^a,b   de Jong, Sjakko J ^a,c   Hodiamont, Paul P G ^a   de Gelder, Beatrice ^a,b,d  

^a TILBURG UNIVERSITY   (Netherlands)

^b UNIVERSITY OF LEUVEN   (Belgium)

^c GGZ Breburg Groep   (Netherlands)

^d MASSACHUSETTS GENERAL HOSPITAL   (United States)

Author keywords

Audiovisual; Body; Emotion; Schizophrenia

Indexed keywords

ADULT; ARTICLE; ASSOCIATION; AUDITORY STIMULATION; BODY POSTURE; EMOTION; FEMALE; HUMAN; MALE; MIDDLE AGED; PATHOPHYSIOLOGY; PERCEPTION; PHOTOSTIMULATION; PHYSIOLOGY; RECOGNITION; SCHIZOPHRENIA;

ACOUSTIC STIMULATION; ADULT; CUES; EMOTIONS; FEMALE; HUMANS; MALE; MIDDLE AGED; PERCEPTION; PHOTIC STIMULATION; POSTURE; RECOGNITION (PSYCHOLOGY); SCHIZOPHRENIA; YOUNG ADULT;

EID: 84857409677     PISSN: 17470919     EISSN: 17470927     Source Type: Journal    
DOI: 10.1080/17470919.2011.568790     Document Type: Article

References (52)

1. APA. 2000. Diagnostic and statistical manual of mental disorders (DSM-IV-TR), Washington, DC: American Psychiatric Association.
2. Argyle, M. 1988. Bodily communication, London: Methuen.
3. Banse, R. and Scherer, K. R. 1996. Acoustic profiles in vocal emotion expression. Journal of Personality & Social Psychology, 70(3): 614-636.
4. Bertelson, P. and de Gelder, B. 2004. "The psychology of multimodal perception". In Crossmodal space and crossmodal attention, Edited by: Spence, C. and Driver, J. 151-177. Oxford, UK: Oxford University Press.
5. Bertrand, M. C., Achim, A. M., Harvey, P. O., Sutton, H., Malla, A. K. and Lepage, M. 2008. Structural neural correlates of impairments in social cognition in first episode psychosis. Social Neuroscience, 3(1): 79-88.
6. Borod, J. C., Martin, C. C., Alpert, M., Brozgold, A. and Welkowitz, J. 1993. Perception of facial emotion in schizophrenic and right brain-damaged patients. Journal of Nervous and Mental Disease, 181(8): 494-502.
7. Borod, J. C., Pick, L. H., Hall, S., Sliwinski, M., Madigan, N.Obler, L. K. 2000. Relationships among facial, prosodic, and lexical channels of emotional perceptual processing. Cognition and Emotion, 14(2): 193-211.
8. Cutting, J. E. and Kozlowski, L. T. 1977. Recognizing friends by their walk: Gait perception without familiarity cues. Bulletin of the Psychonomic Society, 9: 353-356.
9. de Gelder, B. 2006. Towards the neurobiology of emotional body language. Nature Reviews Neuroscience, 7(3): 242-249.
10. de Gelder, B. and Bertelson, P. 2003. Multisensory integration, perception and ecological validity. Trends in Cognitive Sciences, 7(10): 460-467.
11. de Gelder, B., Bocker, K. B., Tuomainen, J., Hensen, M. and Vroomen, J. 1999. The combined perception of emotion from voice and face: Early interaction revealed by human electric brain responses. Neuroscience Letters, 260(2): 133-136.
12. de Gelder, B., Snyder, J., Greve, D., Gerard, G. and Hadjikhani, N. 2004. Fear fosters flight: A mechanism for fear contagion when perceiving emotion expressed by a whole body. Proceedings of the National Academy of Sciences of the United States of America, 101(47): 16701-16706.
13. de Gelder, B. and Van den Stock, J. 2011. "Real faces, real emotions: Perceiving facial expressions in naturalistic contexts of voices, bodies and scenes". In The Oxford handbook of face perception, Edited by: Calder, A. J., Rhodes, G., Johnson, M. H. and Haxby, J. V. 535-550. New York, NY: Oxford University Press.
14. de Gelder, B., van den Stock, J., de Diego Balaguer, R. and Bachoud-Levi, A. C. 2008. Huntington's disease impairs recognition of angry and instrumental body language. Neuropsychologia, 46(1): 369-373.
15. de Gelder, B., Van den Stock, J., Meeren, H. K., Sinke, C. B., Kret, M. E. and Tamietto, M. 2010. Standing up for the body. Recent progress in uncovering the networks involved in the perception of bodies and bodily expressions. Neuroscience and Biobehavioral Reviews, 34(4): 513-527.
16. de Gelder, B. and Vroomen, J. 2000. The perception of emotions by ear and by eye. Cognition and Emotion, 14(3): 289-311.
17. de Gelder, B., Vroomen, J., de Jong, S. J., Masthoff, E. D., Trompenaars, F. J. and Hodiamont, P. 2005. Multisensory integration of emotional faces and voices in schizophrenia. Schizophrenics Research, 72(2-3): 195-203.
18. de Jong, J. J., Hodiamont, P. P., Van den Stock, J. and de Gelder, B. 2009. Audiovisual emotion recognition in schizophrenia: Reduced integration of facial and vocal affect. Schizophrenia Research, 107(2-3): 286-293.
19. Dolan, R. J., Morris, J. S. and de Gelder, B. 2001. Crossmodal binding of fear in voice and face. Proceedings of the National Academy of Sciences of the United States of America, 98(17): 10006-10010.
20. Ekman, P. and Friesen, W. V. 1976. Pictures of facial affect, Palo Alto, CA: Consulting Psychologists Press.
21. Ethofer, T., Anders, S., Erb, M., Droll, C., Royen, L.Saur, R. 2006. Impact of voice on emotional judgment of faces: An event-related fMRI study. Human Brain Mapping, 27(9): 707-714.
22. Feinberg, T. E., Rifkin, A., Schaffer, C. and Walker, E. 1986. Facial discrimination and emotional recognition in schizophrenia and affective disorders. Archives of General Psychiatry, 43(3): 276-279.
23. Grèzes, J., Pichon, S. and de Gelder, B. 2007. Perceiving fear in dynamic body expressions. NeuroImage, 35(2): 959-967.
24. Gur, R. E., McGrath, C., Chan, R. M., Schroeder, L., Turner, T.Turetsky, B. I. 2002. An fMRI study of facial emotion processing in patients with schizophrenia. American Journal of Psychiatry, 159(12): 1992-1999.
25. Hadjikhani, N. and de Gelder, B. 2003. Seeing fearful body expressions activates the fusiform cortex and amygdala. Current Biology, 13(24): 2201-2205.
26. Hadjikhani, N., Joseph, R. M., Manoach, D. S., Naik, P., Snyder, J.Dominick, K. 2009. Body expressions of emotion do not trigger fear contagion in autism spectrum disorder. Social, Cognitive and Affective Neuroscience, 4(1): 70-78.
27. Heimberg, C., Gur, R. E., Erwin, R. J., Shtasel, D. L. and Gur, R. C. 1992. Facial emotion discrimination. III. Behavioral findings in schizophrenia. Psychiatry Research, 42(3): 253-265.
28. Johnson-Frey, S. H., Maloof, F. R., Newman-Norlund, R., Farrer, C., Inati, S. and Grafton, S. T. 2003. Actions or hand-object interactions? Human inferior frontal cortex and action observation. Neuron, 39(6): 1053-1058.
29. Joshua, N. and Rossell, S. 2009. Configural face processing in schizophrenia. Schizophrenia Research, 112(1-3): 99-103.
30. Kee, K. S., Horan, W. P., Wynn, J. K., Mintz, J. and Green, M. F. 2006. An analysis of categorical perception of facial emotion in schizophrenia. Schizophrenia Research, 87(1-3): 228-237.
31. Kohler, C. G., Turner, T. H., Bilker, W. B., Brensinger, C. M., Siegel, S. J.Kanes, S. J. 2003. Facial emotion recognition in schizophrenia: Intensity effects and error pattern. American Journal of Psychiatry, 160(10): 1768-1774.
32. Mandal, M. K., Pandey, R. and Prasad, A. B. 1998. Facial expressions of emotions and schizophrenia: A review. Schizophrenia Bulletin, 24(3): 399-412.
33. Massaro, D. W. and Egan, P. B. 1996. Perceiving affect from the voice and the face. Psychonomic Bulletin and Review, 3: 215-221.
34. Michalopoulou, P. G., Surguladze, S., Morley, L. A., Giampietro, V. P., Murray, R. M. and Shergill, S. S. 2008. Facial fear processing and psychotic symptoms in schizophrenia: Functional magnetic resonance imaging study. British Journal of Psychiatry, 192(3): 191-196.
35. Peelen, M. V. and Downing, P. E. 2007. The neural basis of visual body perception. Nature Reviews Neuroscience, 8(8): 636-648.
36. Phillips, M. L., Williams, L., Senior, C., Bullmore, E. T., Brammer, M. J.Andrew, C. 1999. A differential neural response to threatening and non-threatening negative facial expressions in paranoid and non-paranoid schizophrenics. Psychiatry Research, 92(1): 11-31.
37. Pichon, S., de Gelder, B. and Grèzes, J. 2008. Emotional modulation of visual and motor areas by still and dynamic body expressions of anger. Social Neuroscience, 3(3-4): 199-212.
38. Pinkham, A. E., Hopfinger, J. B., Pelphrey, K. A., Piven, J. and Penn, D. L. 2008a. Neural bases for impaired social cognition in schizophrenia and autism spectrum disorders. Schizophrenia Research, 99(1-3): 164-175.
39. Pinkham, A. E., Hopfinger, J. B., Ruparel, K. and Penn, D. L. 2008b. An investigation of the relationship between activation of a social cognitive neural network and social functioning. Schizophrenia Bulletin, 34(4): 688-697.
40. Pomarol-Clotet, E., Hynes, F., Ashwin, C., Bullmore, E. T., McKenna, P. J. and Laws, K. R. 2010. Facial emotion processing in schizophrenia: A non-specific neuropsychological deficit?. Psychological Medicine, 40(6): 911-919.
41. Pourtois, G., Debatisse, D., Despland, P. A. and de Gelder, B. 2002. Facial expressions modulate the time course of long latency auditory brain potentials. Cognitive Brain Research, 14(1): 99-105.
42. Ross, L. A., Saint-Amour, D., Leavitt, V. M., Molholm, S., Javitt, D. C. and Foxe, J. J. 2007. Impaired multisensory processing in schizophrenia: Deficits in the visual enhancement of speech comprehension under noisy environmental conditions. Schizophrenia Research, 97(1-3): 173-183.
43. Scherer, K. R., Banse, R., Wallbott, H. G. and Goldbeck, T. 1991. Vocal cues in emotion encoding and decoding. Motivation and Emotion, 15(2): 123-148.
44. Sprengelmeyer, R., Young, A. W., Schroeder, U., Grossenbacher, P. G., Federlein, J.Buttner, T. 1999. Knowing no fear. Proceedings of the Royal Society. Series B: Biological Sciences, 266(1437): 2451-2456.
45. Stekelenburg, J. J. and de Gelder, B. 2004. The neural correlates of perceiving human bodies: An ERP study on the body-inversion effect. Neuroreport, 15(5): 777-780.
46. Tamietto, M., Geminiani, G., Genero, R. and de Gelder, B. 2007. Seeing fearful body language overcomes attentional deficits in patients with neglect. Journal of Cognitive Neuroscience, 19(3): 445-454. doi:doi: 10.1162/jocn.2007.19.3.445
47. Van den Stock, J., Grèzes, J. and de Gelder, B. 2008a. Human and animal sounds influence recognition of body language. Brain Research, 1242: 185-190.
48. Van den Stock, J., Peretz, I., Grèzes, J. and de Gelder, B. 2009. Instrumental music influences recognition of emotional body language. Brain Topography, 21(3-4): 216-220.
49. Van den Stock, J., Righart, R. and de Gelder, B. 2007. Body expressions influence recognition of emotions in the face and voice. Emotion, 7(3): 487-494.
50. Van den Stock, J., van de Riet, W. A., Righart, R. and de Gelder, B. 2008b. Neural correlates of perceiving emotional faces and bodies in developmental prosopagnosia: An event-related fMRI-study. PLoS One, 3(9): e3195
51. Vroomen, J., Driver, J. and de Gelder, B. 2001. Is cross-modal integration of emotional expressions independent of attentional resources?. Cognitive, Affective, & Behavioral Neuroscience, 1(4): 382-387.
52. Wolwer, W., Streit, M., Polzer, U. and Gaebel, W. 1996. Facial affect recognition in the course of schizophrenia. European Archives of Psychiatry and Clinical Neuroscience, 246(3): 165-170.