Modality-specific attention and multisensory integration of emotions in schizophrenia: Reduced regulatory effects

Schizophrenia Research

Volumn 122, Issue 1-3, 2010, Pages 136-143

  de Jong, J J ^a,b   Hodiamont, P P G ^a,b   de Gelder, B ^a,c  

^a TILBURG UNIVERSITY   (Netherlands)

^b GGZ Breburg Groep   (Netherlands)

^c MASSACHUSETTS GENERAL HOSPITAL   (United States)

Author keywords

Cognition; Emotion recognition; Modality specific attention; Multisensory integration; Schizophrenia; Selective attention

Indexed keywords

ADULT; ARTICLE; ASSOCIATION; ATTENTION DISTURBANCE; AUDITORY STIMULATION; CONTROLLED STUDY; EDUCATIONAL STATUS; EMOTIONALITY; FACIES; FEMALE; HUMAN; INFORMATION PROCESSING; MAJOR CLINICAL STUDY; MALE; POSITIVE AND NEGATIVE SYNDROME SCALE; PRIORITY JOURNAL; PSYCHIATRIST; PSYCHOLOGIC ASSESSMENT; PSYCHOSIS; RIGHT HANDEDNESS; SCHIZOPHRENIA; SELECTIVE ATTENTION; SENSORY EVALUATION; SEX DIFFERENCE; TASK PERFORMANCE; VISUAL STIMULATION; VOCALIZATION;

ACOUSTIC STIMULATION; ADULT; ANALYSIS OF VARIANCE; ATTENTION DEFICIT DISORDER WITH HYPERACTIVITY; AUDITORY PERCEPTION; DISCRIMINATION (PSYCHOLOGY); EMOTIONS; FACE; FEMALE; HUMANS; MALE; MIDDLE AGED; PATTERN RECOGNITION, VISUAL; PERCEPTUAL DISORDERS; PHOTIC STIMULATION; REACTION TIME; SCHIZOPHRENIA; SCHIZOPHRENIC PSYCHOLOGY;

EID: 77956184851     PISSN: 09209964     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.schres.2010.04.010     Document Type: Article

References (44)

1. Alsius A., Navarra J., Campbell R., Soto-Faraco S. Audiovisual integration of speech falters under high attention demands. Curr. Biol. 2005, 15:839-843.
2. Bertelson P., de Gelder B. The psychology of multimodal perception. Crossmodal Space and Crossmodal Attention 2004, 151-177. Oxford University Press, Oxford. C. Spence, J. Driver (Eds.).
3. Brancazio L., Miller J.L. Use of visual information in speech perception: evidence for a visual rate effect both with and without a McGurk effect. Percept. Psychophys. 2005, 67:759-769.
4. Butler P.D., DeSanti L.A., Maddox J., Harkavy-Friedman J.M., Amador X.F., Goetz R.R., Javitt D.C., Gorman J.M. Visual backward-masking deficits in schizophrenia: relationship to visual pathway function and symptomatology. Schizophr. Res. 2003, 59:199-209.
5. Butler P.D., Martinez A., Foxe J.J., Kim D., Zemon V., Silipo G., Mahoney J., Shpaner M., Jalbrzikowski M., Javitt D.C. Subcortical visual dysfunction in schizophrenia drives secondary cortical impairments. Brain 2007, 130:417-430.
6. Calvert G.A. Crossmodal processing in the human brain: insights from functional neuroimaging studies. Cereb. Cortex 2001, 11:1110-1123.
7. Calvert G.A. Handbook of Multisensory Processes 2004, MIT, Cambridge, MA.
8. Calvert G.A., Campbell R., Brammer M.J. Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex. Curr. Biol. 2000, 10:649-657.
9. Couture S.M., Penn D.L., Roberts D.L. The functional significance of social cognition in schizophrenia: a review. Schizophr. Bull. 2006, 32(Suppl 1):S44-S63.
10. de Gelder B. Neuroscience. More to seeing than meets the eye. Science 2000, 289:1148-1149.
11. de Gelder B., Pourtois G., Weiskrantz L. Fear recognition in the voice is modulated by unconsciously recognized facial expressions but not by unconsciously recognized affective pictures. Proc. Natl. Acad. Sci. U. S. A. 2002, 99:4121-4126.
12. de Gelder B., Morris J.S., Dolan R.J. Unconscious fear influences emotional awareness of faces and voices. Proc. Natl. Acad. Sci. U. S. A. 2005, 20(102):18682-18687.
13. de Gelder B., Vroomen J., de Jong J.J., Masthoff E.D., Trompenaars F.J., Hodiamont P. Multisensory integration of emotional faces and voices in schizophrenics. Schizophr. Res. 2005, 72:195-203.
14. de Jong J.J., Hodiamont P.P.G., van den Stockde J., Gelder B. Audiovisual emotion recognition in schizophrenia: reduced integration of facial and vocal affect. Schizophr. Res. 2009, 107:286-293.
15. Dolan R.J., Morris J.S., de Gelder B. Crossmodal binding of fear in voice and face. Proc. Natl. Acad. Sci. U. S. A. 2001, 98:10006-10010.
16. Edwards J., Jackson H.J., Pattison P.E. Emotion recognition via facial expression and affective prosody in schizophrenia: a methodological review. Clin. Psychol. Rev. 2002, 22:789-832.
17. Ekman P., Friessen W.V. Measuring facial movement. J. Environ. Psychol. Non-Verbal Behav. 1976, 1:56-75.
18. Green M.F., Kern R.S., Braff D.L., Mintz J. Neurocognitive deficits and functional outcome in schizophrenia: are we measuring the "right stuff"?. Schizophr. Bull. 2000, 26:119-136.
19. Green M.F., Nuechterlein K.H., Gold J.M., Barch D.M., Cohen J., Essock S., Fenton W.S., Frese F., Goldberg T.E., Heaton R.K., Keefe R.S., Kern R.S., Kraemer H., Stover E., Weinberger D.R., Zalcman S., Marder S.R. Approaching a consensus cognitive battery for clinical trials in schizophrenia: the NIMH-MATRICS conference to select cognitive domains and test criteria. Biol. Psychiatry 2004, 56:301-307.
20. Green M.F., Olivier B., Crawley J.N., Penn D.L., Silverstein S. Social cognition in schizophrenia: recommendations from the measurement and treatment research to improve cognition in schizophrenia new approaches conference. Schizophr. Bull. 2005, 31:882-887.
21. Hershenson M. Reaction time as a measure of intersensory facilitation. J. Exp. Psychol. 1962, 63:289-293.
22. Johnson J.A., Zatorre R.J. Neural substrates for dividing and focusing attention between simultaneous auditory and visual events. Neuroimage 2006, 31:1673-1681.
23. Jones J.A., Callan D.E. Brain activity during audiovisual speech perception: an fMRI study of the McGurk effect. NeuroReport 2003, 14:1129-1133.
24. Kohler C.G., Bilker W., Hagendoorn M., Gur R.E., Gur R.C. Emotion recognition deficit in schizophrenia: association with symptomatology and cognition. Biol. Psychiatry 2000, 48:127-136.
25. Laurienti P.J., Burdette J.H., Wallace M.T., Yen Y.F., Field A.S., Stein B.E. Deactivation of sensory-specific cortex by cross-modal stimuli. J. Cogn. Neurosci. 2002, 14:420-429.
26. Macaluso E., Frith C.D., Driver J. Modulation of human visual cortex by crossmodal spatial attention. Science 2000, 289:1206-1208.
27. Macaluso E., George N., Dolan R., Spence C., Driver J. Spatial and temporal factors during processing of audiovisual speech: a PET study. Neuroimage 2004, 21:725-732.
28. Mandal M.K., Pandey R., Prasad A.B. Facial expressions of emotions and schizophrenia: a review. Schizophr. Bull. 1998, 24:399-412.
29. McGurk H., MacDonald J. Hearing lips and seeing voices. Nature 1976, 264:746-748.
30. Meeren H.K., van Heijnsbergen C.C., de Gelder B. Rapid perceptual integration of facial expression and emotional body language. Proc. Natl. Acad. Sci. U. S. A. 2005, 102:16518-16523.
31. Meredith M.A., Stein B.E. Visual, auditory, and somatosensory convergence on cells in superior colliculus results in multisensory integration. J. Neurophysiol. 1986, 56:640-662.
32. Mozolic J.L., Hugenschmidt C.E., Peiffer A.M., Laurienti P.J. Modality-specific selective attention attenuates multisensory integration. Exp. Brain Res. 2008, 184:39-52.
33. Pourtois G., de Gelder B., Vroomen J., Rossion B., Crommelinck M. The time-course of intermodal binding between seeing and hearing affective information. NeuroReport 2000, 11:1329-1333.
34. Pourtois G., de Gelder B., Bol A., Crommelinck M. Perception of facial expressions and voices and of their combination in the human brain. Cortex 2005, 41:49-59.
35. Rabinowicz E.F., Silipo G., Goldman R., Javitt D.C. Auditory sensory dysfunction in schizophrenia: imprecision or distractibility?. Arch. Gen. Psychiatry 2000, 57:1149-1155.
36. Radeau M. Auditory-visual spatial interaction and modularity. Curr. Psychol. Cogn. 1994, 13:117-123.
37. Spence C., Nicholls M.E., Driver J. The cost of expecting events in the wrong sensory modality. Percept. Psychophys. 2001, 63:330-336.
38. Stein B.E., Huneycutt W.S., Meredith M.A. Neurons and behavior: the same rules of multisensory integration apply. Brain Res. 1988, 448:355-358.
39. Talsma D., Doty T.J., Woldorff M.G. Selective attention and audiovisual integration: is attending to both modalities a prerequisite for early integration?. Cereb. Cortex 2006, 17:679-690.
40. Talsma D., Kok A., Slagter H.A., Cipriani G. Attentional orienting across the sensory modalities. Brain Cogn. 2008, 66:1-10.
41. Turatto M., Benso F., Galfano G., Umilta C. Nonspatial attentional shifts between audition and vision. J. Exp. Psychol. Hum. Percept. Perform. 2002, 28:628-639.
42. van den Stock J., Righart R., de Gelder B. Body expressions influence recognition of emotions in the face and voice. Emotion 2007, 7:487-494.
43. Velligan D.I., Mahurin R.K., Diamond P.L., Hazleton B.C., Eckert S.L., Miller A.L. The functional significance of symptomatology and cognitive function in schizophrenia. Schizophr. Res. 1997, 25:21-31.
44. Velligan D.I., Bow-Thomas C.C., Mahurin R.K., Miller A.L., Halgunseth L.C. Do specific neurocognitive deficits predict specific domains of community function in schizophrenia?. J. Nerv. Ment. Dis. 2000, 188:518-524.