Prosodic and narrative processing in American Sign Language: An fMRI study

NeuroImage

Volumn 52, Issue 2, 2010, Pages 669-676

  Newman, Aaron J ^a   Supalla, Ted ^b   Hauser, Peter C ^c   Newport, Elissa L ^b   Bavelier, Daphne ^b  

^a DALHOUSIE UNIVERSITY   (Canada)

^b UNIVERSITY OF ROCHESTER   (United States)

^c ROCHESTER INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; ASSOCIATION; BASAL GANGLION; BRAIN REGION; CLINICAL ARTICLE; CONTROLLED STUDY; FACIAL EXPRESSION; FEMALE; FRONTAL CORTEX; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HEARING IMPAIRMENT; HEMISPHERIC DOMINANCE; HUMAN; INFORMATION PROCESSING; LANGUAGE ABILITY; LEFT HEMISPHERE; LINGUISTICS; MALE; NARRATIVE; NEUROIMAGING; NONVERBAL COMMUNICATION; PRIORITY JOURNAL; RIGHT HEMISPHERE; SIGN LANGUAGE; SUPRASYLVIAN GYRUS; TEMPORAL CORTEX; VERBAL COMMUNICATION; ADOLESCENT; BRAIN; BRAIN MAPPING; NERVE TRACT; NUCLEAR MAGNETIC RESONANCE IMAGING; PATHOPHYSIOLOGY; PHYSIOLOGY; SPEECH PERCEPTION; UNITED STATES; YOUNG ADULT;

ADOLESCENT; ADULT; BRAIN; BRAIN MAPPING; CUES; DEAFNESS; FEMALE; FUNCTIONAL LATERALITY; HUMANS; LINGUISTICS; MAGNETIC RESONANCE IMAGING; MALE; NARRATION; NEURAL PATHWAYS; SIGN LANGUAGE; SPEECH PERCEPTION; UNITED STATES; YOUNG ADULT;

EID: 77953712544     PISSN: 10538119     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neuroimage.2010.03.055     Document Type: Article

References (78)

1. Atkinson J., Campbell R., Marshall J., Thacker A., Woll B. Understanding 'not': neuropsychological dissociations between hand and head markers of negation in BSL. Neuropsychologia 2004, 42:214-229.
2. Awad M., Warren J.E., Scott S.K., Turkheimer F.E., Wise R.J.S. A common system for the comprehension and production of narrative speech. J. Neurosci. 2007, 27:11455-11464.
3. Baum S.R., Pell M.D. The neural bases of prosody: insights from lesion studies and neuroimaging. Aphasiology 1999, 13:581-608.
4. Bavelier D., Corina D.P., Jezzard P., Clark V., Karni A., Lalwani A., Rauschecker J.P., Braun A., Turner R., Neville H.J. Hemispheric specialization for English and ASL: left invariance-right variability. NeuroReport 1998, 9:1537-1542.
5. Bavelier D., Tomann A., Hutton C., Mitchell T., Corina D., Liu G., Neville H. Visual attention to the periphery is enhanced in congenitally deaf individuals. J. Neurosci. 2000, 20:RC93.
6. Bavelier D., Brozinsky C., Tomann A., Mitchell T., Neville H., Liu G. Impact of early deafness and early exposure to sign language on the cerebral organization for motion processing. J. Neurosci. 2001, 21:8931-8942.
7. Bavelier D., Newman A.J., Mukherjee M., Hauser P., Kemeny S., Braun A., Boutla M. Encoding, rehearsal, and recall in signers and speakers: shared network but differential engagement. Cereb. Cortex 2008, 18:2263-2274.
8. Beckmann C.F., Jenkinson M., Smith S.M. General multilevel linear modeling for group analysis in fMRI. NeuroImage 2003, 20:1052-1063.
9. Beeman M.J., Chiarello C. Right hemisphere language comprehension: perspectives from cognitive neuroscience 1997, Lawrence Erlbaum.
10. Bloom R.L., Borod J.C., Obler L.K., Gerstman L.J. Impact of emotional content on discourse production in patients with unilateral brain damage. Brain Lang. 1992, 42:153-164.
11. Bonda E., Petrides M., Ostry D., Evans A. Specific involvement of human parietal systems and the amygdala in the perception of biological motion. J. Neurosci. 1996, 16:3737-3744.
12. Braun A.R., Guillemin A., Hosey L., Varga M. The neural organization of discourse: an H2 15O-PET study of narrative production in English and American Sign Language. Brain 2001, 124:2028-2044.
13. Brownell H.H., Potter H.H., Bihrle A.M., Gardner H. Inference deficits in right brain-damaged patients. Brain Lang. 1986, 27:310-321.
14. Capek C.M., Bavelier D., Corina D.P., Newman A.J., Jezzard P., Neville H.J. The cortical organization of audio-visual sentence comprehension: an fMRI study at 4 Tesla. Brain Res. Cogn. Brain Res. 2004, 20:111-119.
15. Caplan R., Dapretto M. Making sense during conversation: an fMRI study. NeuroReport 2001, 12:3625-3632.
16. Corina, D.P., 1998. Aphasia in users of signed languages. Coppens, Patrick (Ed); Lebrun, Yvan (Ed); et al. (1998). Aphasia in atypical populations. Lawrence Erlbaum Associates, Inc., Publishers, Mahwah, NJ, US, pp. 261-309.
17. Corina D.P., Bellugi U., Reilly J. Neuropsychological studies of linguistic and affective facial expressions in deaf signers. Lang. Speech 1999, 42:307-331.
18. Corina D.P., San Jose-Robertson L., Guillemin A., High J., Braun A.R. Language lateralization in a bimanual language. J. Cogn. Neurosci. 2003, 15:718-730.
19. Emmorey K., Corina D.P., Bellugi U. Differential processing of topographic and referential functions of space. Language, gesture, and space 1995, 43-62. Lawrence Erlbaum Associates, Inc, Hillsdale, NJ, US. K. Emmorey, J.S. Reilly (Eds.).
20. Emmorey K., Grabowski T., McCullough S., Damasio H., Ponto L.L., Hichwa R.D., Bellugi U. Neural systems underlying lexical retrieval for sign language. Neuropsychologia 2003, 41:85-95.
21. Fine I., Finney E.M., Boynton G.M., Dobkins K.R. Comparing the effects of auditory deprivation and sign language within the auditory and visual cortex. J. Cogn. Neurosci. 2005, 17:1621-1637.
22. Finney E.M., Fine I., Dobkins K.R. Visual stimuli activate auditory cortex in the deaf. Nat. Neurosci. 2001, 4:1171-1173.
23. Friederici A.D. Aphasics' perception of words in sentential context: some real-time processing evidence. Neuropsychologia 1983, 21:351-358.
24. Friederici A.D. Levels of processing and vocabulary types: evidence from on-line comprehension in normals and agrammatics. Cognition 1985, 19:133-166.
25. Friederici A.D., Kotz S.A. The brain basis of syntactic processes: functional imaging and lesion studies. NeuroImage 2003, 20(Suppl. 1):S8-S17.
26. Gandour J., Dzemidzic M., Wong D., Lowe M., Tong Y., Hsieh L., Satthamnuwong N., Lurito J. Temporal integration of speech prosody is shaped by language experience: an fMRI study. Brain Lang. 2003, 84:318-336.
27. Gandour J., Wong D., Dzemidzic M., Lowe M., Tong Y., Li X. A cross-linguistic fMRI study of perception of intonation and emotion in Chinese. Hum. Brain Mapp. 2003, 18:149-157.
28. Gorelick P.B., Ross E.D. The aprosodias: further functional-anatomical evidence for the organisation of affective language in the right hemisphere. J. Neurol. Neurosurg. Psychiatry 1987, 50:553-560.
29. Grossman E., Donnelly M., Price R., Pickens D., Morgan V., Neighbor G., Blake R. Brain areas involved in perception of biological motion. J. Cogn. Neurosci. 2000, 12:711-720.
30. Gur R.C., Skolnick B.E., Gur R.E. Effects of emotional discrimination tasks on cerebral blood flow: regional activation and its relation to performance. Brain Cogn. 1994, 25:271-286.
31. Haxby J.V., Hoffman E.A., Gobbini M.I. The distributed human neural system for face perception. Trends Cogn. Sci. 2000, 4:223-233.
32. Hein G., Knight R.T. Superior temporal sulcus-it's my area: or is it?. J. Cogn. Neurosci. 2008, 20:2125-2136.
33. Hickok G., Bellugi U., Klima E.S. The neurobiology of sign language and its implications for the neural basis of language. Nature 1996, 381:699-702.
34. Hickok G., Wilson M., Clark K., Klima E.S., Kritchevsky M., Bellugi U. Discourse deficits following right hemisphere damage in deaf signers. Brain Lang. 1999, 66:233-248.
35. Humphries C., Love T., Swinney D., Hickok G. Response of anterior temporal cortex to syntactic and prosodic manipulations during sentence processing. Hum. Brain Mapp. 2005, 26:128-138.
36. Jenkinson M., Bannister P., Brady M., Smith S. Improved optimization for the robust and accurate linear registration and motion correction of brain images. NeuroImage 2002, 17:825-841.
37. Kanwisher N., Yovel G. The fusiform face area: a cortical region specialized for the perception of faces. Philos. Trans. R. Soc. Lond. B Biol. Sci. 2006, 361:2109-2128.
38. Kassubek J., Hickok G., Erhard P. Involvement of classical anterior and posterior language areas in sign language production, as investigated by 4T functional magnetic resonance imaging. Neurosci. Lett. 2004, 364:168-172.
39. Koelsch S., Gunter T.C., von Cramon D.Y., Zysset S., Lohmann G., Friederici A.D. Bach speaks: a cortical "language-network" serves the processing of music. NeuroImage 2002, 17:956-966.
40. Kotz S.A., Meyer M., Alter K., Besson M., von Cramon D.Y., Friederici A.D. On the lateralization of emotional prosody: an event-related functional MR investigation. Brain Lang. 2003, 86:366-376.
41. Lambertz N., Gizewski E.R., de Greiff A., Forsting M. Cross-modal plasticity in deaf subjects dependent on the extent of hearing loss. Cogn. Brain Res. 2005, 25:884-890.
42. MacSweeney M., Woll B., Campbell R., McGuire P.K., David A.S., Williams S.C., Suckling J., Calvert G.A., Brammer M.J. Neural systems underlying British Sign Language and audio-visual English processing in native users. Brain 2002, 125:1583-1593.
43. MacWhinney, B., Bates, E., 1989. The Crosslinguistic Study of Sentence Processing. Cambridge University Press, New York.
44. Maess B., Koelsch S., Gunter T.C., Friederici A.D. Musical syntax is processed in Broca's area: an MEG study. Nat. Neurosci. 2001, 4:540-545.
45. McCullough S., Emmorey K., Sereno M. Neural organization for recognition of grammatical and emotional facial expressions in deaf ASL signers and hearing nonsigners. Brain Res. Cogn. Brain Res. 2005, 22:193-203.
46. Meyer M., Friederici A.D., von Cramon D.Y. Neurocognition of auditory sentence comprehension: event related fMRI reveals sensitivity to syntactic violations and task demands. Cogn. Brain Res. 2000, 9:19-33.
47. Meyer M., Alter K., Friederici A.D., Lohmann G., von Cramon D.Y. fMRI reveals brain regions mediating slow prosodic modulations in spoken sentences. Hum. Brain Mapp. 2002, 17:73-88.
48. Meyer, M., Toepel, U., Keller, J., Friederici, A., 2004. The neural substrates of German Sign Language (DGS). Cognitive Neuroscience Society Abstracts 12.
49. Mitchell R.L., Elliott R., Barry M., Cruttenden A., Woodruff P.W. The neural response to emotional prosody, as revealed by functional magnetic resonance imaging. Neuropsychologia 2003, 41:1410-1421.
50. Narumoto J., Okada T., Sadato N., Fukui K., Yonekura Y. Attention to emotion modulates fMRI activity in human right superior temporal sulcus. Cogn. Brain Res. 2001, 12:225-231.
51. Neville H.J., Lawson D. Attention to central and peripheral visual space in a movement detection task: III. Separation effects of auditory deprivation and acquisition of a visual language. Brain Res. 1987, 405:284-294.
52. Neville H.J., Bavelier D., Corina D., Rauschecker J., Karni A., Lalwani A., Braun A., Clark V., Jezzard P., Turner R. Cerebral organization for language in deaf and hearing subjects: biological constraints and effects of experience. Proc. Natl. Acad. Sci. U. S. A. 1998, 95:922-929.
53. Newman A.J., Bavelier D., Corina D., Jezzard P., Neville H.J. A critical period for right hemisphere recruitment in American Sign Language processing. Nat. Neurosci. 2002, 5:76-80.
54. Newman A.J., Suaplla T., Hauser P., Newport E., Bavelier D. Contrasting neural subsystems involved word order and inflection. Proc. Natl. Acad. Sci. U.S.A. 2010, 107(16):7539-75440. doi:10.1073/pnas.1003174107.
55. Oldfield R.C. The assessment and analysis of handedness: the Edinburgh Inventory. Neuropsychologia 1971, 9:97-113.
56. Petitto L.A., Zatorre R.J., Gauna K., Nikelski E.J., Dostie D., Evans A.C. Speech-like cerebral activity in profoundly deaf people processing signed languages: implications for the neural basis of human language. Proc. Natl. Acad. Sci. U. S. A. 2000, 97:13961-13966.
57. Poizner H., Bellugi U., Klima E.S. What the hands reveal about the brain 1987, MIT Press, Cambridge, MA.
58. Rayner K. Eye movements in reading and information processing: 20years of research. Psychol. Bull. 1998, 124:372-422.
59. Rehak A., Kaplan J.A., Gardner H. Sensitivity to conversational deviance in right-hemisphere-damaged patients. Brain Lang. 1992, 42:203-217.
60. Ross E.D. The aprosodias: functional-anatomic organization of affective components of language in the right hemisphere. Ann. Neurol. 1981, 38:561-589.
61. Sakai K.L., Tatsuno Y., Suzuki K., Kimura H., Ichida Y. Sign and speech: amodal commonality in left hemisphere dominance for comprehension of sentences. Brain 2005, 128:1407-1417.
62. San Jose-Robertson L., Corina D.P., Ackerman D., Guillemin A., Braun A.R. Neural systems for sign language production: mechanisms supporting lexical selection, phonological encoding, and articulation. Hum. Brain Mapp. 2004, 23:156-167.
63. Saxe R., Wexler A. Making sense of another mind: the role of the right temporo-parietal junction. Neuropsychologia 2005, 43:1391-1399.
64. Saxe R., Xiao D.K., Kovacs G., Perrett D.I., Kanwisher N. A region of right posterior superior temporal sulcus responds to observed intentional actions. Neuropsychologia 2004, 42:1435-1446.
65. Schmitt J.J., Hartje W., Willmes K. Hemispheric asymmetry in the recognition of emotional attitude conveyed by facial expression, prosody and propositional speech. Cortex 1997, 33:65-81.
66. Smith S.M. Fast robust automated brain extraction. Hum. Brain Mapp. 2002, 17:143-155.
67. St George M., Kutas M., Martinez A., Sereno M.I. Semantic integration in reading: engagement of the right hemisphere during discourse processing. Brain 1999, 122:1317-1325.
68. Tillmann B., Koelsch S., Escoffier N., Bigand E., Lalitte P., Friederici A.D., von Cramon D.Y. Cognitive priming in sung and instrumental music: activation of inferior frontal cortex. NeuroImage 2006, 31:1771-1782.
69. Tzourio-Mazoyer N., Landeau B., Papathanassiou D., Crivello F., Etard O., Delcroix N., Mazoyer B., Joliot M. Automated anatomical labeling of activations in SPM using a macroscopic anatomical parcellation of the MNI MRI single-subject brain. NeuroImage 2002, 15:273-289.
70. Ullman M.T. A neurocognitive perspective on language: the declarative/procedural model. Nat. Rev. Neurosci. 2001, 2:717-726.
71. Vogel J.J., Bowers C.A., Vogel D.S. Cerebral lateralization of spatial abilities: a meta-analysis. Brain Cogn. 2003, 52:197-204.
72. Woolrich M.W. Robust group analysis using outlier inference. NeuroImage 2008, 41:286-301.
73. Woolrich M.W., Ripley B.D., Brady M., Smith S.M. Temporal autocorrelation in univariate linear modeling of fMRI data. NeuroImage 2001, 14:1370-1386.
74. Woolrich M.W., Behrens T.E., Beckmann C.F., Jenkinson M., Smith S.M. Multilevel linear modelling for fMRI group analysis using Bayesian inference. NeuroImage 2004, 21:1732-1747.
75. Worsley K. Statistical analysis of activation images. Functional MRI: an introduction to methods 2001, Oxford University Press, New York. P. Jezzard, P.M. Matthews, S.M. Smith (Eds.).
76. Wright T.M., Pelphrey K.A., Allison T., McKeown M.J., McCarthy G. Polysensory interactions along lateral temporal regions evoked by audiovisual speech. Cereb. Cortex 2003, 13:1034-1043.
77. Wymer J.H., Lindman L.S., Booksh R.L. A neuropsychological perspective of aprosody: features, function, assessment, and treatment. Appl. Neuropsychol. 2002, 9:37-47.
78. Zatorre R.J., Evans A.C., Meyer E., Gjedde A. Lateralization of phonetic and pitch discrimination in speech processing. Science 1992, 256:846-849.