The cognitive neuroscience of signed language: Applications to a working memory system for sign and speech

Memory, Aging and the Brain: A Festschrift in Honour of Lars-Göran Nilsson

Volumn , Issue , 2009, Pages 265-286

  Rönnberg, Jerker ^a   Rudner, Mary ^a   Foo, Catharina ^b  

^a Linköping University   (Sweden)

^b LINKÖPING UNIVERSITY   (Sweden)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 77951073521     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.4324/9780203866665     Document Type: Chapter

References (105)

1. Allen, R. J., Baddeley, A. D., & Hitch, G. J. (2006). Is the binding of visual features in working memory resource-demanding? Journal of Experimental Psychology:General, 135, 298-313.
2. Andersson, U. (2002). Deterioration of the phonological processing skills in adults with an acquired severe hearing loss. European Journal of Cognitive Psychology, 14, 335-352.
3. Andersson, U., Lyxell, B., Rönnberg, J., & Spens, K.-E. (2001a). Cognitive predictors of visual speech understanding. Journal of Deaf Studies and Deaf Education, 6, 103-115.
4. Andersson, U., Lyxell, B., Rönnberg, J., & Spens, K.-E. (2001b). A follow-up study on the effects of speech tracking training on visual speechreading of sentences and words: Cognitive prerequisites and chronological age. Journal of Deaf Studies and Deaf Education, 6, 116-129.
5. Atkinson, J., Campbell, R., Marshall, J., Thacker, A., & Woll, B. (2004). Understanding "not": neuropsychological dissociations between hand and head markers of negation in BSL. Neuropsychologia, 42, 214-229.
6. Atkinson, J., Marshall, J., Woll, B., & Thacker, A. (2005). Testing comprehension abilities in users of BSL following CVA. Brain & Language, 94, 233-248.
7. Baddeley, A. D. (2000). The episodic buffer: A new component of working memory? Trends in Cognitive Science, 4, 417-423.
8. Barch, D. M., Braver, T. S., Nystrom, L. E., Forman, S. D., Noll, D. C., & Cohen, J. D. (1997). Dissociating working memory from task difficulty in human prefrontal cortex. Neuropsychologia, 35, 1373-1380.
9. Bavelier, D., Corina, D., Jezzard, P., Clark, V., Karni, A., Lalwani, A., et al. (1998). Hemispheric specialization for English and ASL: Left invariance-right variability. NeuroReport, 9, 1537-1542.
10. Bellugi, U., Poizner, H., & Klima, E. S. (1983). Brain organization for language: Clues from sign aphasia. Human Neurobiology, 2, 155-170.
11. Bergman, B. (1982). Studies in Swedish sign language. Doctoral dissertation, Institute of Linguistics, University of Stockholm, Sweden.
12. Bergman, B. (1983). Verbs and adjectives: Morphological processes in Swedish sign language. In: J. Kyle & B. Woll (Eds.), Language in sign: An international perspective on sign language. London: Croom Helm.
13. Bergman, B. (1990). Grammaticalisation of location. In: W. H. Edmondson & F. Karlsson (Eds.), SLR'87. Papers from The Fourth International Symposium on Sign Language Research (Lapeenranta, Finland). Hamburg: Signum-Press.
14. Boutla, M., Supalla, T., Newport, E. L., & Bavelier, D. (2004). Short-term memory span: Insights from sign language. Nature Neuroscience, 7(9), 997-1002.
15. Braver, T. S., Cohen, J. D., Nystrom, L. E., Jonides, J., Smith, E. E., & Noll, D. C. (1997). A parametric study of prefrontal cortex involvement in human working memory. NeuroImage, 5, 49-62.
16. Cabeza, R., & Nyberg, L. (2000). Imaging cognition II: An empirical review of 275 PET and fMRI studies. Journal of Cognitive Neuroscience, 12(1), 1-47.
17. Calvert, G. A., Bullmore, E. T., Brammer, M. J., Campbell, R., Williams, S. C. R., McGuire, P. K., et al. (1997). Activation of auditory cortex during silent lipreading. Science, 276, (5312), 593-596.
18. Corina, D., Kritchevsky, M., & Bellugi, U. (1996). Visual language processing and The cognitive neuroscience of signed language 281 unilateral neglect: Evidence from American sign language. Cognitive Neuropsychology, 3, 321-356.
19. Courtin, M., & Melot, A. M. (2005). Metacognitive development of deaf children:Lessons from the appearance-reality and false belief tasks. Developmental Science, 8(1), 16-25.
20. Daneman, M., & Merikle, P M. (1996). Working memory and language comprehension:A meta-analysis. Psychonomic Bulletin & Review, 3(4), 422-433.
21. Dillon, H. (2001). Hearing aids. Stuttgart: Thieme.
22. Emmorey, K. (2002). Language, cognition and the brain: Insights from sign language research. Mahwah, NJ: Lawrence Erlbaum Associates, Inc.
23. Emmorey, K., Grabowski, T., McCullough, S., Damasio, H., Ponto, L. B., Hichwa, D., et al. (2003). Neural systems underlying lexical retrieval for sign language. Neuropsychologia, 41, 85-95.
24. Foo, C., Rudner, M., Rönnberg, J., & Lunner, T. (2007). Recognition of speech in noise with new hearing instrument compression release settings requires explicit cognitive storage and processing capacity. Journal of American Academy of Audiology, 18, 553-566.
25. Hagerman, B. (1982). Sentences for testing speech-intelligibility in noise. Scandinavian Audiology, 11, 79.
26. Hagerman, B., & Kinnefors, C. (1995). Efficient adaptive methods for measuring speech reception threshold in quiet and in noise. Scandinavian Audiology, 24(1), 71-77.
27. Hällgren, M., Larsby, B., & Arlinger, S. (2006). A Swedish version of the Hearing In Noise Test (HINT) for measurement of speech recognition. International Journal of Audiology, 45(4), 227-237.
28. Hannon, B., & Daneman, M. (2001). A new tool for measuring and understanding individual differences in the component processes of reading comprehension. Journal of Educational Psychology, 93(1): 103-128.
29. Hickok, G., Bellugi, U., & Klima, E. S. (1998). What's right about the neural organization of sign language? A perspective on recent neuroimaging results. Trends in Cognitive Sciences, 2, 465-467.
30. Hickok, G., Klima, E. S., & Bellugi, U. (1996a). The neurobiology of sign language and its implications for the neural basis of language. Nature, 381, 699-702.
31. Hickok, G., Kritchevsky, M., Bellugi, U., & Klima, E. S. (1996b). The role of the frontal operculum in sign language aphasia. Neurocase, 5, 373-380.
32. Hickok, G., Say, K., Bellugi, U., & Klima, E. S. (1996c). The basis for hemispheric asymmetries for language and spatial cognition: Clues from focal brain damage in two deaf signers. Aphasiology, 10, 577-591.
33. Höien, T., Lundberg, I., Stanovitch, K., & Bjaalid, I.-K. (1995). Components of phonological awareness. Reading and Writing, 7, 171-188.
34. Hygge, S., Rönnberg, J., Larsby, B., & Arlinger, S. (1992). Normal and hearingimpaired subjects' ability to just follow conversation in competing speech, reversed speech, and noise backgrounds. Journal of Speech and Hearing Research, 35, 208-215.
35. Kegl. J., Cohen, H., & Poizner, H. (1999). Articulatory consequences of Parkinson's disease: Perspectives from two modalities. Brain and Cognition, 40, 355-386.
36. Kim, J. J., Kim, M. S., Lee, J. S., Lee, D. S., Lee, M. C., & Kwon, J. S. (2002). Dissociation of working memory processing associated with native and second languages: PET investigation. NeuroImage, 15, 879-891.
37. Lee, H.-J., Truy, E., Mamou, G., Sappey-Marinier, D., & Giraud, A-L. (2007). Visual speech circuits in profound acquired deafness: A possible role for latent multimodal connectivity. Brain, 130, 2929-2941.
38. Levänen, S. (1998). Neuromagnetic studies of human auditory cortex function and reorganization. Scandinavian Audiology, Supplement 27(49), 16.
39. Leybaert, J. (1998). Phonological representations in deaf children: The importance of early linguistic experience. Scandinavian Journal of Psychology, 39, 169-173.
40. Leybaert, J., & Charlier, B. L. (1996). Visual speech in the head: The effect of cued speech on rhyming, remembering, and spelling. Journal of Deaf Studies and Deaf Education, 1, 234-248.
41. Lidestam, B. (2003). Semantic framing of speech: Emotional and topical cues in perception of poorly specified speech [Doctoral dissertation, Linköping University, Sweden]. Linköping Studies in Education and Psychology, 94.
42. Lillo-Martin, D. (1997). The modular effects of sign language acquisition. In M. Marschark & V. S. Everhart (Eds.), Relations of language and thought: The view from sign language and deaf children (pp. 62-109). Oxford, UK: Oxford University Press.
43. Lyxell, B. (1994). Skilled speechreading: A single case study. Scandinavian Journal of Psychology, 35, 212-219.
44. Lyxell, B., Arlinger, S., Andersson, J., Bredberg, G., Harder, H., & Rönnberg, J. (1998). Phonological representation and speech understanding with cochlear implants in deafened adults. Scandinavian Journal of Psychology, 39, 175-179.
45. Lyxell, B., Arlinger, S., Andersson, J., Harder, H., Näsström, E., Svensson, H., et al. (1996). Information-processing capabilities and cochlear implants: Pre-operative predictors for speech understanding. Journal of Deaf Studies and Deaf Education, 1, 190-201.
46. Lyxell, B., & Rönnberg, J. (1989). Information-processing skills and speechreading. British Journal of Audiology, 23, 339-347.
47. Lyxell, B., & Rönnberg, J. (1991). Visual speech processing: Word decoding and word discrimination related to sentence-based speechreading and hearing-impairment. Scandinavian Journal of Psychology, 32, 9-17.
48. Lyxell, B., & Rönnberg, J. (1992). The relationship between verbal ability and sentence-based speechreading. Scandinavian Audiology, 21, 67-72.
49. Lyxell, B., Rönnberg, J., & Samuelsson, S. (1994). Internal speech functioning and speechreading in deafened and normal hearing adults. Scandinavian Audiology, 23, 179-185.
50. MacSweeney, M., Campbell, R., Woll, B., Brammer, M. J., Giampietro, V., David, A. S., et al. (2006). Lexical and sentential processing in British Sign Language. Human Brain Mapping, 27(1), 63-76.
51. MacSweeney, M., Campbell, R., Woll, B., Giampietro, V., David, A. S., McGuire, P. K., et al. (2004). Dissociating linguistic and nonlinguistic gestural communication in the brain. NeuroImage, 22(4), 1605-1618.
52. Marshall, J., Atkinson, J., Smulovitch, E., Thacker, A., & Woll., B. (2004). Aphasia in a user of British Sign Language: Dissociation between sign and gesture. Cognitive Neuropsychology, 21(5), 537-554.
53. McGuire, P. K., Robertson, D., Thacker, A., David, A. S., Kitson, N., Frackowiak, R. S. J., et al. (1997). Neural correlates of thinking in sign language. NeuroReport, 8, 695-698.
54. Meyer, M., Toepel, U., Keller, J., Nussbaumer, D., Zysset, S., & Friedrici, A. D. (2007). Neuroplasticity of sign language: Implications from structural and functional brain imaging. Restorative Neurology and Neuroscience, 25, 335-351.
55. Milkovic, M., Bradaric-Joncic, S., & Wilbur, R. B. (2007). Information status and word order in Croatian Sign Language. Clinical Linguistics & Phonetics, 21(11), 1007-1017.
56. Newman, A. J., Bavelier, D., Corina, D., Jezzard, P., & Neville, H. J. (2002). A critical period for right hemisphere recruitment in American Sign Language processing. Nature Neuroscience, 5(1), 76-80.
57. Neville, H. J., Bavelier, D., Corina, D., Rauschecker, J., Karni, A., Lawani, A., et al. (1998). Cerebral organization for language in deaf and hearing subjects: Biological constraints and effects of experience. Proceedings of the National Academy of Sciences USA, 95, 922-929.
58. Neville, H. J., Coffey, S. A., Lawson, D. S., Fischer, A., Emmorey, K., & Bellugi, U. (1997). Neural systems mediating American Sign Language: Effects of sensory experience and age of acquisition. Brain and Language, 57, 285-308.
59. Nilsson, M. Soli, S. D., & Sullivan, J. A. (1994). Development of the Hearing In Noise Test for the measurement of speech reception thresholds in quiet and in noise. Journal of the Acoustical Society of America, 95, 1085-1099.
60. Nishimura, H., Hashikawa, K., Doi, K., Iwaki, T., Watanabe, Y., Kusuoka, H., et al. (1999). Sign language "heard" in the auditory cortex. Nature, 397, 116.
61. Öhngren, G. (1992). Components of tactually mediated speechreading. Unpublished doctoral thesis, Uppsala University, Sweden.
62. Osaka, N., Osaka, M., Kondo, H., Morishita, M., Fukuyama, H., & Shibasaki, H. (2004). The neural basis of executive function in working memory: An fMRI study based on individual differences. NeuroImage, 21, 623-631.
63. Petitto, L. A., Zatorre, R. J., Gauna, K., Nikelski, E. J., Dostie, D., Evans, A. C. (2000). Speech-like cerebral activity in profoundly deaf people processing signed languages: Implications for the neural basis of human language. Proceedings of the National Academy of Sciences USA, 97(25), 13961-13966.
64. Pichora-Fuller, K. (2003). Processing speed: Psychoacoustics, speech perception, and comprehension. International Journal of Audiology, 42, S59-S67.
65. Poizner, H., Klima, E. S., & Bellugi, U. (1987). What the hands reveal about the brain. Cambridge, MA: MIT Press.
66. Poizner, H., Klima, E. S., & Bellugi, U. (1990). Biological foundation of language:Clues from sign language. Annual Review of Neuroscience, 13, 283-307.
67. Prabhakaran, V., Narayanan, K., Zhao, Z., & Gabrielli, J. D. E. (2000). Integration of diverse information in working memory in the frontal lobe. Nature Neuroscience, 3, 85-90.
68. Repovs, G., & Baddeley, A. (2006). The multi-component model of working memory:Explorations in experimental cognitive psychology. Neuroscience, 139(1), 5-21.
69. Rönnberg, J. (1990). Cognitive and communicative function: The effects of chronological age and "handicap age". European Journal of Cognitive Psychology, 2, 253-273.
70. Rönnberg, J. (1993). Cognitive characteristics of skilled tactiling: The case of GS. European Journal of Cognitive Psychology, 5, 19-33.
71. Rönnberg, J. (1995). What makes a skilled speechreader? In G. Plant & K. Spens (Eds.), Profound deafness and speech communication (pp. 393-416). London:Whurr.
72. Rönnberg, J. (2003a). Cognition in the hearing impaired and deaf as a bridge between signal and dialogue: A framework and a model. International Journal of Audiology, 42: S68-S76.
73. Rönnberg, J. (2003b). Working memory, neuroscience, and language. In M. Marschark & P. E. Spencer (Eds.), Oxford handbook of deaf studies, language, and education (pp. 478-489). Oxford, UK: Oxford University Press.
74. Rönnberg, J., Andersson, J., Andersson, U., Johansson, K., Lyxell, B., & Samuelsson, S. (1998a). Cognition as a bridge between signal and dialogue: Communication in the hearing impaired and deaf. Scandinavian Audiology, 27(suppl. 49), 101-108.
75. Rönnberg, J., Andersson, J., Samuelsson, S., Söderfeldt, B., Lyxell, B., & Risberg, J. (1999). A speechreading expert: The case of MM. Journal of Speech, Language, and Hearing Research, 42, 5-20.
76. Rönnberg, J., Andersson, U., Lyxell, B., & Spens, K. (1998b). Vibrotactile speechreading support: Cognitive prerequisites for training. Journal of Deaf Studies & Deaf Education, 3, 143-156.
77. Rönnberg, J., Arlinger, S., Lyxell, B., & Kinnefors, C. (1989). Visual evoked potentials:Relation to adult speechreading and cognitive function. Journal of Speech and Hearing Research, 32, 725-735.
78. Rönnberg, J., Rudner, M., & Ingvar, M. (2004). Neural correlates of working memory for sign language. Cognitive Brain Research, 20, 165-182.
79. Rönnberg, J., Samuelsson, S., & Lyxell, B. (1998c). Conceptual constraints in sentence-based lipreading in the hearing impaired. In R. Campbell, B. Dodd, & D. Burnham (Eds.), Hearing by eye: Part II. Advances in the psychology of speechreading and audiovisual speech (pp. 143-153). London: Lawrence Erlbaum Associates.
80. Rönnberg, J., Söderfeldt, B., & Risberg, J. (1998d). Regional cerebral blood flow during signed and heard episodic and semantic tasks. Applied Neuropsychology, 5, 132-138.
81. Rönnberg, J., Söderfeldt, B., & Risberg, J. (2000). The cognitive neuroscience of signed language. Acta Psychologica, 105, 237-254.
82. Rudner, M., Foo, C., Rönnberg, J., & Lunner, T. (in press). Cognition and aided speech recognition in noise: Specific role for cognitive factors following nine-week experience with adjusted compression settings on hearing aids. Scandinavian Journal of Psychology.
83. Rudner, M., Fransson, P., Ingvar, M., Nyberg, L., & Rönnberg, J. (2007). Neural representation of binding lexical signs and words in the episodic buffer of working memory. Neuropsychologia, 45(10), 2258-2276.
84. Rudner, M., & Rönnberg, J. (2004). Perceptual saliency in the visual channel enhances explicit language processing. Iranian Audiology, 3(1), 16-26.
85. Rudner, M., & Rönnberg, J. (2006). Towards a functional ontology for working memory for sign and speech. Cognitive Processing, 7, S183-S186.
86. Rudner, M., & Rönnberg, J. (2008). The role of the episodic buffer in working memory for language processing. Cognitive Processing, 9, 19-28.
87. Sakai, K. L., Tatsuno, Y., Suzuki, K., Kimura, H., & Ichida, Y. (2005). Sign and speech: Amodal commonality in left hemisphere dominance for comprehension of sentences. Brain, 128, 1407-1417.
88. Siple, P. (1997). Universals, generalizability, and the acquisition of sign language. In M. Marschark & V. S. Everhart (Eds.), Relations of language and thought: The view from sign language and deaf children (pp. 24-61). Oxford, UK: Oxford University.
89. Smith, E. E., & Jonides, J. (1997). Working memory: A view from neuroimaging. Cognitive Psychology, 33, 5-42.
90. Smith, M. E. G., & Campbell, P. (1997). Discourses on deafness: Social policy and the communicative habilitation of the deaf. Canadian Journal of Sociology, 22, 437-456.
91. Söderfeldt, B., Ingvar, M., Rönnberg, J., Eriksson, L., Serrander, M., & Stone-Elander, S. (1997). Signed and spoken language perception studied by positron emission tomography. Neurology, 49, 82-87.
92. Söderfeldt, B., Rönnberg, J., & Risberg, J. (1994a). Regional cerebral blood flow in sign-language users. Brain and Language, 46, 59-68.
93. Söderfeldt, B., Rönnberg, J., & Risberg, J. (1994b). Regional cerebral blood flow during sign language perception: A comparison between deaf and hearing subjects with deaf parents. Sign Language Studies, 84, 199-208.
94. Stokoe, W. C. (1960). Sign language structure: An outline of the visual communication systems of the American deaf. In Studies in Linguistics: Occasional papers (Vol. 8). Buffalo, NY: University of Buffalo.
95. Stokoe, W. C., Casterline, D., & Croneberg, C. (1965). Dictionary of American Sign Language. Washington, DC: Gallaudet College Press.
96. Suchan, B., Linnewerth, B. Köster, O., Daum, I., & Schmid, G. (2006). Cross-modal processing in auditory and visual working memory. NeuroImage, 29, 853-858.
97. Summerfield, Q. (1987). Some preliminaries to a comprehensive account of audiovisual speech perception. In B. Dodd & R. Campbell (Eds.), Hearing by eye: The psychology of lipreading (pp. 3-51). Hillsdale, NJ: Lawrence Erlbaum Associates.
98. Sutton-Spence, R., & Woll, B. (1998). Fingerspelling as a resource for lexical innovation in British sign language. In M. K. Verma (Ed.), Sociolinguistics, language and society: Language and development (Vol. 5, pp. 10-143). New Delhi: Sage.
99. Wallin, L. (1996). Polysynthetic signs in Swedish sign language. Doctoral dissertation, Stockholm University, Sweden.
100. Wilson, K., & Emmorey, K. (1997a). A visuospatial "phonological" loop in working memory: Evidence from American Sign Language. Memory & Cognition, 25, 313-320.
101. Wilson, K., & Emmorey, K. (1997b). Working memory for sign language: A window into the architecture of the working memory system. Journal of Deaf Studies and Deaf Education, 2, 121-130.
102. Wilson, K., & Emmorey, K. (1998). A "word length" for sign language: Further evidence for the role of language in structuring working memory. Memory & Cognition, 26, 584-591.
103. Woll, B. (1990). Sign language. In N. E. Collinge (Ed.), An encyclopedia of language (pp. 740-783). London: Routledge.
104. Zago, L., & Tzourio-Mazoyer, N. (2002). Distinguishing visuospatial working memory and complex mental calculation areas within the parietal lobes. Neuroscience Letters, 331, 45-49.
105. Zhang, D., Zhang, X., Sun, X., Li, Z., Wang, Z., He, S., et al. (2004). Cross-modal temporal order memory for auditory digits and visual locations: An fMRI study. Human Brain Mapping, 22(4), 280-289.