Neural organization of linguistic short-term memory is sensory modality-dependent: Evidence from signed and spoken language

Journal of Cognitive Neuroscience

Volumn 20, Issue 12, 2008, Pages 2198-2210

  Pa, Judy ^a   Wilson, Stephen M ^a   Pickell, Herbert ^b   Bellugi, Ursula ^b   Hickok, Gregory ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b SALK INSTITUTE FOR BIOLOGICAL STUDIES   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; BRAIN REGION; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HEARING; HUMAN; HUMAN EXPERIMENT; LANGUAGE; LINGUISTICS; MALE; NERVE CELL NETWORK; NEUROPHYSIOLOGICAL RECRUITMENT; NORMAL HUMAN; PHONETICS; PRIORITY JOURNAL; SENSORIMOTOR INTEGRATION; SENSORY MEMORY; SHORT TERM MEMORY; TASK PERFORMANCE;

ACOUSTIC STIMULATION; ADULT; BRAIN; BRAIN MAPPING; FEMALE; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; LINGUISTICS; MAGNETIC RESONANCE IMAGING; MALE; MEMORY, SHORT-TERM; OXYGEN; SIGN LANGUAGE; SPEECH; VERBAL LEARNING; YOUNG ADULT;

EID: 56649108209     PISSN: 0898929X     EISSN: 15308898     Source Type: Journal    
DOI: 10.1162/jocn.2008.20154     Document Type: Article

References (56)

1. Andersen, R. (1997). Multimodal integration for the representation of space in the posterior parietal cortex. Philosophical Transactions of the Royal Society of London, Series B, Biological Sciences, 352, 1421-1428.
2. Baddeley, A. D. (1992). Working memory. Science, 255, 556-559.
3. Baddeley, A. D., & Larsen, J. D. (2007a). The phonological loop unmasked? A comment on the evidence for a "perceptual-gestural" alternative. Quarterly Journal of Experimental Psychology (Colchester), 60, 497-504.
4. Baddeley, A. D., & Larsen, J. D. (2007b). The phonological loop: Some answers and some questions. Quarterly Journal of Experimental Psychology (Colchester), 60, 512-518.
5. Beauchamp, M. S., Argall, B. D., Bodurka, J., Duyn, J. H., & Martin, A. (2004). Unraveling multisensory integration: Patchy organization within human STS multisensory cortex. Nature Neuroscience, 7, 1190-1192.
6. Boutla, M., Supalla, T., Newport, E. L., & Bavelier, D. (2004). Short-term memory span: Insights from sign language. Nature Neuroscience, 7, 997-1002.
7. Buchsbaum, B., Hickok, G., & Humphries, C. (2001). Role of left posterior superior temporal gyrus in phonological processing for speech perception and production. Cognitive Science, 25, 663-678.
8. Buchsbaum, B., Pickell, B., Love, T., Hatrak, M., Bellugi, U., & Hickok, G. (2005). Neural substrates for verbal working memory in deaf signers: fMRI study and lesion case report. Brain and Language, 95, 265-272.
9. Buchsbaum, B. R., Olsen, R. K., Koch, P., & Berman, K. F. (2005). Human dorsal and ventral auditory streams subserve rehearsal-based and echoic processes during verbal working memory. Neuron, 48, 687-697.
10. Chaminade, T., Meltzoff, A. N., & Decety, J. (2005). An fMRI study of imitation: Action representation and body schema. Neuropsychologia, 43, 115-127.
11. Corina, D., Chiu, Y. S., Knapp, H., Greenwald, R., San Jose-Robertson, L., & Braun, A. (2007). Neural correlates of human action observation in hearing and deaf subjects. Brain Research, 1152, 111-129.
12. Courtney, S. M., Ungerleider, L. G., Keil, K., & Haxby, J. V. (1997). Transient and sustained activity in a distributed neural system for human working memory. Nature, 386, 608-611.
13. Downing, P. E., Jiang, Y., Shuman, M., & Kanwisher, N. (2001). A cortical area selective for visual processing of the human body. Science, 293, 2470-2473.
14. Duvernoy, H. M. (1999). The human brain: Surface, three-dimensional sectional anatomy with MRI, and blood supply. New York: Springer-Verlag Wein.
15. Emmorey, K. (1995). Processing the dynamic visual-spatial morphology of signed languages. In L. B. Feldman (Ed.), Morphological aspects of language processing: Crosslinguistic perspectives (pp. 29-54). Hillsdale, NJ: Erlbaum.
16. Emmorey, K. (2002). Language, cognition, and the brain: Insights from sign language research. Mahwah, NJ: Erlbaum.
17. Emmorey, K., Mehta, S., & Grabowski, T. J. (2007). The neural correlates of sign versus word production. Neuroimage, 36, 202-208.
18. Finney, E. M., Clementz, B. A., Hickok, G., & Dobkins, K. R. (2003). Visual stimuli activate auditory cortex in deaf subjects: Evidence from MEG. NeuroReport, 14, 1425-1427.
19. Fuster, J. M. (1995). Memory in the cerebral cortex. Cambridge: MIT Press.
20. Griffiths, T. D., & Warren, J. D. (2002). The planum temporale as a computational hub. Trends in Neurosciences, 25, 348-353.
21. Grill-Spector, K., Kourtzi, Z., & Kanwisher, N. (2001). The lateral occipital complex and its role in object recognition. Vision Research, 41, 1409-1422.
22. Grossman, E., Donnelly, M., Price, R., Pickens, D., Morgan, V., Neighbor, G., et al. (2000). Brain areas involved in perception of biological motion. Journal of Cognitive Neuroscience, 12, 711-720.
23. Hickok, G., Buchsbaum, B., Humphries, C., & Muftuler, T. (2003). Auditory-motor interaction revealed by fMRI: Speech, music, and working memory in area Spt. Journal of Cognitive Neuroscience, 15, 673-682.
24. Hickok, G., & Poeppel, D. (2000). Towards a functional neuroanatomy of speech perception. Trends in Cognitive Sciences, 4, 131-138.
25. Hickok, G., & Poeppel, D. (2004). Dorsal and ventral streams: A framework for understanding aspects of the functional anatomy of language. Cognition, 92, 67-99.
26. Hickok, G., & Poeppel, D. (2007). The cortical organization of speech processing. Nature Reviews Neuroscience, 8, 393-402.
27. Holmes, C. J., Hoge, R., Collins, L., Woods, R., Toga, A. W., & Evans, A. C. (1998). Enhancement of MR images using registration for signal averaging. Journal of Computer Assisted Tomography, 22, 324-333.
28. Jacquemot, C., & Scott, S. K. (2006). What is the relationship between phonological short-term memory and speech processing? Trends in Cognitive Sciences, 10, 480-486.
29. Jenkinson, M., & Smith, S. M. (2001). A global optimisation method for robust affine registration of brain images. Medical Image Analysis, 5, 143-156.
30. Jones, D. M., Hughes, R. W., & Macken, W. J. (2006). Perceptual organization masquerading as phonological storage: Further support for a perceptual-gestural view of short-term memory. Journal of Memory and Language, 54, 265-281.
31. Jones, D. M., Hughes, R. W., & Macken, W. J. (2007). The phonological store abandoned. Quarterly Journal of Experimental Psychology (Colchester), 60, 505-511.
32. Jones, D. M., & Macken, W. J. (1996). Irrelevant tones produce an irrelevant speech effect: Implications for phonological coding in working memory. Journal of Experimental Psychology: Learning, Memory, and Cognition, 19, 369-381.
33. Jones, D. M., Macken, W. J., & Nicholls, A. P. (2004). The phonological store of working memory: Is it phonological and is it a store? Journal of Experimental Psychology. Learning, Memory, and Cognition, 30, 656-674.
34. Jones, D. M., & Tremblay, S. (2000). Interference in memory by process or content? A reply to Neath. Psychonomic Bulletin & Review, 7, 550-558.
35. Koechlin, E., & Jubault, T. (2006). Broca's area and the hierarchical organization of human behavior. Neuron, 50, 963-974.
36. MacSweeney, M., Woll, B., Campbell, R., McGuire, P. K., David, A. S., Williams, S. C., et al. (2002). Neural systems underlying British Sign Language and audio-visual English processing in native users. Brain, 125, 1583-1593.
37. Milner, A. D., & Goodale, M. A. (1995). The visual brain in action. Oxford: Oxford University Press.
38. Neath, I. (2000). Modeling the effects of irrelevant speech on memory. Psychonomic Bulletin & Review, 7, 403-423.
39. Pasternak, T., & Greenlee, M. W. (2005). Working memory in primate sensory systems. Nature Reviews Neuroscience, 6, 97-107.
40. Peigneux, P., Van der Linden, M., Garraux, G., Laureys, S., Degueldre, C., Aerts, J., et al. (2004). Imaging a cognitive model of apraxia: The neural substrate of gesture-specific cognitive processes. Human Brain Mapping, 21, 119-142.
41. Pessoa, L., Gutierrez, E., Bandettini, P., & Ungerleider, L. (2002). Neural correlates of visual working memory: fMRI amplitude predicts task performance. Neuron, 35, 975-987.
42. Petitto, L. A., Zatorre, R. J., Gauna, K., Nikelski, E. J., Dostie, D., & Evans, A. C. (2000). Speech-like cerebral activity in profoundly deaf people processing signed languages: Implications for the neural basis of human language. Proceedings of the National Academy of Sciences, U.S.A., 97, 13961-13966.
43. Postle, B. R. (2006). Working memory as an emergent property of the mind and brain. Neuroscience, 139, 23-38.
44. Ronnberg, J., Rudner, M., & Ingvar, M. (2004). Neural correlates of working memory for sign language. Brain Research, Cognitive Brain Research, 20, 165-182.
45. Ruchkin, D. S., Grafman, J., Cameron, K., & Berndt, R. S. (2003). Working memory retention systems: A state of activated long-term memory. Behavioral and Brain Sciences, 26, 709-777.
46. Smith, E. E., & Jonides, J. (1999). Storage and executive processing the frontal lobes. Science, 283, 1657-1661.
47. Smith, S. M. (2002). Fast robust automated brain extraction. Human Brain Mapping, 17, 143-155.
48. Smith, S. M., Jenkinson, M., Woolrich, M. W., Beckmann, C. F., Behrens, T. E., Johansen-Berg, H., et al. (2004). Advances in functional and structural MR image analysis and implementation as FSL. Neuroimage, 23(Suppl. 1), S208-S219.
49. Stevens, A. A. (2004). Dissociating the cortical basis of memory for voices, words and tones. Cognitive Brain Research, 18, 162-171.
50. Thompson-Schill, S. L., Bedny, M., & Goldberg, R. F. (2005). The frontal lobes and the regulation of mental activity. Current Opinion in Neurobiology, 15, 219-224.
51. Wilson, M. (2001). The case for sensorimotor coding in working memory. Psychonomic Bulletin & Review, 8, 44-57.
52. Wilson, M., & Emmorey, K. (1997). A visuospatial "phonological loop" in working memory: Evidence from American Sign Language. Memory & Cognition, 25, 313-320.
53. Wilson, M., & Emmorey, K. (1998). A "word length effect" for sign language: Further evidence for the role of language in structuring working memory. Memory & Cognition, 26, 584-590.
54. Wilson, M., & Emmorey, K. (2003). The effect of irrelevant visual input on working memory for sign language. Journal of Deaf Studies and Deaf Education, 8, 97-103.
55. Worsley, K. J., Liao, C., Aston, J., Petre, V., Duncan, G. H., Morales, F., et al. (2002). A general statistical analysis for fMRI data. Neuroimage, 15, 1-15.
56. Xu, Y., & Chun, M. M. (2006). Dissociable neural mechanisms supporting visual short-term memory for objects. Nature, 440, 91-95.