Hand and mouth: Cortical correlates of lexical processing in British sign language and speechreading english

Journal of Cognitive Neuroscience

Volumn 20, Issue 7, 2008, Pages 1220-1234

  Capek, Cheryl M ^a   Waters, Dafydd ^a   Woll, Bencie ^a   MacSweeney, Mairéad ^a   Brammer, Michael J ^b   McGuire, Philip K ^b   David, Anthony S ^b   Campbell, Ruth ^a  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

^b KING'S COLLEGE LONDON   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; CLINICAL ARTICLE; CONTROLLED STUDY; ELECTROENCEPHALOGRAM; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; LANGUAGE PROCESSING; MALE; PERCEPTION; PRIORITY JOURNAL; SIGN LANGUAGE; SPEECH; TEMPORAL CORTEX;

ADULT; ANALYSIS OF VARIANCE; BRAIN MAPPING; CEREBRAL CORTEX; FEMALE; FUNCTIONAL LATERALITY; HAND; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; LIPREADING; MAGNETIC RESONANCE IMAGING; MALE; MOUTH; OXYGEN; PREDICTIVE VALUE OF TESTS; REACTION TIME; SEMANTICS; SIGN LANGUAGE;

EID: 45849115439     PISSN: 0898929X     EISSN: 15308898     Source Type: Journal    
DOI: 10.1162/jocn.2008.20084     Document Type: Article

References (51)

1. Atkinson, J., Marshall, J., Woll, B., & Thacker, A. (2005). Testing comprehension abilities in users of British Sign Language following CVA. Brain and Language, 94, 233-248.
2. Bavelier, D., Corina, D., Jezzard, P., Clark, V., Karni, A., Lalwani, A., et al. (1998). Hemispheric specialization for English and ASL: Left invariance right variability. NeuroReport, 9, 1537-1542.
3. Blumstein, S. E. (1994). Impairments of speech production and speech perception in aphasia. Philosophical Transactions of the Royal Society of London, Series B, Biological Sciences, 346, 29-36.
4. Boyes Braem, P., & Sutton-Spence, R. (Eds.) (2001). The hands are the head of the mouth: The mouth as articulator in sign language. Hamburg: Signum.
5. Brammer, M. J., Bullmore, E. T., Simmons, A., Williams, S. C., Grasby, P. M., Howard, R. J., et al. (1997). Generic brain activation mapping in functional magnetic resonance imaging: A nonparametric approach. Magnetic Resonance Imaging, 15, 763-770.
6. Brentari, D. (1998). A prosodic model of sign language phonology. Cambridge: MIT Press.
7. Bullmore, E. T., Brammer, M., Williams, S. C., Rabe-Hesketh, S., Janot, N., David, A., et al. (1996). Statistical methods of estimation and inference for functional MR image analysis. Magnetic Resonance in Medicine, 35, 261-277.
8. Bullmore, E. T., Long, C., Suckling, J., Fadili, J., Calvert, G., Zelaya, F., et al. (2001). Colored noise and computational inference in neurophysiological (fMRI) time series analysis: Resampling methods in time and wavelet domains. Human Brain Mapping, 12, 61-78.
9. Bullmore, E. T., Suckling, J., Overmeyer, S., Rabe-Hesketh, S., Taylor, E., & Brammer, M. J. (1999). Global, voxel, and cluster tests, by theory and permutation, for a difference between two groups of structural MR images of the brain. IEEE Transactions on Medical Imaging, 18, 32-42.
10. Calvert, G. A., Bullmore, E. T., Brammer, M. J., Campbell, R., Williams, S. C. R., McGuire, P. K., et al. (1997). Activation of auditory cortex during silent lipreading. Science, 276, 593-596.
11. Calvert, G. A., Campbell, R., & Brammer, M. J. (2000). Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex. Current Biology, 10, 649-657.
12. Campbell, R., MacSweeney, M., Surguladze, S., Calvert, G., McGuire, P., Suckling, J., et al. (2001). Cortical substrates for the perception of face actions: An fMRI study of the specificity of activation for seen speech and for meaningless lower-face acts (gurning). Brain Research, Cognitive Brain Research, 12, 233-243.
13. Capek, C. M., Bavelier, D., Corina, D., Newman, A. J., Jezzard, P., & Neville, H. J. (2004). The cortical organization of audio-visual sentence comprehension: An fMRI study at 4 Tesla. Brain Research, Cognitive Brain Research, 20, 111-119.
14. Davis, M. H., & Johnsrude, I. S. (2003). Hierarchical processing in spoken language comprehension. Journal of Neuroscience, 23, 3423-3431.
15. Donoho, D. L., & Johnstone, J. M. (1994). Ideal spatial adaptation by wavelet shrinkage. Biometrika, 81, 425-455.
16. Downing, P. E., Jiang, Y., Shuman, M., & Kanwisher, N. (2001). A cortical area selective for visual processing of the human body. Science, 293, 2470-2473.
17. Emmorey, K. (2002). Language, cognition, and the brain: Insights from sign language research. Mahwah, NJ: Erlbaum.
18. Friman, O., Borga, M., Lundberg, P., & Knutsson, H. (2003). Adaptive analysis of fMRI data. Neuroimage, 19, 837-845.
19. Friston, K. J., Josephs, O., Rees, G., & Turner, R. (1998). Nonlinear event-related responses in fMRI. Magnetic Resonance in Medicine, 39, 41-52.
20. Goldenberg, G., & Karnath, H. O. (2006). The neural basis of imitation is body part specific. Journal of Neuroscience, 26, 6282-6287.
21. Hockett, C. F. (1960). The origin of speech. Scientific American, 203, 89-96.
22. Johnston, T. (2005). Sign language: Morphology. In K. Brown (Ed.), Encyclopedia of language & linguistics (2nd ed., Vol. 11, pp. 324-328). Cambridge: University of Cambridge.
23. Klein, D., Zatorre, R. J., Chen, J. K., Milner, B., Crane, J., Belin, P., et al. (2006). Bilingual brain organization: A functional magnetic resonance adaptation study. Neuroimage, 31, 366-375.
24. Klima, E., & Bellugi, U. (1979). The signs of language. Cambridge: Harvard University Press.
25. Lambertz, N., Gizewski, E. R., de Greiff, A., & Forsting, M. (2005). Cross-modal plasticity in deaf subjects dependent on the extent of hearing loss. Brain Research, Cognitive Brain Research, 25, 884-890.
26. Liddell, S. K. (1978). Nonmanual signs and relative clauses in American Sign Language (perspectives in neurolinguistics and psycholinguistics). In P. Siple (Ed.), Understanding language through sign language research (pp. 59-90). New York: Academic Press.
27. MacSweeney, M., Calvert, G. A., Campbell, R., McGuire, P. K., David, A. S., Williams, S. C., et al. (2002). Speechreading circuits in people born deaf. Neuropsychologia, 40, 801-807.
28. MacSweeney, M., Woll, B., Campbell, R., McGuire, P. K., David, A. S., Williams, S. C. R., et al. (2002). Neural systems underlying British Sign Language and audio-visual English processing in native users. Brain, 125, 1583-1593.
29. McCullough, S., Emmorey, K., & Sereno, M. (2005). Neural organization for recognition of grammatical and emotional facial expressions in deaf ASL signers and hearing nonsigners. Brain Research, Cognitive Brain Research, 22, 193-203.
30. Mohammed, T., MacSweeney, M., & Campbell, R. (2003). Developing the TAS: Individual differences in silent speechreading, reading and phonological awareness in deaf and hearing speechreaders. Paper presented at the Auditory-Visual Speech Processing (AVSP), St Joriot, France.
31. Muir, L. J., & Richardson, I. E. (2005). Perception of sign language and its application to visual communications for deaf people. Journal of Deaf Studies and Deaf Education, 10, 390-401.
32. Neville, H. J., Bavelier, D., Corina, D., Rauschecker, J., Karni, A., Lalwani, A., et al. (1998). Cerebral organization for language in deaf and hearing subjects: Biological constraints and effects of experience. Proceedings of the National Academy of Sciences, U.S.A., 95, 922-929.
33. Newman, A. J., Bavelier, D., Corina, D., Jezzard, P., & Neville, H. J. (2002). A critical period for right hemisphere recruitment in American Sign Language processing. Nature Neuroscience, 5, 76-80.
34. Pekkola, J., Ojanen, V., Autti, T., Jaaskelainen, I. P., Mottonen, R., Tarkiainen, A., et al. (2005). Primary auditory cortex activation by visual speech: An fMRI study at 3 T. NeuroReport, 16, 125-128.
35. Pelphrey, K. A., Morris, J. P., Michelich, C. R., Allison, T., & McCarthy, G. (2005). Functional anatomy of biological motion perception in posterior temporal cortex: An fMRI study of eye, mouth and hand movements. Cerebral Cortex, 15, 1866-1876.
36. Perani, D., & Abutalebi, J. (2005). The neural basis of first and second language processing. Current Opinion in Neurobiology, 15, 202-206.
37. Petitto, L. A., Zatorre, R. J., Guana, K., Nikelski, E. J., Dostie, D., & Evans, A. C. (2000). Speech-like cerebral activity in profoundly deaf people while processing signed languages: Implications for the neural basis of all human language. Proceedings of the National Academy of Sciences, 97, 13961-13966.
38. Poizner, H., Klima, E. S., & Bellugi, U. (1987). What the hands reveal about the brain. Cambridge: MIT Press.
39. Puce, A., Allison, T., Bentin, S., Gore, J. C., & McCarthy, G. (1998). Temporal cortex activation in humans viewing eye and mouth movements. Journal of Neuroscience, 18, 2188-2199.
40. Puce, A., & Perrett, D. (2003). Electrophysiology and brain imaging of biological motion. Philosophical Transactions of the Royal Society of London, Series B, Biological Sciences, 358, 435-445.
41. Rauschecker, J. P. (1998). Cortical processing of complex sounds. Current Opinion in Neurobiology, 8, 516-521.
42. Sakai, K. L., Tatsuno, Y., Suzuki, K., Kimura, H., & Ichida, Y. (2005). Sign and speech: Amodal commonality in left hemisphere dominance for comprehension of sentences. Brain, 128, 1407-1417.
43. Sandler, W., & Lillo-Martin, D. (2001). Natural sign languages. In M. Aronoff & J. Rees-Miller (Eds.), The handbook of linguistics (pp. 533-562). Malden, MA: Blackwell.
44. Schlosser, M. J., Aoyagi, N., Fulbright, R. K., Gore, J. C., & McCarthy, G. (1998). Functional MRI studies of auditory comprehension. Human Brain Mapping, 6, 1-13.
45. Schwartz, J.-L., Robert-Ribes, J., & Escudier, P. (1998). Ten years after Summerfield: A taxonomy of models for audio-visual fusion in speech perception. In R. Campbell, B. Dodd, & D. Burnham (Eds.), Hearing by eye: II. Advances in the psychology of speechreading and auditory-visual speech (pp. 85-109). Hove, UK: Psychology Press.
46. Söderfeldt, B., Ingvar, M., Rönnberg, J., Eriksson, L., Serrander, M., & Stone-Elander, S. (1997). Signed and spoken language perception studied by positron emission tomography. Neurology, 49, 82-87.
47. Söderfeldt, B., Rönnberg, J., & Risberg, J. (1994). Regional cerebral blood f low in sign language users. Brain and Language, 46, 59-68.
48. Stokoe, W. C. (1960). Sign language structure: An outline of the visual communication systems of the American deaf. In Studies in linguistics: Occasional papers (Vol. 8, p. 78). Buffalo, NY: University of Buffalo.
49. Sutton-Spence, R., & Woll, B. (1999). The linguistics of British Sign Language. Cambridge: Cambridge University Press.
50. Talairach, J., & Tournoux, P. (1988). Co-planar stereotaxic atlas of the human brain. New York: Thieme.
51. Woll, B. (2001). The sign that dares to speak its name: Echo phonology in British Sign Language (BSL). In P. Boyes Braem & R. Sutton-Spence (Eds.), The hands are the head of the mouth: The mouth as articulator in sign language (pp. 87-98). Hamburg: Signum.