How vision matters for individuals with hearing loss

International Journal of Audiology

Volumn 46, Issue 9, 2007, Pages 500-511

  Mitchell, Teresa V ^a   Maslin, Melissa T ^a  

^a UNIVERSITY OF MASSACHUSETTS MEDICAL SCHOOL   (United States)

Author keywords

Children; CI; Cross model plasticity; Deafness; Speech perception; Visual perception

Indexed keywords

ATTENTION; COCHLEA PROSTHESIS; FACE; HEARING IMPAIRMENT; HEARING LOSS; HUMAN; IMPLANTATION; MOVEMENT PERCEPTION; PLASTICITY; PRIORITY JOURNAL; REVIEW; SPEECH PERCEPTION; VISION; VISUAL FIELD; VISUAL SYSTEM;

AUDITORY CORTEX; AUDITORY PATHWAYS; COCHLEAR IMPLANTS; DEAFNESS; HUMANS; NEURONAL PLASTICITY; VISUAL PATHWAYS; VISUAL PERCEPTION;

EID: 36649007503     PISSN: 14992027     EISSN: 17088186     Source Type: Journal    
DOI: 10.1080/14992020701383050     Document Type: Review

References (106)

1. Alho, K., Kujala, T., Paavilainen, P., Summala, H. & Naatanen, R. 1993. Auditory processing in visual brain areas of the early blind: Evidence from event-related potentials. Electroencephalogr Clin Neurophysiol, 86(6), 418-27.
2. Andersen, R.A., Snyder, L.H., Bradley, D.C. & Xing, J. 1997. Multimodal representation of space in the posterior parietal cortex and its use in planning movements. Annual Review of Neuroscience, 20(1), 303-330.
3. Anderson, R., Essick, G.K. & Siegel, R.M. 1985. Encoding of spatial location by posterior parietal neurons. Science, 230, 456-458.
4. Armstrong, B., Neville, H., Hillyard, S. & Mitchell, T. 2002. Auditory deprivation affects processing of motion, but not color. Cognitive Brain Research, 14, 422-434.
5. Atkinson, J., Anker, S., Braddick, O., Nokes, L., Mason, A., et al. 2001. Visual and visuospatial development in young children with Williams syndrome. Developmental Medicine & Child Neurology, 43(5), 330-7.
6. Bavelier, D., Brozinsky, C., Tomann, A., Mitchell, T., Neville, H., et al. 2001. Impact of early deafness and early exposure to sign language on the cerebral organization for motion processing. J Neurosci, 21(22), 8931-8942.
7. Bavelier, D., Tomann, A., Hutton, C., Mitchell, T., Corina, D., et al. 2000. Visual attention to the periphery is enhanced in congenitally deaf individuals. J Neurosci, 20(RC93), 1-6.
8. Beauchamp, M.S., Cox, R.W. & DeYoe, E.A. 1997. Graded effects of spatial and featural attention on human area MT and associated motion processing areas. J Neurophysiol, 78, 516-520.
9. Bellugi, U., O'Grady, L., Lillo-Martin, D., O'Grady Hynes, M., van Hoek, K. & Corina, D. 1990. Enhancement of spatial cognition in deaf children. In V. Volterra and C.J. Erting (eds.) Form Gesture to Language in Hearing and Deaf Children. New York: Springer.
10. Bergeson, T.R., Pisoni, D.B. & Davis, R.A. 2005. Development of audiovisual comprehension skills in prelingually deaf children with cochlear implants. Ear Hear, 26(2), 149-64.
11. Bettger, J., Emmorey, K., McCullough, S. & Bellugi, U. 1997. Enhanced facial discrimination: language. Journal of Deaf Studies & Deaf Education, 2(4), 223-233.
12. Bosworth, R.G. & Dobkins, K.R. 1999. Left-hemisphere dominance for motion processing in deaf signers. Psychological Science, 10(3), 256-262.
13. Bosworth, R.G. & Dobkins, K.R. 2002. Visual field asymmetries for motion processing in deaf and hearing signers. Brain and Cognition, 49, 170-181.
14. Braddick, O., Atkinson, J. & Wattam-Bell, J. 2003. Normal and anomalous development of visual motion processing: Motion coherence and'dorsal-stream vulnerability'. Neuropsychologia, 41(13), 1769-84.
15. Brozinsky, C.J. & Bavelier, D. 2004. Motion velocity thresholds in deaf signers: Changes in lateralization but not in overall sensitivity. Cognitive Brain Research, 21(1), 1 -10.
16. Bushara, K.O., Weeks, R.A., Ishii, K., Catalan, M.J., Tian, B., et al. 1999. Modality-specific frontal and parietal areas for auditory and visual spatial localization in humans. Nature Neuroscience, 2(8), 759-66.
17. Carey, S. & Diamond, R. 1977. From piecemeal to configurational representation of faces. Science, 195(4275), 312-4.
18. Corina, D.P. 1989. Recognition of affective and non-canonical linguistic facial expressions in hearing and deaf subjects. Brain & Cognition, 9(2), 227-37.
19. Cowey, A. & Rolls, E.T. 1974. Human cortical magnification factor and its relation to visual acuity. Experimental Brain Research, 21(5), 447-454.
20. De Schonen, S., Deruelle, C., Mancini, J. & Pascalis, O. 1993. Hemispheric differences in face processing and brain maturation. In B. de Boysson-Bardies, S. de Schonen, P.W. Jusczyk, P. McNeilage & J. Morton (eds.) Developmental neurocognition: Speech and face processing in the first year of life. Dordrecht: Kluwer Academic Publishers, 69, pp. 149-163.
21. Doucet, M.E., Bergeron, F., Lassonde, M., Ferron, P. & Lepore, F. 2006. Cross-modal reorganization and speech perception in cochlear implant users. Brain, 129(12), 3376-83.
22. Engel, S., Glover, G. & Wandell, B. 1997. Retinotopic organization in human visual cortex and the spatial precision of functional MRI. Cerebral Cortex, 7(2), 181-192.
23. Falchier, A., Clavagnier, S., Barone, P. & Kennedy, H. 2002. Anatomical evidence of multimodal integration in primate striate cortex. J Neurosci, 22(13), 5749-59.
24. Farah, M.J., Wilson, K.D., Drain, M. & Tanaka, J.N. 1998. What is'special' about face perception? Psychological Review, 105(3), 482-498.
25. Fine, I., Finney, E.M., Boynton, G.M. & Dobkins, K.R. 2005. Comparing the effects of auditory deprivation and sign language within the auditory and visual cortex. J Cogn Neurosci, 17(10), 1621-1637.
26. Finney, E.M. & Dobkins, K.R. 2001. Visual contrast sensitivity in deaf versus hearing populations: Exploring the perceptual consequences of auditory deprivation and experience with a visual language. Cognitive Brain Research, 11(1), 171-183.
27. Finney, E.M., Fine, I. & Dobkins, K.R. 2001. Visual stimuli activate auditory cortex in the deaf. Nature Neuroscience, 4(12), 1171-1173.
28. Ghazanfar, A.A. & Schroeder, C. 2006. Is neocortex essentially multisensory? Trends in Cognitive Sciences, 10(6), 278-85.
29. Giraud, A.L., Price, C.J., Graham, J.M., Truy, E. & Frackowiak, R.S. 2001. Cross-modal plasticity underpins language recovery after cochlear implantation. Neuron, 30(3), 657-63.
30. Giraud, A.L. & Truy, E. 2002. The contribution of visual areas to speech comprehension: a PET study in cochlear implants patients and normal-hearing subjects. Neuropsychologia, 40(9), 1562-9.
31. Goldstone, R.L. 1998. Perceptual learning. Annual Review of Psychology, 49, 585-612.
32. Gougoux, F., Zatorre, R.J., Lassonde, M., Voss, P. & Lepore, F. 2005. A functional neuroimaging study of sound localization: Visual cortex activity predicts performance in early-blind individuals. Public Library of Science: Biology, 3(2), 324-333.
33. Heil, P., Bronchti, G., Wollberg, Z. & Scheich, H. 1991. Invasion of visual cortex by the auditory system in the naturally blind mole rat. Neuroreport, 2, 735-738.
34. Horn, D.L., Davis, R.A., Pisoni, D.B. & Miyamoto, R.T. 2005a. Behavioral inhibition and clinical outcomes in children with cochlear implants. Laryngoscope, 115(4), 595-600.
35. Horn, D.L., Davis, R.A., Pisoni, D.B. & Miyamoto, R.T. 2005b. Development of visual attention skills in prelingually deaf children who use cochlear implants. Ear Hear, 26(4), 389-408.
36. Horton, J.C. & Hoyt, W.F. 1991. The representation of the visual field in human striate cortex. A revision of the classic Holmes map. Arch Ophthal, 109(6), 816-824.
37. Hotting, K. & Roder, B. 2004. Hearing cheats touch, but less in congenitally blind than in sighted individuals. Psychological Science, 15(1), 60-64.
38. Hubel, D.H. & Wiesel, T.N. 1968. Receptive fields and functional architecture of monkey striate cortex. J Physiol, 195(1), 215-43.
39. Itier, R.J. & Taylor, M.J. 2004. Face recognition memory and configural processing: A developmental ERP study using upright, inverted, and contrast-reversed faces. J Cogn Neurosci, 16(3), 487-502.
40. Kaiser, A.R., Kirk, K.I., Lachs, L. & Pisoni, D.B. 2003. Talker and lexical effects on audiovisual word recognition by adults with cochlear implants. J Speech Lang Hear Res, 46(2), 390-404.
41. Kanwisher, N., McDermott, J. & Chun, M.M. 1997. The fusiform face area: A module in human extrastriate cortex specialized for face perception. J Neurosci, 17(11), 4302-4311.
42. Kujala, T., Palva, M.J., Salonen, O., Alku, P., Huotilainen, M., et al. 2005. The role of blind humans' visual cortex in auditory change detection. Neuroscience Letters, 379(2), 127-31.
43. Le Grand, R., Mondloch, C.J., Maurer, D. & Brent, H.P. 2001. Neuroperception: Early visual experience and face processing. Nature, 410(6831), 890.
44. Lee, D.S., Lee, J.S., Oh, S.H., Kim, S.K., Kim, J.W., et al. 2001. Crossmodal plasticity and cochlear implants. Nature, 409(6817), 149-50.
45. Lee, H.J., Giraud, A.L., Kang, E., Oh, S.H., Kang, H., et al. 2007. Cortical activity at rest predicts cochlear implantation outcome. Cerebral Cortex, 17, 909-917.
46. Lee, H.J., Kang, E., Oh, S.H., Kang, H., Lee, D.S., et al. 2005. Preoperative differences of cerebral metabolism relate to the outcome of cochlear implants in congenitally deaf children. Hear Res, 203(1-2), 2-9.
47. Letourneau S.M. & Mitchell T. 2006. Effects of deafness on electrophysiological markers of holistic face processing. Poster presented at the Annual Meeting of the Cognitive Neuroscience Society, San Francisco, USA.
48. Letourneau S.M., Thrasher M. & Mitchell T. 2006. Effects of deafness on configural and holistic face processing. Poster presented at the International Conference on Cognitive and Neural Systems, Boston, USA.
49. Lewis, T.L. & Maurer, D. 2005. Multiple sensitive periods in human visual development: Evidence from visually deprived children. Developmental Psychobiology, 46(3), 163-83.
50. Loke, W.H. & Song, S. 1991. Central and peripheral visual processing in hearing and nonhearing individuals. Bulletin of the Psychonomic Society, 29(5), 437-440.
51. Malach, R., Reppas, J.B., Benson, R.R., Kwong, K.K., Jiang, H., et al. 1995. Object-related activity revealed by functional magnetic resonance imaging in human occipital cortex. Proceedings of the National Academy of Sciences, 92, 8135-8139.
52. Martinez, A., Moses, P., Frank, L., Buxton, R., Wong, E. & Stiles, J. 1997. Hemispheric asymmetries in global and local processing: evidence from fMRI. Neuroreport, 8(7), 1685-9.
53. McCarthy, G. 2001. Physiological studies of face processing in humans. In M.S. Gazzaniga (ed.), The New Cognitive Neurosciences. Cambridge, MA: MIT Press, pp. 393-409.
54. McCullough S., Emmorey K.M.S., Gazzaniga (d.), & Sereno M. 2005. Neural organization for recognition of grammatical and emotional facial expressions in deaf ASL signers and hearing non-signers. Cognitive Brain Research, 22, 2, 193-203.
55. McGurk, H. & MacDonald, J. 1976. Hearing lips and seeing voices. Nature, 264, 746-748.
56. Meier, R.P. 1991. Language acquisition by deaf children. American Scientist, 79, 60-70.
57. Mishkin, M., Ungerleider, L.G. & Macko, K.A. 1983. Object vision and spatial vision: Two cortical pathways. Trends in Neuroscience, 6, 414-417.
58. Mitchell T., More S. & Van der Heide R. 2005. Effects of deafness on the development of face perception. Poster presented at the Annual Meeting of the Cognitive Neuroscience Society, New York, USA.
59. Mitchell T.V. 1996. How audition shapes visual attention. Department of Psychology. Bloomington, Indiana University, USA.
60. Mitchell, T.V. & Neville, H.J. 2002. Effects of age and experience on the development of neurocognitive systems. In A Zani & A.M. Proverbio (eds.) The Cognitive Physiology of Mind. New York, Academic Press.
61. Mitchell, T.V. & Neville, H.J. 2004. Asynchrony in the development of electrophysiological responses to motion and color. J Cogn Neurosci, 16(8), 1363-1374.
62. Mitchell, T.V. & Quittner, A.L. 1996. A multimethod study of attention and behavior problems in hearing-impaired children. Journal of Clinical Child Psychology, 25, 83-96.
63. Mitchell T.V. & Smith L.B. 1996. Deafness drives development of attention to change. In: G. Cottrell (ed.). Proceedings of the Eighteenth Annual Conference of the Cognitive Science Society, Mahwah, NJ: Erlbaum, pp. 627-632.
64. Mondloch, C.J., Le Grand, R. & Maurer, D. 2002. Configural face processing develops more slowly than featural face processing. Perception, 31(5), 553-6.
65. Morrell, F. 1972. Visual system's view of acoustic space. Nature, 238(5358), 44-6.
66. Moses, P., Roe, K., Buxton, R.B., Wong, E.C., Frank, L.R., et al. 2002. Functional MRI of global and local processing in children. Neuroimage, 16(2), 415-24.
67. Neville, H.J. & Lawson, D. 1987a. Attention to central and peripheral visual space in a movement detection task. III. Separate effects of auditory deprivation and acquisition of a visual language. Brain Research, 405(2), 284-94.
68. Neville, H.J. & Lawson, D. 1987b. Attention to central and peripheral visual space in a movement detection task: An event-related potential and behavioral study. I. Normal hearing adults. Brain Research, 405(2), 253-67.
69. Neville, H.J. & Lawson, D. 1987c. Attention to central and peripheral visual space in a movement detection task: An event-related potential and behavioral study: II. Congenitally deaf adults. Brain Research, 405(2), 268-283.
70. Newport E.L. & Meier R.P. 1985. The acquisition of American Sign Language. In D.I. Slobin, (ed.). The Crosslinguistic Study of Language Acquisition, Vol. 1, The Data. Hillsdale, NJ: Erlbaum.
71. Nikolopoulos, T.P., O'Donoghue, G.M. & Archbold, S. 1999. Age at implantation: its importance in pediatric cochlear implantation. Laryngoscope, 109(4), 595-9.
72. Parasnis, I. & Samar, V.J. 1985. Parafoveal attention in congenitally deaf and hearing young adults. Brain and Cognition, 4(3), 313-327.
73. Parasnis, I., Samar, V.J., Bettger, J.G. & Sathe, K. 1996. Does deafness lead to enhancement of visual spatial cognition in children? Negative evidence from deaf nonsigners. Journal of Deaf Studies & Deaf Education, 1(2), 145-152.
74. Pelphrey, K.A., Mitchell, T.V., McKeown, M.J., Goldstein, J., Allison, T., et al. 2003. Brain activity evoked by the perception of human walking: Controlling for meaningful coherent motion. J Neurosci, 23(17), 6819-6825.
75. Pollak, S.D. & Sinha, P. 2002. Effects of early experience on children's recognition of facial displays of emotion. Dev Psychol, 38(5), 784-791.
76. Proksch, J. & Bavelier, D. 2002. Changes in the spatial distribution of visual attention after early deafness. J Cogn Neurosci, 14(5), 687-701.
77. Puce, A., Allison, T., Asgari, M., Gore, J.C. & McCarthy, G. 1996. Differential sensitivity of human visual cortex to faces, letterstrings, and textures: A functional magnetic resonance imaging study. J Neurosci, 16(16), 5205-5215.
78. Puce, A., Allison, T., Bentin, S., Gore, J.C. & McCarthy, G. 1998. Temporal cortex activation in humans viewing eye and mouth movements. J Neurosci, 18(6), 2188-2199.
79. Puce, A., Allison, T., Gore, J.C. & McCarthy, G. 1995. Face-sensitive regions in human extrastriate cortex studied by functional MRI. J Neurophysiol, 74(3), 1192-9.
80. Puce, A. & Perrett, D. 2003. Electrophysiology and brain imaging of biological motion. Philosophical Transactions of the Royal Society of London, Series B: Biological Sciences, 358(1431), 435-45.
81. Quittner, A.L., Smith, L.B., Osberger, M.J., Mitchell, T.V. & Katz, D.B. 1994. The impact of audition on the development of visual attention. Psychological Science, 5(6), 347-353.
82. Rauschecker, J.P. & Kniepert, U. 1994. Auditory localization behaviour in visually deprived cats. Eur J Neurosci, 6(1), 149-60.
83. Rauschecker, J. P. & Korte, M. 1993. Auditory compensation for early blindness in cat cerebral cortex. J Neurosci, 13(10), 4538-4548.
84. Recanzone, G.H. 1998. Rapidly induced auditory plasticity: The ventriloquism after-effect. Proceedings of the National Academy of Sciences USA, 95(3), 869-75.
85. Recanzon, G.H. 2003. Auditory influences on visual temporal rate perception. J Neurophysiol, 89(2), 1078-93.
86. Reilly, J.S., McIntire, M.L. & Bellugi, U. 1990. The acquisition of conditionals in American Sign Language: Grammaticized facial expressions. Applied Psycholinguistics, 11(4), 369-392.
87. Rettenbach, R., Diller, G. & Sireteanu, R. 1999. Do deaf people see better? Texture segmentation and visual search compensate in adult but not in juvenile subjects. J Cogn Neurosci, 11(5), 560-583.
88. Rockland, K.S. & Ojima, H. 2003. Multisensory convergence in calcarine visual areas in macaque monkey. Int J Psychophysiol, 50(1-2), 19-26.
89. Röder, B., Teder-Salejarvi, W., Sterr, A., Rosler, F., Hillyard, S.A., et al. 1999. Improved auditory spatial tuning in blind humans. Nature, 400, 162-166.
90. Rosenblum, L.D., Schmuckler, M.A. & Johnson, J.A. 1997. The McGurk effect in infants. Perception and Psychophysics, 59(3), 347-57.
91. Rovamo, J. & Virsu, V. 1979. An estimation and application of the human cortical magnification factor. Experimental Brain Research, 37, 495-510.
92. Sadato, N., Pascual-Leone, A., Grafman, J., Ibanez, V., Deiber, M., et al. 1996. Activation of the primary visual cortex by Braille reading in blind subjects. Nature, 380, 526-528.
93. Schorr, E.A., Fox, N.A., van Wassenhove, V. & Knudsen, E.I. 2005. Auditory-visual fusion in speech perception in children with cochlear implants. Proceedings of the National Academy of Sciences, 102(51), 18748-18750.
94. Sharma, A., Dorman, M., Spahr, A. & Todd, N.W. 2002a. Early cochlear implantation in children allows normal development of central auditory pathways. Ann Otol Rhinol Laryngol Suppl, 189, 38-41.
95. Sharma, A., Dorman, M.F. & Kral, A. 2005. The influence of a sensitive period on central auditory development in children with unilateral and bilateral cochlear implants. Hear Res, 203(1-2), 134-43.
96. Sharma, A., Dorman, M.F. & Spahr, A.J. 2002b. A sensitive period for the development of the central auditory system in children with cochlear implants: Implications for age of implantation. Ear Hear, 23(6), 532-9.
97. Smith, L.B., Quittner, A.L., Osberger, M.J. & Miyamoto, R. 1998. Audition and visual attention: The developmental trajectory in deaf and hearing populations. Dev Psychol, 34(5), 840-850.
98. Snitzer Reilly, J., McIntire, M.L. & Bellugi, U. 1990. Faces: The relationship between language and affect. In V. Volterra & C.J. Erting (eds.) From Gesture to Language in Hearing and Deaf Children. New York: Springer-Verlag.
99. Spencer, J., O'Brien, J., Riggs, K., Braddick, O., Atkinson, J., et al. 2000. Motion processing in autism: Evidence for a dorsal stream deficiency. NeuroReport, 11(12), 2765-7.
100. Taylor, M.J., McCarthy, G., Saliba, E. & Degiovanni, E. 1999. ERP evidence of developmental changes in processing of faces. Clin Neurophysiol, 110(5), 910-915.
101. Tharpe, A.M., Ashmead, D.H. & Rothpletz, A.M. 2002. Visual attention in children with normal hearing, children with hearing aids, and children with cochlear implants. J Speech Lang Hear Res, 45, 403-413.
102. Tootell, R.B.H., Reppas, J.B., Kwong, K.K., Malach, R., Born, R., et al. 1995. Functional analysis of Human MT and related visual cortical areas using magnetic resonance imaging. J Neurosci, 15(4), 3215-3230.
103. Ungerleider, L.G. & Haxby, J.V. 1994. What' and'where' in the human brain. Current Opinion in Neurobiology, 4, 157-165.
104. Ungerleider, L.G. & Mishkin, M. 1982. Two cortical visual systems. In D.J. Ingle, M.A. Goodale & R.J.W. Mansfield. (eds.) Analysis of Visual Behavior. Cambridge, MA: MIT Press, pp. 549-586.
105. Yin, R.K. 1969. Looking at upside-down faces. J Experimen Psychol, 81(1), 141-145.
106. Zeki, S., Watson, J.D.G., Lueck, C.J., Friston, K.J., Kennard, C., et al. 1991. A direct demonstration of functional specialization in human visual cortex. J Neurosci, 11, 641-649.