Review of visual speech perception by hearing and hearingimpaired people clinical implications

International Journal of Language and Communication Disorders

Volumn 44, Issue 3, 2009, Pages 253-270

  Woodhouse, Lynn ^a   Hickson, Louise ^a   Dodd, Barbara ^b  

^a School of Health and Rehabilitation Sciences

^b UNIVERSITY OF QUEENSLAND   (Australia)

Author keywords

Assessment; Hearing impairment; Speech perception; Speechreading

Indexed keywords

ELECTROENCEPHALOGRAM; HEARING IMPAIRMENT; HEARING LOSS; HUMAN; INFANT; LIP READING; NEUROIMAGING; NEWBORN; PHONETICS; REVIEW; SPEECH AND LANGUAGE; SPEECH PERCEPTION;

ADULT; CHILD; HEARING; HEARING IMPAIRED PERSONS; HUMANS; INFANT; LIPREADING; SPEECH PERCEPTION; VISUAL PERCEPTION; YOUNG ADULT;

EID: 70350639544     PISSN: 13682822     EISSN: 14606984     Source Type: Journal    
DOI: 10.1080/13682820802090281     Document Type: Review

References (99)

1. ALEGRIA, J., CHARLIER, B. and MATTYS, S., 1999, The role of lip-reading and cued speech in the processing of phonological information in French educated deaf children. European Journal of Cognitive Psychology, 11(4), 451-472.
2. AMERICAN SPEECH LANGUAGE HEARING ASSOCIATION 2005, (Central) Auditory Processing Disorders. (available at: http://www.asha.org/members/) (accessed 12 March 2007).
3. AUER, E., 2002, The influence of the lexicon on speech read word recognition: Contrasting segmental and lexical distinctiveness. Psychonomic Bulletin and Review, 9(2), 341-347.
4. AUER, E. and BERNSTEIN, L., 2007, Enhanced visual perception in individuals with early onset hearing impairment. Journal of Speech, Language and Hearing Research, 50, 1157-1165.
5. BERGESON, T., PISONI, D. and DAVIS, R., 2005, A longitudinal study of audio-visual speech perception by children with hearing loss who have cochlear implants. Volta Review, 103, 347-370.
6. BERNSTEIN, L., 2005, Phonetic processing by the speech perceiving brain. In D. Pisoni and R. Remez (eds), The Handbook of Speech Perception (Cambridge, MA: Blackwell), pp. 79-98.
7. BERNSTEIN, L., AUER, E. and MOORE, J., 2004, Modality-specific perception of auditory and visual speech. In G. A. Calvert, C. Spence and B. E. Stein (eds), The Handbook of Multisensory Processing (Cambridge, MA: MIT Press), pp. 203-223.
8. BERNSTEIN, L., DEMOREST, M. and TUCKER, P., 1998, What makes a good speechreader? First you have to find one. In R. Campbell, B. Dodd and D. Burnham (eds), Hearing by Eye: 11. The Psychology of Speechreading and Auditory-Visual Speech (Hove: Psychology Press), pp. 211-228.
9. BERNSTEIN, L., DEMOREST, M. and TUCKER, P., 2000, Speech perception without hearing. Perception and Psychophysics, 62(2), 233-252.
10. BORNSTEIN, M. H., HAHN, C. S. and HAYES, O. M., 2004, Specific and general language performance across early childhood: Stability and gender considerations. First Language, 24 (3), 267-304.
11. BURNHAM, D. and DODD, B., 2004, Auditory-visual speech integration by prelinguistic infants: Perception of an emergent consonant in the McGurk Effect. Developmental Psychobiology, 45, 204-220.
12. CALVERT, G. and CAMPBELL, R., 2003, Reading speech from still and moving faces: The neural substrates of visible speech. Journal of Cognitive Neuroscience, 15(1), 57-70.
13. CALVERT, G., WOODRUFF, I., WRIGHT, E., BULLMORE, M., BRAMMER, S. and WILLIAMS, P., 1997, fMRI imaging of visual and audio-visual speech. International Journal of Psychophysiology, 25, 23.
14. CAMPBELL, R. and DODD, B., 1984, Aspects of hearing by eye. In H. Bouma and D. Bouwhuis (eds), Attention and Performance, X, Control of Language Processes (Hillsdale, NJ: Lawrence Erlbaum Associates), pp. 299-314.
15. CAMPBELL, R., ZIHL, J., MASSARO, D., MUNHALL, K. and COHEN, M., 1997, Lipreading in the akinetopsic patient, L.M. Brain, 120, 1793-1803.
16. CAMPBELL, R., GARWOOD, J., FRANKLIN, S., HOWARD, D., LANDIS, T. and REGARD, M., 1990, Neuropsychological studies of auditory-visual fusion illusions. Four case studies and their implications. Neuropsychologia, 28, 787-802.
17. COLTHEART, M.., 2005, Modeling reading: The dual route approach. In M. Snowling and C. Hulme (eds), The Source of Reading (Oxford: Blackwell), pp. 6-23.
18. CONRAD, R., 1979, The Deaf Schoolchild (London: Harper & Row).
19. COSTELLO, M., 1957, A study of speech reading as a developing language process in deaf and hard of hearing children. Unpublished thesis, Northwestern University.
20. CRAIG, W., 1964, Effects of preschool training on the development of reading and lipreading skills of deaf children. American Annals of the Deaf, 109, 280-296.
21. DE FILIPPO, C., 1982, Memory for articulated sequences and lipreading performance of hearing-impaired observers. Volta Review, 31, 60-65.
22. DEAFNESS RESEARCH UK, 2007, Auditory Processing Disorder. (available at: http://www.deafnessreseach. org.uk/) (accessed 19 September 2007).
23. DESJARDINS, R., ROGERS, J. and WERKER, J., 1997, An exploration of why preschoolers perform differently than do adults in audio-visual speech perception tasks. Journal of Experimental Child Psychology, 66, 85-110.
24. DIEHL, R. and KLUENDER, K., 1989, On the objects of speech perception. Ecological Psychology, 1, 121-144.
25. DILLON, H. and CHING, T.., 1995, What makes a good speech test? In G. Plant and K. E. Spens (eds), Profound Deafness and Speech Communication (London: Whurr).
26. DODD, B., 1972, Effects of social and vocal stimulation on infant babbling. Developmental Psychology, 7, 80-83.
27. DODD, B., 1977, The role of vision in the perception of speech. Perception and Psychophysics, 6, 3140.
28. DODD, B., 1979, Lip reading in infants: Attention to speech presented in- and out-of-synchrony. Cognitive Psychology, 11, 478-484.
29. DODD, B., 1980, Interaction of auditory and visual information in speech perception. British Journal of Psychology, 71, 541-549.
30. DODD, B., 1983, The visual and auditory modalities in phonological acquisition. In A. E. Mills (eds) , Language Acquisition in the Blind Child (London: Croom Helm), pp. 57-61.
31. DODD, B., 1987a, Lip-reading, phonological coding and deafness. In B. Dodd and R. Campbell (eds), Hearing by Eye: The Psychology of Speech-Reading (Hillsdale, NJ: Lawrence Erlbaum Associates), pp. 177-190.
32. DODD, B., 1987b, The acquisition of lip-reading skills by normally hearing children. In B. Dodd and R. Campbell (eds), Hearing by Eye: The Psychology of Speech-Reading (Hillsdale, NJ: Lawrence Erlbaum Associates), pp. 163-176.
33. DODD, B. and BURNHAM, D., 1988, Processing speech read information. Volta Review, 90, 45-60.
34. DODD, B. and CAMPBELL, R., 1987, Hearing by Eye: The Psychology of Speech-Reading (Hillsdale, NJ: Lawrence Erlbaum Associates).
35. DODD, B. and HERMELIN, B., 1977, Phonological coding by the prelinguistically deaf. Perception and Psychophysics, 21, 413-417.
36. DODD, B., MCINTOSH, B., ERDENER, D. and BURNHAM, D., 2008, Perception of the auditory-illusion in speech perception by children with phonological disorders. Clinical Linguistics and Phonetics, 22, 69-82.
37. DODD, B. and MURPHY, J., 1992, Visual thoughts. In R. Campbell (ed.), Mental Lives: Case Studies in Cognition (Oxford: Blackwell), pp. 47-60.
38. ELPHICK, R., 1996, Issues in comparing the lipreading abilities of hearing impaired and hearing 15 to 16 year-old pupils. British Journal of Educational Psychology, 66, 357-365.
39. ERBER, N., 1975, Auditory-visual perception of speech. Journal of Speech and Hearing Disorders, 40, 481-492.
40. EVANS, L., 1965, Psychological factors related to lipreading. Teacher of the Deaf, 63, 131-136.
41. EWING, I. and EWING, A., 1954, Speech and the Deaf Child (Manchester: Manchester University Press).
42. FOURCIN, A., 1975, Language development in the absence of expressive speech. In E. Lenneberg and E. Lenneberg (eds), Foundations of Language Development, Vol.2 (New York, NY: Academic Press).
43. FOWLER, C. and DECKLE, D., 1991, Listening with eye and hand: Crossmodal contributions to speech perception. Journal of Experimental Psychology: Human Perception and Performance, 17, 816-828.
44. FOWLER, C. and GALANTUCCI, B.., 2005, The relation of speech perception and production. In D. Pisoni and R. Remez (eds), The Handbook of Speech Perception (Cambridge, MA: Blackwell), pp. 633-652.
45. GREEN, K., 1998, The use of auditory information and visual information during phonetic processing: Implications for theories of speech perception. In R. Campbell and B. Dodd (eds), Hearing by Eye. 11: Advances in the Psychology of Speechreading and Audio-visual Speech (Hove: Psychology Press), pp. 3-25.
46. GREEN, K. and HOLMES, D., 1981, Growth of lipreading proficiency in young hearing impaired children. Volta Review, October/November, 389-393.
47. GREEN, K., KUHL, P., MELTZOFF, A. and STEVENS, E., 1991, Integrating speech information across talkers, gender, and sensory modalities: Female faces and male voices in the McGurk effect. Perception and Psychophysics, 50, 524.
48. HALL, D., FUSSELL, C. and SUMMERFIELD, A. Q., 2005, Reading fluent speech from talking faces: Typical brain networks and individual differences. Journal of Cognitive Neuroscience, 16(6), 939-954.
49. JEFFERS, J. and BARLEY, M., 1971, Lipreading (Springfield, IL: Charles C. Thomas).
50. JERGER, J. and MUSIEK, F., 2000, Report of the consensus conference on the diagnosis of auditory processing disorders in school aged children. Journal of the American Academy of Audiology, 11, 467-474.
51. JOHNSON, S., 1775, A Journey to the Western Islands of Scotland (London: Scholar).
52. KUHL, P. and MELTZOFF, A., 1982, The bimodal perception of speech in infancy. Science, 218(4577), 1138-1141.
53. LACHS, L., PISONI, D. and KIRK, K., 2001, Use of audio-visual information in speech perception by prelingually deaf children with cochlear implants: A first report. Ear and Hearing, 22(3), 236-251.
54. LEYBAERT, J., 2000, Phonology acquired through the eyes and spelling in deaf children. Journal of Experimental Psychology, 75, 291-318.
55. LIBERMAN, A., COOPER, F., SHANKWEILER, D. and STUDDERT-KENNEDY, M., 1967, Perception of the speech code. Psychological Review, 74, 431-461.
56. LIBERMAN, A. and MATTINGLY, I., 1985, The motor theory of speech perception revised. Cognition, 21, 1-36.
57. LIBERMAN, A. and WHALEN, D., 2000, On the relation of speech to language. Trends in Cognitive Sciences, 4, 187-196.
58. LIDESTAM, B., LYXELL, B. and ANDERSSON, G., 1999, Lipreading: Cognitive predictors and displayed emotion. Scandinavian Audiology, 28(4), 211-217.
59. LOCKE, A., GINSBORG, J. and PEERS, I., 2002, Development and disadvantage: Implications for the early years and beyond. International Journal of Language and Communication Disorders, 37, 3-15.
60. LUCE, P. and PISONI, D., 1998, Recognizing spoken words: The neighborhood activation model. Ear and Hearing, 19(1), 1-36.
61. MACSWEENEY, M., AMARO, E., CALVERT, G. and CAMPBELL, R., 2000, Silent speechreading in the absence of scanner noise: An event-related fMRI study. NeuroReport, 11, 1729-1733.
62. MARKIDES, A., 1979, Lipreading. Child: Care, Health and Development, 5, 93-101.
63. MASSARO, D., 1984, Children's perception of visual and auditory speech. Child Development, 55 (5), 1777-1788.
64. MASSARO, D., 1987, Speech Perception by Ear and Eye (Hillsdale, NJ: Lawrence Erlbaum Associates).
65. MASSARO, D., COHEN, M. and GESI, A., 1993, Long-term training, transfer, and retention in learning to speech-read. Perception and Psychophysics, 53(5), 549-562.
66. MATTYS, S., BERNSTEIN, L. and AUER, E., 2002, Stimulus-based lexical distinctiveness as a general wordrecognition mechanism. Perception and Psychophysics, 64, 667-679.
67. MCGURK, H. and MACDONALD, J., 1976, Hearing lips and seeing voices. Nature, 264(5588), 746-748.
68. MELTZOFF, A. and MOORE, M., 1983, Newborn infants imitate adult facial gestures. Child Development, 54 (3), 702-709.
69. MELTZOFF, A. and MOORE, M., 1977, Imitation of facial and manual gestures by human neonates. Science, 198(4312), 74-78.
70. MOGFORD, K., 1987, Lipreading in the prelingually deaf. In B. Dodd and R. Campbell (eds), Hearing by Eye: The Psychology of Speech-Reading (Hillsdale, NJ: Lawrence Erlbaum Associates), pp. 191-211.
71. MOLFESE, D., FONARYOVA KEY, A., MAGUIRE, M., DOVE, G. and MOLFESE, V.., 2005, The use of event-related evoked potentials (ERPs) to study the brain's role in speech perception from infancy into adulthood. In Handbook of Speech Perception Cambridge, MA: Blackwell), pp. 99-112.
72. NEYHUS, A. I. and MYKELBUST, H. R., 1969, Speechreading Failure in Deaf Children (Washington, DC: Bureau of Education for the Handicapped, Department of Health, Education and Welfare).
73. O'NEILL, J. and DAVIDSON, J., 1956, Relationship between lipreading and five psychological factors. Journal of Speech and Hearing Disorders, 21, 478-481.
74. OJANEN, V., 2005, Neurocognitive mechanisms of audio-visual perception. Doctoral dissertation, Helsinki University of Technology, Helsinki.
75. PAUL, P.., 2001, Language and Deafness , 3rd edn(Ohio: Singular Thomson Learning).
76. REID, G., 1946, A preliminary investigation in the testing of lipreading achievement. American Annals of the Deaf, 91, 403-413.
77. RHOADES, E., 2006, Research outcomes of auditory-verbal intervention: Is the approach justified? Deafness and Education International, 8, 125-143.
78. RISBERG, A. and AGELFORS, E., 1978, Information extraction and information processing in speechreading. Speech transmission Laboratory, Quarterly Progress Report (Stockholm), 2-3, 62-82.
79. ROSENBLUM, L.., 2005, Primacy of multimodal speech perception. In D. Pisoni and R. Remez (eds), The Handbook of Speech Perception (Cambridge, MA: Blackwell).
80. ROSENBLUM, L. and GORDON, M., 2001, The generality of specificity: Some lessons from audio-visual speech. Behavioural and Brain Sciences, 24, 239-240.
81. ROSENBLUM, L., MILLER, R. and SANCHEZ, K., 2007, Lip-read me now, hear me better later: Cross-modal transfer of talker familiarity effect. Psychological Science, 18(5), 392-396.
82. ROSENBLUM, L. and SALDAÑ A, H., 1996, An audio-visual test of kinematic primitives for visual speech perception. Journal of Experimental Psychology: Human Perception and Performance, 22, 318-331.
83. SEKIYAMA, K. and TOHKURA, Y., 1991, Japanese subjects hearing Japanese syllables of high auditory intelligibility. Journal of the Acoustical Society of America, 90, 1797-1805.
84. SHARMA, A., DORMAN, M. and SPAHR, A., 2002, A sensitive period for the development of the central auditory system in children with cochlear implants: Implications for age of implantation. Ear and Hearing, 23(6), 532-539.
85. SHARP, E., 1972, The relationship between visual closure to speechreading. Exceptional Child, 38, 729-734.
86. SIMMONS, A., 1959, Factors related to lipreading. Journal of Speech and Hearing Research, 2, 340-352.
87. SIVA, N., STEVENS, E., KUHL, P. and MELTZOFF, A., 1995, A comparison between cerebral-palsied and normal adults in the perception of auditory-visual illusions. Journal of the Acoustical Society of America, 98, 2983.
88. SMITH, E. and BENNETTO, L., 2007, Audio-visual speech integration and lip-reading in autism. Journal of Child Psychology and Psychiatry and Allied Disciplines, 48, 813-821.
89. SUMMERFIELD, A. Q., 1987, A comprehensive account of audio-visual speech perception. In B. Dodd and R. Campbell (eds), Hearing by Eye: The Psychology of Lip-Reading (London: Erlbaum), pp. 3-51.
90. SUMMERFIELD, A. Q., 1991, Visual perception of phonetic gestures. In G. Mattingly and M. Studdert Kennedy (eds), Modularity and the Motor Theory (Hillsdale, NJ: Lawrence Erlbaum Associates), pp. 117-137.
91. TALLAL, P., 1987, The neuropsychology of developmental language disorders. In First Symposium on Specific Language Disorders in Children London: AFASIC), 36-47.
92. TALLAL, P. and PIERCY, M., 1975, Developmental aphasia: The perception of brief vowels and extended stop consonants. Neuropsychologia, 13, 69-74.
93. THOMAS, S. and JORDAN, T., 2004, Contributions of oral and extra-oral facial motion to visual and audiovisual speech perception. Journal of Experimental Psychology: Human Perception and Performance, 30, 873-888.
94. TOBEY, E., GEERS, A., BRENNER, C., ALTUNA, D. and GABBERT, G., 2003, Factors associated with development of speech production skills in children implanted by age five. Ear and Hearing, 24 (1), 36-45.
95. WERKER, J. and TEES, R., 1999, Influences on infant speech processing: Toward a new synthesis. Annual Review Psychology, 50, 509-535.
96. WILSON, S., SAYGIN, A., SERENO, M. and IACOBONI, M., 2004, Listening to speech activates motor areas involved in speech production. Nature Neuroscience, 7, 701-702.
97. WISE, R., CHOLLET, F., HADAR, U., FRISTON, K., HOFFNER, E. and FRACKOWIAK, R., 1991, Distribution of cortical neural networks involved in word comprehension and word retrieval. Brain, 114 (4), 1803-1817.
98. WOODHOUSE, L., 2007, Speech-reading skills and communication development in a hearing impaired cohort. Doctoral dissertation, University of Queensland.
99. WUNDT, W., 1911, Volkerpsychologie Bd. I Die Sprache (Leipzig: Engleman).