Bisensory augmentation: A speechreading advantage when speech is clearly audible and intact

British Journal of Psychology

Volumn 92, Issue 2, 2001, Pages 339-355

  Arnold, Paul ^a   Hill, Fiona ^b  

^a UNIVERSITY OF MANCHESTER   (United Kingdom)

^b NONE

Author keywords

[No Author keywords available]

Indexed keywords

ADOLESCENT; ADULT; ARTICLE; AUDITORY STIMULATION; COGNITION; FACIAL EXPRESSION; FEMALE; HUMAN; PHOTOSTIMULATION; PILOT STUDY; SPEECH PERCEPTION; STATISTICAL MODEL;

ACOUSTIC STIMULATION; ADOLESCENT; ADULT; COGNITION; FACIAL EXPRESSION; FEMALE; HUMANS; LINEAR MODELS; PHOTIC STIMULATION; PILOT PROJECTS; SPEECH PERCEPTION;

EID: 0035347346     PISSN: 20448295     EISSN: None     Source Type: Journal    
DOI: 10.1348/000712601162220     Document Type: Article

References (38)

1. Alegría, J. (1996). On the origin of phonological representations in deaf people. In M. Carreiras, J. E. Garcia-Albea, & N. Sebastián-Gallés (Eds.), Language processing in Spanish (pp. 119-144). Hillsdale, NJ: Erlbaum.
2. Arnold, P. (2000). Bisensory augmentation: Children's speechreading and listening. Manuscript submitted for publication.
3. Benôit, C., Guiard-Marigny, T., Le Goff, B., & Adjoudani, A. (1996). Which components of the face do humans and machines best speechread? In D. G. Stork & M. E. Hennecke (Eds.), Speechreading by humans and machines: Models, systems and applications (pp. 315-28). NATO ASI Series. Berlin: Springer.
4. Berg, F. S., Blair, J. C., & Benson, P. V. (1996). Classroom acoustics: The problem, impact, and solution. Language, Speech, and Hearing in Schools, 27, 16-20.
5. Brooke, N. M. (1998). Computational aspects of visual speech: Machines that can speechread and simulate talking faces. In R. Campbell, B. Dodd, & D. Burnham (Eds.), Hearing by eye II: Advances in the psychology of speechreading and auditory-visual speech (pp. 109-122). Hove: Psychology Press.
6. Calvert, E. A., Bullmore, E. T., Brammer, M. J., Campbell, R., Williams, S. C. R., McGuire, P. K., Woodruff, P. W. R., Iversen, S. D., & David, A. S. (1997). Activation of auditory cortex during silent lipreading. Science, 276, 593-596.
7. Campbell, R., Dodd, B., & Burnham, D. (1998). Hearing by eye II: Advances in the psychology of speechreading and auditory-visual speech. Hove: Psychology Press.
8. Cotton, J. C. (1935). Normal 'visual hearing'. Science, 82, 592-593.
9. Diehl, R. L., & Kluender, K. R. (1989). On the objects of speech perception. Ecological Psychology, 1, 121-144.
10. Dodd, B. (1987). Lip-reading skills of hearing children. In B. Dodd & R. Campbell (Eds.), Hearing by eye: The psychology of lip-reading (pp. 163-175). London: Erlbaum.
11. Dodd, B., & Campbell, R. (1987). Hearing by eye: The psychology of lip-reading. London: Erlbaum.
12. Erber, N. P. (1974) Auditory-visual perception of speech: A survey. In H. Birk Nielsen & E. Kampp (Eds.), Visual and audio-visual perception of speech (pp. 12-30). Copenhagen: Gl.Avernæs.
13. Garstecki, D. C. (1988). Speechreading with auditory cues. The Volta Review, 90, 161-176.
14. Jordan, N. C. (1988). Language processing and reading ability in children: A study based on speech-shadowing techniques. Journal of Psycholinguistics Research, 17, 357-377.
15. Lerner, S. (1975). A study of shadowing ability. Dissertations Abstracts International, 35, 10-B, 5120.
16. MacDonald, J., & McGurk, H. (1978). Visual influences on speech perception processes. Perception and Psychophysics, 24, 253-257.
17. Massaro, D. W., Cohen, M. M., Gesi, A., Heredia, R., & Tsuzaki, M. (1993). Bimodal speech perception: An examination across languages. Journal of Phonetics, 21, 445-478.
18. McGurk, H., & MacDonald, J. (1976). Hearing lips and seeing voices. Nature, 264, 746-748.
19. Meudell, P. (1974). Coding and forgetting in visual memory. Unpublished PhD Thesis, University of Manchester.
20. Miller, G. A., & Nicely, P. E. (1955). An analysis of perceptual confusions among some English consonants. Journal of the Acoustical Society of America, 27, 338-352.
21. Neale, M. D. (1988a). Neale Analysis of Reading Ability: Revised British Edition (Reader). Windsor: NFER-Nelson.
22. Neale, M. D. (1998b). Neale Analysis of Reading Ability: Revised British Edition (Manual). Windsor: NFER-Nelson.
23. Probasco, P. D. (1970). Social feedback factors in vocal shadowing. Dissertations Abstracts International, 31A, 828-829.
24. Raven, J. C. (1958). Standard progressive matrices. Cambridge: University Printing House.
25. Reisberg, D. (1978). Looking where you listen: Visual cues and auditory attention. Acta Psychologica, 42, 331-341.
26. Reisberg, D., McLean, J., & Goldfield, A. (1987). Easy to hear but hard to understand: A speechreading advantage with intact auditory stimuli. In B. Dodd & R. Campbell (Eds.), Hearing by eye: The psychology lip-reading. (pp. 97-113). London: Erlbaum.
27. Rey, A. (1964). L'examen clinique en psychologie [Auditory-Verbal Learning Test]. Paris: Presses Universitaires de France.
28. Rönnberg, J. (1990). Cognitive and communicative function: The effects of chronological age and 'handicap age'. European Journal of Cognitive Psychology, 2, 253-273.
29. Rosenblum, L. D. & Saldaña, H. M. (1998). Time-varying information for visual speech perception. In R. Campbell, B. Dodd, & D. Burnham (Eds.), Hearing by eye II: Advances m the psychology of speechreading and auditory-visual speech (pp. 61-81). Hove: Psychology Press.
30. Sanders, D. A., & Goodrich, S. J. (1971). The relative contribution of visual components of speech to speech intelligibility as a function of 3 conditions of frequency distortion. Journal of Speech and Hearing Research, 14, 154-159.
31. Schwartz, J.-L., Robert-Ribes, J., & Escudier, P. (1998). Ten years after Summerfield: A taxonomy of models for audio-visual fusion in speech perception. In R. Campbell, B. Dodd, & D. Burnham (Eds.), Hearing by eye II: Advances in the psychology of speechreading and auditory-visual speech (pp. 85-108). Hove: Psychology Press.
32. Stork, D. G., & Hennecke, M E. (Eds.) (1996). Speechreading by humans and machines: Models, systems and applications. NATO ASI Series. Berlin: Springer.
33. Summerfield, Q. (1987). Some preliminaries to a comprehensive account of audio-visual speech perception. In B. Dodd & R. Campbell (Eds.), Hearing by eye: The psychology of lip-reading (pp. 3-51). London: Erlbaum.
34. Summerfield, A. Q. (1991). Visual perception of phonetic gestures. In I. G. Mattingly & M. Studdert-Kennedy (Eds.), Modularity and the motor theory of speech perception (pp. 117-137). Hillsdale, NJ: Erlbaum.
35. Summerfield, A. Q., McLeod, A., McGrath, M., & Brooke, M. (1989). Lips, teeth, and the benefits of lipreading. In A. W. Young & H. D. Ellis (Eds.), Handbook of research on face processing (pp. 223-333). Amsterdam: Elsevier.
36. Von Raffler-Engel, W. (1973). The development from sound to phoneme in child language. In C. A. Ferguson & D. Slobin (Eds.), Studies in child language development (pp. 9-12). New York: Holt, Rinehart & Winston.
37. Walden, B. E., Prosek, R. A., Montgomery, A. A., Scherr, C. K., & Jones, C. J. (1977) Effects of training on the visual recognition of consonants. Journal of Speech and Hearing Research, 20, 130-145.
38. Wundt, W. (1911). Völkerpsychologie (Vol. C3, 3rd ed.). Leipzig: Engleman.