Effects of facial image size on visual and audio-visual speech recognition

Hearing Eye II: Advances in the Psychology of Speechreading and Auditory-Visual Speech

Volumn , Issue , 2013, Pages 155-176

  Jordan, Timothy R ^a   Sergeant, Paul C ^a  

^a UNIVERSITY OF ST ANDREWS   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0002690169     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.4324/9780203098752-17     Document Type: Chapter

References (42)

1. Aubert, H. (1886). Die Bewegungsempfindung. Archiv für die Gesamte Psychologie, 39, 347-70.
2. Bertelson, P., Vroomen, J., Wiegeraad, G. & de Gelder, B. (1994). Exploring the relation between McGurk interference and ventriloquism. Paper presented at the International Conference on Spoken Language Processing, September. Yokohama, Japan.
3. Binnie, C.A., Montgomery, A.A. & Jackson, P.L. (1974). Auditory and visual contributions to the perception of selected English consonants for normally hearing and hearing-impaired listeners. In H. Birk Nielsen & E. Kampp (Eds), Visual and Audio-visual Perception of Speech (Scandinavian Supplementum 4, pp. 181-209). Stockholm: Almquist & Wiksell.
4. Burr, D.C. (1991). Human sensitivity to flicker and motion. In J.J. Kulikowski, V. Walsh and I.J. Murray (Eds), Vision and Visual Dysfunction (5) (pp. 147-59). London: Macmillan.
5. Conrad, R. (1979). The Deaf Schoolchild. London: Harper & Row.
6. Diesch, E. (1995). Left and right hemifield advantages of fusions and combinations in audiovisual speech perception. Quarterly Journal of Experimental Psychology, 48 A, 320-33.
7. Erber, N.P. (1971). Effects of distance on the visual reception of speech. Journal of Speech and Hearing Research, 14, 848-57.
8. Erber, N.P. (1974). Effects of angle, distance and illumination on visual reception of speech by profoundly deaf children. Journal of Speech and Hearing Research, 17, 99-112.
9. Gailey, L. (1987). Psychological parameters of lip-reading skill. In B. Dodd & R. Campbell (Eds), Hearing by Eye: The Psychology of Lipreading (pp. 115-41). Hove, UK: Lawrence Erlbaum Associates Ltd.
10. Green, K.P. (1994). The influence of an inverted face on the McGurk effect. Poster presented at the spring meeting of the Acoustical Society of America. Cambridge, Massachusetts. Journal of the Acoustical Society of America, 95, 3014 (Abstract).
11. Green, K.P., Kuhl, P.K. & Meltzoff, A.N. (1988). Factors affecting the integration of auditory and visual information in speech: The effect of vowel environment. Journal of the Acoustical Society of America, 84, 155.
12. Green, K.P., Kuhl, P.K., Meltzoff, A.N. & Stevens, E.B. (1991). Integrating speech information across talkers, gender and sensory modality: Female faces and male voices in the McGurk effect. Perception and Psychophysics, 50, 524-36.
13. Johnson, J.A., Rosenblum, L.D. & Saldaña, H.M. (1994). The contribution of a reduced visual image to speech perception in noise. Poster presented at the spring meeting of the Acoustical Society of America. Cambridge, Massachusetts. Journal of the Acoustical Society of America, 95, 3009 (Abstract).
14. Jordan, T.R. & Bevan, K.M. (1997). Seeing and hearing rotated faces: Influences of facial orientation on visual and audio-visual speech recognition. Journal of Experimental Psychology: Human Perception and Performance, 23, 388-403.
15. Liberman, A.M. & Mattingly, I.G. (1985). The motor theory of speech perception revised. Cognition, 21, 1-36.
16. McClelland, J.L. & Rumelhart, D.E. (1981). An interactive activation model of context effects in letter perception: Part 1. An account of basic findings. Psychological Review, 88, 375-407.
17. McClelland, J.L. & Rumelhart, D.E. (1988). Explorations in Parallel Distributed Processing. Cambridge, Massachusetts: MIT Press.
18. MacDonald, J. & McGurk, H. (1978). Visual influences on speech perception processes. Perception and Psychophysics, 24, 253-7.
19. McGurk, H. & MacDonald, J. (1976). Hearing lips and seeing voices. Nature, 264, 746-8.
20. McKee, S.P. (1991). The physical constraints on visual hyperacuity. In J.J. Kulikowski, V. Walsh and I.J. Murray (Eds), Vision and Visual Dysfunction (5) (pp. 221-33). London: Macmillan.
21. Massaro, D.W. & Cohen, M.M. (1990). Perception of synthesized audible and visible speech. Psychological Science, 1, 55-63.
22. Massaro, D.W. & Cohen, M.M. (1996). Perceiving speech from inverted faces. Perception and Psychophysics, 58, 1047-65.
23. Montgomery, A.A., & Jackson, P.L. (1983). Physical characteristics of the lips underlying vowel lipreading performance. Journal of the Acoustical Society of America, 73, 2134-2144.
24. Neely, K.K. (1956). Effect of visual factors on the intelligibility of speech. Journal of the Acoustical Society of America, 28, 1275-1277.
25. Petajan, E.D. (1984). Automatic lipreading to enhance speech recognition. Proceedings of the IEEE Communications Society, 265-72.
26. Rönnberg, J. (1993). Cognitive characteristics of skilled tactiling: The case of GS. European Journal of Cognitive Psychology, 5, 19-33.
27. Rosenblum, L.D. & Saldaña, H.M. (1992). Discrimination tests of visually influenced syllables. Perception and Psychophysics, 52, 461-73.
28. Rosenblum, L.D. & Saldaña, H.M. (1996). An audiovisual test of kinematic primitives for visual speech perception. Journal of Experimental Psychology: Human Perception and Performance, 22, 318-31.
29. Rosenblum, L.D., Johnson, J.A. & Saldaña, H.M. (1995). Determining the kinematic features for visual speech perception. Unpublished manuscript.
30. Rumelhart, D.E. & McClelland, J.L. (1982). An interactive activation model of context effects in letter perception: Part 2. The contextual enhancement effect and some tests and extensions of the model. Psychological Review, 89, 60-94.
31. Saldaña, H.M., Rosenblum, L.D. & Osinger, T. (1992). Visual influence on heard speech syllables with a reduced visual image. Journal of the Acoustical Society of America, 92, 2340 (Abstract).
32. Samuelsson, S. & Rönnberg, J. (1993). Implicit and explicit use of scripted constraints in lip-reading. European Journal of Cognitive Psychology, 5, 201-33.
33. Sudman, J.A. & Berger, K.W. (1971). Two-dimension vs. three-dimension viewing in speech-reading. Journal of Communication Disorders, 4, 195-8.
34. Summerfield, A.Q. (1987). Some preliminaries to a comprehensive account of audio-visual speech perception. In B. Dodd & R. Campbell (Eds), Hearing by Eye: The Psychology of Lipreading (pp. 3-51). Hove, UK: Lawrence Erlbaum Associates Ltd.
35. Summerfield, A.Q. (1992). Lipreading and audio-visual speech perception. In V. Bruce, A. Cowey, A.W. Ellis & D.I. Perrett (Eds), Processing the Facial Image (pp. 71-8). Oxford: Oxford University Press.
36. Summerfield, A.Q. & McGrath, M. (1984). Detection and resolution of audio-visual incompatibility in the perception of vowels. Quarterly Journal of Experimental Psychology, 36A, 51-74.
37. Summerfield, A.Q., MacLeod, P., McGrath, M. & Brooke, N.M. (1989). Lips, teeth, and the benefits of lipreading. In A.W. Young and H.B. Ellis (Eds), Handbook of Research on Face Processing (pp. 223-33). Amsterdam: North-Holland.
38. Utley, J. (1946). A test of lip-reading ability. Journal of Speech Disorders, 11, 109-16.
39. Vandegrind, W.A., Koenderink, J.J. & Vandoorn, A.J. (1992). Viewing distance invariance of movement detection. Experimental Brain Research, 91, 135-50.
40. Walden, B.E., Prosek, R.A., Montgomery, A.A., Scherr, C.K. & Jones, C.J. (1977). Effects of training on the visual recognition of consonants. Journal of Speech and Hearing Research, 20, 130-45.
41. Wandell, B.A. (1995). Foundations of Vision. Sunderland, Mass: Sinauer Associates.
42. Woodward, M.F. & Barber, C.G. (1960). Phoneme perception in lipreading. Journal of Speech and Hearing Research, 3, 212-22.