Speechreading: Illusion or window into pattern recognition

Trends in Cognitive Sciences

Volumn 3, Issue 8, 1999, Pages 310-317

  Dominic, I ^a   Massaro, W ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COGNITION; HUMAN; INFORMATION PROCESSING; LANGUAGE; NEUROPATHOLOGY; PATTERN RECOGNITION; REVIEW; SPEECH; SPEECH PERCEPTION; THEORY;

EID: 0032789664     PISSN: 13646613     EISSN: None     Source Type: Journal    
DOI: 10.1016/S1364-6613(99)01360-1     Document Type: Review

References (55)

1. McGurk, H. and MacDonald, J. (1976) Hearing lips and seeing voices Nature 264, 746-748
2. Fodor, J.A. (1983) Modularity of Mind, Bradford Books/MIT Press
3. Bertelson, P. and Radeau, M. (1981) Cross-modal bias and perceptual fusion with auditory-visual spatial discordance Percept. Psychophys. 29,578-584
4. Bertelson, P. (1994) The cognitive architecture behind auditory-visual interaction in scene analysis and speech identification Cahiers de Psychologie Cognitive 13, 69-75
5. Radeau, M. (1994) Auditory-visual spatial interaction and modularity. Cahiers de Psychologie Cognitive 13, 3-51
6. Fisher, B. (1992) Integration of visual and auditory information in the perception of speech events Dissert. Abstr. Int. 52, 3324B
7. Massaro, D.W. (1992) Broadening the domain of the fuzzy logical model of perception, in Cognition: Conceptual and Methodological Issues (Pick, H.L., Jr, Van den Broek, P. and Knill, D.C., eds), pp. 51-84, American Psychological Association
8. Warren, R.M. (1970) Perceptual restoration of missing speech sounds Science 167,392-363
9. Samuel, A.G. (1981) Phonemic restoration: insights from a new methodology J. Exp. Psycho!. Gen. 110, 474-494
10. Frost, R., Repp, B.H. and Katz, L. (1988) Can speech perception be influenced by simultaneous presentation of print? J. Mem. Lang. 27, 741-755
11. Massaro, D.W., Cohen, M.M. and Thompson, L.A. (1988) Visible language in speech perception: lipreading and reading Visible Lang. 1, 8-31
12. Massaro, D.W. (1998) Illusions and issues in bimodal speech perception, in Proc. Audit. Visual Speech Percept. (Terrigal, Australia), pp. 21-26, Causal Productions, Rundle Mall
13. Calvert, G.A., Brammer, M.J. and Iverson, S.D. (1998) Crossmodal identification Trends Cognit. Sei. 2, 247-253
14. Massaro, D.W. (1987) Speech Perception by Ear and Eye: A Paradigm for Psychological Inquiry, Erlbaum
15. Massaro, D.W. (1998) Perceiving Talking Faces: From Speech Perception to a Behavioral Principle, MIT Press
16. Dennett, D.C. (1991) Consciousness Explained, Little, Brown & Co.
17. Blumstein, S.E. (1986) On acoustic invariance in speech, in Invariance and Variability in Speech Processes (Perkell, J.S. and Klatt, D.H., eds), pp. 178-197, Erlbaum
18. Blumstein, S.E. and Stevens, K.N. (1979) Acoustic invariance in speech production: evidence from measurements of the spectral characteristics of stop consonants J. Acoust. Soc. Am. 66, 1001-1017
19. Diehl, R.L and Kluender, K.R. (1989) On the objects of speech perception fco/. Psychol. 1, 121-144
20. Sekiyama, K. and Tohkura, Y. (1991) McGurk effect in non-English listeners: few visual effects for Japanese subjects hearing Japanese syllables of high auditory intelligibility J. Acoust. Soc. Am. 90, 1797-1805
21. Sekiyama, K. and Tohkura, Y. (1993) Inter-language differences in the influence of visual cues in speech perception J. Phonet. 21, 427-444
22. Cutting, J. E. eta/. (1992) Selectivity, scope, and simplicity of models: a lesson from fitting judgments of perceived depth J. Exp. Psychol. Gen. 121,364-381
23. Massaro, D.W. (1988) Ambiguity in perception and experimentation J. Exp. Psychol. Gen. 117, 417-421
24. Massaro, D.W. and Cohen, M.M. (1993) The paradigm and the fuzzy logical model of perception are alive and well J. Exp. Psychol. Gen. 122, 115-124
25. Liberman, A.M. (1996) Speech: A Special Code, MIT Press
26. Mattingly. I.G. and Studdert-Kennedy, M., eds (1991) Modularity and the Motor Theory of Speech Perception, Erlbaum
27. Robert-Ribes, J. et al. (1995) Expliting sensor fusion architectures and stimuli complementarity in AV speech recognition, in Speechreading by Humans and Machines (Stork, D.G. and Hennecke, M.E., eds), pp. 193-210, Springer-Verlag
28. Robert-Ribes, J., Schwartz, J-L and Escudier, P. (1995) A comparison of models for fusion of the auditory and visual sensors in speech perception Artif. Intel!. Rev. 9, 323-346
29. Massaro, D.W. and Stork, D.G. (1998) Speech recognition and sensory integration Am. Sei. 86, 236-244
30. Fowler, C.A. (1996) Listeners do hear sounds, not tongues J. Acoust. Soc. Am. 99, 1730-1741
31. Best, C.T. (1995) A direct realist view of cross-language speech perception, in Speech Perception and Linguistic Experience: Issues in Cross-Language Research (Strange, W., ed.), pp. 171-204, York Press, Baltimore
32. Oden, G.C. and Massaro, D.W. (1978) Integration of featural information in speech perception Psychol. Rev. 85, 172-191
33. Massaro, D.W. and Friedman, D. (1990) Models of integration given multiple sources of information Psychol. Rev. 97, 225-252
34. Mesulam, M-M. (1994) Neurocognitive networks and selectively distributed processing Rev. Neural. (Paris) 150, 564-569
35. Green, D.M. and Swets, J.A. (1966) Signal Detection Theory and Psycho physics, John Wiley & Sons
36. Massaro, D.W. (1996) Bimodal speech perception: a progress report, in Speechreading by Humans and Machines (Stork, D.G. and Hennecke, M.E., eds), pp. 79-101, Springer-Verlag
37. Campbell, C.S. and Massaro, D.W. (1997) Perception of visible speech: influence of spatial quantization Perception 26, 627-644
38. McClelland, J.L. and Elman, J.L (1986) The TRACE model of speech perception Cognit. Psycho!. 18, 1-86
39. Campbell, R. (1988) Tracing lip movements: making speech visible Visible Lang. 22, 32-57
40. O'Reilly, R.C. (1998) Six principles for biologically based computational models of cortical cognition Trends Cognit. Sei. 2, 455-462
41. White, E.L. (1989) Cortical Circuits: Synaptic Organization of the Cerebral Cortex: Structure, Function, and Theory, Birkhauser
42. McClelland, J.L. (1991) Stochastic interactive processes and the effect of context on perception Cognit. Psychol. 23, 1-44
43. Massaro, D.W. and Cohen, M.M. (1991) Integration versus interactive activation: the joint influence of stimulus and context in perception Cognit. Psychol. 23, 558-614
44. Grant, K.W., Waiden, B.E. and Seitz, P.P. (1998) Auditory-visual speech recognition by hearing-impaired subjects: consonant recognition, sentence recognition, and auditory-visual integration/ Acoust. Soc. Am. 103,2677-2690
45. Massaro, D.W. eta/. (1993) Bimodal speech perception: an examination across languages/ Phonet. 21, 445-478
46. Massaro, D.W., Cohen, M.M. and Smeele, P.M.T. (1995) Cross-linguistic comparisons in the integration of visual and auditory speech Mem. Cognit. 23, 113-131
47. Massaro, D.W. and Egan, P.B. (1996) Perceiving affect from the voice and the face Psychonomic Bull. Rev. 3, 215-221
48. Hess, U., Kappas, A. and Scherer, K.R. (1988) Multichannel communication of emotion: synthetic signal production, in Facets of Emotion: Recent Research (Scherer, K.R., ed.), pp. 161-182, Erlbaum
49. De Gelder, B. et a/. The combined perception of emotion from voice and face: early interaction revealed by electric brain responses Neurosci. Lett, (in press)
50. Campbell, C.S., Schwartzer, G. and Massaro, D.W. Face perception: an information-processing framework, in Computational, Geometric, and Process Perspectives on Facial Cognition (Wenger, M.J. and Townsend, J.T., eds), Erlbaum (in press)
51. Smeele, P.M.T. et al. (1998) Laterality in visual speech perception J. Exp. Psychol. Hum. Percept. Perform. 24, 1232-1242
52. Summerfield, Q. (1987) Some preliminaries to a comprehensive account of audio-visual speech perception, in Hearing by Eye: The Psychology of Lip-Reading (Dodd, B. and Campbell, R., eds), pp. 3-51, Erlbaum
53. Jordan, T.R. and Sergeant, P.C. (1998) Effects of facial image size on visual and audio-visual speech recognition, in Hearing by Eye II: Advances in the Psychology of Speechreading and Auditory-Visual Speech (Dodd, B., Campbell, R. and Burnham, D., eds), pp. 155-176, Psychology Press/Erlbaum
54. Massaro, D.W. and Cohen, M.M. (1993) Perceiving aysnchronous bimodal speech in consonant-vowel and vowel syllables Speech Commun. 13, 127-134
55. Massaro, D.W., Cohen, M.M. and Smeele, P.M.T. (1996) Perception of asynchronous and conflicting visual and auditory speech/ Acoust. Soc. Am. 100, 1777-1786