Perceiving speech from inverted faces

Perception and Psychophysics

Volumn 58, Issue 7, 1996, Pages 1047-1065

  Massaro, Dominic W ^a   Cohen, Michael M ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; ATTENTION; COMMUNICATION AID; COMPUTER SIMULATION; FACIAL EXPRESSION; FEMALE; FUZZY LOGIC; HUMAN; INDIVIDUALITY; LIP READING; MALE; ORIENTATION; PHONETICS; PSYCHOPHYSICS; REACTION TIME; SOUND DETECTION; SPEECH; SPEECH PERCEPTION;

ADULT; ATTENTION; COMMUNICATION AIDS FOR DISABLED; COMPUTER SIMULATION; FACIAL EXPRESSION; FEMALE; FUZZY LOGIC; HUMANS; INDIVIDUALITY; LIPREADING; MALE; ORIENTATION; PHONETICS; PSYCHOACOUSTICS; REACTION TIME; SOUND SPECTROGRAPHY; SPEECH ACOUSTICS; SPEECH PERCEPTION;

EID: 0030254871     PISSN: 00315117     EISSN: None     Source Type: Journal    
DOI: 10.3758/BF03206832     Document Type: Article

References (47)

1. BERNSTEIN, L. E., & EBERHARDT, S. P. (1986). Johns Hopkins lipreading corpus I-II: Disc I. Baltimore: Johns Hopkins University Press.
2. BERTELSON, P., VROOMEN, J., WIEGERAAD, G., & DE GELDER, B. (1994, September). Exploring the relation between McGurk interference and ventriloquism. Paper presented at the 1994 International Conference on Spoken Language Processing, Yokohama, Japan.
3. BRAIDA, L. D. (1991). Crossmodal integration in the identification of consonant segments. Quarterly Journal of Experimental Psychology, 43A, 647-677.
4. BRUNO, N., & CUTTING, J. E. (1988). Minimodularity and the perception of layout. Journal of Experimental Psychology: General, 117, 161-170.
5. CAMPBELL, R. (1992). The neuropsychology of lipreading. Philosophical Transactions of the Royal Society London: Series B, 335, 39-45.
6. CAMPBELL, R. (1994). Audiovisual speech: Where, what, when, how? Current Psychology of Cognition, 13, 76-80.
7. CHANDLER, J. P. (1969). Subroutine STEPIT - Finds local minima of a smooth function of several parameters. Behavioral Science, 14, 81-82.
8. COHEN, M. M., & MASSARO, D. W. (1990). Synthesis of visible speech. Behavior Research Methods, Instruments, & Computers, 22, 260-263.
9. COHEN, M. M., & MASSARO, D. W. (1992). On the similarity of categorization models. In F. G. Ashby (Ed.), Probabilistic multidimensional models of perception and cognition (pp. 395-447). Hillsdale, NJ: Erlbaum.
10. COHEN, M. M., & MASSARO, D. W. (1993). Modeling coarticulation in synthetic visual speech. In N. M. Thalmann & D. Thalmann (Eds.), Models and techniques in computer animation (pp. 139-156). Tokyo: Springer-Verlag.
11. COHEN, M. M., & MASSARO, D. W. (1994). Development and experimentation with synthetic visible speech. Behavior Research Methods, Instruments, & Computers, 26, 260-265.
12. CUTTING, J. E., BRUNO, N., BRADY, N. P., & MOORE, C. (1992). Selectivity, scope, and simplicity of models: A lesson from fitting judgments of perceived depth. Journal of Experimental Psychology: General, 121, 364-381.
13. DE GELDER, B., VROOMEN, J., & VAN DER HEIDE, L. (1991). Face recognition and lip-reading in autism. European Journal of Cognitive Psychology, 3, 69-86.
14. ETCOFF, N. L., & MAGEE, J. J. (1992). Categorical perception of facial expressions. Cognition, 44, 227-240.
15. FISHER, B. (1991). Integration of visual and auditory information in perception of speech events. Unpublished doctoral dissertation, University of California, Santa Cruz.
16. GOURAUD, H. (1971). Continuous shading of curved surfaces. IEEE Transactions on Computers, C-20, 623-628.
17. GREEN, K. P. (1994). The influence of an inverted face on the McGurk effect. Journal of the Acoustical Society of America, 95, 3014.
18. GREEN, K. P., KUHL, P. K., MELTZOFF, A. N., & STEVENS, E. B. (1991). Integrating speech information across talkers, gender, and sensory modality: Female faces and male voices in the McGurk effect. Perception & Psychophysics, 50, 524-536.
19. HELLIGE, J. B. (1993). Hemispheric asymmetry: What's right and what's left. Cambridge, MA: Harvard University Press.
20. JORDAN, T. R., & BEVAN, K. (in press). Seeing and hearing rotated faces: Influence of facial orientation on visual and audio-visual speech recognition. Journal of Experimental Psychology: Human Perception & Performance.
21. LEVINE, S. C., BANICH, M. T., & KOCH-WESER, M. P. (1988). Face recognition: A general or specific right hemisphere capacity? Brain & Cognition, 8, 303-325.
22. MASSARO, D. W. (1984). Children's perception of auditory and visual speech. Child Development, 55, 1777-1788.
23. MASSARO, D. W. (1987). Speech perception by ear and eye: A paradigm for psychological inquiry. Hillsdale, NJ: Erlbaum.
24. MASSARO, D. W. (1989a). Multiple book review of Speech Perception by Ear and Eve: A Paradigm for Psychological Inquiry. Behavioral & Brain Sciences, 12, 741-794.
25. MASSARO, D. W. (1989b). Testing between the TRACE model and the Fuzzy Logical Model of Perception. Cognitive Psychology, 21, 398-421.
26. MASSARO, D. W. (1990). A fuzzy logical model of speech perception. In D. Vickers & P. L. Smith (Eds.), Human information processing: Measures, mechanisms, and models (pp. 367-379). Amsterdam: Elsevier, North-Holland.
27. MASSARO, D. W. (1992). Broadening the domain of the fuzzy logical model of perception. In H. L. Pick, Jr., P. Van den Broek, & D. C. Knill (Eds.), Cognition, conceptual, and methodological issues (pp. 51-84). Washington, DC: American Psychological Association.
28. MASSARO, D. W., & COHEN, M. M. (1983). Evaluation and integration of visual and auditory information in speech perception. Journal of Experimental Psychology: Human Perception & Performance, 3, 753-771.
29. MASSARO, D. W., & COHEN, M. M. (1990). Perception of synthesized audible and visible speech. Psychological Science, 1, 55-63.
30. MASSARO, D. W., COHEN, M. M., & SMEELE, P. M. T. (1995). Cross-linguistic comparisons in the integration of visual and auditory speech. Memory & Cognition, 23, 113-131.
31. MASSARO, D. W., & FRIEDMAN, D. (1990). Models of integration given multiple sources of information. Psychological Review, 97, 225-252.
32. MASSARO, D. W., TSUZAKI, M., COHEN, M. M., GESI, A., & HEREDIA, R. (1993). Bimodal speech perception: An examination across languages. Journal of Phonetics, 21, 445-478.
33. MCGURK, H., & MACDONALD, J. (1976). Hearing lips and seeing voices. Nature, 264, 746-748.
34. PARKE, F. I. (1974). A parametric model for human faces (Tech. Rep. UTEC-CSc-75-047). Salt Lake City: University of Utah.
35. PARKE, F. I. (1975). A model for human faces that allows speech synchronized animation. Computers & Graphics Journal, 1(1), 1-4.
36. PARKE, F. I. (1982). Parameterized models for facial animation. IEEE Computer Graphics, 2(9), 61-68.
37. PEARCE, A., WYVILL, B., WYVILL, G., & HILL, D. (1986). Speech and expression: A computer solution to face animation. Proceedings of Graphics Interface '86 (pp. 136-140).
38. PLATT, J. R. (1964). Strong inference. Science, 146, 347-353.
39. RHODES, G. (1994). Secrets of the face. New Zealand Journal of Psychology, 23, 3-17.
40. SEKIYAMA, K., & TOHKURA, Y. (1991). McGurk effect in non-English listeners: Few visual effects for Japanese subjects hearing Japanese syllables of high auditory intelligibility. Journal of the Acoustical Society of America, 90, 1797-1805.
41. SEKIYAMA, K., & TOKHURA, Y. (1993). Inter-language differences in the influence of visual cues in speech perception. Journal of Phonetics, 21, 427-444.
42. SERGENT, J. (1994). Cognitive and neural structures in face processing. In A. Kertesz (Ed.), Localization and neuroimaging in neuropsychology (pp. 473-494). San Diego: Academic Press.
43. TANAKA, J. W., & FARAH, M. J. (1993). Parts and wholes in face recognition. Quarterly Journal of Experimental Psychology: Human Experimental Psychology, 46A, 225-245.
44. THOMPSON, L. A., & MASSARO, D. W. (1989). Before you see it, you see its parts: Evidence for feature encoding and integration in preschool children and adults. Cognitive Psychology, 21, 334-362.
45. VALENTINE, T. (1988). Upside-down faces: A review of the effect of inversion upon face recognition. British Journal of Psychology, 79, 471-491.
46. VROOMEN, J. H. M. (1992). Hearing voices and seeing lips: Investigations in the psychology of lipreading. Doctoral dissertation, Katholieke Universiteit Brabant, Nijmegen.
47. ZAIDEL, D. W. (1994). Worlds apart: Pictorial semantics in the left and right cerebral hemispheres. Current Directions in Psychological Science, 3, 5-8.