Motor activation from visible speech: Evidence from stimulus response compatibility

Journal of Experimental Psychology: Human Perception and Performance

Volumn 26, Issue 2, 2000, Pages 634-647

  Kerzel, Dirk ^a   Bekkering, Harold ^a  

^a MAX PLANCK INSTITUTE FOR HUMAN COGNITIVE AND BRAIN SCIENCES   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; FEMALE; HUMAN; LIP READING; MALE; PHONETICS; SPEECH; SPEECH INTELLIGIBILITY; SPEECH PERCEPTION;

ADULT; FEMALE; HUMANS; LIPREADING; MALE; PHONETICS; SPEECH ACOUSTICS; SPEECH INTELLIGIBILITY; SPEECH PERCEPTION;

EID: 0034168823     PISSN: 00961523     EISSN: None     Source Type: Journal    
DOI: 10.1037/0096-1523.26.2.634     Document Type: Article

References (73)

1. Binnie, C. A., Montgomery, A. A., & Jackson, P. M. (1974). Auditory and visual contributions to the perception of consonants. Journal of Speech and Hearing Research, 17, 619-630.
2. Browman, C. P., & Goldstein, L. (1992). Articulatory phonology: An overview. Phonetica, 49, 155-180.
3. Dalrymple-Alford, E. C., & Azkoul, J. (1972). The locus of interference in the Stroop and related tasks. Perception & Psychophysics, 11, 385-388.
4. Decety, J., Grezes, J., Costes, N., Perani, D., Jeannerod, M., Procyk, E., Grassi, F., & Fazio, F. (1997). Brain activity during observation of actions: Influence of action content and subject's strategy. Brain, 120, 1763-1777.
5. De Jong, R., Liang, C. C., & Lauber, E. (1994). Conditional and unconditional automaticity: A dual-process model of effects of spatial stimulus-response correspondence. Journal of Experimental Psychology: Human Perception and Performance, 20, 731-750.
6. Dunbar, K., & MacLeod, C. M. (1984). A horse race of different color: Stroop interference patterns with transformed words. Journal of Experimental Psychology: Human Perception and Performance, 10, 622-639.
7. Eimer, M. (1995). Stimulus-response compatibility and automatic response activation: Evidence from psychophysiological studies. Journal of Experimental Psychology: Human Perception and Performance, 21, 837-854.
8. Fadiga, L., Fogassi, L., Pavesi, G., & Rizzolatti, G. (1995). Motor facilitation during action observation: A magnetic stimulation study. Journal of Neurophysiology, 73, 2608-2611.
9. Fowler, C. A. (1986). An event approach to the study of speech perception from a direct-realist perspective. Journal of Phonetics, 14, 3-28.
10. Fowler, C. A., & Dekle, D. J. (1991). Listening with eye and hand: Cross-modal contributions to speech perception. Journal of Experimental Psychology: Human Perception and Performance, 17, 816-828.
11. Fowler, C. A., & Rosenblum, L. D. (1991). The perception of phonetic gestures. In I. G. Mattingly & M. Studdert-Kennedy (Eds.), Modularity and the motor theory of speech perception (pp. 33-59). Hillsdale, NJ: Erlbaum.
12. Gallese, V., Fadiga, L., Fogassi, L., & Rizzolatti, G. (1996). Action recognition in the premotor cortex. Brain, 119, 593-609.
13. Gibson, J. J. (1966). The senses considered as perceptual systems. Boston: Houghton Mifflin.
14. Gibson, J. J. (1979). The ecological approach to visual perception. Boston: Houghton Mifflin.
15. Glaser, M. O., & Glaser, W. R. (1982). Time course analysis of the Stroop phenomenon. Journal of Experimental Psychology: Human Perception and Performance, 8, 875-894.
16. Glaser, W. R., & Düngelhoff, F.-J. (1984). The time course of picture-word interference. Journal of Experimental Psychology: Human Perception and Performance, 10, 640-654.
17. Glaser, W. R., & Glaser, M. O. (1989). Context effects on Stroop-like word and picture processing. Journal of Experimental Psychology: General, 118, 13-42.
18. Gordon, P. C., & Meyer, D. E. (1984). Perceptual-motor processing of phonetic features in speech. Journal of Experimental Psychology: Human Perception and Performance, 10, 153-178.
19. Green, K. P., & Kuhl, P. K. (1991). Integral processing of visual place and auditory voicing information during phonetic perception. Journal of Experimental Psychology: Human Perception and Performance, 17, 278-288.
20. Green, K. P., & Miller, J. L. (1985). On the role of visual rate information in phonetic perception. Perception & Psychophysics, 38, 269-276.
21. Grèzes, J., Costes, N., & Decety, J. (1998). Top-down effect of strategy on the perception of human biological motion: A PET investigation. Cognitive Neuropsychology, 15, 553-582.
22. Guiard, Y., Hasbroucq, T., & Possamai, C.-A. (1994). Stimulus congruity, irrelevant spatial SR correspondence, and displaycontrol arrangement correspondence: A reply to O'Leary, Barber, and Simon (1994). Psychological Research, 56, 210-212.
23. Gumenik, W. E., & Glass, R. (1970). Effects of reducing the readability of the words in the Stroop Color-Word Test. Psychonomic Science, 20, 247-248.
24. Hasbroucq, T., & Guiard, Y. (1991). Stimulus-response compatibility and the Simon effect: Toward a conceptual clarification. Journal of Experimental Psychology: Human Perception and Performance, 17, 246-266.
25. Hock, H. S., & Egeth, H. (1970). Verbal interference with encoding in a perceptual classification task. Journal of Experimental Psychology, 83, 299-303.
26. Hommel, B. (1993). The relationship between stimulus processing and response selection in the Simon task: Evidence for a temporal overlap. Psychological Research, 55, 280-290.
27. Hommel, B. (1995). Stimulus-response compatibility and the Simon effect: Toward an empirical clarification. Journal of Experimental Psychology: Human Perception and Performance, 21, 764-775.
28. Hommel, B. (1996). S-R compatibility effects without response uncertainty. Quarterly Journal of Experimental Psychology: Human Experimental Psychology, 49A, 546-571.
29. Hommel, B., Müsseler, J., Aschersleben, G., & Prinz, W. (1999). The theory of event coding (TEC): A framework for perception and action. Manuscript submitted for publication.
30. Keele, S. W. (1972). Attention demands of memory retrieval. Journal of Experimental Psychology, 93, 245-248.
31. Kenstowicz, M., & Kisseberth, C. (1979). Generative phonology: Description and theory. Boston: Academic Press.
32. Klein, G. S. (1964). Semantic power measured through the interference of words with color naming. American Journal of Psychology, 77, 576-588.
33. Kornblum, S. (1994). The way irrelevant dimensions are processed depends on what they overlap with: The case of Stroop-and Simon-like stimuli. Psychological Research, 56, 130-135.
34. Kornblum, S., Hasbroucq, T., & Osman, A. (1990). Dimensional overlap: Cognitive basis for stimulus-response compatibility - A model and taxonomy. Psychological Review, 97, 253-270.
35. Langton, S. R. H., O'Malley, C., & Bruce, V. (1996). Actions speak no louder than words: Symmetrical cross-modal interference effects in the processing of verbal and gestural information. Journal of Experimental Psychology: Human Perception and Performance, 22, 1357-1375.
36. Liberman, A. M., Cooper, F. S., Shankweiler, D. P., & Studdert-Kennedy, M. (1967). Perception of the speech code. Psychological Review, 74, 431-461.
37. Liberman, A. M., & Mattingly, I. G. (1985). The motor theory of speech perception revised. Cognition, 21, 1-36.
38. Lu, C.-H., & Proctor, R. W. (1995). The influence of irrelevant location information on performance: A review of the Simon and spatial Stroop effects. Psychonomic Bulletin & Review, 2, 174-207.
39. Lupker, S. J. (1982). The role of phonetic and orthographic similarity in picture word interference. Canadian Journal of Psychology, 36, 349-367.
40. MacDonald, J., & McGurk, H. (1978). Visual influences on speech perception processes. Perception & Psychophysics, 24, 253-257.
41. MacKay, D. G. (1987). The organization of perception and action: A theory for language and other cognitive skills. Berlin: Springer-Verlag.
42. Marks, L. E. (1987). On cross-modal similarity: Auditory-visual interactions in speeded discrimination. Journal of Experimental Psychology: Human Perception and Performance, 13, 384-394.
43. Massaro, D. (1987). Speech perception by ear and eye: A paradigm for psychological inquiry. Hillsdale, NJ: Erlbaum.
44. Massaro, D. (1998). Perceiving talking faces: From speech perception to a behavioral principle. Cambridge, MA: MIT Press.
45. Massaro, D. W., Cohen, M. M., & Thompson, L. A. (1988). Visible language in speech perception: Lipreading and reading. Visible Language, 1, 8-31.
46. Mattingly, I. G., Liberman, A. M., Syrdal, A. M., & Halwes, T. (1971). Discrimination in speech and nonspeech modes. Cognitive Psychology, 2, 131-157.
47. McGurk, H., & MacDonald, J. (1976). Hearing lips and seeing voices. Nature, 264, 746-748.
48. McNeill, D. (1985). So you think gestures are non-verbal? Psychological Review, 92, 350-371.
49. Melara, R. D., & Mounts, J. R. W. (1993). Selective attention to Stroop dimensions: Effects of baseline discriminability, response mode and practice. Memory & Cognition, 21, 627-645.
50. Motion, J. (1969). Categories of interference: Verbal mediation and conflict in card sorting. British Journal of Psychology, 60, 329-346.
51. O'Leary, M. J., & Barber, P. J. (1993). Interference effects in the Stroop and Simon paradigms. Journal of Experimental Psychology: Human Perception and Performance, 19(4), 830-844.
52. O'Leary, M. J., Barber, P. J., & Simon, J. R. (1994). Does stimulus correspondence account for the Simon effect? Comments on Hasbroucq and Guiard (1991). Psychological Research, 56, 203-209.
53. Palef, S. R., & Olson, D. R. (1975). Spatial and verbal rivalry in a Stroop-like task. Canadian Journal of Psychology, 29, 201-209.
54. Porter, R., & Lubker, J. (1980). Rapid reproduction of vowel-vowel sequences: Evidence for a fast and direct acoustic-motoric linkage in speech. Journal of Speech and Hearing Research, 23, 593-602.
55. Prinz, W. (1990). A common coding approach to perception and action. In O. Neumann & W. Prinz (Eds.), Relationships between perception and action (pp. 167-201). Berlin: Springer-Verlag.
56. Proctor, R. W., Dutta, A., Kelly, P. L., & Weeks, D. J. (1994). Cross-modal compatibility effects with visual-spatial and auditory-verbal stimulus and response sets. Perception & Psychophysics, 55, 42-47.
57. Proctor, R. W., & Reeve, T. G. (1991). The prevalence of salient-features coding in choice reaction tasks. In J. Requin & G. E. Stelmach (Eds.), Tutorials in motor neuroscience (pp. 17-26). Dordrecht, the Netherlands: Kluwer Academic.
58. Rizzolatti, G., & Arbib, M. A. (1998). Language within our grasp. Trends in Neuroscience, 21, 188-194.
59. Rizzolatti, G., Camarda, R., Fogassi, L., Gentilucci, M., Luppino, G., & Mattelli, M. (1988). Functional organization of inferior area 6 in the macaque monkey: II. Area F5 and the control of distal movements. Experimental Brain Research, 71, 491-507.
60. Rizzolatti, G., Fidiga, L., Mattelli, M., Bettinardi, V., Paulesu, E., Perani, D., & Fazio, F. (1996). Localization of grasp representations in humans by PET: 1. Observation versus execution. Experimental Brain Research, 111, 246-252.
61. Rosenblum, L. D., & Saldana, H. M. (1996). An audiovisual test of kinematic primitives for visual speech perception. Journal of Experimental Psychology: Human Perception and Performance, 22, 318-331.
62. Saldaña, H. M., & Rosenblum, L. D. (1993). Visual influences on auditory pluck and bow judgments. Perception & Psychophysics, 54, 406-416.
63. Seymour, P. H. K. (1977). Stroop interference with response, comparison, and encoding stages in a sentence picture comparison task. Memory & Cognition, 2, 19-26.
64. Simon, J. R., Hinrichs, J. V., & Craft, J. L. (1970). Auditory S-R compatibility: Reaction time as a function of ear-hand correspondence and ear-response-location correspondence. Journal of Experimental Psychology, 86, 97-102.
65. Simon, J. R., & Small, A. M. (1969). Processing auditory irrelevant information: Interference from an irrelevant cue. Journal of Applied Psychology, 53, 433-435.
66. Smeele, P. M. T., Massaro, D. W., Cohen, M. M., & Sittig, A. C. (1998). Laterality in visual speech perception. Journal of Experimental Psychology: Human Perception and Performance, 24, 1232-1242.
67. Starreveld, P. A., & La Heij, W. (1995). Semantic interference, orthographic facilitation, and their interaction in naming tasks. Journal of Experimental Psychology: Learning, Memory, and Cognition, 21, 686-698.
68. Stirling, N. (1979). Stroop interference: An input and an output phenomenon. Quarterly Journal of Experimental Psychology, 31, 121-132.
69. Stoffels, E. J., Van der Molen, M. W., & Keuss, P. G. J. (1989). An additive factor analysis of the effect(s) of location cues associated with auditory stimuli on stages of information processing. Acta Psychologica, 70, 161-197.
70. Stroop, J. R. (1935). Studies of interference in serial verbal reactions. Journal of Experimental Psychology, 18, 643-662.
71. Sumby, W. H., & Pollack, I. (1954). Visual contribution to speech intelligibility in noise. Journal of the Acoustical Society of America, 26, 212-215.
72. Warren, R. E. (1972). Stimulus encoding and memory. Journal of Experimental Psychology, 94, 90-100.
73. Xu, Y., Liberman, A. M., & Whalen, D. H. (1997). On the immediacy of phonetic perception. Psychological Science, 8, 358-362.