Actions Speak No Louder Than Words: Symmetrical Cross-Modal Interference Effects in the Processing of Verbal and Gestural Information

Journal of Experimental Psychology: Human Perception and Performance

Volumn 22, Issue 6, 1996, Pages 1357-1375

  Langton, Stephen R H ^a,b   O'Malley, Claire ^a   Bruce, Vicki ^b  

^a UNIVERSITY OF NOTTINGHAM   (United Kingdom)

^b UNIVERSITY OF STIRLING   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0030487882     PISSN: 00961523     EISSN: None     Source Type: Journal    
DOI: 10.1037/0096-1523.22.6.1357     Document Type: Article

References (89)

1. Argyle, M. (1975). Bodily communication. London: Methuen.
2. Baddeley, A. D. (1981). The concept of working memory: A view of its current state and probable future development. Cognition, 10, 17-23.
3. Baddeley, A. D. (1983). Working memory. Philosophical Transactions of the Royal Society of London, Series B, 302, 311-324.
4. Butterworth, B., & Hadar, U. (1989). Gesture, speech and computational stages: A reply to McNeill. Psychological Review, 96, 168-174.
5. Chang, P., & Hammond, G. R. (1987). Mutual interactions between speech and finger movements. Journal of Motor Behavior, 19, 265-274.
6. Corballis, M. C., & Beale, I. L. (1976). The psychology of left and right. Hillsdale, NJ: Erlbaum.
7. Cowan, N. (1989a). The reality of cross-modal Stroop effects. Perception and Psychophysics, 45, 87-88.
8. Cowan, N. (1989b). A reply to Miles, Madden, and Jones (1989): Mistakes and other flaws in the challenge to the cross-modal Stroop effect. Perception and Psychophysics, 45, 82-84.
9. Cowan, N., & Barron, A. (1987). Cross-modal auditory visual Stroop interference and possible implications for speech memory. Perception and Psychophysics, 41, 393-401.
10. Craft, J. L., & Simon, J. R. (1970). Processing symbolic information from a visual display: Interference from an irrelevant cue. Journal of Experimental Psychology, 83, 415-420.
11. Dunbar, K., & MacLeod, C. M. (1984). A horse race of a different color: Stroop interference patterns with transformed words. Journal of Experimental Psychology: Human Perception and Performance, 10, 622-639.
12. Dyer, F. N. (1972). Latencies for movement naming with congruent and incongruent word stimuli. Perception and Psychophysics, 11, 377-380.
13. Dyer, F. N. (1973). The Stroop phenomenon and its use in the study of perceptual, cognitive and response processes. Memory & Cognition, 1, 106-120.
14. Efron, D. (1972). Gesture, race and culture. The Hague, The Netherlands: Mouton (Original work published 1941).
15. Ekman, P., & Freisen, W. V. (1972). Hand movements. Journal of Communication, 22, 353-374.
16. Farrell, W. S. (1979). Coding left and right. Journal of Experimental Psychology: Human Perception and Performance, 5, 42-51.
17. Feyereisen, P. (1987). Gestures and speech, interactions and separations: A reply to McNeill. Psychological Review, 94, 493-498.
18. Feyereisen, P. (1991). Brain pathology, lateralization, and nonverbal behavior. In R. S. Feldman & B. Rimé (Eds.), Fundamentals of nonverbal behavior (pp. 31-70). Cambridge, England: Cambridge University Press.
19. Fitts, P. M., & Seeger, G. M. (1953). S-R compatibility: Spatial characteristics of stimulus and response codes. Journal of Experimental Psychology, 46, 483-491.
20. Garner, W. R., & Felfoldy, G. L. (1970). Integrality of stimulus dimensions in various types of information processing. Cognitive Psychology, 1, 225-241.
21. Glaser, M. O., & Glaser, W. R. (1982). Time course analysis of the Stroop phenomenon. Journal of Experimental Psychology: Human Perception and Performance, 8, 875-894.
22. Glaser, W. R., & Düngelhoff, F. J. (1984). The time course of picture-word interference. Journal of Experimental Psychology: Human Perception and Performance, 10, 640-654.
23. Glaser, W. R., & Glaser, M. O. (1989). Context effects in Stroop-like word and picture processing. Journal of Experimental Psychology: General, 118, 13-42.
24. Graham, J. A., & Argyle, M. (1975). A cross-cultural study of the communication of extra-verbal meaning by gestures. International Journal of Psychology, 10, 57-67.
25. Graham, J. A., & Heywood, S. (1975). The effects of the elimination of hand gestures and of verbal codability on speech performance. European Journal of Social Psychology, 5, 189-195.
26. Hasbroucq, T., & Guiard, Y. (1991). Stimulus-response compatibility and the Simon effect: Toward a conceptual clarification. Journal of Experimental Psychology: Human Perception and Performance, 17, 246-266.
27. Hedge, A., & Marsh, N. W. A. (1975). The effects of irrelevant spatial correspondence on two-choice response time. Acta Psychologica, 39, 427-439.
28. Hock, H. S., & Egeth, H. (1970). Verbal interference with encoding in a perceptual classification task. Journal of Experimental Psychology, 83, 299-303.
29. Jacoby, L. L. (1991). A process dissociation framework: Separating automatic from intentional uses of memory. Journal of Memory and Language, 30, 513-541.
30. Keele, S. (1972). Attention demands on memory retrieval. Journal of Experimental Psychology, 93, 549-561.
31. Kendon, A. (1983). Gesture and speech: How they interact. In J. M. Wiemann & R. P. Harrison (Eds.), Nonverbal interaction (pp. 13-45). Beverly Hills, CA: Sage Publications.
32. Kendon, A. (1986). Some reasons for studying gesture. Semiotica, 62, 3-28.
33. Langton, S. R. H. (1996). Exploring interference effects in the processing of verbal and gestural components of an utterance. Unpublished doctoral dissertation, University of Nottingham, Nottingham, England.
34. Lindsay, S. D., & Jacoby, L. L. (1994). Stroop process dissociations: The relationship between facilitation and interference. Journal of Experimental Psychology: Human Perception and Performance, 20, 219-234.
35. Logan, G. D. (1980). Attention and automaticity in Stroop and priming tasks: Theory and data. Cognitive Psychology, 12, 523-553.
36. Logan, G. D., Zbrodoff, N. J., & Williamson, J. (1984). Strategies in the color-word Stroop task. Bulletin of the Psychonomic Society, 22, 135-138.
37. MacLeod, C. M. (1991). Half a century of research on the Stroop effect: An integrative review. Psychological Bulletin, 109, 163-203.
38. MacLeod, C. M., & Dunbar, K. (1988). Training and Stroop-like interference: Evidence for a continuum of automaticity. Journal of Experimental Psychology: Learning, Memory, and Cognition, 14, 126-135.
39. Maki, R. H., Grandy, C. A., & Hauge, G. (1979). Why is telling right from left more difficult than telling above from below? Journal of Experimental Psychology: Human Perception and Performance, 5, 52-67.
40. McClain, L. (1983). Stimulus-response compatibility affects auditory Stroop interference. Perception and Psychophysics, 33, 266-270.
41. McGurk, H., & MacDonald, J. (1976). Hearing lips and seeing voices. Nature, 264, 746-748.
42. McNeill, D. (1985). So you think gestures are non-verbal? Psychological Review, 92, 350-371.
43. McNeill, D. (1987a). Psycholinguistics: A new approach. New York: Harper & Row.
44. McNeill, D. (1987b). So you do think gestures are non-verbal! Reply to Feyereisen (1987). Psychological Review, 94, 499-504.
45. McNeill, D. (1989). A straight path to where? Reply to Butterworth and Hadar. Psychological Review, 96, 175-179.
46. McNeill, D. (1992). Hand and mind: What gestures reveal about thoughts. Chicago: University of Chicago Press.
47. Melara, R. D. (1989). Dimensional interaction between color and pitch. Journal of Experimental Psychology: Human Perception and Performance, 15, 69-79.
48. Melara, R. D., & Marks, L. E. (1990). Processes underlying dimensional interactions: Correspondences between linguistic and nonlinguistic dimensions. Memory & Cognition, 18, 477-495.
49. Melara, R. D., & Mounts, J. R. W. (1993). Selective attention to Stroop dimensions: Effects of baseline discriminability, response mode and practice. Memory & Cognition, 21, 627-645.
50. Melara, R. D., & O'Brien, T. P. (1987). Interaction between synesthetically corresponding dimensions. Journal of Experimental Psychology: General, 116, 323-336.
51. Mewaldt, S. P., Connelly, C. L., & Simon, J. R. (1980). Response selection in choice reaction time: Test of a buffer model. Memory and Cognition, 8, 606-611.
52. Miles, C., & Jones, D. M. (1989). The fallacy of the cross-modal Stroop effect: A rejoinder to Cowan (1989). Perception and Psychophysics, 45, 85-86.
53. Miles, C., Madden, C., & Jones, D. M. (1989). Cross-modal, auditory-visual Stroop interference: A reply to Cowan and Barron (1987). Perception and Psychophysics, 45, 77-91.
54. Morton, J. (1969). Categories of interference: Verbal mediation and conflict in card sorting. British Journal of Psychology, 60, 329-346.
55. Morton, J., & Chambers, S. M. (1973). Selective attention to words and colors. Quarterly Journal of Experimental Psychology, 25, 387-397.
56. O'Leary, M. J., & Barber, P. J. (1993). Interference effects in the Stroop and Simon paradigms. Journal of Experimental Psychology: Human Perception and Performance, 19, 830-844.
57. Pomerantz, J. R. (1983). Global and local precedence: Selective attention in form and motion perception. Journal of Experimental Psychology: General, 112, 515-540.
58. Pomerantz, J. R. (1986). Visual form perception: An overview. In E. C. Schwab & H. C. Nusbaum (Eds.), Pattern recognition by humans and machines: Visual perception (pp. 1-30). New York: Academic Press.
59. Posner, M. I., & Snyder, C. R. R. (1975). Attention and cognitive control. In R. L. Solso (Ed.), Information processing and cognition: The Loyola Symposium (pp. 55-85). Hillsdale, N.J.: Erlbaum.
60. Rimé, B. (1983). Nonverbal communication or nonverbal behavior? Towards a cognitive-motor theory of nonverbal behavior. In W. Dolse & S. Moscovici (Eds.), Current issues in European social psychology (pp. 85-141). Cambridge, England: Cambridge University Press.
61. Rimé, B., & Schiaratura, L. (1991). Gesture and speech. In R. S. Feldman & B. Rimé (Eds.), Fundamentals of nonverbal behavior (pp. 239-281). Cambridge, England: Cambridge University Press.
62. Rimé, B., Schiaratura, L., Hupet, M., & Ghysselinckx, A. (1984). Effects of relative immobilization on the speaker's nonverbal behavior and on the dialogue imagery level. Motivation and Emotion, 8, 311-325.
63. Riseborough, M. G. (1981). Physiographic gestures as decoding facilitators: Three experiments exploring a neglected facet of communication. Journal of Nonverbal Behavior, 5, 172-183.
64. Roe, W. T., Wilsoncroft, W. E., & Griffiths, R. S. (1980). Effects of motor and verbal practice on the Stroop task. Perceptual and Motor Skills, 50, 647-650.
65. Rogers, W. T. (1979). The relevance of body motion cues to both functional and dysfunctional communicative behavior. Journal of Communication Disorders, 12, 273-282.
66. Rosinski, R. R., Golinkoff, R. M., & Kukish, K. S. (1975). Automatic semantic processing in a picture-word interference task. Child Development, 46, 247-253.
67. Rothi, L. J. G., Mack, L., & Heilman, K. M. (1986). Pantomime agnosia. Journal of Neurology, Neurosurgery, and Psychiatry, 49, 451-454.
68. Schriefers, H., & Meyer, A. S. (1990). Experimental note: Cross-modal, visual-auditory picture-word interference. Bulletin of the Psychonomic Society, 28, 418-420.
69. Seymour, P. H. (1973). Stroop interference in naming and verifying spatial locations. Perception and Psychophysics, 14, 95-100.
70. Seymour, P. H. (1974). Stroop interference with response, comparison and encoding stages in a sentence-picture comparison task. Memory & Cognition, 2, 19-26.
71. Seymour, P. H. (1977). Conceptual encoding and locus of the Stroop effect. Quarterly Journal of Experimental Psychology, 29, 245-265.
72. Shimada, H. (1990). Effect of auditory presentation of words on color naming: The intermodal Stroop effect. Perceptual and Motor Skills, 70, 1155-1161.
73. Sholl, M. J., & Egeth, H. E. (1981). Right left confusion in the adult: A verbal labeling effect. Memory & Cognition, 9, 339-350.
74. Shor, R. E. (1970). The processing of conceptual information on spatial directions from pictorial and linguistic symbols. Acta Psychologica, 32, 346-365.
75. Shor, R. E. (1971). Symbol processing speed differences and symbol interference effects in a variety of concept domains. Journal of General Psychology, 85, 187-205.
76. Simon, J. R. (1982). Effects of an auditory stimulus on the processing of a visual stimulus under single and dual task conditions. Acta Psychologica, 51, 61-73.
77. Simon, J. R., & Berbaum, K. (1990). Effects of conflicting cues on information processing: The "Stroop effect" vs. the "Simon effect." Acta Psychologica, 73, 159-170.
78. Simon, J. R., & Rudell, A. P. (1967). The effect of an irrelevant cue on information processing. Journal of Applied Psychology, 51, 300-304.
79. Simon, J. R., Sly, P. E., & Vilapakkam, S. (1981). Effects of compatibility of S-R mapping on reaction toward the stimulus source. Acta Psychologica, 47, 63-81.
80. Smith, M. C., & Magee, L. E. (1980). Tracing the time course of picture-word processing. Journal of Experimental Psychology: General, 109, 373-392.
81. Smyth, M. M., Pearson, N. A., & Pendleton, L. R. (1988). Movement and working memory: Patterns and positions in space. Quarterly Journal of Experimental Psychology, 40A, 497-514.
82. Smyth, M. M., & Pendleton, L. R. (1989). Working memory for movements. Quarterly Journal of Experimental Psychology, 41A, 235-250.
83. Stroop, J. R. (1935). Studies of interference in serial verbal reactions. Journal of Experimental Psychology, 18, 643-662.
84. Thompson, L. A., & Massaro, D. W. (1986). Evaluation and integration of speech and pointing gestures during referential understanding. Journal of Experimental Child Psychology, 42, 144-168.
85. Thompson, L. A., & Massaro, D. W. (1994). Children's integration of speech and gestures in comprehension. Journal of Experimental Child Psychology, 57, 327-354.
86. Toms, M., Morris, N., & Foley, P. (1994). Characteristics of visual interference with visuospatial working memory. British Journal of Psychology, 85, 131-144.
87. Virzi, R. A., & Egeth, H. E. (1985). Toward a translational model of Stroop interference. Memory & Cognition, 13, 304-319.
88. Woodall, W. G., & Folger, J. P. (1981). Encoding specificity and nonverbal cue context: An expansion of episodic memory research. Communication Monographs, 48, 39-53.
89. Woodall, W. G., & Folger, J. P. (1985). Nonverbal cue context and episodic memory: On the availability and endurance of nonverbal behaviors as retrieval cues. Communication Monographs, 52, 319-333.