Self-directed speech affects visual search performance

Quarterly Journal of Experimental Psychology

Volumn 65, Issue 6, 2012, Pages 1068-1085

  Lupyan, Gary ^a   Swingley, Daniel ^b  

^a UNIVERSITY OF WISCONSIN MADISON   (United States)

^b Department of Psychology ^*  (United States)

Author keywords

Language and thought; Self directed speech; Top down effects; Verbal labels; Visual search

Indexed keywords

ADAPTIVE BEHAVIOR; ARTICLE; ATTENTION; FEMALE; HUMAN; MALE; PATTERN RECOGNITION; PERCEPTIVE DISCRIMINATION; PHOTOSTIMULATION; PHYSIOLOGY; REACTION TIME; SPEECH PERCEPTION; STATISTICS; STUDENT; UNIVERSITY;

ATTENTION; DISCRIMINATION (PSYCHOLOGY); FEEDBACK, PSYCHOLOGICAL; FEMALE; HUMANS; MALE; PATTERN RECOGNITION, VISUAL; PHOTIC STIMULATION; REACTION TIME; SPEECH PERCEPTION; STATISTICS AS TOPIC; STUDENTS; UNIVERSITIES;

EID: 84863493872     PISSN: 17470218     EISSN: 17470226     Source Type: Journal    
DOI: 10.1080/17470218.2011.647039     Document Type: Article

References (65)

1. Alexander, R., Zhang, W. and Zelinsky, G. J. 2010. "Visual similarity effects in categorical search". In Proceedings of the 32nd Annual Conference of the Cognitive Science Society, Edited by: Ohlsson, S. and Catrambone, R. 1222-1227. Austin, TX: Cognitive Science Society.
2. Allopenna, P., Magnuson, J. and Tanenhaus, M. 1998. Tracking the time course of spoken word recognition using eye movements: Evidence for continuous mapping models. Journal of Memory and Language, 38(4): 419-439.
3. Altmann, G. T. M. 2011. Language can mediate eye movement control within 100 milliseconds, regardless of whether there is anything to move the eyes to. Acta Psychologica, 137(2): 190-200. doi:10.1016/j.actpsy.2010.09.009
4. Anderson, S. E., Chiu, E., Huette, S. and Spivey, M. J. 2011. On the temporal dynamics of language-mediated vision and vision-mediated language. Acta Psychologica, 137(2): 181-189. doi:10.1016/j.actpsy.2010.09.008
5. Andersson, R., Ferreira, F. and Henderson, J. M. 2011. I see what you're saying: The integration of complex speech and scenes during language comprehension. Acta Psychologica, 137(2): 208-216. doi:16/j.actpsy.2011.01.007
6. Baayen, R. H., Davidson, D. J. and Bates, D. M. 2008. Mixed-effects modeling with crossed random effects for subjects and items. Journal of Memory and Language, 59(4): 390-412. doi:16/j.jml.2007.12.005
7. Baddeley, A. D., Chincotta, D. and Adlam, A. 2001. Working memory and the control of action: Evidence from task switching. Journal of Experimental Psychology: General, 130(4): 641-657. doi:10.1037/0096-3445.130.4.641
8. Bar, M., Kassam, K. S., Ghuman, A. S., Boshyan, J., Schmidt, A. M.Dale, A. M. 2006. Top-down facilitation of visual recognition. Proceedings of the National Academy of Sciences of the United States of America, 103(2): 449-454. doi:10.107/pnas.0507062103
9. Berk, L. E. and Garvin, R. A. 1984. Development of private speech among low-income Appalachian children. Developmental Psychology, 20(2): 271-286.
10. Berk, L. E. and Potts, M. K. 1991. Development and functional-significance of private speech among attention-deficit hyperactivity disordered and normal boys. Journal of Abnormal Child Psychology, 19(3): 357-377.
11. Carlson, R. A. 1997. Experienced cognition, 1, Hove, UK: Psychology Press.
12. Castelhano, M. S., Pollatsek, A. and Cave, K. R. 2008. Typicality aids search for an unspecified target, but only in identification and not in attentional guidance. Psychonomic Bulletin & Review, 15(4): 795-801.
13. Clark, A. 1997. Being there: Putting brain, body, and world together again, Cambridge, MA: MIT Press.
14. Clark, A. and Karmiloff-Smith, A. 1993. The cognizer's innards: A psychological and philosophical perspective on the development of thought. Mind & Language, 8(4): 487-519.
15. Cohen, R., Kelter, S. and Woll, G. 1980. Analytical competence and language impairment in aphasia. Brain and Language, 10(2): 331-347.
16. Dahan, D. and Tanenhaus, M. K. 2005. Looking at the rope when looking for the snake: Conceptually mediated eye movements during spoken-word recognition. Psychonomic Bulletin & Review, 12(3): 453-459.
17. Davidoff, J. and Roberson, D. 2004. Preserved thematic and impaired taxonomic categorisation: A case study. Language and Cognitive Processes, 19(1): 137-174.
18. Dennett, D. C. (1994). The role of language in intelligence. In J. Khalfa (Ed.), What is intelligence? The Darwin College Lectures, Cambridge.
19. Emerson, M. J. and Miyake, A. 2003. The role of inner speech in task switching: A dual-task investigation. Journal of Memory and Language, 48(1): 148-168.
20. Enns, J. T. and Lleras, A. 2008. What's next? New evidence for prediction in human vision. Trends in Cognitive Sciences, 12(9): 327-333. doi:10.1016/j.tics.2008.06.001
21. Gilbert, A. L., Regier, T., Kay, P. and Ivry, R. B. 2006. Whorf hypothesis is supported in the right visual field but not the left. Proceedings of the National Academy of Sciences of the United States of America, 103(2): 489-494.
22. Gleitman, H., Fridlund, A. J. and Reisberg, D. 2004. Psychology, 6, New York, NY: Norton & Company.
23. Gleitman, L. and Papafragou, A. 2005. "Language and thought". In Cambridge handbook of thinking and reasoning, Edited by: Holyoak, K. and Morrison, B. 633-661. Cambridge, UK: Cambridge University Press.
24. Goldstein, K. 1948. Language and language disturbances, New York, NY: Grune & Stratton.
25. Gopnik, A. 2001. "Theories, language, and culture: Whorf without wincing". In Language acquisition and conceptual development, 45-69. Cambridge, UK: Cambridge University Press.
26. Huettig, F. and Altmann, G. T. M. 2007. Visual-shape competition during language-mediated attention is based on lexical input and not modulated by contextual appropriateness. Visual Cognition, 15(8): 985-1018. doi:10.1080/13506280601130875
27. Huettig, F. and Altmann, G. T. M. 2010. Looking at anything that is green when hearing "frog": How object surface colour and stored object colour knowledge influence language-mediated overt attention. The Quarterly Journal of Experimental Psychology, doi:10.1080/17470218.2010.481474
28. Huettig, F. and Hartsuiker, R. J. 2010. Listening to yourself is like listening to others: External, but not internal, verbal self-monitoring is based on speech perception. Language and Cognitive Processes, 25(3): 347 doi:10.1080/01690960903046926
29. James, W. 1890. Principles of psychology, Vol. 1, New York, NY: Holt.
30. Jescheniak, J. D., Schriefers, H., Garrett, M. F. and Friederici, A. D. 2002. Exploring the activation of semantic and phonological codes during speech planning with event-related brain potentials. Journal of Cognitive Neuroscience, 14(6): 951-964. doi:10.1162/089892902760191162
31. Lamme, V. A. F. and Roelfsema, P. R. 2000. The distinct modes of vision offered by feedforward and recurrent processing. Trends in Neurosciences, 23(11): 571-579.
32. Lupyan, G. 2007a. The label feedback hypothesis: Linguistic influences on visual processing (unpublished PhD thesis). Pittsburgh, PA: Carnegie Mellon University
33. Lupyan, G. 2007b. "Reuniting categories, language, and perception". In Twenty-Ninth Annual Meeting of the Cognitive Science Society, Edited by: Mcnamara, D. S. and Trafton, J. G. 1247-1252. Austin, TX: Cognitive Science Society.
34. Lupyan, G. 2008. The conceptual grouping effect: Categories matter (and named categories matter more). Cognition, 108: 566-577.
35. Lupyan, G. 2009. Extracommunicative functions of language: Verbal interference causes selective categorization impairments. Psychonomic Bulletin & Review, 16(4): 711-718. doi:10.3758/PBR.16.4.711
36. Lupyan, G. and Spivey, M. J. 2008. Perceptual processing is facilitated by ascribing meaning to novel stimuli. Current Biology, 18(10): R410-R412.
37. Lupyan, G. and Spivey, M. J. 2010a. Making the invisible visible: Auditory cues facilitate visual object detection. PLoS ONE, 5(7): e11452 doi:10.1371/journal.pone.0011452
38. Lupyan, G. and Spivey, M. J. 2010b. Redundant spoken labels facilitate perception of multiple items. Attention, Perception & Psychophysics, 72(8): 2236-2253. doi:10.3758/APP.72.8.2236
39. Lupyan, G., & Thompson-Schill, S. L. (2012). The evocative power of words: Activation of concepts by verbal and nonverbal means. Journal of Experimental Psychology-General, 141(1), 170-186. doi:10.1037/a0024904
40. Lupyan, G., Thompson-Schill, S. L. and Swingley, D. 2010. Conceptual penetration of visual processing. Psychological Science, 21(5): 682-691.
41. MacLeod, C. M., Gopie, N., Hourihan, K. L., Neary, K. R. and Ozubko, J. D. 2010. The production effect: Delineation of a phenomenon. Journal of Experimental Psychology: Learning, Memory & Cognition, 36(3): 671-685. doi:10.1037/a0018785
42. Meyer, A. S., Belke, E., Telling, A. L. and Humphreys, G. W. 2007. Early activation of object names in visual search. Psychonomic Bulletin & Review, 14(4): 710-716.
43. Miyake, A., Emerson, M. J., Padilla, F. and Ahn, J. C. 2004. Inner speech as a retrieval aid for task goals: The effects of cue type and articulatory suppression in the random task cuing paradigm. Acta Psychologica, 115(2-3): 123-142. doi:10.1016/j.actpsy.2003.12.004
44. MRC Psycholinguistic Database. Retrieved September 7, 2011, from http://www.psy.uwa.edu.au/mrcdatabase/uwa_mrc.htm.
45. Richardson, D. C. and Dale, R. 2005. Looking to understand: The coupling between speakers' and listeners' eye movements and its relationship to discourse comprehension. Cognitive Science, 29: 1045-1060.
46. Riesenhuber, M. and Poggio, T. 2000. Models of object recognition. Nature Neuroscience, 3(SUPPL.): 1199-1204. doi:10.1038/81479
47. Risko, E. F., Dixon, M. J., Besner, D. and Ferber, S. 2006. The ties that keep us bound: Top-down influences on the persistence of shape-from-motion. Consciousness and Cognition, 15(2): 475-483. doi:16/j.concog.2005.11.004
48. Roberson, D. and Davidoff, J. 2000. The categorical perception of colors and facial expressions: The effect of verbal interference. Memory & Cognition, 28(6): 977-986.
49. Roberson, D., Pak, H. and Hanley, J. R. 2008. Categorical perception of colour in the left and right visual field is verbally mediated: Evidence from Korean. Cognition, 107(2): 752-762. doi:10.1016/j.cognition.2007.09.001
50. Rossion, B. and Pourtois, G. 2004. Revisiting Snodgrass and Vanderwart's object pictorial set: The role of surface detail in basic-level object recognition. Perception, 33(2): 217-236.
51. Rumelhart, D. E. and McClelland, J. L. 1982. An interactive activation model of context effects in letter perception: 2. The contextual enhancement effect and some tests and extensions of the model. Psychological Review, 89(1): 60-94.
52. Rumelhart, D. E., Smolensky, D., McClelland, J. L. and Hinton, G. E. 1986. "Parallel distributed processing models of schemata and sequential thought processes". In Parallel distributed processing, Vol. II, 7-57. Cambridge, MA: MIT Press.
53. Salverda, A. P. and Altmann, G. T. M. 2011. Attentional capture of objects referred to by spoken language. Journal of Experimental Psychology: Human Perception and Performance, 37(4): 1122-1133. doi:10.1037/a0023101
54. Schmidt, J. and Zelinsky, G. J. 2009. Search guidance is proportional to the categorical specificity of a target cue. Quarterly Journal of Experimental Psychology, 62(10): 1904-1914. doi:10.1080/17470210902853530
55. Smilek, D., Dixon, M. J. and Merikle, P. M. 2006. Revisiting the category effect: The influence of meaning and search strategy on the efficiency of visual search. Brain Research, 1080: 73-90.
56. Snedeker, J. and Gleitman, L. 2004. "Why is it hard to label our concepts?". In Weaving a lexicon, illustrated, Edited by: Hall, D. G. and Waxman, S. R. 257-294. Cambridge, MA: MIT Press.
57. Soto, D., & Humphreys, G. W. (2007). Automatic guidance of visual attention from verbal working memory. Journal of Experimental Psychology: Human Perception and Performance, 33(3), 730-737. doi:10.1037/0096-1523.33.3.730
58. Spivey, M. J. 2008. The continuity of mind, New York, NY: Oxford University Press.
59. The American National Corpus. Retrieved September 7, 2011, from http://www.anc.org/.
60. Vickery, T. J., King, L.-W. and Jiang, Y. 2005. Setting up the target template in visual search. Journal of Vision, 5(1): 81-92. doi:10:1167/5.1.8
61. Vygotsky, L. 1962. Thought and language, Cambridge, MA: MIT Press.
62. Winawer, J., Witthoft, N., Frank, M. C., Wu, L., Wade, A. R. and Boroditsky, L. 2007. Russian blues reveal effects of language on color discrimination. Proceedings of the National Academy of Sciences of the United States of America, 104(19): 7780-7785.
63. Yang, H. and Zelinsky, G. J. 2009. Visual search is guided to categorically-defined targets. Vision Research, 49(16): 2095-2103. doi:10.1016/j.visres.2009.05.017
64. Yee, E. and Sedivy, J. C. 2006. Eye movements to pictures reveal transient semantic activation during spoken word recognition. Journal of Experimental Psychology: Learning, Memory & Cognition, 32(1): 1-14. doi:10.1037/0278-7393.32.1.1
65. Zelinsky, G. J. and Murphy, G. L. 2000. Synchronizing visual and language processing: An effect of object name length on eye movements. Psychological Science, 11(2): 125-131.