Incidental and context-responsive activation of structure-and function-based action features during object identification

Journal of Experimental Psychology: Human Perception and Performance

Volumn 39, Issue 1, 2013, Pages 257-270

  Lee, Chia lin ^a   Middleton, Erica ^a   Mirman, Daniel ^a   Kalénine, Solène ^a   Buxbaum, Laurel J ^a  

^a MOSS REHABILITATION RESEARCH INSTITUTE   (United States)

Author keywords

Action representations; Context; Eye tracking; Object concepts; Object grasping; Objectuse; Two action systems hypothesis

Indexed keywords

AGED; ARTICLE; ATTENTION; AUDITORY STIMULATION; COLOR VISION; DECISION MAKING; FEMALE; HUMAN; MALE; MIDDLE AGED; PATTERN RECOGNITION; PHOTOSTIMULATION; RECOGNITION; TASK PERFORMANCE;

ACOUSTIC STIMULATION; AGED; ATTENTION; COLOR PERCEPTION; FEMALE; HUMANS; JUDGMENT; MALE; MIDDLE AGED; PATTERN RECOGNITION, VISUAL; PHOTIC STIMULATION; RECOGNITION (PSYCHOLOGY); TASK PERFORMANCE AND ANALYSIS;

MLCS; MLOWN;

EID: 84880491547     PISSN: 00961523     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0027533     Document Type: Article

References (79)

1. Allopenna, P. D., Magnuson, J. S., & Tanenhaus, M. K. (1998) Tracking the time course of spoken word recognition using eye movements: evidence for continuous mapping models. Journal of Memory and Language, 38, 419-439. doi:10.1006/jmla.1997.2558
2. Allport, A. (1987). Selection for action: Some behavioral and neurophysiological considerations of attention and action. In H. Heuer & A. F. Sanders (Eds.), Perspectives on perception and action (pp. 395-419). Hillsdale, NJ: Erlbaum.
3. Allport, A. (1989). Visual attention: Foundations of cognitive science (pp. 631-682). Cambridge, MA: The MIT Press.
4. Altmann, G. T., & Kamide, Y. (2004). Now you see it, now you don't: Mediating the mapping between language and the visual world. In J. M. Henderson & F. Ferreira (Eds.), The interface of language, vision, and action: Eye movements and the visual world (pp. 313-345). New York, NY: Psychology Press.
5. Altmann, G. T. M., & Kamide, Y. (2007). The real-time mediation of visual attention by language and world knowledge: Linking anticipatory (and other) eye movements to linguistic processing. Journal of Memory and Language, 57, 502-518. doi:10.1016/j.jml.2006.12.004
6. Bekkering, H., & Neggers, S. F. W. (2002). Visual search is modulated by action intentions. Psychological Science, 13, 370-374. doi:10.1111/ j.0956-7976.2002.00466.x
7. Orghi, A. M., & Riggio, L. (2009). Sentence comprehension and simulation of object temporary, canonical and stable affordances. Brain Research, 1253, 117-128. doi:10.1016/j.brainres.2008.11.064
8. Botvinick, M. M., Buxbaum, L. J., Bylsma, L. M., & Jax, S. A. (2009). Toward an integrated account of object and action selection: A computational analysis and empirical findings from reaching-to-grasp and tool-use. Neuropsychologia, 47, 671-683. doi:10.1016/j.neuropsychologia. 2008.11.024
9. Bub, D. N., Masson, M. E., & Cree, S. (2008). Evocation of functional and volumetric gestural knowledge by objects and words. Cognition, 106, 27-58. doi:10.1016/j.cognition.2006.12.010
10. Bub, D. N., & Masson, M. E. J. (2006). Gestural knowledge evoked by objects as part of conceptual representations. Aphasiology, 20, 1112-1124. doi:10.1080/02687030600741667
11. Bub, D. N., & Masson, M. E. J. (2010). On the nature of hand-action representations evoked during written sentence comprehension. Cognition, 116, 394-408. doi:10.1016/j.cognition.2010.06.001
12. Buccino, G., Riggio, L., Melli, G., Binkofski, F., Gallese, V., & Rizzolatti, G. (2005). Listening to action-related sentences modulates the activity of the motor system: A combined TMS and behavioral study. Cognitive Brain Research, 24, 355-363. doi:10.1016/j.cogbrainres.2005.02.020
13. Buxbaum, L. J., & Coslett, H. B. (1998). Spatio-motor representations in reaching: Evidence for subtypes of optic ataxia. Cognitive Neuropsychology, 15, 279-312. doi:10.1080/026432998381186
14. Buxbaum, L. J., & Kalénine, S. (2010). Action knowledge, visuomotor activation, and embodiment in the two action systems. Annals of the New York Academy of Sciences, 1191, 201-218. doi:10.1111/j.1749-6632.2010.05447.x
15. Buxbaum, L. J., Kyle, K. M., Grossman, M., & Coslett, H. B.(2007)Left inferior parietal representations for skilled hand-object interactions: Evidence from stroke and corticobasal degenerationCortex: A Journal Devoted to the Study of the Nervous System and Behavior 43, 411-423. doi:10.1016/S0010-9452(08)70466-0
16. Buxbaum, L. J., & Saffran, E. M. (1998). Knowing 'how' vs. 'what for': A new dissociation. Brain and Language, 65, 73-76.
17. Buxbaum, L. J., Sirigu, A., Schwartz, M. F., & Klatzky, R. (2003). 268 LEE, MIDDLETON, MIRMAN, KALÉNINE, AND BUXBAUM Cognitive representations of hand posture in ideomotor apraxia. Neuropsychologia, 41, 1091-1113. doi:10.1016/S0028-3932(02)00314-7
18. Buxbaum, L. J. (2001). Ideomotor apraxia: A call to action. Neurocase, 7, 445-458. doi:10.1093/neucas/7.6.445
19. Campanella, F., & Shallice, T. (2011). Manipulability and object recognition: Is manipulability a semantic feature? Experimental brain research. Experimentelle Hirnforschung. Expe ́rimentation ce ́re ́brale, 208, 369-383. doi:10.1007/s00221-010-2489-7
20. Cant, J. S., Westwood, D. A., Valyear, K. F., & Goodale, M. A. (2005). No evidence for visuomotor priming in a visually guided action task. Neuropsychologia, 43, 216-226. doi:10.1016/j.neuropsychologia.2004 .11.008
21. Craighero, L., Bello, A., Fadiga, L., & Rizzolatti, G. (2002). Hand action preparation influences the responses to hand pictures. Neuropsychologia, 40, 492-502. doi:10.1016/S0028-3932(01)00134-8
22. Craighero, L., Fadiga, L., Rizzolatti, G., & Umiltà, C. (1999). Action for perception: A motor-visual attentional effect. Journal of Experimental Psychology: Human Perception and Performance, 25, 1673-1692. doi: 10.1037/0096-1523.25.6.1673
23. Craighero, L., Fadiga, L., Umiltà, C. A., & Rizzolatti, G. (1996). Evidence for visuomotor priming effect. Neuroreport: An International Journal for the Rapid Communication of Research in Neuroscience, 8, 347-349. doi:10.1097/00001756-199612200-00068
24. Dahan, D., Magnuson, J. S., Tanenhaus, M. K., & Hogan, E. M. (2001). Subcategorical mismatches and the time course of lexical access: Evidence for lexical competition. Language and Cognitive Processes, 16, 507-534. doi:10.1080/01690960143000074
25. Dahan, D., & Tanenhaus, M. K. (2005). Looking at the rope when looking for the snake: Conceptually mediated eye movements during spokenword recognition. Psychonomic Bulletin & Review, 12, 453-459. doi: 10.3758/BF03193787
26. Folstein, M. F., Folstein, S. E., & McHugh, P. R. (1975). "Mini-mental state" A practical method for grading the cognitive state of patients for the clinician. Journal of Psychiatric Research, 12, 189-198. doi: 10.1016/0022-3956(75)90026-6
27. Garofeanu, C., Kroliczak, G., Goodale, M., & Humphrey, G. K. (2004). Naming and grasping common objects: A priming study. Experimental Brain Research.
28. Glenberg, A. M., & Kaschak, M. P. (2002). Grounding language in action. Psychonomic Bulletin & Review, 9, 558-565. doi:10.3758/BF03196313
29. Grafton, S. T., Fadiga, L., Arbib, M. A., & Rizzolatti, G. (1997). Premotor cortex activation during observation and naming of familiar tools. Neuroimage, 6, 231-236. doi:10.1006/nimg.1997.0293
30. Gutteling, T. P., Kenemans, J. L., & Neggers, S. F. W. (2011). Grasping preparation enhances orientation change detection. PLoS ONE, 6, e17675. doi:10.1371/journal.pone.0017675
31. Hallett, P. E. (1986). Eye movements. In K. R. Boff, L. Kaufman, & J. P. Thomas (Eds.), Handbook of perception and human performance (pp. 10.1-10.112). New York, NY: Wiley.
32. Hannus, A., Cornelissen, F. W., Lindemann, O., & Bekkering, H. (2005). Selection-for-action in visual search. Acta Psychologica, 118(1-2):171-191. doi:10.1016/j.actpsy.2004.10.010
33. Hauk, O., Johnsrude, I., & Pulvermüller, F. (2004). Somatotopic Representation of Action Words in Human Motor and Premotor Cortex. Neuron, 41, 301-307. doi:10.1016/S0896-6273(03)00838-9
34. Huettig, F., & Altmann, G. T. M. (2004). The online processing of ambiguous and unambiguous words in context: Evidence from headmounted eye-tracking. New York, NY: Psychology Press.
35. Huettig, F., & Altmann, G. T. M. (2005). Word meaning and the control of eye fixation: Semantic competitor effects and the visual world paradigm. Cognition, 96, B23-B32. doi:10.1016/j.cognition.2004.10.003
36. Huettig, F., & Altmann, G. T. M. (2007). Visual-shape competition during language-mediated attention is based on lexical input and not modulated by contextual appropriateness. Visual Cognition, 15, 985-1018. doi: 10.1080/13506280601130875
37. Jax S.A., & Buxbaum, L. J. (2010). Response interference between functional and structural actions linked to the same familiar object. Cognition, 115, 350-355. doi:10.1016/j.cognition.2010.01.004
38. Jax, S. A., & Buxbaum, L. J. (Under Revision). Response interference between functional and structural object-related actions is increased in patients with ideomotor apraxia.
39. Jax, S. A., & Rosenbaum, D. A. (2009). Hand path priming in manual obstacle avoidance: Rapid decay of dorsal stream information. Neuropsychologia, 47, 1573-1577. doi:10.1016/j.neuropsychologia.2008 .05.019
40. Jeannerod, M. (1997). The cognitive neuroscience of action. Fundamentals of cognitive neuroscience. Malden: Blackwell Publishing.
41. Johnson-Frey, S. H. (2004). The neural bases of complex tool use in humans. Trends in Cognitive Sciences, 8, 71-78. doi:10.1016/ j.tics.2003.12.002
42. Kalénine, S., Mirman, D., Middleton, E. L., & Buxbaum, L. J. (in press). Temporal dynamics of activation of thematic and functional action knowledge during auditory comprehension of artifact words. Journal of Experimental Psychology: Learning, Memory, and Cognition.
43. Kamide, Y., Altmann, G. T., & Haywood, S. L. (2003). The time-course of prediction in incremental sentence processing: Evidence from anticipatory eye movements. Journal of Memory and Language, 49, 133-156. doi:10.1016/S0749-596X(03)00023-8
44. Kukona, A., Fang, S.-Y., Aicher, K. A., Chen, H., & Magnuson, J. S. (2011). The time course of anticipatory constraint integration. Cognition, 119, 23-42. doi:10.1016/j.cognition.2010.12.002
45. Masson, M. E. J., Bub, D. N., & Newton-Taylor, M. (2008). Languagebased access to gestural components of conceptual knowledge. The Quarterly Journal of Experimental Psychology, 61, 869-882. doi: 10.1080/17470210701623829
46. Masson, M. E. J., Bub, D. N., & Warren, C. M. (2008). Kicking calculators: Contribution of embodied representations to sentence comprehension. Journal of Memory and Language, 59, 256-265. doi:10.1016/ j.jml.2008.05.003
47. Mirman, D., Dixon, J. A., & Magnuson, J. S. (2008). Statistical and computational models of the visual world paradigm: Growth curves and individual differences. Journal of Memory and Language, 59, 475-494. doi:10.1016/j.jml.2007.11.006
48. Mirman, D., & Magnuson, J. S. (2009). Dynamics of activation of semantically similar concepts during spoken word recognition. Memory & Cognition, 37, 1026-1039. doi:10.3758/MC.37.7.1026
49. Mirman, D., Strauss, T. J., Dixon, J. A., & Magnuson, J. S. (2009). Effect of representational distance between meanings on recognition of ambiguous spoken words. Cognitive Science: A Multidisciplinary Journal, 34, 161-173. doi:10.1111/j.1551-6709.2009.01069.x
50. Moore, T., & Armstrong, K. M. (2003). Selective gating of visual signals by microstimulation of frontal cortex. Nature, 421, 370-373. doi: 10.1038/nature01341
51. Müsseler, J., Steininger, S., & Wühr, P. (2001). Can actions affect perceptual processing? The Quarterly journal of experimental psychology. A, Human Experimental Psychology, 54, 137-154. doi:10.1080/ 02724980042000057
52. Myung, J. Y., Blumstein, S. E., & Sedivy, J. C. (2006). Playing on the typewriter, typing on the piano: Manipulation knowledge of objects. Cognition, 98, 223-243. doi:10.1016/j.cognition.2004.11.010
53. Myung, J. Y., Blumstein, S. E., Yee, E., Sedivy, J. C., Thompson-Schill, S. L., & Buxbaum, L. J. (2010). Impaired access to manipulation features in Apraxia: Evidence from eyetracking and semantic judgment tasks. Brain and Language, 112, 101-112. doi:10.1016/j.bandl .2009.12.003
54. Neggers, S. F. W., Huijbers, W., Vrijlandt, C. M., Vlaskamp, B. N. S., Schutter, D. J. L. G., & Kenemans, J. L. (2007). TMS Pulses on the STRUCTURE-AND FUNCTION-BASED ACTION FEATURES 269 Frontal Eye Fields Break Coupling Between Visuospatial Attention and Eye Movements. Journal of Neurophysiology, 98, 2765-2778. doi: 10.1152/jn.00357.2007
55. Pavese, A., & Buxbaum, L. J. (2002). Action matters: The role of action plans and object affordances in selection for action. Visual Cognition, 9, 559-590. doi:10.1080/13506280143000584
56. Pelgrims, B., Olivier, E., & Andres, M. (2011). Dissociation between manipulation and conceptual knowledge of object use in the supramarginalis gyrus. Human Brain Mapping, 32, 1802-1810. doi:10.1002/ hbm.21149
57. Pisella, L., Binkofski, F., Lasek, K., Toni, I., & Rossetti, Y. (2006). No double-dissociation between optic ataxia and visual agnosia: Multiple sub-streams for multiple visuo-manual integrations. Neuropsychologia, 44, 2734-2748. doi:10.1016/j.neuropsychologia.2006.03.027
58. Pulvermüller, F. (2005). Brain mechanisms linking language and action. Nature Reviews Neuroscience, 6, 576-582. doi:10.1038/nrn1706
59. Raposo, A., Moss, H. E., Stamatakis, E. A., & Tyler, L. K. (2009). Modulation of motor and premotor cortices by actions, action words and action sentences. Neuropsychologia, 47, 388-396. doi:10.1016/ j.neuropsychologia.2008.09.017
60. Rizzolatti, G., & Matelli, M. (2003). Two different streams form the dorsal visual system: Anatomy and functions. Experimental Brain Research Experimentelle Hirnforschung Expe ́rimentation Cérébrale, 153, 146-157.
61. Rizzolatti, G., Riggio, L., Dascola, I., & Umilta ́, C. (1987). Reorienting attention across the horizontal and vertical meridians: Evidence in favor of a premotor theory of attention. Neuropsychologia, 25, 31-40. doi: 10.1016/0028-3932(87)90041-8
62. Rizzolatti, G., Riggio, L., & Sheliga, B. M. (1994). Space and selective attention. Attention and performance 15: Conscious and nonconscious information processing., Attention and performance series. (pp. 232-265). Cambridge, MA, US: The MIT Press.
63. Rueschemeyer, S.-A., Lindemann, O., van Rooij, D., van Dam, W., & Bekkering, H. (2010). Effects of Intentional Motor Actions on Embodied Language Processing. Experimental Psychology, 57, 260-266. doi: 10.1027/1618-3169/a000031
64. Ruff, C. C., Blankenburg, F., Bjoertomt, O., Bestmann, S., Freeman, E., Haynes, J.-D., . . . Driver, J. (2006). Concurrent TMS-fMRI and psychophysics reveal frontal influences on human retinotopic visual cortex. Current Biology, 16, 1479-1488. doi:10.1016/j.cub.2006.06.057
65. Salverda, A. P., & Altmann, G. T. M. (2011). Attentional capture of objects referred to by spoken language. Journal of Experimental Psychology: Human Perception and Performance, 37, 1122-1133. doi:10.1037/ a0023101
66. Sirigu, A., Duhamel, J.-R., Cohen, L., Pillon, B., Dubois, B., & Agid, Y. (1996). The Mental representation of hand movements after parietal cortex damage. Science, 273, 1564-1568. doi:10.1126/science.273.5281.1564
67. Symes, E., Tucker, M., Ellis, R., Vainio, L., & Ottoboni, G. (2008). Grasp preparation improves change detection for congruent objects. Journal of Experimental Psychology: Human Perception and Performance, 34, 854-871. doi:10.1037/0096-1523.34.4.854
68. Tanenhaus, M. K., Spivey-Knowlton, M., Eberhard, K., & Sedivy, J. (1995). Integration of visual and linguistic information in spoken language comprehension. Science, 268(5217), 1632-1634. doi:10.1126/ science.7777863
69. Tanenhaus, M. K., & Spivey-Knowlton, M. J. (1996). Eye-Tracking. Language and Cognitive Processes, 11, 583-588. doi:10.1080/ 016909696386971
70. Taylor, L. J., & Zwaan, R. A. (2008). Motor resonance and linguistic focus. Quarterly Journal of Experimental Psychology (2006), 61, 896-904. doi:10.1080/17470210701625519
71. Tucker, M., & Ellis, R. (1998). On the relations between seen objects and components of potential actions. Journal of Experimental Psychology: Human Perception and Performance, 24, 830-846. doi:10.1037/0096-1523.24.3.830
72. Tucker, M., & Ellis, R. (2001). The potentiation of grasp types during visual object categorization. Visual Cognition, 8, 769-800. doi:10.1080/ 13506280042000144
73. Tucker, M., & Ellis, R. (2004). Action priming by briefly presented objects. Acta Psychologica, 116, 185-203. doi:10.1016/j.actpsy.2004 .01.004
74. Vainio, L., Symes, E., Ellis, R., Tucker, M., & Ottoboni, G. (2008). On the relations between action planning, object identification, and motor representations of observed actions and objects. Cognition, 108, 444-465. doi:10.1016/j.cognition.2008.03.007
75. van Elk, M., van Schie, H. T., Neggers, S. F. W., & Bekkering, H. (2010). Neural and Temporal Dynamics Underlying Visual Selection for Action. Journal of Neurophysiology, 104, 972-983. doi:10.1152/jn.01079.2009
76. Vingerhoets, G., Acke, F., Vandemaele, P., & Achten, E. (2009). Tool responsive regions in the posterior parietal cortex: Effect of differences in motor goal and target object during imagined transitive movements. NeuroImage, 47, 1832-1843. doi:10.1016/j.neuroimage.2009.05.100
77. Willems, R. M., Toni, I., Hagoort, P., & Casasanto, D. (2009). Bodyspecific motor imagery of hand actions: Neural evidence from right-and left-handers. Frontiers in Human Neuroscience, 3, 39. doi:10.3389/ neuro.09.039.2009
78. Yee, E., Huffstetler, S., & Thompson-Schill, S. L. (2011). Function follows form: Activation of shape and function features during object identification. Journal of Experimental Psychology. General, 140, 348-363
79. Yee, E, & Sedivy, J. C. (2006). Eye movements to pictures reveal transient semantic activation during spoken word recognition. Journal of Experimental Psychology: Learning, Memory, and Cognition, 32, 1-14. doi: 10.1037/0278-7393.32.1.1