Linking perception and action by structure or process? Toward an integrative perspective

Neuroscience and Biobehavioral Reviews

Volumn 52, Issue , 2015, Pages 105-116

  Herwig, Arvid ^a  

^a BIELEFELD UNIVERSITY   (Germany)

Author keywords

Anticipation; Attention; Eye movements; Ideomotor theory; Prediction; Priority map

Indexed keywords

ACTION; AFFECT; ANTICIPATION; ATTENTION; COGNITION; CONCEPT FORMATION; CONCEPTUAL FRAMEWORK; CONTROLLED STUDY; EYE MOVEMENT; HUMAN; HUMAN EXPERIMENT; KNOWLEDGE; LEARNING; LINKING PERCEPTION; MOTIVATION; OBSERVATIONAL LEARNING; OPERANT BEHAVIORAL TEST; PERCEPTION; PREDICTION; PRIORITY JOURNAL; REVIEW; SACCADIC EYE MOVEMENT; SPATIOTEMPORAL ANALYSIS; TRANSSACCADIC LEARNING; VISION; VISUAL MEMORY; BRAIN; PHYSIOLOGY; PSYCHOMOTOR PERFORMANCE; STIMULATION;

ATTENTION; BRAIN; EYE MOVEMENTS; GOALS; HUMANS; PERCEPTION; PHYSICAL STIMULATION; PSYCHOMOTOR PERFORMANCE;

EID: 84924605001     PISSN: 01497634     EISSN: 18737528     Source Type: Journal    
DOI: 10.1016/j.neubiorev.2015.02.013     Document Type: Review

References (134)

1. Ach N. Über den Willensakt und das Temperament 1910, Quelle & Meyer, Leipzig.
2. Allport D.A. Selection for action: some behavioral and neurophysiological considerations of attention and action. Perspectives on Perception and Action 1987, 395-419. Hillsdale, NJ, Erlbaum. H. Heuer, A.F. Sanders (Eds.).
3. Awh E., Jonides J. Overlapping mechanisms of attention and working memory. Trends Cogn. Sci. 2001, 5:119-126.
4. Awh E., Jonides J., Reuter-Lorenz P.A. Rehearsal in spatial working memory. J. Exp. Psychol. Hum. Percept. Perform. 1998, 24:780-790.
5. Awh E., Vogel E.K., Oh S.H. Interactions between attention and working memory. Neuroscience 2006, 139:201-208.
6. Baldauf D., Deubel H. Attentional landscapes in reaching and grasping. Vis. Res. 2010, 50:999-1013.
7. Band G.P.H., van Steenbergen H., Ridderinkhof K.R., Falkenstein M., Hommel B. Action-effect negativity: irrelevant action effects are monitored like relevant feedback. Biol. Psychol. 2009, 82:211-218.
8. Beckers T., De Houwer J., Eelen P. Automatic integration of non-perceptual action effect features: the case of the associative affective Simon effect. Psychol. Res. 2002, 66:166-173.
9. Bisley J.W., Goldberg M.E. Attention, intention and priority in the parietal lobe. Annu. Rev. Neurosci. 2010, 33:1-21.
10. Blakemore S.J., Frith C.D., Wolpert D.M. Spatio-temporal prediction modulates the perception of self-produced stimuli. J. Cogn. Neurosci. 1999, 11:551-559.
11. Brass M., Bekkering H., Prinz W. Movement observation affects movement execution in a simple response task. Acta Psychol. 2001, 106:3-22.
12. Bundesen C. A theory of visual attention. Psychol. Rev. 1990, 97:523-547.
13. Bundesen C., Habekost T., Kyllingsbæk S. A neural theory of visual attention: bridging cognition and neurophysiology. Psychol. Rev. 2005, 112:291-328.
14. Buswell G.T. How People Look at Pictures: A study of the Psychology of Perception in Art 1935, Chicago University Press, Chicago.
15. Chun M.M. Visual working memory as visual attention sustained internally over time. Neuropsychologia 2011, 49:1407-1409.
16. Coren S., Hoenig P. Effect of non-target stimuli upon length of voluntary saccades. Percept. Mot. Skills 1972, 34:499-508.
17. Craighero L., Fadiga L., Rizzolatti G., Umiltà C. Action for perception: a motor-visual attentional effect. J. Exp. Psychol. Hum. Percept. Perform. 1999, 25:1673-1692.
18. Demeyer M., De Graef P., Wagemans J., Verfaillie K. Object form discontinuity facilitates displacement discrimination across saccades. J. Vis. 2010, 10(6):17. 1-14.
19. Dennett D.C. Consciousness Explained 1991, Little, Brown and Co., Boston, MA.
20. Desimone R., Duncan J. Neural mechanisms of selective visual attention. Annu. Rev. Neurosci. 1995, 18:193-222.
21. Deubel H., Schneider W.X. Saccade target selection and object recognition: evidence for a common attentional mechanism. Vis. Res. 1996, 36:1827-1837.
22. Deubel H., Schneider W.X. Attentional selection in sequential manual movements, movements around an obstacle and in grasping. Attention in Action: Advances from Cognitive Neuroscience 2005, 69-91. Psychology Press, Hove. G.W. Humphreys, M.J. Riddoch (Eds.).
23. Deubel H., Schneider W.X., Bridgeman B. Postsaccadic target blanking prevents saccadic suppression of image displacement. Vis. Res. 1996, 36:985-996.
24. Duncan J., Ward R., Shapiro K. Direct measurement of attentional dwell time in human vision. Nature 1994, 369:313-315.
25. Elsner B., Hommel B. Effect anticipation and action control. J. Exp. Psychol. Hum. Percept. Perform. 2001, 27:229-240.
26. Elsner B., Hommel B. Contiguity and contingency in action-effect learning. Psychol. Res. 2004, 68:138-154.
27. Engel A.K., Maye A., Kurthen M., König P. Where's the action? The pragmatic turn in cognitive science. Trends Cogn. Sci. 2013, 17:202-209.
28. Fagioli S., Hommel B., Schubotz R.I. Intentional control of attention: action planning primes action-related stimulus dimensions. Psychol. Res. 2007, 71:22-29.
29. Fecteau J.H., Munoz D.P. Salience, relevance, and firing: a priority map for target selection. Trends Cogn. Sci. 2006, 10:382-390.
30. Findlay J.M. Global processing for saccadic eye movements. Vis. Res. 1982, 22:1033-1045.
31. Gazzaley A., Nobre A.C. Top-down modulation: bridging selective attention and working memory. Trends Cogn. Sci. 2012, 16:129-135.
32. Glenberg A.M., Jaworski B., Rischal M., Levin J.R. What brains are for: action, meaning, and reading comprehension. Reading Comprehension Strategies: Theories, Interventions, and Technologies 2007, 221-240. Erlbaum, Mahwah, NJ. D. McNamara (Ed.).
33. Goebel R. Perceiving complex visual scenes: an oscillator neural network model that integrates selective attention, perceptual organisation, and invariant recognition. Advances in Neural Information Processing Systems 1993, Morgan Kaufman, San Mateo, CA. C.L. Giles, S.J. Hanson, D.J. Cowan (Eds.).
34. Goschke T. Volition in action: intentions, control dilemmas and the dynamic regulation of intentional control. Action Science: Foundations of an Emerging Discipline 2013, 409-434. MIT Press, Cambridge, MA. W. Prinz, A. Beisert, A. Herwig (Eds.).
35. Gottlieb J. From thought to action: the parietal cortex as a bridge between perception, action and cognition. Neuron 2007, 53:9-16.
36. Griffiths G., Herwig A., Schneider W.X. Stimulus localization interferes with stimulus recognition: evidence from an attentional blink paradigm. J. Vis. 2013, 13(7):7. 1-14.
37. Haggard P., Clark S., Kalogeras J. Voluntary action and conscious awareness. Nat. Neurosci. 2002, 5:382-385.
38. Harleß E. Der Apparat des Willens. Zeitschrift für Philosophie und philosophische Kritik 1861, 38(2):50-73.
39. Heckhausen H. Motivation and Action 1991, Springer-Verlag, Berlin.
40. Herwig A. Experimentelle Handlungsforschung: Die individuelle Perspektive. Experimentelle Handlungsforschung: Kognitive Grundlagen der Wahrnehmung und Steuerung von Handlungen 2014, 57-106. Kohlhammer, Stuttgart. W. Prinz (Ed.).
41. Herwig A., Beisert M., Prinz W. Action science emerging: introduction and leitmotifs. Action Science: Foundations of an Emerging Discipline 2013, 1-33. MIT Press, Cambridge, MA. W. Prinz, M. Beisert, A. Herwig (Eds.).
42. Herwig A., Beisert M., Schneider W.X. On the spatial interaction of visual working memory and attention: evidence for a global effect from memory-guided saccades. J. Vis. 2010, 10(5):8. 1-10.
43. Herwig A., Horstmann G. Action-effect associations revealed by eye movements. Psychon. Bull. Rev. 2011, 18(3):531-537.
44. Herwig A., Massen C. Action planning with two-handed tools. Psychol. Res. 2009, 73:727-740.
45. Herwig A., Prinz W., Waszak F. Two modes of sensorimotor integration in intention-based and stimulus-based actions. Q. J. Exp. Psychol. 2007, 60:1540-1554.
46. Herwig A., Schneider W.X. Predicting object features across saccades: evidence from object recognition and visual search. J. Exp. Psychol. Gen. 2014, 143(5):1903-1922.
47. Herwig A., Waszak F. Intention and attention in ideomotor learning. Q. J. Exp. Psychol. 2009, 62:219-227.
48. Herwig A., Waszak F. Action-effect bindings and ideomotor learning in intention- and stimulus-based actions. Front. Psychol. 2012, 3:444. 10.3389/fpsyg.2012.00444.
49. Herwig A., Weiß K., Schneider W.X. When circles become triangular: how transsaccadic predictions shape the perception of shape. Annals of the New York Academy of Sciences 2015, (in press). 10.1111/nyas.12672.
50. Hommel B. Action control according to TEC (theory of event coding). Psychol. Res. 2009, 73:512-526.
51. Hommel B. Grounding attention in action control: the intentional control of selection. Effortless Attention: A New Perspective in the Cognitive Science of Attention and Action 2010, 121-140. MIT Press, Cambridge, MA. B.J. Bruya (Ed.).
52. Hommel B. Attention and spatial stimulus coding in the Simon task. Acta Psychologica 2011, 136:265-268.
53. Hommel B., Alonso D., Fuentes L.J. Acquisition and generalization of action effects. Visual Cogn. 2003, 10:965-986.
54. Hommel B., Elsner B. Acquisition, representation, and control of action. Oxford Handbook of Human Action 2009, 371-398. Oxford University Press, New York. E. Morsella, J.A. Bargh, P.M. Gollwitzer (Eds.).
55. Hommel B., Müsseler J., Aschersleben G., Prinz W. The theory of event coding (TEC): a framework for perception and action planning. Behav. Brain Sci. 2001, 24:849-878.
56. Huestegge L., Koch I. Fixation disengagement enhances peripheral perceptual processing: evidence for a perceptual gap effect. Exp. Brain Res. 2010, 201:631-640.
57. Huestegge L., Kreutzfeldt M. Action effects in saccade control. Psychon. Bull. Rev. 2012, 19:198-203.
58. Hughes G., Desantis A., Waszak F. Mechanisms of intentional binding and sensory attenuation: the role of temporal prediction, temporal control, identity prediction, and motor prediction. Psychol. Bull. 2013, 139:133-151.
59. James, W. [1890] (1981). The Principles of Psychology. Macmillan/Harvard University Press.
60. Jeannerod M. The Neural and Behavioural Organization of Goal-Directed Movements 1988, Clarendon Press, Oxford.
61. Jones A., Hughes G., Waszak F. The interaction between attention and motor prediction: an ERP study. Neuroimage 2013, 83:533-541.
62. Kiesel A., Hoffmann J. Variable action effects: response control by context-specific effect anticipations. Psychol. Res. 2004, 68:155-162.
63. Kiyonaga A., Egner T. Working memory as internal attention: toward an integrative account of internal and external selection processes. Psychon. Bull. Rev. 2013, 20:228-242.
64. Knuf L., Aschersleben G., Prinz W. An analysis of ideomotor action. J. Exp. Psychol. Gen. 2001, 130:779-798.
65. Kornblum S., Hasbroucq T., Osman A. Dimensional overlap: cognitive basis for stimulus-response compatibility - a model of taxonomy. Psychol. Rev. 1990, 97:253-270.
66. Krauzlis R.J., Liston D., Carello C. Target selection and the superior colliculus: goals, choices and hypotheses. Vis. Res. 2004, 44:1445-1451.
67. Khan A., McFadden S.A., Harwood M., Wallman J. Salient distractors can induce saccade adaptation. J. Ophthalmol. 2014, 2014(585792):1-11.
68. Kühn S., Brass M. Planning not to do something: does intending not to do something activate associated sensory consequences?. Cogn. Affect. Behav. Neurosci. 2010, 10:454-459.
69. Kühn S., Seurinck R., Fias W., Waszak F. The internal anticipation of sensory action effects: when action induces FFA and PPA activity. Front. Hum. Neurosci. 2010, 4/54:1-7.
70. Kunde W. Response-effect compatibility in manual choice reaction tasks. J. Exp. Psychol. Hum. Percept. Perform. 2001, 27:387-394.
71. Kunde W. Temporal response-effect compatibility. Psychol. Res. 2003, 67:153-159.
72. Kunde W., Lozo L., Neumann R. Effect-based control of facial expressions: evidence from action-effect compatibility. Psychon. Bull. Rev. 2011, 18:820-826.
73. Kunde W., Pfister R., Janczyk M. The locus of tool-transformation costs. J. Exp. Psychol. Hum. Percept. Perform. 2012, 38:703-714.
74. LaBerge D., Brown V. Theory of attentional operations in shape identification. Psychol. Rev. 1989, 96:101-124.
75. Land M.F., Tatler B.W. Looking and Acting: Vision and Action in Natural Behaviour 2009, Oxford University Press, Oxford.
76. Llinás R. The I of the Vortex 2001, MIT Press, Cambridge, MA.
77. Lotze R.H. Medizinische Psychologie oder die Physiologie der Seele 1852, Weidmann'sche Buchhandlung, Leipzig, Germany.
78. Voluntary Action: Brains, Minds, and Sociality 2003, Oxford University Press, Oxford. S. Maasen, W. Prinz, G. Roth (Eds.).
79. Massen C., Prinz W. Programming tool-use actions. J. Exp. Psychol. Hum. Percept. Perform. 2007, 33:692-704.
80. Mechsner F., Kerzel D., Knoblich G., Prinz W. Perceptual basis of bimanual coordination. Nature 2001, 414:69-73.
81. The Imitative Mind: Development, Evolution, and Brain Bases 2002, Cambridge University Press, Cambridge. A.N. Meltzoff, W. Prinz (Eds.).
82. Memelink J., Hommel B. Intentional weighting: a basic principle in cognitive control. Psychol. Res. 2013, 77:249-259.
83. Miller G.A., Galanter E., Pribram K.H. Plans and the Structure of Behavior 1960, Holt, New York.
84. Oxford Handbook of Human Action 2009, Oxford University Press, New York. E. Morsella, J.A. Bargh, P.M. Gollwitzer (Eds.).
85. Müsseler J., Hommel B. Blindness to response-compatible stimuli. J. Exp. Psychol. Hum. Percept. Perform. 1997, 23:861-872.
86. Müsseler J., Kunde W., Gausepohl D., Heuer H. Does a tool eliminate spatial compatibility effects?. Eur. J. Cogn. Psychol. 2008, 20:211-231.
87. Nattkemper D., Ziessler M., Frensch P.A. Binding in voluntary action control. Neurosci. Biobehav. Rev. 2010, 34:1092-1101.
88. Neumann O. Beyond capacity: a functional view of attention. Perspectives on Perception and Action 1987, 361-394. Lawrence Erlbaum Associates, Inc., Hillsdale, NJ. H. Heuer, A.F. Sanders (Eds.).
89. Neumann O. Visual attention and action. Relationships Between Perception and Action: Current Approaches 1990, 227-267. Springer-Verlag, Berlin/New York. O. Neumann, W. Prinz (Eds.).
90. Olivers C.N.L., Meijer F., Theeuwes J. Feature-based memory-driven attentional capture: visual working memory content affects visual attention. J. Exp. Psychol. Hum. Percept. Perform. 2006, 32:1243-1265.
91. Olshausen B.A., Anderson C.H., Van Essen D.C. A neurobiological model of visual attention and invariant pattern recognition based on dynamic routing of information. J. Neurosci. 1993, 13:4700-4719.
92. Paulus M., van Dam W., Hunnius S., Lindemann O., Bekkering H. Action-effect binding by observational learning. Psychon. Bull. Rev. 2011, 18:1022-1028.
93. Pfister R., Janczyk M. Harleß' apparatus of will: 150 years later. Psychol. Res. 2012, 76:561-565.
94. Pfister R., Pfeuffer C.U., Kunde W. Perceiving by proxy: effect-based action control with unperceivable effects. Cognition 2014, 132:251-261.
95. Postle B.R., Awh E., Jonides J., Smith E.E., D'Esposito M. The where and how of attention-based rehearsal in spatial working memory. Cogn. Brain Res. 2004, 20:194-205.
96. Prinz W. Modes of linkage between perception and action. Cognition and Motor Processes 1984, 185-193. Springer, Berlin, Heidelberg. W. Prinz, A.F. Sanders (Eds.).
97. Prinz W. A common coding approach to perception and action. Relationships Between Perception and Action: Current Approaches 1990, 167-201. Springer-Verlag, Berlin/New York. O. Neumann, W. Prinz (Eds.).
98. Prinz W. Perception and action planning. Eur. J. Cogn. Psychol. 1997, 9:129-154.
99. Prinz W. Wille und Ziel. Willenshandlungen. Zur Natur und Kultur der Selbststeuerung 2008, 14-39. Suhrkamp, Frankfurt. T. Vierkant (Ed.).
100. Prinz W. Action representation: crosstalk between semantics and pragmatics. Neuropsychologia 2014, 55:51-56.
101. Prinz W., Aschersleben G., Koch I. Cognition and action. Oxford Handbook of Human Action 2009, 35-71. Oxford University Press, New York. E. Morsella, J.A. Bargh, P.M. Gollwitzer (Eds.).
102. Action Science: Foundations of an Emerging Discipline 2013, MIT Press, Cambridge, MA. W. Prinz, M. Beisert, A. Herwig (Eds.).
103. Raymond J.E., Shapiro K.L., Arnell K.M. Temporary suppression of visual processing in an RSVP task: an attentional blink?. J. Exp. Psychol. Hum. Percept. Perform. 1992, 18:849-860.
104. Rizzolatti G., Riggio L., Dascola I., Umiltá C. Reorienting attention across the horizontal and vertical meridians: evidence in favor of a premotor theory of attention. Neuropsychologia 1987, 25:31-40.
105. Robinson D.L., Petersen S.E. The pulvinar and visual salience. Trends Neurosci. 1992, 15:127-132.
106. Roussel C., Hughes G., Waszak F. A preactivation account of sensory attenuation. Neuropsychologia 2013, 51:922-929.
107. Rosenbaum D.A. Human movement initiation: specification of arm, direction, and extent. J. Exp. Psychol. Gen. 1980, 109:444-474.
108. Schack T., Mechsner F. Representation of motor skills in human long-term memory. Neurosci. Lett. 2006, 391:77-81.
109. Schall J.D., Thompson K.G. Neural selection and control of visually guided eye movements. Annu. Rev. Neurosci. 1999, 22:241-259.
110. Schneider W.X. VAM: a neuro-cognitive model for visual attention control of segmentation, object recognition, and space-based motor action. Visual Cogn. 1995, 2:331-375.
111. Schneider W.X. Selective visual processing across competition episodes: a theory of task-driven visual attention and working memory. Philos. Trans. R. Soc. Lond. B: Biol. Sci. 2013, 368:1-13.
112. Schneider W.X., Deubel H. Selection-for-perception and selection-for-spatial-motor-action are coupled by visual attention: a review of recent findings and new evidence from stimulus-driven saccade control. Attention and Performance XIX: Common Mechanisms in Perception and Action 2002, 609-627. Oxford University Press, Oxford. W. Prinz, B. Hommel (Eds.).
113. Schneider W.X., Einhäuser W., Horstmann G. Attentional selection in visual perception, memory and action: a quest for cross-domain integration. Philos. Trans. R. Soc. Lond. B: Biol. Sci. 2013, 368:1-7.
114. Schütz A.C., Braun D.I., Gegenfurtner K.R. Eye movements and perception: a selective review. J. Vis. 2011, 11(5):9. 1-30.
115. Shin Y.K., Proctor R.W., Capaldi E.J. A review of contemporary ideomotor theory. Psychol. Bull. 2010, 136:943-974.
116. Simon J.R., Rudell A.P. Auditory S-R compatibility: the effect of an irrelevant cue on information processing. J. Appl. Psychol. 1967, 51:300-304.
117. Smith D.T., Ball K., Ellison A. Covert visual search within and beyond the effective oculomotor range. Vis. Res. 2014, 95:11-17.
118. Smith D.T., Schenk T. The premotor theory of attention: time to move on?. Neuropsychologia 2012, 50:1104-1114.
119. Soto D., Heinke D., Humphreys G.W., Blanco M.J. Early, involuntary top-down guidance of attention from working memory. J. Exp. Psychol. Hum. Percept. Perform. 2005, 31:248-261.
120. Stränger J., Hommel B. The perception of action and movement. Handbook of Perception and Action: Perception 1996, vol. 1:397-451. Academic Press, London.
121. Summerfield C., Egner T. Expectation (and attention) in visual cognition. Trends Cogn. Sci. 2009, 13:403-409.
122. Symes E., Tucker M., Ellis R., Vainio L., Ottoboni G. Grasp preparation improves change detection for congruent objects. J. Exp. Psychol. Hum. Percept. Perform. 2008, 34:854-871.
123. Thomaschke R., Hopkins B., Miall R.C. The Planning and Control Model (PCM) of motorvisual priming: reconciling motorvisual impairment and facilitation effects. Psychol. Rev. 2012, 119:388-407.
124. Turvey M.T. Ecological perspective on perception-action: what kind of science does it entail?. Action Science: Foundations of an Emerging Discipline 2013, 139-170. MIT Press, Cambridge, MA. W. Prinz, M. Beisert, A. Herwig (Eds.).
125. Walker R., Deubel H., Schneider W.X., Findlay J.M. The effect of remote distractors on saccade programming: evidence for an extended fixation zone. J. Neurophysiol. 1997, 78:1108-1119.
126. Walter A.M., Rieger M. Target- and effect-directed actions towards temporal goals: similar mechanisms?. J. Exp. Psychol. Hum. Percept. Perform. 2012, 38:958-974.
127. Waszak F., Herwig A. Effect anticipation modulates deviance processing in the brain. Brain Res. 2007, 1183:74-82.
128. Weiss C., Herwig A., Schütz-Bosbach S. The self in action effects: selective attenuation of self-generated sounds. Cognition 2011, 121(2):207-218.
129. Weiß K., Schneider W., Herwig A. Associating peripheral and foveal visual input across saccades: a default mode of the human visual system?. J. Vis. 2014, 14(11):7. 1-15.
130. Wolff P. Saccadic eye movements and visual stability: preliminary considerations towards a cognitive approach. Cognition and Motor Processes 1984, 121-137. Springer, Berlin, Germany. W. Prinz, A.F. Sanders (Eds.).
131. Wykowska A., Schubö A., Hommel B. How you move is what you see: action planning biases selection in visual search. J. Exp. Psychol. Hum. Percept. Perform. 2009, 35:1755-1769.
132. Yarbus A. Eye Movements and Vision 1967, Plenum, New York.
133. Ziessler M., Nattkemper D. Learning of event sequences is based on response-effect learning: further evidence from serial reaction task. J. Exp. Psychol. Learn. Mem. Cogn. 2001, 27:595-613.
134. Zwickel J., Grosjean M., Prinz W. A contrast effect between the concurrent production and perception of movement directions. Visual Cogn. 2008, 26:953-978.