Navigating the Affordance Landscape: Feedback Control as a Process Model of Behavior and Cognition

Trends in Cognitive Sciences

Volumn 20, Issue 6, 2016, Pages 414-424

  Pezzulo, Giovanni ^a   Cisek, Paul ^b  

^a INSTITUTE OF COGNITIVE SCIENCES AND TECHNOLOGIES   (Italy)

^b UNIVERSITÉ DE MONTRÉAL   (Canada)

Author keywords

Active inference; Affordance competition; Embodied cognition; Feedback control

Indexed keywords

ABSTRACTING; BRAIN; FEEDBACK CONTROL; FORECASTING; PSYCHOPHYSIOLOGY;

ACTIVE INFERENCE; ADAPTIVE SELECTION; AFFORDANCES; ALTERNATIVE FRAMEWORK; COGNITIVE PSYCHOLOGY; EMBODIED COGNITION; HIGH-LEVEL GOALS; LEVELS OF ABSTRACTION;

PROCESS CONTROL;

ACTION POTENTIAL; BEHAVIOR; BRAIN CORTEX; COMPETITION; CONTROLLED STUDY; FEEDBACK SYSTEM; INFORMATION PROCESSING; LANDSCAPE; NEUROPHYSIOLOGY; PREDICTION; PROCESS MODEL; SPECIES; ANIMAL; ANIMAL BEHAVIOR; BIOLOGICAL MODEL; BRAIN; COGNITION; PHYSIOLOGY;

ANIMALS; BEHAVIOR; BEHAVIOR, ANIMAL; BRAIN; COGNITION; MODELS, BIOLOGICAL;

EID: 84992301553     PISSN: 13646613     EISSN: 1879307X     Source Type: Journal    
DOI: 10.1016/j.tics.2016.03.013     Document Type: Review

References (80)

1. Thagard P. Cognitive science. The Stanford Encyclopedia of Philosophy (Fall 2014 edition) 2014, Standord University. E.N. Zalta (Ed.).
2. Ashby W.R. Design for a Brain 1952, John Wiley & Sons.
3. Wiener N. Cybernetics: Or Control and Communication in the Animal and the Machine 1948, MIT Press.
4. Powers W.T. Behavior: The Control of Perception 1973, Aldine.
5. Dewey J. The reflex arc concept in psychology. Psychol. Rev. 1896, 3:357-370.
6. Cisek P. Beyond the computer metaphor: behavior as interaction. J. Conscious. Stud. 1999, 6:125-142.
7. Pezzulo G., Castelfranchi C. Thinking as the control of imagination: a conceptual framework for goal-directed systems. Psychol. Res. 2009, 73:559-577.
8. Cannon W.B. The Wisdom of the Body 1939, Norton.
9. Scott S.H. The computational and neural basis of voluntary motor control and planning. Trends Cogn. Sci. 2012, 16:541-549.
10. Yin H.H. Action, time and the basal ganglia. Philos. Trans. R. Soc. Lond. B Biol. Sci. 2014, 369:20120473.
11. Shadmehr R., et al. Error correction, sensory prediction, and adaptation in motor control. Annu. Rev. Neurosci. 2010, 33:89-108.
12. Hinde R.A. Animal Behaviour: A Synthesis of Ethology and Comparative Psychology 1966, McGraw-Hill Book Company.
13. Cisek P. Cortical mechanisms of action selection: the affordance competition hypothesis. Philos. Trans. R. Soc. Lond. B Biol. Sci. 2007, 362:1585-1599.
14. Friston K., et al. Active inference and agency: optimal control without cost functions. Biol. Cybernet. 2012, 106:523-541.
15. Verschure P., et al. The why, what, where, when and how of goal-directed choice: neuronal and computational principles. Philos. Trans. R. Soc. Lond. B Biol. Sci. 2014, 369:20130483.
16. Tani J. Self-organization and compositionality in cognitive brains: a neurorobotics study. Proc. IEEE 2014, 102:586-605.
17. Botvinick M., Toussaint M. Planning as inference. Trends Cogn. Sci. 2012, 16:485-488.
18. Cisek P., Kalaska J.F. Neural correlates of reaching decisions in dorsal premotor cortex: specification of multiple direction choices and final selection of action. Neuron 2005, 45:801-814.
19. Cisek P., Pastor-Bernier A. On the challenges and mechanisms of embodied decisions. Philos. Trans. R. Soc. Lond. B Biol. Sci. 2014, 369:1655.
20. Cisek P. Making decisions through a distributed consensus. Curr. Opin. Neurobiol. 2012, 22:927-936.
21. Friston K. A theory of cortical responses. Philos. Trans. R. Soc. Lond. B Biol. Sci. 2005, 360:815-836.
22. Bar M. The proactive brain: using analogies and associations to generate predictions. Trends Cogn. Sci. 2007, 11:280-289.
23. Pezzulo G. Coordinating with the future: the anticipatory nature of representation. Minds Mach. 2008, 18:179-225.
24. Pezzulo G., et al. When affordances climb into your mind: advantages of motor simulation in a memory task performed by novice and expert rock climbers. Brain Cogn. 2010, 73:68-73.
25. Lepora N.F., Pezzulo G. Embodied choice: how action influences perceptual decision making. PLoS Comput. Biol. 2015, 11:e1004110.
26. Araújo D., et al. The ecological dynamics of decision making in sport. Psychol. Sport Exercise 2006, 7:653-676.
27. Fuster J.M. Frontal lobe and cognitive development. J. Neurocytol. 2002, 31:373-385.
28. Shadlen M.N., et al. Neurobiology of decision making: an intentional framework. Better than Conscious? Decision Making, the Human Mind, and Implications for Institutions 2008, 71-101. MIT Press. C. Engel, W. Singer (Eds.).
29. Graziano M.S. Ethological action maps: a paradigm shift for the motor cortex. Trends Cogn. Sci. 2016, 20:121-132.
30. Stepniewska I., et al. Optical imaging in galagos reveals parietal-frontal circuits underlying motor behavior. Proc. Natl. Acad. Sci. U.S.A. 2011, 108:E725-E732.
31. Brown A.R., Teskey G.C. Motor cortex is functionally organized as a set of spatially distinct representations for complex movements. J. Neurosci. 2014, 34:13574-13585.
32. Cisek P., Kalaska J.F. Neural mechanisms for interacting with a world full of action choices. Annu. Rev. Neurosci. 2010, 33:269-298.
33. Fluet M-C., et al. Context-specific grasp movement representation in macaque ventral premotor cortex. J. Neurosci. 2010, 30:15175-15184.
34. Redgrave P., et al. The basal ganglia: a vertebrate solution to the selection problem?. Neuroscience 1999, 89:1009-1023.
35. Gruber A.J., McDonald R.J. Context, emotion, and the strategic pursuit of goals: interactions among multiple brain systems controlling motivated behavior. Front. Behav. Neurosci. 2012, 6:50.
36. Mink J.W. The basal ganglia: focused selection and inhibition of competing motor programs. Prog. Neurobiol. 1996, 50:381-425.
37. Pezzulo G., et al. Active inference, homeostatic regulation and adaptive behavioural control. Prog. Neurobiol. 2015, 134:17-35.
38. Mendoza G., Merchant H. Motor system evolution and the emergence of high cognitive functions. Prog. Neurobiol. 2014, 122:73-93.
39. Badre D., D'Esposito M. Is the rostro-caudal axis of the frontal lobe hierarchical?. Nat. Rev. Neurosci. 2009, 10:659-669.
40. Badre D., et al. Frontal cortex and the discovery of abstract action rules. Neuron 2010, 66:315-326.
41. Koechlin E. An evolutionary computational theory of prefrontal executive function in decision-making. Philos. Trans. R. Soc. Lond. B Biol. Sci. 2014, 369:1655.
42. Bonini L., et al. Grasping neurons of monkey parietal and premotor cortices encode action goals at distinct levels of abstraction during complex action sequences. J. Neurosci. 2011, 31:5876-5886.
43. Kiebel S.J., et al. A hierarchy of time-scales and the brain. PLoS Comput. Biol. 2008, 4:e1000209.
44. Harrison T.C., et al. Distinct cortical circuit mechanisms for complex forelimb movement and motor map topography. Neuron 2012, 74:397-409.
45. Passingham R.E., Wise S.P. The Neurobiology of the Prefrontal Cortex: Anatomy, Evolution, and the Origin of Insight 2012, Oxford University Press. (1st edn).
46. Mansell W. Control of perception should be operationalized as a fundamental property of the nervous system. Top. Cogn. Sci. 2011, 3:257-261.
47. Piaget J. The Construction of Reality in the Child 1954, Ballentine Books.
48. Buzsáki G., et al. Emergence of cognition from action. Cold Spring Harb. Symp. Quant. Biol. 2014, 79:41-50.
49. Pezzulo G. Grounding procedural and declarative knowledge in sensorimotor anticipation. Mind Lang. 2011, 26:78-114.
50. Grush R. The emulation theory of representation: motor control, imagery, and perception. Behav. Brain Sci. 2004, 27:377-396.
51. Hesslow G. The current status of the simulation theory of cognition. Brain Res. 2012, 1428:71-79.
52. Koziol L.F., et al. Consensus paper: the cerebellum's role in movement and cognition. Cerebellum 2014, 13:151-177.
53. Ito M. Movement and thought: identical control mechanisms by the cerebellum. Trends Neurosci. 1993, 16:448-450.
54. Schmahmann J.D. Disorders of the cerebellum: ataxia, dysmetria of thought, and the cerebellar cognitive affective syndrome. J. Neuropsychiatry 2004, 16:367-378.
55. Jeannerod M. Neural simulation of action: a unifying mechanism for motor cognition. Neuroimage 2001, 14:S103-S109.
56. Pezzulo G., et al. Internally generated sequences in learning and executing goal-directed behavior. Trends Cogn. Sci. 2014, 18:647-657.
57. Pfeiffer B.E., Foster D.J. Hippocampal place-cell sequences depict future paths to remembered goals. Nature 2013, 497:74-79.
58. van der Meer M., et al. Information processing in decision-making systems. Neuroscientist 2012, 18:342-359.
59. Pezzulo G. An active inference view of cognitive control. Front. Psychol. 2012, 3:478.
60. Barkley R.A. The executive functions and self-regulation: an evolutionary neuropsychological perspective. Neuropsychol. Rev. 2001, 11:1-29.
61. Miller G.A. The cognitive revolution: a historical perspective. Trends Cogn. Sci. 2003, 7:141-144.
62. Krubitzer L. The magnificent compromise: cortical field evolution in mammals. Neuron 2007, vol. 56:201-208.
63. Fuster J.M. The Prefrontal Cortex: Anatomy Physiology, and Neuropsychology of the Frontal Lobe 1997, Lippincott-Raven.
64. Graziano M.S.A., Webb T.W. The attention schema theory: a mechanistic account of subjective awareness. Front. Psychol. 2015, 6:500.
65. Barsalou L.W. Perceptual symbol systems. Behav. Brain Sci. 1999, 22:577-600.
66. Pezzulo G., et al. The mechanics of embodiment: a dialogue on embodiment and computational modeling. Front. Cogn. 2011, 2:1-21.
67. Glenberg A.M., et al. From the revolution to embodiment: 25 years of cognitive psychology. Perspect. Psychol. Sci. 2013, 8:573-585.
68. Sutton R.S., Barto A.G. Reinforcement Learning: An Introduction 1998, MIT Press.
69. Gelly S., et al. The grand challenge of computer Go: Monte Carlo tree search and extensions. Commun. ACM 2012, 55:106-113.
70. Stoianov I., et al. Prefrontal goal codes emerge as latent states in probabilistic value learning. J. Cogn. Neurosci. 2016, 28:140-157.
71. Pearson J.M., et al. Decision making: the neuroethological turn. Neuron 2014, 82:950-965.
72. Gibson J.J. The Ecological Approach to Visual Perception 1979, Lawrence Erlbaum Associates.
73. Ballard D. Animate vision. Artificial Intelligence 1991, 48:1-27.
74. Friston K., et al. Perceptions as hypotheses: saccades as experiments. Front. Psychol. 2012, 3:151.
75. Friston K. The free-energy principle: a unified brain theory?. Nat. Rev. Neurosci. 2010, 11:127-138.
76. Feldman H., Friston K.J. Attention, uncertainty, and free-energy. Front. Hum. Neurosci. 2010, 4:215.
77. Friston K., et al. Active inference and epistemic value. Cogn. Neurosci. 2015, 6:187-214.
78. Seth A.K. The cybernetic Bayesian brain from interoceptive inference to sensorimotor contingencies. Open MIND 2015, 1-24. MIND Group. T.K. Metzinger, J.M. Windt (Eds.).
79. Conant R.C., Ashby W.R. Every good regulator of a system must be a model of that system. Int. J. Systems Sci. 1970, 1:89-97.
80. Clark A. Surfing Uncertainty: Prediction, Action, and the Embodied Mind 2015, Oxford University Press.