Action understanding and active inference

Biological Cybernetics

Volumn 104, Issue 1-2, 2011, Pages 137-160

  Friston, Karl ^a   Mattout, Jérémie ^a,b   Kilner, James ^a  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

^b INSERM   (France)

Author keywords

Action observation; Free energy; Generative models; Inference; Mirror neuron system; Perception; Precision; Predictive coding

Indexed keywords

ACTION-OBSERVATION; GENERATIVE MODEL; INFERENCE; MIRROR-NEURON SYSTEM; PERCEPTION; PRECISION; PREDICTIVE CODING;

CHARACTER RECOGNITION; ELECTROPHYSIOLOGY; FREE ENERGY; OPTIMIZATION; TRAJECTORIES;

MIRRORS;

ARTICLE; BAYES THEOREM; BIOLOGICAL MODEL; CYBERNETICS; HANDWRITING; HUMAN; MOTONEURON; NONLINEAR SYSTEM; PERCEPTION; PHYSIOLOGY; PSYCHOMOTOR PERFORMANCE; SENSATION;

BAYES THEOREM; CYBERNETICS; HANDWRITING; HUMANS; MODELS, NEUROLOGICAL; MOTOR NEURONS; NONLINEAR DYNAMICS; PERCEPTION; PSYCHOMOTOR PERFORMANCE; SENSATION;

EID: 79952575636     PISSN: 03401200     EISSN: 14320770     Source Type: Journal    
DOI: 10.1007/s00422-011-0424-z     Document Type: Article

References (94)

1. V Afraimovich I Tristan R Huerta MI Rabinovich 2008 Winnerless competition principle and prediction of the transient dynamics in a Lotka-Volterra model Chaos 18 4 043103 19123613
2. T Allison A Puce G McCarthy 2000 Social perception from visual cues: role of the STS region Trends Cogn Sci 4 267 278 10859571 (Pubitemid 30392370)
3. MA Arbib 2008 From grasp to language: embodied concepts and the challenge of abstraction J Physiol (Paris) 102 1-3 4 20
4. MA Arbib 2010 Mirror system activity for action and language is embedded in the integration of dorsal and ventral pathways Brain Lang 112 1 12 24 19942271
5. DH Ballard GE Hinton TJ Sejnowski 1983 Parallel visual computation Nature 306 21 26 6633656 1:STN:280:DyaL2c%2FjvFyjsw%3D%3D
6. FP Battaglia GR Sutherland BL McNaughton 2004 Local sensory cues and place cell directionality: additional evidence of prospective coding in the hippocampus J Neurosci 24 19 4541 4550 15140925 1:CAS:528:DC%2BD2cXksFCqtbs%3D (Pubitemid 38656610)
7. R Bogacz K Gurney 2007 The basal ganglia and cortex implement optimal decision making between alternative actions Neural Comput 19 2 442 477 17206871
8. AM Borghi C Gianelli C Scorolli 2010 Sentence comprehension: effectors and goals, self and others. An overview of experiments and implications for robotics Front Neurorobot 4 3 Jun 14
9. G Buccino A Baumgaertner L Colle C Büchel G Rizzolatti F Binkofski 2007 The neural basis for understanding non-intended actions Neuroimage. 36 Suppl 2 T119 T127 17499159
10. N Burgess C Barry J O'Keefe 2007 An oscillatory interference model of grid cell firing Hippocampus 17 9 801 812 17598147 (Pubitemid 47493460)
11. M Butz L Timmermann J Gross B Pollok M Dirks H Hefter A Schnitzler 2006 Oscillatory coupling in writing and writer's cramp J Physiol Paris 99 1 14 20 16026973 (Pubitemid 41503403)
12. CR Clark GM Geffen LB Geffen 1989 Catecholamines and the covert orientation of attention in humans Neuropsychologia 27 131 139 2538773 1:STN:280:DyaL1M7ot1Cntg%3D%3D (Pubitemid 19084931)
13. JT Coull 1998 Neural correlates of attention and arousal: insights from electrophysiology, functional neuroimaging and psychopharmacology Prog Neurobiol 55 343 361 9654384 1:CAS:528:DyaK1cXjvFWgur0%3D (Pubitemid 28255041)
14. JW Dalley J McGaughy MT O'Connell RN Cardinal L Levita TW Robbins 2001 Distinct changes in cortical acetylcholine and noradrenaline efflux during contingent and noncontingent performance of a visual attentional task J Neurosci 21 4908 4914 11425918 1:CAS:528:DC%2BD3MXks1akt70%3D (Pubitemid 32565649)
15. MC Davidson RT Marrocco 2000 Local infusion of scopolamine into intraparietal cortex slows covert orienting in rhesus monkeys J Neurophysiol 83 1536 1549 10712478 1:CAS:528:DC%2BD3cXisVartLw%3D (Pubitemid 30159579)
16. P Dayan GE Hinton RM Neal 1995 The Helmholtz machine Neural Comput 7 889 904 7584891 1:STN:280:DyaK28%2FitVKrtA%3D%3D
17. J Decety J Grèzes N Costes D Perani M Jeannerod E Procyk F Grassi F Fazio 1997 Brain activity during observation of actions. Influence of action content and subject's strategy Brain 120 1763 1777 9365369 (Pubitemid 27443052)
18. M Del Giudice V Manera C Keysers 2009 Programmed to learn? The ontogeny of mirror neurons Dev Sci 12 2 350 363 19143807
19. R Desimone J Duncan 1995 Neural mechanisms of selective visual attention Annu Rev Neurosci 18 193 222 7605061 1:CAS:528:DyaK2MXktl2ltrk%3D
20. G Di Pellegrino L Fadiga L Fogassi V Gallese G Rizzolatti 1992 Understanding motor events: a neurophysiological study Exp Brain Res 91 176 180 1301372 1:STN:280:DyaK3s3ksF2guw%3D%3D
21. E Donchin MGH Coles 1988 Is the P300 component a manifestation of context updating? Behav Brain Sci 11 355 372
22. G Dragoi G Buzsáki 2006 Temporal encoding of place sequences by hippocampal cell assemblies Neuron 50 1 145 157 16600862 1:CAS:528: DC%2BD28XjslyqtbY%3D
23. AG Feldman 2009 New insights into action-perception coupling Exp Brain Res 194 1 39 58 19082821
24. H Feldman K Friston 2010 Attention, uncertainty and free-energy Front Hum Neurosci 4 215 10.3389/fnhum.2010.00215 21160551
25. JR Flanagan P Vetter RS Johansson DM Wolpert 2003 Prediction precedes control in motor learning Curr Biol 13 2 146 150 12546789 1:CAS:528: DC%2BD3sXmsFeqsA%3D%3D (Pubitemid 36154343)
26. L Fogassi PF Ferrari B Gesierich S Rozzi F Chersi G Rizzolatti 2005 Parietal lobe: from action organization to intention understanding Science 308 662 667 15860620 1:CAS:528:DC%2BD2MXjsFyktbc%3D (Pubitemid 40594381)
27. MJ Frank A Scheres SJ Sherman 2007 Understanding decision-making deficits in neurological conditions: insights from models of natural action selection Philos Trans R Soc Lond B Biol Sci 362 1485 1641 1654 17428775 (Pubitemid 47395855)
28. D Friedman YM Cycowicz H Gaeta 2001 The novelty P3: an event-related brain potential (ERP) sign of the brain's evaluation of novelty Neurosci Biobehav Rev 25 355 373 11445140 1:STN:280:DC%2BD3MzptFemug%3D%3D (Pubitemid 32624376)
29. P Fries T Womelsdorf R Oostenveld R Desimone 2008 The effects of visual stimulation and selective visual attention on rhythmic neuronal synchronization in macaque area V4 J Neurosci 28 18 4823 4835 18448659 1:CAS:528: DC%2BD1cXlvFWhuro%3D
30. K Friston 2008 Hierarchical models in the brain PLoS Comput Biol 4 11 e1000211 18989391
31. K Friston 2009 The free-energy principle: a rough guide to the brain? Trends Cogn Sci 13 7 293 301 19559644
32. K Friston J Kilner L Harrison 2006 A free energy principle for the brain J Physiol (Paris) 100 1-3 70 87 (Pubitemid 44827686)
33. KJ Friston J Daunizeau SJ Kiebel 2009 Reinforcement learning or active inference? PLoS One 4 7 e6421 19641614
34. KJ Friston J Daunizeau J Kilner SJ Kiebel 2010 Action and behavior: a free-energy formulation Biol Cybern 102 3 227 260 20148260
35. Friston K, Stephan K, Li B, Daunizeau J (2010b) Generalised filtering. Math Prob Eng. Article ID 621670
36. CD Frith U Frith 1999 Interacting minds-a biological basis Science 286 1692 1695 10576727 1:CAS:528:DyaK1MXnslKnsbs%3D
37. V Gallese A Goldman 1998 Mirror-neurons and the simulation theory of mind reading Trends Cogn Sci 2 493 501 21227300 1:STN:280:DC%2BC3M7gvFerug%3D%3D (Pubitemid 28557112)
38. V Gallese L Fadiga L Fogassi Rizzolatti G 1996 Action recognition in the premotor cortex Brain 119 593 609 8800951 (Pubitemid 26149371)
39. C Geisler K Diba E Pastalkova K Mizuseki S Royer G Buzsáki 2010 Temporal delays among place cells determine the frequency of population theta oscillations in the hippocampus Proc Natl Acad Sci USA 107 17 7957 7962 20375279 1:CAS:528:DC%2BC3cXlsFyqurc%3D
40. CM Gómez A Flores MR Digiacomo A Ledesma J González-Rosa 2008 P3a and P3b components associated to the neurocognitive evaluation of invalidly cued targets Neurosci Lett 430 181 185 18063304
41. ST Grafton AF Hamilton 2007 Evidence for a distributed hierarchy of action representation in the brain Hum Mov Sci 26 4 590 616 17706312 (Pubitemid 47324192)
42. MS Graziano 1999 Where is my arm? The relative role of vision and proprioception in the neuronal representation of limb position Proc Natl Acad Sci USA 96 18 10418 10421 10468623 1:CAS:528:DyaK1MXlvFentb0%3D (Pubitemid 29422573)
43. M Graziano 2006 The organization of behavioral repertoire in motor cortex Annu Rev Neurosci 29 105 134 16776581 1:CAS:528:DC%2BD28XosVeisbY%3D (Pubitemid 44476841)
44. RL Gregory 1968 Perceptual illusions and brain models Proc R Soc Lond B 171 179 196
45. RL Gregory 1980 Perceptions as hypotheses Phil Trans R Soc Lond B 290 181 197 1:STN:280:DyaL3M%2FhsVWgsw%3D%3D
46. J Grèzes P Fonlupt B Bertenthal C Delon-Martin C Segebarth J Decety 2001 Does perception of biological motion rely on specific brain regions? Neuroimage 13 775 785 11304074 (Pubitemid 32848323)
47. E Grossman M Donnelly R Price D Pickens V Morgan G Neighbor R Blake 2000 Brain areas involved in perception of biological motion J Cogn Neurosci 12 711 720 11054914 1:STN:280:DC%2BD3crgs1ClsA%3D%3D
48. AF Hamilton ST Grafton 2006 Goal representation in human anterior intraparietal sulcus J Neurosci 26 1133 1137 16436599 1:CAS:528: DC%2BD28XhsVSjsbw%3D (Pubitemid 43237045)
49. ME Hasselmo LM Giocomo 2006 Cholinergic modulation of cortical function J Mol Neurosci 30 1-2 133 135 17192659 1:CAS:528:DC%2BD28XhtlWgurrE (Pubitemid 46035351)
50. TE Hazy MJ Frank RC O'reilly 2007 Towards an executive without a homunculus: computational models of the prefrontal cortex/basal ganglia system Philos Trans R Soc Lond B Biol Sci 362 1485 1601 1613 17428778 (Pubitemid 47395852)
51. JL Herrero MJ Roberts LS Delicato MA Gieselmann P Dayan A Thiele 2008 Acetylcholine contributes through muscarinic receptors to attentional modulation in V1 Nature 454 1110 1114 18633352 1:CAS:528:DC%2BD1cXhtVGgtrzI
52. Ijspeert JA, Nakanishi J, Schaal S (2002) Movement imitation with nonlinear dynamical systems in humanoid robots. In International Conference on Robotics and Automation (ICRA 2002), pp 1398-1403 (Pubitemid 34916443)
53. M Jeannerod MA Arbib G Rizzolatti H Sakata 1995 Grasping objects: the cortical mechanisms of visuomotor transformation Trends Neurosci 18 7 314 320 7571012 1:CAS:528:DyaK2MXmsFymt7k%3D
54. K Jerbi JP Lachaux K N'Diaye D Pantazis RM Leahy L Garnero S Baillet 2007 Coherent neural representation of hand speed in humans revealed by MEG imaging Proc Natl Acad Sci USA 104 18 7676 7681 17442753 1:CAS:528:DC%2BD2sXlslaitbk%3D (Pubitemid 47185965)
55. C Keysers DI Perrett 2004 Demystifying social cognition: a Hebbian perspective Trends Cogn Sci 8 501 507 15491904 (Pubitemid 39387845)
56. C Keysers JH Kaas V Gazzola 2010 Somatosensation in social perception Nat Rev Neurosci 11 6 417 428 20445542 1:CAS:528:DC%2BC3cXls12qur0%3D
57. SJ Kiebel K von Kriegstein J Daunizeau KJ Friston 2009 Recognizing sequences of sequences PLoS Comput Biol 5 8 e1000464 19680429
58. SJ Kiebel J Daunizeau KJ Friston 2009 Perception and hierarchical dynamics Front Neuroinf 3 20
59. JM Kilner C Vargas S Duval S-J Blakemore A Sirigu 2004 Motor activation prior to observation of a predicted movement Nat Neurosci 7 1299 1301 15558063 1:CAS:528:DC%2BD2cXhtVCjsLzO (Pubitemid 41057751)
60. JM Kilner KJ Friston CD Frith 2007 Predictive coding: an account of the mirror neuron system Cogn Process 8 3 159 166 17429704 (Pubitemid 47245944)
61. JM Kilner KJ Friston CD Frith 2007 The mirror-neuron system: a Bayesian perspective Neuroreport 18 6 619 623 17413668 (Pubitemid 46594926)
62. J Lee R Fowler D Rodney L Cherney SL Small 2010 IMITATE: an intensive computer-based treatment for aphasia based on action observation and imitation Aphasiology 24 4 449 465 20543997
63. M Longcamp T Tanskanen R Hari 2006 The imprint of action: motor cortex involvement in visual perception of handwritten letters Neuroimage 33 2 681 688 16965922 1:STN:280:DC%2BD28rps1ygtQ%3D%3D (Pubitemid 44485549)
64. G Luppino A Murata P Govoni M Matelli 1999 Largely segregated parietofrontal connections linking rostral intraparietal cortex (areas AIP and VIP) and the ventral premotor cortex (areas F5 and F4) Exp Brain Res 128 181 187 10473756 1:STN:280:DyaK1Mvgs1Kkuw%3D%3D (Pubitemid 29425617)
65. GR Mangun SA Hillyard 1991 Modulations of sensory-evoked brain potentials indicate changes in perceptual processing during visual-spatial priming J Exp Psychol Hum Percept Perform 17 1057 1074 1837297 1:STN:280:DyaK387htlCruw%3D%3D
66. RC Miall 2003 Connecting mirror neurons and forward models Neuroreport 14 17 2135 2137 14625435 1:STN:280:DC%2BD3srks1egtA%3D%3D
67. N Miura M Sugiura M Takahashi Y Sassa A Miyamoto S Sato K Horie K Nakamura R Kawashima 2010 Effect of motion smoothness on brain activity while observing a dance: An fMRI study using a humanoid robot Soc Neurosci 5 1 40 58 19585386
68. D Mumford 1992 On the computational architecture of the neocortex. II. The role of cortico-cortical loops Biol Cybern 66 241 251 1540675 1:STN:280:DyaK387ntlSjtw%3D%3D
69. R Näätänen M Tervaniemi E Sussman P Paavilainen I Winkler 2001 "Primitive intelligence" in the auditory cortex Trends Neurosci 24 283 288 11311381
70. J Namikawa J Tani 2010 Learning to imitate stochastic time series in a compositional way by chaos Neural Netw 23 5 625 638 20045751
71. J O'Keefe 1999 Do hippocampal pyramidal cells signal non-spatial as well as spatial information? Hippocampus 9 4 352 364 10495018 (Pubitemid 29419623)
72. MW Oram DI Perrett 1994 Responses of anterior superior temporal polysensory (STPa) neurons to biological motion stimuli J Cogn Neurosci 6 99 116
73. B Porr F Wörgötter 2003 Isotropic sequence order learning Neural Comput 15 4 831 864 12689389 (Pubitemid 37049809)
74. M Rabinovich R Huerta G Laurent 2008 Neuroscience. Transient dynamics for neural processing Science 321 5885 48 50 18599763 1:CAS:528: DC%2BD1cXotlCht70%3D (Pubitemid 351956234)
75. RP Rao DH Ballard 1998 Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive field effects Nat Neurosci 2 79 87 (Pubitemid 30488944)
76. JH Reynolds DJ Heeger 2009 The normalization model of attention Neuron 61 2 168 185 19186161 1:CAS:528:DC%2BD1MXitVamurk%3D
77. G Rizzolatti L Craighero 2004 The mirror-neuron system Annu Rev Neurosci 27 169 192 15217330 1:CAS:528:DC%2BD2cXmslant70%3D (Pubitemid 39050401)
78. G Rizzolatti L Fogassi V Gallese 2001 Neurophysiological mechanisms underlying the understanding and imitation of action Nat Rev Neurosci 2 661 670 11533734 1:CAS:528:DC%2BD3MXmvVWqtbs%3D (Pubitemid 33674057)
79. E Salinas TJ Sejnowski 2001 Gain modulation in the central nervous system: where behavior, neurophysiology, and computation meet Neuroscientist 7 5 430 440 11597102 1:STN:280:DC%2BD3MrltVGlsQ%3D%3D (Pubitemid 32923758)
80. S Schaal P Mohajerian A Ijspeert 2007 Dynamics systems vs. optimal control: a unifying view Prog Brain Res 165 425 445 17925262 (Pubitemid 47513886)
81. CE Schroeder AD Mehta JJ Foxe 2001 Determinants and mechanisms of attentional modulation of neural processing Front Biosci 6 D672 D684 11333209 1:STN:280:DC%2BD3MrmvFWrug%3D%3D
82. Y Singer N Tishby 1994 Dynamical encoding of cursive handwriting Biol Cybern 71 3 227 237 7918801 1:STN:280:DyaK2M%2Fgt1egsw%3D%3D
83. H Takahashi T Shibuya M Kato T Sassa M Koeda N Yahata T Suhara Y Okubo 2008 Enhanced activation in the extrastriate body area by goal-directed actions Psychiatry Clin Neurosci 62 2 214 219 18412845 (Pubitemid 351537711)
84. J Tani 2003 Learning to generate articulated behavior through the bottom-up and the top-down interaction processes Neural Netw 16 1 11 23 12576102 (Pubitemid 36164776)
85. J Tani M Ito Y Sugita 2004 Self-organization of distributedly represented multiple behavior schemata in a mirror system: reviews of robot experiments using RNNPB Neural Netw 17 8-9 1273 1289 15555866 (Pubitemid 39539542)
86. E Todorov W Li X Pan 2005 From task parameters to motor synergies: a hierarchical framework for approximately-optimal control of redundant manipulators J Robot Syst 22 11 691 710 17710121 (Pubitemid 41684629)
87. M Tsodyks 1999 Attractor neural network models of spatial maps in hippocampus Hippocampus 9 4 481 489 10495029 1:STN:280:DyaK1Mvitlahsg%3D%3D (Pubitemid 29419634)
88. MA Umilta E Kohler V Gallesse L Fogassi L Fadiga C Keysers G Rizzolatti 2001 I know what you are doing. A neurophysiological study Neuron 31 155 165 11498058 1:STN:280:DC%2BD3MvltVyqtA%3D%3D (Pubitemid 32757096)
89. T Verschure PF Voegtlin RJ Douglas 2003 Environmentally mediated synergy between perception and behavior in mobile robots Nature 425 620 624 14534588 1:CAS:528:DC%2BD3sXnvV2hsL4%3D (Pubitemid 37280145)
90. ML Voytko DS Olton RT Richardson LK Gorman JR Tobin DL Price 1994 Basal forebrain lesions in monkeys disrupt attention but not learning and memory J Neurosci 14 167 186 8283232 1:STN:280:DyaK2c7htVymtg%3D%3D (Pubitemid 24022106)
91. C Weber S Wermter M Elshaw 2006 A hybrid generative and predictive model of the motor cortex Neural Netw 19 4 339 353 16352416 (Pubitemid 43850237)
92. DM Wolpert Z Ghahramani MI Jordan 1995 An internal model for sensorimotor integration Science 269 1880 1882 7569931 1:CAS:528:DyaK2MXotlKqtbw%3D
93. DM Wolpert K Doya M Kawato 2003 A unifying computational framework for motor control and social interaction Philos Trans R Soc Lond B Biol Sci 358 593 602 12689384 (Pubitemid 36380538)
94. F Wörgötter B Porr 2005 Temporal sequence learning, prediction, and control: a review of different models and their relation to biological mechanisms Neural Comput 17 2 245 319 15720770 (Pubitemid 40190477)