Vicarious Neural Processing of Outcomes during Observational Learning

PLoS ONE

Volumn 8, Issue 9, 2013, Pages

  Monfardini, Elisabetta ^a,b   Gazzola, Valeria ^c,d   Boussaoud, Driss ^e   Brovelli, Andrea ^e   Keysers, Christian ^c,d   Wicker, Bruno ^e,f  

^a LYON NEUROSCIENCE RESEARCH CENTER   (France)

^b Inst de Med Environnementale   (France)

^c UNIVERSITY MEDICAL CENTER GRONINGEN   (Netherlands)

^d NETHERLANDS INSTITUTE FOR NEUROSCIENCE   (Netherlands)

^e AIX MARSEILLE UNIVERSITY   (France)

^f UNIVERSIDAD DE BUENOS AIRES   (Argentina)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ANTERIOR INSULA; ARTICLE; BRAIN REGION; CONTROLLED STUDY; FEMALE; FRONTAL CORTEX; FUNCTIONAL MAGNETIC RESONANCE IMAGING; FUNCTIONAL NEUROIMAGING; HUMAN; HUMAN EXPERIMENT; LEARNING; MALE; MIRROR NEURON SYSTEM; NERVE CELL NETWORK; NORMAL HUMAN; OBSERVATIONAL LEARNING; POSTERIOR MEDIAL FRONTAL CORTEX; POSTERIOR SUPERIOR TEMPORAL SULCUS; SUPERIOR TEMPORAL SULCUS;

ADULT; BRAIN MAPPING; CEREBRAL CORTEX; COGNITION; FEMALE; HUMANS; LEARNING; MAGNETIC RESONANCE IMAGING; MALE; PHOTIC STIMULATION; PSYCHOMOTOR PERFORMANCE; YOUNG ADULT;

EID: 84883525774     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0073879     Document Type: Article

References (98)

1. Bandura A (1977) Social learning theory. Englewood Cliffs (NJ): Prentice-Hall.
2. Rendell L, Boyd R, Cownden D, Enquist M, Eriksson K, et al. (2010) Why copy others? Insights from the social learning strategies tournament. Science 328: 208-213.
3. Frith CD, Frith U, (2010) Mechanisms of Social Cognition. Annu Rev Psychol 63: 287-313.
4. Galef BG, Laland KN, (2005) Social learning in animals: empirical studies and theoretical models. Bio Sci 55: 489-499.
5. Heyes CM, Dawson GR, (1990) A demonstration of observational learning in rats using a bidirectional control. Q J Exp Psychol B 42: 59-71.
6. Range F, Viranyi Z, Huber L, (2007) Selective imitation in domestic dogs. Curr Biol 17: 868-872.
7. Biederman GB, Robertson HA, Vanayan M, (1986) Observational learning of two visual discriminations by pigeons: a within-subjects design. J Exp Anal Behav 46: 45-9.
8. Subiaul F, Cantlon JF, Holloway RL, Terrace HS, (2004) Cognitive imitation in rhesus macaques. Science 305: 407-410.
9. Meunier M, Monfardini E, Boussaoud D, (2007) Learning by observation in rhesus monkeys. Neurobiol Learn Mem 88: 243-248.
10. Chang SW, Winecoff AA, Platt ML, (2011) Vicarious reinforcement in rhesus macaques (macaca mulatta). Front Neurosci 5: 27.
11. Monfardini E, Gaveau V, Boussaoud D, Hadj-Bouziane F, Meunier M, (2012) Social learning as a way to overcome choice-induced preferences? Insights from humans and rhesus macaques. Front Neurosci 6: 127.
12. O'Doherty J, Dayan P, Schultz J, Deichmann R, Friston K, et al. (2004) Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science 304: 452-454.
13. Pessiglione M, Seymour B, Flandin G, Dolan RJ, Frith CD, (2006) Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans. Nature 442: 1042-1045.
14. Schultz W, (1998) Predictive reward signal of dopamine neurons. J Neurophysiol 80: 1-27.
15. Schultz W, Dickinson A, (2000) Neural coding of prediction errors. Annu Rev Neurosci 23: 473-500.
16. D'Ardenne K, McClure SM, Nystrom LE, Cohen JD, (2008) BOLD responses reflecting dopaminergic signals in the human ventral tegmental area Science. 319: 1264-1267.
17. Haruno M, Kawato M, (2006) Different neural correlates of reward expectation and reward expectation error in the putamen and caudate nucleus during stimulus- action-reward association learning. J Neurophysiol 95: 948-959.
18. Brovelli A, Laksiri N, Nazarian B, Meunier M, Boussaoud D, (2008) Understanding the neural computations of arbitrary visuomotor learning through fMRI and associative learning theory. Cereb Cortex 18: 1485-1495.
19. Quilodran R, Rothé M, Procyk E, (2008) Behavioral shifts and action valuation in the anterior cingulate cortex. Neuron 57: 314-25.
20. Burke CJ, Tobler PN, Baddeley M, Schultz W, (2010) Neural mechanisms of observational learning. Proc Natl Acad Sci 107: 14431-6.
21. Suzuki S, Harasawa N, Ueno K, Gardner JL, Ichinohe N, et al. (2012) Learning to simulate others' decisions. Neuron 74: 1125-37.
22. Rizzolatti G, Craighero L, (2004) The mirror-neuron system. Annu Rev Neurosci 27: 169-192.
23. Gazzola V, Keysers C, (2009) The observation and execution of actions share motor and somatosensory voxels in all tested subjects: single-subject analyses of unsmoothed fMRI data. Cereb Cortex 19: 1239-55.
24. Caspers S, Zilles K, Laird AR, Eickhoff SB, (2010) ALE meta-analysis of action observation and imitation in the human brain. Neuroimage 50: 1148-67.
25. Gallese V, Fadiga L, Fogassi L, Rizzolatti G, (1996) Action recognition in the premotor cortex. Brain 119: 593-609.
26. Fogassi L, Ferrari PF, Gesierich B, Rozzi S, Chersi F, et al. (2005) Parietal lobe: from action organization to intention understanding. Science 308: 662-7.
27. Rizzolatti G, Sinigaglia C, (2010) The functional role of the parieto-frontal mirror circuit: interpretations and misinterpretations. Nat Rev Neurosci 11: 264-274.
28. Brovelli A, Nazarian B, Meunier M, Boussaoud D, (2011) Differential roles of caudate nucleus and putamen during instrumental learning. NeuroImage 57: 1580-90.
29. Friston KJ, Holmes AP, Price CJ, Büchel C, Worsley KJ, (1999) Multisubject fMRI Studies and Conjunction Analysis. NeuroImage 10: 385-396.
30. Eickhoff SB, Stephan KE, Mohlberg H, Grefkes C, Fink GR, et al. (2005) A new SPM toolbox for combining probabilistic cytoarchitectonic maps and functional imaging data. NeuroImage 25: 1325-1335.
31. Lancaster JL, Woldorff MG, Parsons LM, Liotti M, Freitas CS, et al. (2000) Automated Talairach atlas labels for functional brain mapping. Hum Brain Mapp 10: 120-131.
32. Burnod Y, Baraduc P, Battaglia-Mayer A, Guigon E, Koechlin E, et al. (2001) The role of ventral and orbital prefrontal cortex in conditional visuomotor learning and strategy use in rhesus monkeys (Macaca mulatta). Behav Neurosci 115: 971-82. Erratum in: Behav Neurosci (2001) 115: 1317.
33. Culham JC, Valyear KF, (2006) Human parietal cortex in action. Curr Opin Neurobiol 16: 205-212.
34. Corbetta M, Shulman GL, (2002) Control of goal-directed and stimulus-driven attention in the brain. Nat Rev Neurosci 3: 201-215.
35. Wise SP, Murray EA, (2000) Arbitrary associations between antecedents and actions. Trends Neurosci 23: 271-276.
36. Suzuki W, Brown E, (2005) Behavioral and neurophysiological analyses of dynamic learning processes. Behav Cogn Neurosci Rev 4: 67-95.
37. Deiber MP, Wise SP, Honda M, Catalan MJ, Grafman J, et al. (1997) Frontal and parietal networks for conditional motor learning: a positron emission tomography study. J Neurophysiol 78: 977-991.
38. Eliassen JC, Souza T, Sanes JN, (2003) Experience-dependent activation patterns in human brain during visual-motor associative learning. J Neurosci 23: 10540-10547.
39. Law JR, Flanery MA, Wirth S, Yanike M, Smith AC, et al. (2005) Functional magnetic resonance imaging activity during the gradual acquisition and expression of paired- associate memory. J Neurosci 25: 5720-5729.
40. Yin HH, Knowlton BJ (2006) The role of the basal ganglia in habit formation. Nat Rev Neurosci: 7 464-476.
41. Balleine BW, Delgado MR, Hikosaka O, (2007) The role of the dorsal striatum in reward and decision-making. J Neurosci 27: 8161-8165.
42. Graybiel AM, (2008) Habits rituals and the evaluative brain. Annu Rev Neurosci 31: 359-387.
43. Yin HH, Ostlund SB, Balleine BW, (2008) Reward-guided learning beyond dopamine in the nucleus accumbens: the integrative functions of cortico-basal ganglia networks. Eur J Neurosci 28: 1437-1448.
44. Packard MG, (2009) Exhumed from thought: basal ganglia and response learning in the plus-maze. Behav Brain Res 199: 24-31.
45. White NM, (2009) Some highlights of research on the effects of caudate nucleus lesions over the past 200 years. Behav Brain Res 199: 3-23.
46. Balleine BW, O'Doherty JP, (2010) Human and rodent homologies in action control: corticostriatal determinants of goal-directed and habitual action. Neuropsychopharmacology 35: 48-69.
47. Ashby FG, Turner BO, Horvitz JC, (2010) Cortical and basal ganglia contributions to habit learning and automaticity. Trends Cogn Sci 14: 208-215.
48. Boettiger CA, D'Esposito M, (2005) Frontal networks for learning and executing arbitrary stimulus-response associations. J Neurosci 25: 2723-2732.
49. Seger CA, Cincotta CM, (2005) The roles of the caudate nucleus in human classification learning. J Neurosci 25: 2941-2951.
50. Delgado MR, Miller MM, Inati S, Phelps EA, (2005) An fMRI study of reward-related probability learning. NeuroImage 24: 862-873.
51. Galvan A, Hare TA, Davidson M, Spicer J, Glover G, et al. (2005) The role of ventral frontostriatal circuitry in reward-based learning in humans. J Neurosci 25: 8650-8656.
52. Grol MJ, de Lange FP, Verstraten FA, Passingham RE, Toni I, (2006) Cerebral changes during performance of overlearned arbitrary visuomotor associations. J Neurosci 26: 117-125.
53. Toni I, Passingham RE, (1999) Prefrontal-basal ganglia pathways are involved in the learning of arbitrary visuomotor associations: a PET study. Exp Brain Res 127: 19-32.
54. Toni I, Ramnani N, Josephs O, Ashburner J, Passingham RE, (2001) Learning arbitrary visuomotor associations: temporal dynamic of brain activity. NeuroImage 14: 1048-1057.
55. Tricomi EM, Delgado MR, Fiez JA, (2004) Modulation of caudate activity by action contingency. Neuron 41: 281-292.
56. Monfardini E, Brovelli A, Boussaoud D, Takerkart S, Wicker B, (2008) I learned from what you did: Retrieving visuomotor associations learned by observation. NeuroImage 42: 1207-13.
57. Gomez-Beldarrain M, Garcia-Monco JC, Rubio B, Pascual-Leone A, (1998) Effect of focal cerebellar lesion on procedural learning in the serial reaction time task. Exp Brain Res 120: 25-30.
58. Appollonio IM, Grafman J, Schwartz V, Massaquoi S, Hallett M, (1993) Memory in patients with cerebellar degeneration. Neurology 43: 1536-1544.
59. Pascual-Leone A, Grafman J, Clark K, Stewart M, Massaquoi S, et al. (1993) Procedural learning in Parkinson's disease and cerebellar degeneration. Annals of Neurology 34: 594-602.
60. Grafman J, Litvan I, Massaquoi S, Stewart M, Sirigu A, et al. (1992) Cognitive planning deficit in patients with cerebellar atrophy. Neurology 42: 493-1496.
61. Torriero S, Oliveri M, Koch G, Caltagirone C, et al. (2007) The what and how of observational learning. J Cogn Neurosci 19: 1656-1663.
62. Bussey TJ, Wise SP, Murray EA, (2001) The role of ventral and orbital prefrontal cortex in conditional visuomotor learning and strategy use in rhesus monkeys (Macaca mulatta). Behav Neurosci 115: 971-82. Erratum in: Behav Neurosci (2001) 115: 1317.
63. Genovesio A, Brasted PJ, Mitz AR, Wise SP, (2005) Prefrontal cortex activity related to abstract response strategies. Neuron 47: 307-20.
64. Vogt S, Buccino G, Wohlschläger AM, Canessa N, Shah NJ, et al. (2007) Prefrontal involvement in imitation learning of hand actions: effects of practice and expertise. NeuroImage 37: 1371-1383.
65. Buccino G, Vogt S, Ritzl A, Fink GR, Zilles K, et al. (2004) Neural circuits underlying imitation learning of hand actions: an event-related fMRI study. Neuron 42: 323-34.
66. Frey SH, Gerry VE, (2006) Modulation of neural activity during observational learning of actions and their sequential orders. J Neurosci 26: 13194-13201.
67. Cross ES, Kraemer DJ, Hamilton AF, Kelley WM, Grafton ST, (2009) Sensitivity of the action observation network to physical and observational learning. Cereb Cortex 19: 315-326.
68. Fabbri-Destro M, Rizzolatti G, (2008) Mirror neurons and mirror systems in monkeys and humans. Physiology (Bethesda) 23: 171-179.
69. Keysers C, Kohler E, Umiltà MA, Nanetti L, Fogassi L, et al. (2003) Audiovisual mirror neurons and action recognition. Exp Brain Res. 153: 628-36.
70. Radke S, de Langen FP, Ullsperger M, de Bruijn ER, (2011) Mistakes that affect others: an fMRI study on processing of own errors in a social context. Exp Brain Res 211: 405-413.
71. Mars RB, Coles MG, Grol MJ, Holroyd CB, Nieuwenhuis S, et al. (2005) Neural dynamics of error processing in medial frontal cortex. NeuroImage 28: 1007-1013.
72. Holroyd CB, Coles MG, (2002) The neural basis of human error processing: reinforcement learning dopamine and the error-related negativity. Psychol Rev 109: 679-709.
73. Ridderinkhof KR, Ullsperger M, Crone EA, Nieuwenhuis S, (2004) The role of the medial frontal cortex in cognitive control. Science 306: 443-447.
74. Ullsperger M, von Cramon DY, (2003) Error monitoring using external feedback: specific roles of the habenular complex, the reward system, and the cingulate motor area revealed by functional magnetic resonance imaging. J Neurosci. 23: 4308-14.
75. Yoshida K, Saito N, Iriki A, Isoda M, (2012) Social error monitoring in macaque frontal cortex. Nat Neurosci. 15: 1307-12.
76. Ullsperger M, Harsay HA, Wessel JR, Ridderinkhof KR, (2010) Conscious perception of errors and its relation to the anterior insula. Brain Struct Funct. 214: 629-43.
77. Klein TA, Neumann J, Reuter M, Hennig J, von Cramon DY, et al. (2007) Genetically determined differences in learning from errors. Science 318: 1642-5.
78. de Bruijn ER, de Lange FP, von Cramon DY, Ullsperger M, (2009) When errors are rewarding. J Neurosci 29: 12183-12186.
79. van Schie HT, Mars RB, Coles MG, Bekkering H, (2004) Modulation of activity in medial frontal and motor cortices during error observation. Nat Neurosci 7: 549-54.
80. Shane MS, Stevens M, Harenski CL, Kiehl KA, (2008) Neural correlates of the processing of another's mistakes: a possible underpinning for social and observational learning. NeuroImage 42: 450-459.
81. van der Helden J, Boksem MA, Blom JH, (2010) The importance of failure: feedback-related negativity predicts motor learning efficiency. Cereb Cortex 20: 1596-603.
82. Hester R, Barre N, Murphy K, Silk TJ, Mattingley JB, (2008) Human medial frontal cortex activity predicts learning from errors. Cereb Cortex 18: 1933-1940.
83. Jones EE, Nisbett RE (1971) The actor and the observer: Divergent Perceptions of the Causes of Behavior. New York: General Learning Press.
84. Nicolle A, Symmonds M, Dolan RJ, (2011) Optimistic biases in observational learning of value. Cognition 119: 394-402.
85. Pandya DN, Yeterian EH (1985) Architecture and connections of cortical association areas. In: Peters A, Jones EG, editors. Cerebral Cortex vol 4. New York: Plenum. 3-61.
86. Boussaoud D, Ungerleider LG, Desimone R, (1990) Pathways for motion analysis: cortical connections of the medial superior temporal and fundus of the superior temporal visual areas in the macaque. J Comp Neurol 296: 462-95.
87. Baizer JS, Ungerleider LG, Desimone R, (1991) Organization of visual inputs to the inferior temporal and posterior parietal cortex in macaques. J Neurosci 11: 168-190.
88. Saxe R, Xiao DK, Kovacs G, Perrett DI, Kanwisher N, (2004) A region of right posterior superior temporal sulcus responds to observed intentional actions. Neuropsychologia 42: 1435-1446.
89. Allison T, Puce A, McCarthy G, (2000) Social perception from visual cues: role of the STS region. Trends Cogn Sci 4: 267-278.
90. Tankersley D, Stowe CJ, Huettel SA, (2007) Altruism is associated with an increased neural response to agency. Nat Neurosci 10: 150-151.
91. Keysers C, Gazzola V, (2006) Towards a unifying neural theory of social cognition. Prog Brain Res 156: 379-401.
92. Rilling JK, Sanfey AG, Aronson JA, Nystrom LE, Cohen JD, (2004) The neural correlates of theory of mind within interpersonal interactions. NeuroImage 22: 1694-1703.
93. Frith CD, Frith U, (1999) Interacting minds-a biological basis. Science 286: 1692-1695.
94. Frith U, Frith CD, (2003) Development and neurophysiology of mentalizing. Philos Trans R Soc Lond B Biol Sci 358: 459-73.
95. Samson D, Apperly IA, Chiavarino C, Humphreys GW, (2004) The left temperoparietal junction is necessary for representing someone else's belief. Nat Neurosci 7: 449-500.
96. Saxe R, Kanwisher N, (2003) People thinking about thinking people. The role of the temporo-parietal junction in "theory of mind". NeuroImage 19: 1835-1842.
97. Toni I, Thoenissen D, Zilles K, (2001) Movement preparation and motor intention. NeuroImage 14: 110-7.
98. Iacoboni M, Koski LM, Brass M, Bekkering H, Woods RP, et al. (2001) Reafferent copies of imitated actions in the right superior temporal cortex. Proc Natl Acad Sci 98: 13995-9.