Frontal operculum temporal difference signals and social motor response learning

Human Brain Mapping

Volumn 30, Issue 5, 2009, Pages 1421-1430

  Kumar, Poornima ^a   Waiter, Gordon ^a   Ahearn, Trevor ^a   Milders, Maarten ^a   Reid, Ian ^a   Steele, J Douglas ^a,b  

^a UNIVERSITY OF ABERDEEN   (United Kingdom)

^b ROYAL CORNHILL HOSPITAL   (United Kingdom)

Author keywords

Computational biology; FMRI; Frontal operculum; Motor activity; Reinforcement; Social interaction; Ventral striatum

Indexed keywords

ADULT; AMYGDALOID NUCLEUS; ARTICLE; BIOLOGY; BRAIN REGION; CINGULATE GYRUS; COGNITION; CORPUS STRIATUM; DOPAMINERGIC SYSTEM; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; LEARNING; MALE; MOTOR ACTIVITY; NORMAL HUMAN; PREDICTION; PRIORITY JOURNAL; REINFORCEMENT; SIGNAL TRANSDUCTION; SOCIAL INTERACTION; TASK PERFORMANCE; THALAMUS;

ADULT; BRAIN MAPPING; CONDITIONING, CLASSICAL; CONDITIONING, OPERANT; FEMALE; FRONTAL LOBE; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; INTERPERSONAL RELATIONS; LEARNING; MAGNETIC RESONANCE IMAGING; MALE; MODELS, NEUROLOGICAL; NEUROPSYCHOLOGICAL TESTS; OXYGEN; PREDICTIVE VALUE OF TESTS; SIGNAL DETECTION, PSYCHOLOGICAL; YOUNG ADULT;

EID: 66149139277     PISSN: 10659471     EISSN: None     Source Type: Journal    
DOI: 10.1002/hbm.20611     Document Type: Article

References (44)

1. Adolphs R, Damasio H, Tranel D (2002): Neural systems for recognition of emotional prosody: A 3D lesion study. Emotion 2:23-51.
2. Berridge KC (2007): The debate over dopaminés role in reward: The case for incentive salience. Psychopharmacology (Berl) 191:391-431.
3. Daw ND, Kakade S, Dayan P (2002): Opponent interactions between serotonin and dopamine. Neural Netw 15:603-616.
4. Dayan P, Abbott LF (2001): Theoretical Neuroscience: Computational and Mathematical Modelling of Neural Systems. Cambridge, MA: The MIT Press.
5. Doya K, Sugimoto N, Wolpert DM, Kawato M (2003): Selecting optimal behaviours based on contexts. International Symposium on Emergent Mechanisms of Communication. Awaji. pp 19-23.
6. Eisenberger NI, Lieberman MD, Williams KD (2003): Does rejection hurt? An FMRI study of social exclusion. Science 302:290-292.
7. Friston K (2004): Introduction to statistical parametric mapping. In: Frackowiak RSJ, editor. Human Brain Function. London: Academic Press.
8. Frith U, Frith CD (2003): Development and neurophysiology of mentalizing. In: Frith CD, Wolpert DM, editors. The Neuroscience of Social Interaction. Oxford: Oxford University Press.
9. Gallese V (2003): The roots of empathy: The shared manifold hypothesis and the neural basis of intersubjectivity. Psychopathology 36:171-180.
10. Genovese CR, Lazar NA, Nichols T (2002): Thresholding of statistical maps in functional neuroimaging using the false discovery rate. Neuroimage 15:870-878.
11. Gobbini MI, Koralek AC, Bryan RE, Montgomery KJ, Haxby JV (2007): Two takes on the social brain: A comparison of theory of mind tasks. J Cogn Neurosci 19:1803-1814.
12. Iacoboni M, Molnar-Szakacs I, Gallese V, Buccino G, Mazziotta JC, Rizzolatti G (2005): Grasping the intentions of others with onés own mirror neuron system. PLoS Biol 3:e79.
13. Kapur S (2003): Psychosis as a state of aberrant salience: A framework linking biology, phenomenology, and pharmacology in schizophrenia. Am J Psychiatry 160:13-23.
14. King-Casas B, Tomlin D, Anen C, Camerer CF, Quartz SR, Montague PR (2005): Getting to know you: Reputation and trust in a two-person economic exchange. Science 308:78-83.
15. Lyons DE, Santos LR, Keil FC (2006): Reflections of other minds: How primate social cognition can inform the function of mirror neurons. Curr Opin Neurobiol 16:230-234.
16. McClure SM, Berns GS, Montague PR (2003a): Temporal prediction errors in a passive learning task activate human striatum. Neuron 38:339-346.
17. McClure SM, Daw ND, Montague PR (2003b): A computational substrate for incentive salience. Trends Neurosci 26:423-428.
18. Menon M, Jensen J, Vitcu I, Graff-Guerrero A, Crawley A, Smith MA, Kapur S. (2007): Temporal difference modeling of the bloodoxygen level dependent response during aversive conditioning in humans: Effects of dopaminergic modulation. Biol Psychiatry 62:765-772.
19. Montague PR (2006): Why Choose This Book? London: Penguin Books Ltd.
20. Montague PR, Dayan P, Sejnowski TJ (1996): A framework for mesencephalic dopamine systems based on predictive Hebbian learning. J Neurosci 16:1936-1947.
21. Montgomery KJ, Isenberg N, Haxby JV (2007): Communicative hand gestures and object-directed hand movements activate the mirror neuron system. Soc Cogn Affect Neurosci 2:114-122.
22. O'Doherty J, Dayan P, Schultz J, Deichmann R, Friston K, Dolan RJ (2004): Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science 304:452-454.
23. O'Doherty JP, Dayan P, Friston K, Critchley H, Dolan RJ (2003): Temporal difference models and reward-related learning in the human brain. Neuron 38:329-337.
24. O'Doherty JP, Buchanan TW, Seymour B, Dolan RJ (2006): Predictive neural coding of reward preference involves dissociable responses in human ventral midbrain and ventral striatum. Neuron 49:157-166.
25. O'Reilly RC, Braver TS, Cohen JD (1999): A biologically based computational model of working memory. In: Miyake A, Shah P, editors. Models of Working Memory: Mechanisms of Active Maintenance and Executive Control. Cambridge: Cambridge University Press. pp 375-441.
26. Paulus MP, Feinstein JS, Tapert SF, Liu TT (2004): Trend detection via temporal difference model predicts inferior prefrontal cortex activation during acquisition of advantageous action selection. Neuroimage 21:733-743.
27. Pessiglione M, Seymour B, Flandin G, Dolan RJ, Frith CD (2006): Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans. Nature 442:1042-1045.
28. Petrides M, Pandya DN (1994): Comparative architectonic analysis of the human and macaque frontal cortex. In: Boller F, Grafman J, editors. Handbook of Neuropsychology. Amsterdam: Elsevier Science B.V. pp 17-58.
29. Peyron R, Laurent B, Garcia-Larrea L (2000): Functional imaging of brain responses to pain. A review and meta-analysis (2000). Neurophysiol Clin 30:263-288.
30. Rescorla RA, Wagner AR (1972): A theory of pavlovian conditioning: variations in the effectiveness of reinforcement and nonreinforcement. In: Black AH, Prokasy WF, editors. Classical Conditioning. II. Current Research and Theory. New York: Appleton Century Crofts.
31. Schultz W (2002): Getting formal with dopamine and reward. Neuron 36:241-263.
32. Schultz W, Dickinson A (2000): Neuronal coding of prediction errors. Annu Rev Neurosci 23:473-500.
33. Seymour B, O'Doherty JP, Koltzenburg M, Wiech K, Frackowiak R, Friston K, Dolan R. (2005): Opponent appetitive-aversive neural processes underlie predictive learning of pain relief. Nat Neurosci 8:1234-1240.
34. Seymour B, Singer T, Dolan R (2007): The neurobiology of punishment. Nat Rev Neurosci 8:300-311.
35. Steele JD, Lawrie SM (2004): Segregation of cognitive and emotional function in the prefrontal cortex: A stereotactic metaanalysis. Neuroimage 21:868-875.
36. Sutton RS, Barto AG (1981): Towards a modern theory of adaptive networks: Expectation and prediction. Psychol Rev 88:135-170.
37. Sutton RS, Barto AG (1990): Time-derivitive models of pavlovian reinforcement. In: Gabriel M, Moore J, editors. Learning and Computational Neuroscience: Foundations of Adaptive Networks. Cambridge, MA: MIT Press. pp 497-537.
38. Sutton RS, Barto AG (1998): Reinforcement Learning. Cambridge, MA: MIT Press.
39. Tanaka SC, Doya K, Okada G, Ueda K, Okamoto Y, Yamawaki S (2004): Prediction of immediate and future rewards differentially recruits cortico-basal ganglia loops. Nat Neurosci 7:887-893.
40. Tesauro G (1995): Temporal difference learning and TD-Gammon. Commun ACM 38:58-68.
41. Tobler PN, O'Doherty JP, Dolan RJ, Schultz W (2006): Human neural learning depends on reward prediction errors in the blocking paradigm. J Neurophysiol 95:301-310.
42. Waelti P, Dickinson A, Schultz W (2001): Dopamine responses comply with basic assumptions of formal learning theory. Nature 412:43-48.
43. Williams KD, Cheung CK, Choi W (2000): Cyberostracism: Effects of being ignored over the Internet. J Pers Soc Psychol 79:748-762.
44. Wolpert DM, Doya K, Kawato M (2003): A unifying computational framework for motor control and social interaction. Philos Trans R Soc Lond B Biol Sci 358:593-602.