Action, Outcome, and Value: A Dual-System Framework for Morality

Personality and Social Psychology Review

Volumn 17, Issue 3, 2013, Pages 273-292

  Cushman, Fiery ^a  

^a BROWN UNIVERSITY   (United States)

Author keywords

dual system theory; emotion; morality; reasoning; reinforcement learning

Indexed keywords

EID: 84880419430     PISSN: 10888683     EISSN: None     Source Type: Journal    
DOI: 10.1177/1088868313495594     Document Type: Article

References (157)

1. Badre D.,Frank M. J.Mechanisms of hierarchical reinforcement learning in Cortio-Striatal circuits 2: Evidence from fMRI.Cerebral Cortex. 2012;22:527-536.
2. Baron J.Nonconsequentialist decisions.Behavioral & Brain Sciences. 1994;17:1-10.
3. Baron J.,Ritov I.Omission bias, individual differences, and normality.Organizational Behavior and Human Decision Processes. 2004;94:74-85.
4. Baron J.,Ritov I.Moral judgment and decision making. Bartels D. M.Bauman C. W.Skitka L. J.Medin D., ed. San Diego, CA: Academic Press; 2009:.
5. Baron J.,Spranca M.Protected values.Virology. 1997;70 (1): 1-16.
6. Bartels D.Principled moral sentiment and the flexibility of moral judgment and decision making.Cognition. 2008;108:381-417.
7. Bartels D.,Medin D. L.Are morally motivated decision makers insensitive to the consequences of their choices?.Psychological Science. 2007;18:24-28.
8. Barto A. G.,Mahadevan S.Recent advances in hierarchical reinforcement learning.Discrete Event Dynamic Systems. 2003;13:341-379.
9. Bayer H. M.,Glimcher P. W.Midbrain dopamine neurons encode a quantitative reward prediction error signal.Neuron. 2005;47:129-141.
10. Bellebaum C.,Jokisch D.,Gizewski E.,Forsting M.,Daum I.The neural coding of expected and unexpected monetary performance outcomes: Dissociations between active and observational learning.Behavioural Brain Research. 2012;227:241-251.
11. Bennis W. M.,Medin D. L.,Bartels D. M.The costs and benefits of calculation and moral rules.Perspectives on Psychological Science. 2010;5:187-202.
12. Biele G.,Rieskamp J.,Krugel L. K.,Heekeren H. R.The neural basis of following advice.PLoS Biology. 2011;9 (6): e1001089.
13. Bjorklund F.,Haidt J.,Murphy S.Moral dumbfounding: When intuition finds no reason.Lund Psychological Reports. 2000;2:1-23.
14. Blair K.,Morton J.,Leonard A.,Blair R. J. R.Impaired decision-making on the basis of both reward and punishment information in individuals with psychopathy.Personality and Individual Differences. 2006;41:155-165.
15. Blair R. J. R.A cognitive developmental approach to morality: Investigating the psychopath.Cognition. 1995;57:1-29.
16. Blair R. J. R.The amygdala and ventromedial prefrontal cortex in morality and psychopathy.Trends in Cognitive Sciences. 2007;11:387-392.
17. Blair R. J. R.,Colledge E.,Murray L.,Mitchell D.A selective impairment in the processing of sad and fearful expressions in children with psychopathic tendencies.Journal of Abnormal Child Psychology. 2001;29:491-498.
18. Blair R. J. R.,Jones L.,Clark F.,Smith M.The psychopathic individual: A lack of responsiveness to distress cues?.Psychophysiology. 1997;34:192-198.
19. Blair R. J. R.,Mitchell D.,Leonard A.,Budhani S.,Peschardt K.,Newman C.Passive avoidance learning in individuals with psychopathy: Modulation by reward but not by punishment.Personality and Individual Differences. 2004;37:1179-1192.
20. Borg J. S.,Hynes C.,Van Horn J.,Grafton S. T.,Sinnott-Armstrong W.Consequences, action, and intention as factors in moral judgments: An fMRI investigation.Journal of Cognitive Neuroscience. 2006;18:803-837.
21. Bornstein A. M.,Daw N. D.Multiplicity of control in the basal ganglia: Computational roles of striatal subregions.Current Opinion in Neurobiology. 2011;21:374-380.
22. Botvinick M. M.,Braver T. S.,Barch D. M.,Carter C. S.,Cohen J.Conflict monitoring and cognitive control.Psychological Review. 2001;108:624-652.
23. Chomsky N.Syntactic structures. The Hague, Netherlands: Mouton; 1957:.
24. Ciaramelli E.,Muccioli M.,Ladavas E.,di Pellegrino G.Selective deficit in personal moral judgment following damage to ventromedial prefrontal cortex.Social Cognitive Affective Neuroscience. 2007;2:84-92.
25. Conway P.,Gawronski B.Deontological versus utilitarian inclinations in moral decision-making: A process dissociation approach.Journal of Personality and Social Psychology. 2013;104:216-235.
26. Cools R.,Robinson O. J.,Sahakian B.Acute tryptophan depletion in healthy volunteers enhances punishment prediction but does not affect reward prediction.Neuropsychopharmacology. 2007;33:2291-2299.
27. Cools R.,Sheridan M.,Jacobs E.,D'Esposito M.Impulsive personality predicts dopamine-dependent changes in frontostriatal activity during component processes of working memory.Journal of Neuroscience. 2007;27:5506-5514.
28. Cooper J. C.,Dunne S.,Furey T.,O'Doherty J. P.Human dorsal striatum encodes prediction errors during observational learning of instrumental actions.Journal of Cognitive Neuroscience. 2012;24:106-118.
29. Courville A. C.,Daw N. D.,Touretzky D. S.Bayesian theories of conditioning in a changing world.Trends in Cognitive Sciences. 2006;10:294-300.
30. Crockett M. J.,Clark L.,Hauser M.,Robbins T.Serotonin selectively influences moral judgment and behavior through effects on harm aversion.Proceedings of the National Academy of Sciences. 2010;107:17433-17438.
31. Crockett M. J.,Clark L.,Robbins T. W.Reconciling the role of serotonin in behavioral inhibition and aversion: Acute tryptophan depletion abolishes punishment-induced inhibition in humans.Journal of Neuroscience. 2009;29:11993-11999.
32. Cushman F. A.,Gray K.,Gaffey A.,Mendes W.Simulating murder: The aversion to harmful action.Emotion. 2012;12:2-7.
33. Cushman F. A.,Greene J. D.The social psychology of morality: Exploring the causes of good and evil. Mikulincer M.Shaver P. R., ed. Washington, DC: APA Press; 2011:33-50.
34. Cushman F. A.,Greene J. D.Finding faults: How moral dilemmas illuminate cognitive structure.Social Neuroscience. 2012;7:269-279.
35. Cushman F. A.,Murray D.,Gordon-McKeon S.,Wharton S.,Greene J. D.Judgment before principle: Engagement of the frontoparietal control network in condemning harms of omission.Social Cognitive and Affective Neuroscience. 2012;7:888-895.
36. Cushman F. A.,Young L.Patterns of moral judgment derive from nonmoral psychological representations.Cognitive Science. 2011;35:1052-1075.
37. Cushman F. A.,Young L.,Greene J. D.The Oxford handbook of moral psychology. Doris J. M.Group T. M. P. R., ed. New York, NY: Oxford University Press; 2010:47-71.
38. Cushman F. A.,Young L.,Hauser M. D.The role of conscious reasoning and intuition in moral judgment: Testing three principles of harm.Psychological Science. 2006;17:1082-1089.
39. Daw N.,Doya K.The computational neurobiology of learning and reward.Current Opinion in Neurobiology. 2006;16:199-204.
40. Daw N.,Shohamy D.The cognitive neuroscience of motivation and learning.Social Cognition. 2008;26:593-620.
41. Dayan P.How to set the switches on this thing.Current Opinion in Neurobiology. 2012;22:1068-1074.
42. Dayan P.,Niv Y.Reinforcement learning: The good, the bad and the ugly.Current Opinion in Neurobiology. 2008;18:185-196.
43. Delgado M. R.,Jou R. L.,Phelps E. A.Neural systems underlying aversive conditioning in humans with primary and secondary reinforcers.Frontiers in Neuroscience. 2011;5:71.
44. DeScioli P.,Bruening R.,Kurzban R.The omission effect in moral cognition: Toward a functional explanation.Evolution & Human Behavior. 2011;32:204-215.
45. DeScioli P.,Christner J.,Kurzban R.The omission strategy.Psychological Science. 2011;22:442-446.
46. Dickinson A.,Balleine B.,Watt A.,Gonzalez F.,Boakes R. A.Motivational control after extended instrumental training.Learning & Behavior. 1995;23:197-206.
47. Dietterich T. G.Hierarchical reinforcement learning with the MAXQ value function decomposition.Journal of Artificial Intelligence Research. 2000;13:227-303.
48. Ditto P. H.,Liu B.The social psychology of morality: Exploring the causes of good and evil. Mikulincer M.Shaver P. R., ed. Washington, DC: APA Press; 2011:51-70.
49. Doll B. B.,Hutchison K. E.,Frank M. J.Dopaminergic genes predict individual differences in susceptibility to confirmation bias.Journal of Neuroscience. 2011;31:6188-6198.
50. Doll B. B.,Jacobs W. J.,Sanfey A. G.,Frank M. J.Instructional control of reinforcement learning: A behavioral and neurocomputational investigation.Brain Research. 2009;1299:74-94.
51. Epstein S.Integration of the cognitive and the psychodynamic unconscious.American Psychologist. 1994;49:709-724.
52. Fiorillo C. D.,Tobler P. N.,Schultz W.Discrete coding of reward probability and uncertainty by dopamine neurons.Science. 2003;299:1898-1902.
53. Fiske A. P.Relational models theory: A contemporary overview. Haslam N., ed. Mahwah, NJ: Lawrence Erlbaum; 2004:57-142.
54. Fiske A. P.,Tetlock P. E.Political psychology: Cultural and crosscultural foundations. Renshon S. A.Duckitt J., ed. London, England: Macmillan; 2000:47-65.
55. Fliessbach K.,Weber B.,Trautner P.,Dohmen T.,Sunde U.,Elger C. E.,Falk A.Social comparison affects reward-related brain activity in the human ventral striatum.Science. 2007;318:1305-1308.
56. Foot P.The problem of abortion and the doctrine of double effect.Oxford Review. 1967;5:5-15.
57. Frank M. J.,Badre D.Mechanisms of hierarchical reinforcement learning in cortio-striatal circuits 1: Computational analysis.Cerebral Cortex. 2012;22:509-526.
58. Frank M. J.,Loughry B.,O'Reilly R. C.Interactions between frontal cortex and basal ganglia in working memory: A computational model.Cognitive, Affective, & Behavioral Neuroscience. 2001;1:137-160.
59. Frank M. J.,Seeberger L. C.,O'Reilly R. C.By carrot or by stick: Cognitive reinforcement learning in parkinsonism.Science. 2004;306:1940-1943.
60. Glascher J.,Daw N.,Dayan P.,O'Doherty J. P.States versus rewards: Dissociable neural prediction error signals underlying model-based and model-free reinforcement learning.Neuron. 2010;66:585-595.
61. Goldman A.The individuation of action.Journal of Philosophy. 1971;68:761-774.
62. Graham J.,Haidt J.,Nosek B.Liberals and conservatives use different sets of moral foundations.Journal of Personality and Social Psychology. 2009;96:1029-1046.
63. Graybiel A. M.The basal ganglia and chunking of action repertoires.Neurobiology of Learning and Memory. 1998;70:119-136.
64. Graybiel A. M.Habits, rituals, and the evaluative brain.Annual Review of Neuroscience. 2008;31:359-387.
65. Greene J. D.The secret joke of Kant's soul Moral psychology. Sinnott-Armstrong W., ed. Cambridge, MA: MIT Press; 2007:35-80.
66. Greene J. D.,Cushman F. A.,Stewart L. E.,Lowenberg K.,Nystrom L. E.,Cohen J. D.Pushing moral buttons: The interaction between personal force and intention in moral judgment.Cognition. 2009;111:364-371.
67. Greene J. D.,Morelli S. A.,Lowenberg K.,Nystrom L. E.,Cohen J. D.Cognitive load selectively interferes with utilitarian moral judgment.Cognition. 2008;107:1144-1154.
68. Greene J. D.,Nystrom L. E.,Engell A. D.,Darley J. M.,Cohen J. D.The neural bases of cognitive conflict and control in moral judgment.Neuron. 2004;44:389-400.
69. Greene J. D.,Sommerville R. B.,Nystrom L. E.,Darley J. M.,Cohen J. D.An fMRI investigation of emotional engagement in moral judgment.Science. 2001;293:2105-2108.
70. Gregg M. E.,James J. E.,Matyas T. A.,Thorsteinsson E. B.Hemodynamic profile of stress-induced anticipation and recovery.International Journal of Psychophysiology. 1999;34:147-162.
71. Gruber A. J.,Dayan P.,Gutkin B. S.,Solla S. A.Dopamine modulation in the basal ganglia locks the gate to working memory.Journal of Computational Neuroscience. 2006;20:153-166.
72. Guitart-Masip M.,Fuentemilla L.,Bach D. R.,Huys Q. J. M.,Dayan P.,Dolan R. J.,Duzel E.Action dominates valence in anticipatory representations in the human striatum and dopaminergic midbrain.Journal of Neuroscience. 2011;31:7867-7875.
73. Haidt J.The emotional dog and its rational tail: A social intuitionist approach to moral judgment.Psychological Review. 2001;108:814-834.
74. Haidt J.,Hersh M. A.Sexual morality: The cultures and emotions of conservatives and liberals.Journal of Applied Social Psychology. 2001;31:191-221.
75. Haidt J.,Koller S. H.,Dias M. G.Affect, culture, and morality, or is it wrong to eat your dog?.Journal of Personality and Social Psychology. 1993;65:613-628.
76. Hauser M. D.,Cushman F. A.,Young L.,Jin R.,Mikhail J. M.A dissociation between moral judgment and justification.Mind & Language. 2007;22:1-21.
77. Hikida T.,Kimura K.,Wada N.,Funabiki K.,Nakanishi S.Distinct roles of synaptic transmission in direct and indirect striatal pathways to reward and aversive behavior.Neuron. 2010;66:896-907.
78. Hood B. M.,Donnelly K.,Leonards U.,Bloom P.Implicit voodoo: Electrodermal activity reveals a susceptibility to sympathetic magic.Journal of Cognition and Culture. 2010;10:391-399.
79. Hooker C. I.,Verosky S. C.,Miyakawa A.,Knight R. T.,D'Esposito M.The influence of personality on neural mechanisms of observational fear and reward learning.Neuropsychologia. 2008;46:2709-2724.
80. Houk J. C.,Adams J. L.,Barto A. G.Models of information processing in the basal ganglia. Houk J. C.Davis J. L.Beiser D. G., ed. Cambridge, MA: MIT Press; 1995:249-270.
81. Huebner B.,Dwyer S.,Hauser M.The role of emotion in moral psychology.Trends in Cognitive Sciences. 2009;13:1-6.
82. Hume D.Selby-Bigge L.Nidditch P. H., ed. 1978:.
83. Izuma K.,Saito D. N.,Sadato N.Processing of the incentive for social approval in the ventral striatum during charitable donation.Journal of Cognitive Neuroscience. 2010;22:621-631.
84. Kahane G.,Wiech K.,Shackel N.,Farias M.,Savulescu J.,Tracey I.The neural basis of intuitive and counterintuitive moral judgment.Social Cognitive and Affective Neuroscience. 2012;7:393-402.
85. Kahneman D.Thinking, fast and slow. New York, NY: Farrar, Straus & Giroux; 2011:.
86. Kamm F. M.Morality, mortality: Death and whom to save from it. New York, NY: Oxford University Press; 1998:.
87. Kant I.Foundations of the metaphysics of morals. New York, NY: Macmillan; 1959:.
88. Kant I.On a supposed right to lie because of philanthropic concerns. Indianapolis, IN: Hackett; 1983:.
89. King L. A.,Burton C. M.,Hicks J. A.,Drigotas S. M.Ghosts, UFOs, and magic: Positive affect and the experiential system.Journal of Personality and Social Psychology. 2007;92 (5): 905-919.
90. Koenigs M.,Young L.,Adolphs R.,Tranel D.,Cushman F.,Hauser M.,Damasio A.Damage to the prefrontal cortex increases utilitarian moral judgements.Nature. 2007;446:908-911.
91. Kravitz A. V.,Tye L. D.,Kreitzer A. C.Distinct roles for direct and indirect pathway striatal neurons in reinforcement.Nature Neuroscience. 2012;15:816-818.
92. Kvaran T.,Sanfey A. G.Toward an integrated neuroscience of morality: The contribution of neuroeconomics to moral cognition.Topics in Cognitive Science. 2010;2:579-595.
93. Lashley K. S.The problem of serial order in behavior. New York, NY: John Wiley; 1951:.
94. Li J.,Delgado M. R.,Phelps E. A.How instructed knowledge modulates the neural systems of reward learning.Proceedings of the National Academy of Sciences. 2011;108:55-60.
95. Lieberman D.,Lobel T.Kinship on the Kibbutz: Coresidence duration predicts altruism, personal sexual aversions and moral attitudes among communally reared peers.Evolution & Human Behavior. 2012;33:26-34.
96. Lieberman D.,Tooby J.,Cosmides L.Does morality have a biological basis? An empirical test of the factors governing moral sentiments relating to incest.Proceedings of the Royal Society of London. Series B: Biological Sciences. 2003;270:819-826.
97. Lieberman D.,Tooby J.,Cosmides L.The architecture of human kin detection.Nature. 2007;445:727-731.
98. Lin A.,Adolphs R.,Rangel A.Social and monetary reward learning engage overlapping neural substrates.Social Cognitive and Affective Neuroscience. 2012;7:274-281.
99. Lohrenz T.,McCabe K.,Camerer C. F.,Montague P. R.Neural signature of fictive learning signals in a sequential investment task.Proceedings of the National Academy of Sciences. 2007;104:9493-9498.
100. Mandel D. R.,Vartanian O.Taboo or tragic: Effect of tradeoff type on moral choice, conflict, and confidence.Mind & Society. 2008;7:215-226.
101. McClure S. M.,Berns G. S.,Montague P. R.Temporal prediction errors in a passive learning task activate human striatum.Neuron. 2003;38:339-346.
102. McIntyre A.The double life of double effect.Theoretical medicine and bioethics. 2004;25:61-74.
103. McNab F.,Klingberg T.Prefrontal cortex and basal ganglia control access to working memory.Nature Neuroscience. 2007;11:103-107.
104. Mendes W.,Blascovich J.,Hunter S.,Lickel B.,Jost J.Threatened by the unexpected: Physiological responses during social interactions with expectancy-violating partners.Journal of Personality and Social Psychology. 2007;92:698-716.
105. Mendez M. F.,Anderson E.,Shapria J. S.An investigation of moral judgment in frontotemporal dementia.Cognitive and Behavioral Neurology. 2005;18:193-197.
106. Mikhail J. M.Rawls' linguistic analogy: A study of the "generative grammar" model of moral theory described by John Rawls in "A theory of justice". Ithaca, NY: Cornell University; 2000:.
107. Miller E. K.,Cohen J. D.An integrative theory of prefrontal cortex function.Annual Review of Neuroscience. 2001;24:167-202.
108. Miller G. A.The magical number seven, plus or minus two: Some limits on our capacity for processing information.Psychological Review. 1956;63:81-97.
109. Miller R.,Cushman F. A.Tough for me, wrong for you: First-person behavioral aversions underlie the moral condemnation of harm.Social & Personality Psychology Compass. in press;:.
110. Miller R.,Hannikainan I.,Cushman F.Bad actions or bad outcomes? Differentiating affective contributions to the moral condemnation of harm. 2013;:.
111. Moll J.,De Oliveira-Souza R.,Zahn R.The neural basis of moral cognition.Annals of the New York Academy of Sciences. 2008;1124:161-180.
112. Moll J.,Zahn R.,de Oliveira-Souza R.,Krueger F.,Grafman J.The neural basis of human moral cognition.Nature Reviews Neuroscience. 2005;6:799-809.
113. Montague P. R.,Dayan P.,Sejnowski T. J.A framework for mesencephalic dopamine systems based on predictive Hebbian learning.Journal of Neuroscience. 1996;16:1936-1947.
114. Moore A.,Clark B.,Kane M.Who shalt not kill? Individual differences in working memory capacity, executive control, and moral judgment.Psychological Science. 2008;19:549-557.
115. Moretto G.,Ladavas E.,Mattioli F.,di Pellegrino G.A psychophysiological investigation of moral judgment after ventromedial prefrontal damage.Journal of Cognitive Neuroscience. 2010;22:1888-1899.
116. Morris G.,Nevet A.,Arkadir D.,Vaadia E.,Bergman H.Midbrain dopamine neurons encode decisions for future action.Nature Neuroscience. 2006;9:1057-1063.
117. Nucci L.,Turiel E.God's word, religious rules, and their relation to Christian and Jewish children's concepts of morality.Child Development. 1993;64:1475-1491.
118. Nucci L. P.,Gingo M.The Wiley Blackwell handbook of childhood cognitive development. Goswami U., ed. Malden, MA: Wiley-Blackwell; 2010:420-445.
119. Olsson A.,Nearing K. I.,Phelps E. A.Learning fears by observing others: The neural systems of social fear transmission.Social Cognitive and Affective Neuroscience. 2007;2:3-11.
120. Olsson A.,Phelps E. A.Learned fear of "unseen" faces after Pavlovian, observational, and instructed fear.Psychological Science. 2004;15:822-828.
121. Olsson A.,Phelps E. A.Social learning of fear.Nature Neuroscience. 2007;10:1095-1102.
122. Otto A. R.,Gershman S. J.,Markman A. B.,Daw N. D.The curse of planning: Dissecting multiple reinforcement learning systems by taxing the central executive.Psychological Science. 2013;:.
123. O'Doherty J.,Dayan P.,Schultz J.,Deichmann R.,Friston K.,Dolan R. J.Dissociable roles of ventral and dorsal striatum in instrumental conditioning.Science. 2004;304:452-454.
124. O'Doherty J. P.,Dayan P.,Friston K.,Critchley H.,Dolan R. J.Temporal difference models and reward-related learning in the human brain.Neuron. 2003;38:329-337.
125. O'Reilly R. C.,Frank M. J.Making working memory work: A computational model of learning in the prefrontal cortex and basal ganglia.Neural Computation. 2006;18:283-328.
126. Parr R.,Russell S.Advances in neural information processing systems. Jordan M.Kearns M.Solla S., ed. Cambridge, MA: MIT Press; 1998:1043-1049.
127. Patt A.,Zeckhauser R.Action bias and environmental decisions.Journal of Risk and Uncertainty. 2000;21:45-72.
128. Paxton J. M.,Greene J. D.Moral reasoning: Hints and allegations.Topics in Cognitive Science. 2010;2:511-527.
129. Paxton J. M.,Ungar L.,Greene J. D.Reflection and reasoning in moral judgment.Cognitive Science. 2012;36:163-177.
130. Pizarro D. A.,Bloom P.The intelligence of the moral intuitions: Comment on Haidt (2001).Psychological Review. 2003;110:193-196.
131. Rescorla R. A.,Wagner A. R.Classical conditioning II: Current research and theory. Black A. H.Prokasy W. F., ed. New York, NY: Appleton-Century-Crofts; 1972:64-99.
132. Ribas-Fernandes J. Ú. J. F.,Solway A.,Diuk C.,McGuire J. T.,Barto A. G.,Niv Y.,Botvinick M. M.A neural signature of hierarchical reinforcement learning.Neuron. 2011;71:370-379.
133. Ritov I. I.,Baron J.Protected values and omission bias.Organizational Behavior and Human Decision Process. 1999;79:79-94.
134. Roesch M. R.,Calu D. J.,Schoenbaum G.Dopamine neurons encode the better option in rats deciding between differently delayed or sized rewards.Nature Neuroscience. 2007;10:1615-1624.
135. Royzman E.,Baron J.The preference for indirect harm.Social Justice Research. 2002;15:165-184.
136. Rozin P.,Millman L.,Nemeroff C.Operation of the laws of sympathetic magic in disgust and other domains.Journal of Personality and Social Psychology. 1986;50:703-712.
137. Samejima K.,Ueda Y.,Doya K.,Kimura M.Representation of action-specific reward values in the striatum.Science. 2005;310:1337-1340.
138. Saslow L. R.,Willer R.,Feinberg M.,Piff P. K.,Clark K.,Keltner D.,Saturn S. R.My brother's keeper? Compassion predicts generosity more among less religious individuals.Social Psychological & Personality Science. 2012;:.
139. Schultz W.,Dayan P.,Montague P. R.A neural substrate of prediction and reward.Science. 1997;275:1593-1599.
140. Schultz W.,Dickinson A.Neuronal coding of prediction errors.Annual Review of Neuroscience. 2000;23:473-500.
141. Seymour B.,O'Doherty J. P.,Dayan P.,Koltzenburg M.,Jones A. K.,Dolan R. J.,Frackowiak R. S.Temporal difference models describe higher-order learning in humans.Nature. 2004;429:664-667.
142. Sloman S.The empirical case for two systems of reasoning.Psychological Bulletin. 1996;119:3-22.
143. Spranca M.,Minsk E.,Baron J.Omission and commission in judgment and choice.Journal of Experimental Social Psychology. 1991;27:76-105.
144. Stanovich K. E.,West R. F.Individual differences in reasoning: Implications for the rationality debate?.Behavioral & Brain Sciences. 2000;23:645-665.
145. Suter R. S.,Hertwig R.Time and moral judgment.Cognition. 2011;119:454-458.
146. Sutton R. S.Learning to predict by the methods of temporal differences.Machine Learning. 1988;3 (1): 9-44.
147. Sutton R. S.,Barto A.Reinforcement learning.Journal of Cognitive Neuroscience. 1999;11:126-134.
148. Takahashi H.,Kato M.,Matsuura M.,Mobbs D.,Suhara T.,Okubo Y.When your gain is my pain and your pain is my gain: Neural correlates of envy and schadenfreude.Science. 2009;323:937-939.
149. Tetlock P. E.Thinking the unthinkable: Sacred values and taboo cognitions.Trends in Cognitive Science. 2003;7:320-324.
150. Thomson J. J.The trolley problem.The Yale Law Journal. 1985;94:1395-1415.
151. Tremblay R.The development of aggressive behavior during childhood: What have we learned in the past century?.International Journal of Behavioral Development. 2000;24:129-141.
152. Trémolière B.,De Neys W.,Bonnefon J.-F.Mortality salience and morality: Thinking about death makes people less utilitarian.Cognition. 2012;124:379-384.
153. Valdesolo P.,DeSteno D.Manipulations of emotional context shape moral judgment.Psychological Science. 2006;17:476-477.
154. Waldmann M. R.,Dieterich J. H.Throwing a bomb on a person versus throwing a person on a bomb intervention myopia in moral intuitions.Psychological Science. 2007;18:247-253.
155. Yin H. H.,Knowlton B.,Balleine B.Lesions of dorsolateral striatum preserve outcome expectancy but disrupt habit formation in instrumental learning.European Journal of Neuroscience. 2004;19:181-189.
156. Yin H. H.,Ostlund S. B.,Balleine B. W.Reward-guided learning beyond dopamine in the nucleus accumbens: The integrative functions of cortico-basal ganglia networks.European Journal of Neuroscience. 2008;28:1437-1448.
157. Young L.,Koenigs M.Investigating emotion in moral cognition: A review of evidence from functional neuroimaging and neuropsychology.British Medical Bulletin. 2007;84:69-79.