Toward a common theory for learning from reward, affect, and motivation: The SIMON framework

Frontiers in Systems Neuroscience

Volumn 7, Issue OCT, 2013, Pages

  Madan, Christopher R ^a  

^a UNIVERSITY OF ALBERTA   (Canada)

Author keywords

Affect; Arousal; Context; Emotion; Motivation; Movements; Reward; Valence

Indexed keywords

AFFECT; AMYGDALOID NUCLEUS; ANTERIOR CINGULATE; AROUSAL; BRAIN FUNCTION; CONCEPTUAL FRAMEWORK; CORPUS STRIATUM; DOPAMINERGIC SYSTEM; EMOTION; EXPERIMENTAL STUDY; FACIAL EXPRESSION; HUMAN; INSTRUMENTAL CONDITIONING; LEARNING; MEDICAL RESEARCH; MOTIVATION; MOTOR PERFORMANCE; NERVE CELL NETWORK; NERVE CELL STIMULATION; NEUROIMAGING; NEUROPHYSIOLOGY; NONHUMAN; PREFRONTAL CORTEX; REINFORCEMENT; REVIEW; REWARD; SENSORY STIMULATION; THEORY;

EID: 84887070063     PISSN: 16625137     EISSN: None     Source Type: Journal    
DOI: 10.3389/fnsys.2013.00059     Document Type: Review

References (62)

1. Balleine, B. W., and Dickinson, A. (1998). Goal-directed instrumental action: contingency and incentive learning and their cortical substrates. Neuropharmacology 37, 407-419. doi: 10.1016/S0028-3908(98)00033-1
2. Bechara, A., Damasio, H., Tranel, D., and Damasio, A. R. (2005). The Iowa Gambling Task and the somatic marker hypothesis: some questions and answers. Trends Cogn. Sci. 9, 159-162. doi: 10.1016/j.tics.2005.02.002
3. Bell, D. E. (1982). Regret in decision making under uncertainty. Oper. Res. 30, 961-981. doi: 10.1287/opre.30.5.961
4. Bell, D. E. (1985). Disappointment in decision making under uncertainty. Oper. Res. 33, 1-27. doi: 10.1287/opre.33.1.1
5. Berridge, K. C. (2004). Motivation concepts in behavioral neuroscience. Physiol. Behav. 81, 179-209. doi: 10.1016/j.physbeh.2004.02.004
6. Berridge, K. C., and Robinson, T. E. (1998). What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience? Brain Res. Rev. 28, 209-369. doi: 10.1016/S0165-0173(98)00019-8
7. Bradley, M. M., and Lang, P. J. (1999). "Affective norms for English words (ANEW): stimuli, instruction manual and affective ratings, " Technical Report C-1 (Gainesville, FL: University of Florida).
8. Bradley, M. M., Miccoli, L., Escrig, M. A., and Lang, P. J. (2008). The pupil as a measure of emotional arousal and autonomic activation. Psychophysiology 45, 602-607. doi: 10.1111/j.1469-8986.2008.00654.x
9. Brown, R. I. F. (1986). Arousal and sensation-seeking components in the general explanation of gambling and gambling addictions. Int. J. Addict. 21, 1001-1016.
10. Bryne, R. M. J. (2002). Mental models and counterfactual thoughts about what might have been. Trends Cogn. Sci. 6, 426-431. doi: 10.1016/S1364-6613(02)01974-5
11. Campbell, B. A., Wood, G., and McBride, T. (1997). "Origins of orienting and defense responses: an evolutionary perspective, " in Attention and Orienting: Sensory and Motivational Processes, eds P. J. Lang, R. F. Simmons, and M. T. Balaban, (Hillsdale, NJ: Lawrence Erlbaum Associates), 41-67.
12. Cardinal, R. N., Parkinson, J. A., Hall, J., and Everitt, B. J. (2002). Emotion and motivation: the role of the amygdala, ventral striatum, and prefrontal cortex. Neurosci. Biobehav. Rev. 26, 321-352. doi: 10.1016/S0149-7634(02)00007-6
13. Carver, C. S. (2006). Approach, avoidance, and the self-regulation of affect and action. Motiv. Emot. 30, 105-110. doi: 10.1007/s11031-006-9044-7
14. Cisek, P. (2012). Making decisions through a distributed consensus. Curr. Opin. Neurobiol. 22, 927-936. doi: 10.1016/j.conb.2012.05.007
15. Cisek, P., and Kalaska, J. F. (2010). Neural mechanisms for interacting with a world full of action choices. Annu. Rev. Neurosci. 33, 269-298. doi: 10.1146/annurev.neuro.051508.135409
16. Cooper, J. C., and Knutson, B. (2008). Valence and salience contribute to nucleus accumbens activation. Neuroimage 39, 538-547. doi: 10.1016/j.neuroimage.2007.08.009
17. Dixon, M. J., Harrigan, K. A., Sandhu, R., Collins, K., and Fugelsang, J. A. (2010). Losses disguised as wins in modern multi-line video slot machines. Addiction 105, 1819-1824. doi: 10.1111/j.1360-0443.2010.03050.x
18. Dodd, M. L., Klos, K. J., Bower, J. H., Geda, Y. E., Josephs, K. A., and Ahlskog, J. E. (2005). Pathological gambling caused by drugs used to treat parkinson disease. Arch. Neurol. 62, 1377-1381. doi: 10.1001/archneur.62.9.noc50009
19. d'Orsi, G., Demaio, V., and Specchio, L. M. (2011). Pathological gambling plus hypersexuality in Restless Legs Syndrome: a new case. Neurol. Sci. 32, 707-709. doi: 10.1007/s10072-011-0605-5
20. Elliot, A. J., and Covington, M. V. (2001). Approach and avoidance motivation. Educ. Psychol. Rev. 13, 73-92. doi: 10.1023/A:1009009018235
21. Eppinger, B., Schuck, N. W., Nystrom, L. E., and Cohen, J. D. (2013). Reduced striatal responses to reward prediction errors in older compared with younger adults. J. Neurosci. 33, 9905-9912. doi: 10.1523/JNEUROSCI.2942-12.2013
22. Estes, Z., and Adelman, J. S. (2008). Automatic vigilance for negative words in lexical decision and naming: comment on Larsen, Mercer, and Balota (2006). Emotion 8, 441-444. doi: 10.1037/1528-3542.8.4.441
23. Farrelly, M. C., Duke, J. C., Davis, K. C., Nonnemaker, J. M., Kamyab, K., Willett, J. G., et al. (2012). Promotion of smoking cessation with emotional and/or graphic antismoking advertising. Am. J. Prev. Med. 43, 475-482. doi: 10.1016/j.amepre.2012.07.023
24. Gibson, J. J. (1977). "The theory of affordances, " in Perceiving, Acting, and Knowing: Toward an Ecological Psychology, eds R. Shaw and J. Bransford (Hillsdale, NJ: Lawrence Erlbaum), 67-82.
25. Hare, T. A., Tottenham, N., Davidson, M. C., Glover, G. H., and Casey, B. J. (2005). Contributions of amygdala and striatal activity in emotion regulation. Biol. Psychiatry 57, 624-632. doi: 10.1016/j.biopsych.2004.12.038
26. Harmon-Jones, E., Gable, P. A., and Price, T. F. (2013). Does negative affect always narrow and positive affect always broaden the mind? Considering the influence of motivational intensity on cognitive scope. Curr. Dir. Psychol. 22, 301-307. doi: 10.1177/0963721413481353
27. Hekmat, H., and Vanian, D. (1971). Behavior modification through covert semantic desensitization. J. Consult Clin. Psychol. 36, 248-251. doi: 10.1037/h0030734
28. Hikosaka, O., Bromber-Martin, E., Hong, S., and Matsumoto, M. (2008). New insights on the subcortical representation of reward. Curr. Opin. Neurobiol. 18, 203-208. doi: 10.1016/j.conb.2008.07.002
29. Hollands, G. J., Prestwich, A., and Marteau, T. M. (2011). Using aversive images to enhance healthy food choices and implicit attitudes: an experimental test of evaluative conditioning. Health Psychol. 30, 195-203. doi: 10.1037/a0022261
30. Izard, C. E. (2010). The many meanings/aspects of emotion: definitions, functions, activation, and regulation. Emot. Rev. 2, 363-370. doi: 10.1177/1754073910374661
31. Jensen, J., Smith, A. J., Willeit, M., Crawley, A. P., Mikulis, D. J., Vitcu, I., et al. (2007). Separate brain regions code for salience vs. valence during reward prediction in humans. Hum. Brain Mapp. 28, 294-302. doi: 10.1002/hbm.20274
32. Kensinger, E. A., and Corkin, S. (2004). Two routes to emotional memory: distinct neural processes for valence and arousal. Proc. Natl. Acad. Sci. U.S.A. 101, 3310-3315. doi: 10.1073/pnas.0306408101
33. Kirkden, R. D., and Pajor, E. A. (2006). Using preference, motivation and aversion tests to ask scientific questions about animalsÕ feelings. Appl. Anim. Behav. Sci. 100, 29-47. doi: 10.1016/j.applanim.2006.04.009
34. Kirsch, I., Lynn, S. J., Vigorito, M., and Miller, R. R. (2004). The role of cognition in classical and operant conditioning. J. Clin. Psychol. 60, 369-392. doi: 10.1002/jclp.10251
35. Kleinginna, P. R. Jr., and Kleinginna, A. M. (1981a). A categorized list of emotion definitions, with suggestions for a consensual definition. Motiv. Emot. 5, 345-379. doi: 10.1007/BF00992553
36. Kleinginna, P. R. Jr., and Kleinginna, A. M. (1981b). A categorized list of motivation definitions, with a suggestion for a consensual definition. Motiv. Emot. 5, 263-291. doi: 10.1007/BF00993889
37. Lang, P. J. (2010). Emotion and motivation: toward consensus definitions and a common research purpose. Emot. Rev. 2, 229-233. doi: 10.1177/1754073910361984
38. Lang, P. J., and Bradley, M. M. (2010). Emotion and the motivational brain. Biol. Psychol. 84, 437-450. doi: 10.1016/j.biopsycho.2009.10.007
39. Lang, P. J., Bradley, M. M., and Cuthbert, B. N. (1998). Emotion, motivation, and anxiety: brain mechanisms and psychophysiology. Biol. Psychiatry 44, 1248-1263. doi: 10.1016/S0006-3223(98)00275-3
40. Lang, P. J., Bradley, M. M., and Cuthbert, B. N. (2008). "International affective picture system (IAPS): affective ratings of pictures and instruction manual, " Technical Report A-8(Gainesville, FL: University of Florida).
41. Litt, A., Plassmann, H., Shiv, B., and Rangel, A. (2011). Dissociating valuation and saliency signals during decision-making. Cereb. Cortex 21, 95-102. doi: 10.1093/cercor/bhq065
42. Ludvig, E. A., Madan, C. R., and Spetch, M. L. (2013). Extreme outcomes sway risky decisions from experience. J. Behav. Decis. Making. doi: 10.1002/bdm.1792
43. Madan, C. R., and Spetch, M. L. (2010). Is the enhancement of memory due to reward driven by value or salience? Acta Psychol. 139, 343-349. doi: 10.1016/j.actpsy.2011.12.010
44. Mather, M., and Knight, M. (2008). The emotional harbinger effect: poor context memory for cues that previously predicted something arousing. Emotion 8, 850-860. doi: 10.1037/a0014087
45. Mellers, B. A., Schwartz, A., Ho, K., and Ritov, I. (1997). Decision affect theory: emotional reactions to the outcomes of risky options. Psychol. Sci. 8, 423-429. doi: 10.1111/j.1467-9280.1997.tb00455.x
46. Panksepp, J. (2000). "Affective consciousness and the instinctual motor system: the neural sources of sadness and joy, " in The Caldron of Consciousness: Motivation, Affect, and Self-Organization, eds R. D. Ellis and N. Newton (Amsterdam: John Benjamins), 27-54.
47. Posner, J., Russell, J. A., Gerber, A., Gorman, D., Colibazzi, T., Yu, S., et al. (2009). The neurophysiological bases of emotion: an fmri study of the affective circumplex using emotion-denoting words. Hum. Brain Mapp. 30, 883-895. doi: 10.1002/hbm.20553
48. Rolls, E. T. (2000). Prècis of the brain and emotion. Behav. Brain Sci. 23, 177-234. doi: 10.1017/S0140525X00002429
49. Russell, J. A. (1980). A circumplex model of affect. J. Pers. Soc. Psychol. 39, 1161-1178. doi: 10.1037/h0077714
50. Schwarze, U., Bingel, U., and Sommer, T. (2012). Event-related nociceptive arousal enhances memory consolidation for neutral scenes. J. Neurosci. 32, 1481-1487. doi: 10.1523/JNEUROSCI.4497-11.2012
51. Sescousse, G., Caldú, X., Segura, B., and Dreher, J.-C. (2013). Processing of primary and secondary rewards: a quantitative meta-analysis and review of human functional neuroimaging studies. Neurosci. Biobehav. Rev. 37, 681-696. doi: 10.1016/j.neubiorev.2013.02.002
52. Steinberg, E. E., Keiflin, R., Boivin, J. R., Witten, I. B., Deisseroth, K., and Janak, P. H. (2013). A causal link between prediction errors, dopamine neurons and learning. Nat. Neurosci. 16, 966-972. doi: 10.1038/nn.3413
53. Trommershäuser, J., Maloney, L. T., and Landy, M. S. (2008). Decision making, movement planning and statistical decision theory. Trends Cogn. Sci. 12, 291-297. doi: 10.1016/j.tics.2008.04.010
54. Veling, H., Aarts, H., and Stroebe, W. (2011). Fear signals inhibit impulsive behavior toward rewarding food objects. Appetite 56, 643-648. doi: 10.1016/j.appet.2011.02.018
55. Warriner, A. B., Kuperman, V., and Brysbaert, M. (2013). Norms of valence, arousal, and dominance for 13,915 English lemmas. Behav. Res. doi: 10.3758/s13428-012-0314-x. [Epub ahead of print].
56. White, N. M. (1989). Reward or reinforcement: what's the difference? Neurosci. Biobehav. Rev. 13, 181-186. doi: 10.1016/S0149-7634(89)80028-4
57. Woergoetter, F., and Porr, B. (2008). Reinforcement learning. Scholarpedia J. 3:1448. doi: 10.4249/scholarpedia.1448
58. Wolpert, D. M., Ghahramani, Z., and Flanagan, J. R. (2001). Perspectives and problems in motor learning. Trends Cogn. Sci. 5, 487-494. doi: 10.1016/S1364-6613(00)01773-3
59. Yacubian, J., Gläscher, J., Schroeder, K., Sommer, T., Braus, D. F., and Büchel, C. (2006). Dissociable systems for gain-and loss-related value predictions and errors of prediction in the human brain. J. Neurosci. 26, 9530-9537. doi: 10.1523/JNEUROSCI.2915-06.2006
60. Yik, M., Russell, J. A., and Steiger, J. H. (2011). A 12-point circumplex structure of core affect. Emotion 11, 705-731. doi: 10.1037/a0023980
61. Young, P. T. (1959). The role of affective processes in learning and motivation. Psychol. Rev. 66, 104-125. doi: 10.1037/h0045997
62. Zink, C. F., Pagnoni, G., Martin-Skurski, M. E., Chappelow, J. C., and Berns, G. S. (2004). Human striatal response to monetary reward depend on saliency. Neuron 42, 509-517. doi: 10.1016/S0896-6273(04)00183-7