Mood as Representation of Momentum

Trends in Cognitive Sciences

Volumn 20, Issue 1, 2016, Pages 15-24

  Eldar, Eran ^a,b   Rutledge, Robb B ^a,b   Dolan, Raymond J ^a,b   Niv, Yael ^c  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

^b MAX PLANCK UCL CENTRE FOR COMPUTATIONAL PSYCHIATRY AND AGEING RESEARCH   (United Kingdom)

^c PRINCETON UNIVERSITY   (United States)

Author keywords

Decision making; Mood; Reinforcement learning

Indexed keywords

DECISION MAKING;

ADAPTIVE MECHANISM; MOOD; MOOD DISORDERS; REAL-WORLD PROBLEM; TWO-WAY INTERACTION;

REINFORCEMENT LEARNING;

ADAPTATION; ENVIRONMENTAL FACTOR; LEARNING; MOOD; MOOD DISORDER; OUTCOME ASSESSMENT; PERCEPTION; PROBLEM SOLVING; REINFORCEMENT; REVIEW; SELF CONCEPT; AFFECT; HUMAN; REWARD;

AFFECT; HUMANS; LEARNING; REINFORCEMENT (PSYCHOLOGY); REWARD;

EID: 84951774934     PISSN: 13646613     EISSN: 1879307X     Source Type: Journal    
DOI: 10.1016/j.tics.2015.07.010     Document Type: Review

References (80)

1. Simon G.E. Social and economic burden of mood disorders. Biol. Psychiatry 2003, 54:208-215.
2. Ferrari A.J., et al. Burden of depressive disorders by country, sex, age, and year: findings from the Global Burden of Disease Study 2010. PLoS Med. 2013, 10:e1001547.
3. King L.A., et al. Ghosts, UFOs, and magic: positive affect and the experiential system. J. Pers. Soc. Psychol. 2007, 92:905-919.
4. Madigan R.J., Bollenbach A.K. The effects of induced mood on irrational thoughts and views of the world. Cogn. Ther. Res. 1986, 10:547-562.
5. Thagard P. Why wasn't OJ convicted? Emotional coherence in legal inference. Cogn. Emot. 2003, 17:361-383.
6. Marsella, S., and Gratch, J. (2002) A step toward irrationality: using emotion to change belief. In Proceedings of the First International Joint Conference on Autonomous Agents and Multiagent Systems: Part 1, pp. 334-341.
7. Dayan P., Daw N.D. Decision theory, reinforcement learning, and the brain. Cogn. Affect. Behav. Neurosci. 2008, 8:429-453.
8. Niv Y. Reinforcement learning in the brain. J. Math. Psychol. 2009, 53:139-154.
9. Sutton R.S., Barto A.G. Introduction to Reinforcement Learning 1998, MIT Press.
10. Montague P.R., et al. Computational psychiatry. Trends Cogn. Sci. 2012, 16:72-80.
11. Huys Q.J., et al. Are computational models of any use to psychiatry?. Neural Netw. 2011, 24:544-551.
12. Wang X.J., Krystal J.H. Computational psychiatry. Neuron 2014, 84:638-654.
13. Westermann R., et al. Relative effectiveness and validity of mood induction procedures: a meta-analysis. Eur. J. Soc. Psychol. 1996, 26:557-580.
14. Mellers B.A., et al. Decision affect theory: emotional reactions to the outcomes of risky options. Psychol. Sci. 1997, 8:423-429.
15. Shepperd J.A., McNulty J.K. The affective consequences of expected and unexpected outcomes. Psychol. Sci. 2002, 13:85-88.
16. Oswald A.J., Wu S. Objective confirmation of subjective measures of human well-being. Science 2010, 327:576-579.
17. Cunningham M.R. Weather, mood, and helping behavior: quasi experiments with the sunshine samaritan. J. Pers. Soc. Psychol. 1979, 37:1947-1956.
18. Sloan L.R. The motives of sports fans. Sports, Games, and Play: Social and Psychological Viewpoints 1989, 175-240. Psychology Press. J.H. Goldstein (Ed.).
19. Csikszentmihalyi M., Larsen R. Validity and reliability of the experience sampling method. J. Nerv. Ment. Dis. 1987, 175:526-537.
20. Killingsworth M.A., Gilbert D.T. A wandering mind is an unhappy mind. Science 2010, 330:932.
21. Kahneman D., et al. A survey method for characterizing daily life experience: the day reconstruction method. Science 2004, 306:1776-1780.
22. Kahneman D., et al. When more pain is preferred to less: adding a better end. Psychol. Sci. 1993, 4:401-405.
23. Jahng S., et al. Analysis of affective instability in ecological momentary assessment: indices using successive difference and group comparison via multilevel modeling. Psychol. Methods 2008, 13:354-375.
24. Ebner-Priemer U.W., et al. State affective instability in borderline personality disorder assessed by ambulatory monitoring. Psychol. Med. 2007, 37:961-970.
25. Bylsma L.M., et al. Emotional reactivity to daily events in major and minor depression. J. Abnorm. Psychol. 2011, 120:155-167.
26. Rutledge R.B., et al. A neural and computational model of momentary subjective well-being. Proc. Natl. Acad. Sci. U.S.A. 2014, 111:12252-12257.
27. Schultz W., et al. A neural substrate of prediction and reward. Science 1997, 275:1593-1599.
28. Knutson B., Gibbs S.E. Linking nucleus accumbens dopamine and blood oxygenation. Psychopharmacology 2007, 191:813-822.
29. Hare T.A., et al. Dissociating the role of the orbitofrontal cortex and the striatum in the computation of goal values and prediction errors. J. Neurosci. 2008, 28:5623-5630.
30. Niv Y., et al. Neural prediction errors reveal a risk-sensitive reinforcement-learning process in the human brain. J. Neurosci. 2012, 32:551-562.
31. Cohen J.Y., et al. Neuron-type-specific signals for reward and punishment in the ventral tegmental area. Nature 2012, 482:85-88.
32. Pessiglione M., et al. Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans. Nature 2006, 442:1042-1045.
33. Caplin A., et al. Measuring beliefs and rewards: a neuroeconomic approach. Q. J. Econ. 2010, 125:923-960.
34. Rutledge R.B., et al. Dopaminergic modulation of decision making and subjective well-being. J. Neurosci. 2015, 35:9811-9822.
35. Mayer J.D., et al. Mood-congruent judgment is a general effect. J. Pers. Soc. Psychol. 1992, 63:119-132.
36. Headey B., Veenhoven R. Does happiness induce a rosy outlook?. How Harmful is Happiness? Consequences of Enjoying Life or Not 1989, 106-127. Universitaire Pers Rotterdam. R. Veenhoven (Ed.).
37. Kavanagh D.J., Bower G.H. Mood and self-efficacy: impact of joy and sadness on perceived capabilities. Cogn. Ther. Res. 1985, 9:507-525.
38. Eldar E., Niv Y. Interaction between emotional state and learning underlies mood instability. Nat. Commun. 2015, 6:6149.
39. Suslow T., et al. Neural correlates of affective priming effects based on masked facial emotion: an fMRI study. Psychiatry Res. 2013, 211:239-245.
40. Aïte A., et al. Impact of emotional context congruency on decision making under ambiguity. Emotion 2013, 13:177-182.
41. Dombrovski A.Y., et al. Reward signals, attempted suicide, and impulsivity in late-life depression. JAMA Psychiatry 2013, 70:1020-1030.
42. Vrieze E., et al. Reduced reward learning predicts outcome in major depressive disorder. Biol. Psychiatry 2013, 73:639-645.
43. Huys Q.J., et al. Mapping anhedonia onto reinforcement learning: a behavioural meta-analysis. Biol. Mood Anxiety Disord. 2013, 3:12.
44. Robinson O.J., et al. Stress increases aversive prediction error signal in the ventral striatum. Proc. Natl. Acad. Sci. U.S.A. 2013, 110:4129-4133.
45. Engelmann J.B., et al. Anticipatory anxiety disrupts neural valuation during risky choice. J. Neurosci. 2015, 35:3085-3099.
46. Parker R.M., et al. Housing conditions affect rat responses to two types of ambiguity in a reward-reward discrimination cognitive bias task. Behav. Brain Res. 2014, 274:73-83.
47. Isen A.M., Patrick R. The effect of positive feelings on risk taking: when the chips are down. Organ. Behav. Hum. Perf. 1983, 31:194-202.
48. Arkes H.R., et al. The role of potential loss in the influence of affect on risk-taking behavior. Organ. Behav. Hum. Dec. Proc. 1988, 42:181-193.
49. Bassi A., et al. 'O Sole Mio: an experimental analysis of weather and risk attitudes in financial decisions. Rev. Financ. Stud. 2013, 26:1824-1852.
50. Edmans A., et al. Sports sentiment and stock returns. J. Finance 2007, 62:1967-1998.
51. Wright W.F., Bower G.H. Mood effects on subjective probability assessment. Organ. Behav. Hum. Dec. Proc. 1992, 52:276-291.
52. Niv Y., et al. A normative perspective on motivation. Trends Cogn. Sci. 2006, 10:375-381.
53. Cools R., et al. Serotonin and dopamine: unifying affective, activational, and decision functions. Neuropsychopharmacology 2011, 36:98-113.
54. Somerville L.H., et al. Interactions between transient and sustained neural signals support the generation and regulation of anxious emotion. Cereb. Cortex 2013, 23:49-60.
55. Wang A.Y., et al. The dorsomedial striatum encodes net expected return, critical for energizing performance vigor. Nat. Neurosci. 2013, 16:639-647.
56. Huntsinger J.R. Does positive affect broaden and negative affect narrow attentional scope? A new answer to an old question. J. Exp. Psychol. Gen. 2012, 141:595-600.
57. Koo M., et al. Affective facilitation and inhibition of cultural influences on reasoning. Cogn. Emot. 2012, 26:680-689.
58. Huntsinger J.R., et al. The affective control of thought: malleable, not fixed. Psychol. Rev. 2014, 121:600-618.
59. Korn C.W., et al. Depression is related to an absence of optimistically biased belief updating about future life events. Psychol. Med. 2014, 44:579-592.
60. Huys Q.J., et al. Depression: a decision theoretic analysis. Annu. Rev. Neurosci. 2015, 38:1-23.
61. Watkins C., Dayan P. Q-learning. Mach. Learn. 1992, 8:279-292.
62. Lykken D., Tellegen A. Happiness is a stochastic phenomenon. Psychol. Sci. 1996, 7:186-189.
63. Brickman P., et al. Lottery winners and accident victims: is happiness relative?. J. Pers. Soc. Psychol. 1978, 36:917-927.
64. Gruber J., et al. A dark side of happiness? How, when, and why happiness is not always good. Perspect. Psychol. Sci. 2011, 6:222-233.
65. Nesse R.M. Natural selection and the elusiveness of happiness. Philos. Trans. R. Soc. Lond. B: Biol. Sci. 2004, 359:1333-1347.
66. Bari A., et al. Serotonin modulates sensitivity to reward and negative feedback in a probabilistic reversal learning task in rats. Neuropsychopharmacology 2010, 35:1290-1301.
67. Kuhnen C.M., Chiao J.Y. Genetic determinants of financial risk taking. PLoS ONE 2009, 4:e4362.
68. Hallfors D.D., et al. Which comes first in adolescence - sex and drugs or depression?. Am. J. Prev. Med. 2005, 29:163-170.
69. Becona E., et al. Pathological gambling and depression. Psychol. Rep. 1996, 78:635-640.
70. Crockford D.N., el-Guebaly N. Psychiatric comorbidity in pathological gambling: a critical review. Can. J. Psychiatry 1998, 43:43-50.
71. Brown L.K., et al. Depressive symptoms as a predictor of sexual risk among African American adolescents and young adults. J. Adolesc. Health 2006, 39:444.e1-444.e8.
72. Diener E., Diener C. Most people are happy. Psychol. Sci. 1996, 7:181-185.
73. Halek M., Eisenhauer J.G. Demography of risk aversion. J. Risk Insur. 2001, 68:1-24.
74. Harmer C.J. Serotonin and emotional processing: does it help explain antidepressant drug action?. Neuropharmacology 2008, 55:1023-1028.
75. Daw N.D., et al. Opponent interactions between serotonin and dopamine. Neural Netw. 2002, 15:603-616.
76. Cohen J.Y., et al. Serotonergic neurons signal reward and punishment on multiple timescales. eLife 2015, 4:e06346.
77. Dayan P., Long T. Statistical models of conditioning. Adv. Neural Inf. Process. Syst. 1998, 10:117-123.
78. Jordan M.I. Learning in Graphical Models 1999, MIT Press.
79. Daw N.D. Advanced reinforcement learning. Neuroeconomics 2014, 299-320. Academic Press. 2nd edn. P.W. Glimcher, E. Fehr (Eds.).
80. Bishop C.M. Pattern Recognition and Machine Learning 2006, Springer.