Deciding How To Decide: Self-Control and Meta-Decision Making

Trends in Cognitive Sciences

Volumn 19, Issue 11, 2015, Pages 700-710

  Boureau, Y Lan ^a   Sokol Hessner, Peter ^a   Daw, Nathaniel D ^a  

^a NEW YORK UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BEHAVIORAL RESEARCH; OPTIMIZATION;

COGNITIVE EFFORTS; DECISION VARIABLES; EXECUTIVE FUNCTION; INDEPENDENT MODEL; META-OPTIMIZATION; OPPORTUNITY COSTS; SHARED RESOURCES;

DECISION MAKING;

ATTENTION; BRAIN FUNCTION; COGNITION; CONDITIONED REFLEX; DECISION MAKING; DELAY DISCOUNTING; DEPRESSION; EGO; EMOTIONALITY; EXECUTIVE FUNCTION; FATIGUE; FORAGING; HABIT; HUMAN; INSTRUMENTAL CONDITIONING; LEARNED HELPLESSNESS; LOCUS OF CONTROL; NONHUMAN; REVIEW; REWARD; SELF CONTROL; WORKING MEMORY; PHYSIOLOGY;

COGNITION; DECISION MAKING; HUMANS; SELF-CONTROL;

EID: 84945897192     PISSN: 13646613     EISSN: 1879307X     Source Type: Journal    
DOI: 10.1016/j.tics.2015.08.013     Document Type: Review

References (100)

1. Kurzban R., et al. An opportunity cost model of subjective effort and task performance. Behav. Brain Sci. 2013, 36:661-679.
2. Westbrook A., Braver T.S. Cognitive effort: a neuroeconomic approach. Cogn. Affect. Behav. Neurosci. 2015, 15:395-415.
3. Shenhav A., et al. The expected value of control: an integrative theory of anterior cingulate cortex function. Neuron 2013, 79:217-240.
4. Keramati M., et al. Speed/accuracy trade-off between the habitual and the goal-directed processes. PLoS Comput. Biol. 2011, 7:e1002055.
5. Lieder F., Griffiths T.L. When to use which heuristic: a rational solution to the strategy selection problem. Proceedings of the 37th Annual Conference of the Cognitive Science Society 2015, 1362-1367.
6. McGuire J.T., Botvinick M.M. Prefrontal cortex, cognitive control, and the registration of decision costs. Proc. Natl. Acad. Sci. U.S.A. 2010, 107:7922-7926.
7. Kool W., et al. Decision making and the avoidance of cognitive demand. J. Exp. Psychol. Gen. 2010, 139:665-682.
8. Dixon M.L., Christoff K. The decision to engage cognitive control is driven by expected reward-value: neural and behavioral evidence. PLoS ONE 2012, 7:e51637.
9. Kool W., Botvinick M. A labor/leisure tradeoff in cognitive control. J. Exp. Psychol. Gen. 2014, 143:131-141.
10. Dayan P. How to set the switches on this thing. Curr. Opin. Neurobiol. 2012, 22:1068-1074.
11. Kahneman D. Thinking, Fast and Slow 2011, Farrar, Straus and Giroux.
12. Gershman S., Wilson R. The neural costs of optimal control. Advances in Neural Information Processing Systems 2010, 23:712-720. Neural Information Processing Systems Foundation.
13. Holmes P., Cohen J.D. Optimality and some of its discontents: successes and shortcomings of existing models for binary decisions. Top. Cogn. Sci. 2014, 6:258-278.
14. Botvinick M.M., Cohen J.D. The Computational and Neural Basis of Cognitive Control: Charted Territory and New Frontiers. Cogn. Sci. 2014, 38:1249-1285.
15. Kanfer F.H., Seidner M.L. Self-control: factors enhancing tolerance of noxious stimulation. J. Pers. Soc. Psychol. 1973, 25:381-389.
16. Payne J.W., et al. Adaptive strategy selection in decision making. J. Exp. Psychol. Learn. Mem. Cogn. 1988, 14:534-552.
17. Gluth S., et al. Deciding when to decide: time-variant sequential sampling models explain the emergence of value-based decisions in the human brain. J. Neurosci. 2012, 32:10686-10698.
18. Hofmann W., et al. Three ways to resist temptation: the independent contributions of executive attention, inhibitory control, and affect regulation to the impulse control of eating behavior. J. Exp. Soc. Psychol. 2009, 45:431-435.
19. Etzel J.A., et al. Reward motivation enhances task coding in frontoparietal cortex. Cereb. Cortex 2015, Published online January 19, 2015. 10.1093/cercor/bhu327.
20. Job V., et al. Ego depletion - is it all in your head? Implicit theories about willpower affect self-regulation. Psychol. Sci. 2010, 21:1686-1693.
21. Gross J.J., Thompson R.A. Emotion regulation: conceptual foundations. Handbook of Emotion Regulation 2007, 3-24. Guilford Press. J.J. Gross (Ed.).
22. Daw N.D., et al. Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nat. Neurosci. 2005, 8:1704-1711.
23. Pezzulo G., et al. The mixed instrumental controller: using value of information to combine habitual choice and mental simulation. Front. Psychol. 2013, 4:92.
24. Bogacz R., et al. The physics of optimal decision making: a formal analysis of models of performance in two-alternative forced-choice tasks. Psychol. Rev. 2006, 113:700-765.
25. Dehaene S., et al. A neuronal model of a global workspace in effortful cognitive tasks. Proc. Natl. Acad. Sci. U.S.A. 1998, 95:14529-14534.
26. Baum E.B., Smith W.D. A Bayesian approach to relevance in game playing. Artif. Intell. 1997, 97:195-242.
27. Koechlin E., Summerfield C. An information theoretical approach to prefrontal executive function. Trends Cogn. Sci. 2007, 11:229-235.
28. Gittins J. Multi-Armed Bandit Allocation Indices 1989, John Wiley & Sons.
29. Dayan P. Exploration from generalization mediated by multiple controllers. Intrinsically Motivated Learning in Natural and Artificial Systems 2013, 73-91. Springer. G. Baldassarre, M. Mirolli (Eds.).
30. Wilson R.C., et al. Humans use directed and random exploration to solve the explore-exploit dilemma. J. Exp. Psychol. Gen. 2014, 143:2074-2081.
31. Norman D.A., Bobrow D.G. On the analysis of performance operating characteristics. Psychol. Rev. 1976, 83:508-510.
32. Ryan R.M., Deci E.L. Self-regulation and the problem of human autonomy: does psychology need choice, self-determination, and will?. J. Pers. 2006, 74:1557-1585.
33. Tversky A., Simonson I. Context-dependent preferences. Manag. Sci. 1993, 39:1179-1189.
34. Morgan K.V., et al. Context-dependent decisions among options varying in a single dimension. Behav. Processes 2012, 89:115-120.
35. Vasconcelos M., et al. Context-dependent preferences in starlings: linking ecology, foraging and choice. PLoS ONE 2013, 8:e64934.
36. Huang H.J., Ahmed A.A. Older adults learn less, but still reduce metabolic cost, during motor adaptation. J. Neurophysiol. 2014, 111:135-144.
37. Dayan P. Rationalizable Irrationalities of Choice. Top. Cogn. Sci. 2014, 6:204-228.
38. Stephens D.W., Krebs J.R. Foraging Theory 1986, Princeton University Press.
39. Niv Y., et al. Tonic dopamine: opportunity costs and the control of response vigor. Psychopharmacology 2007, 191:507-520.
40. Kacelnik A. Normative and descriptive models of decision making: time discounting and risk sensitivity. Ciba Found. Symp. 1997, 208:51-67.
41. Cools R., et al. Serotonin and dopamine: unifying affective, activational, and decision functions. Neuropsychopharmacology 2011, 36:98-113.
42. Dezfouli A., Balleine B.W. Habits, action sequences and reinforcement learning. Eur. J. Neurosci. 2012, 35:1036-1051.
43. Mani A., et al. Poverty impedes cognitive function. Science 2013, 341:976-980.
44. Baddeley A. Working memory: theories, models, and controversies. Annu. Rev. Psychol. 2012, 63:1-29.
45. Hofmann W., et al. Executive functions and self-regulation. Trends Cogn. Sci. 2012, 16:174-180.
46. Raio C.M., et al. Cognitive emotion regulation fails the stress test. Proc. Natl. Acad. Sci. U.S.A. 2013, 110:15139-15144.
47. Otto A.R., et al. Working-memory capacity protects model-based learning from stress. Proc. Natl. Acad. Sci. U.S.A. 2013, 110:20941-20946.
48. Hagger M.S., et al. Ego depletion and the strength model of self-control: a meta-analysis. Psychol. Bull. 2010, 136:495-525.
49. Schmeichel B.J. Attention control, memory updating, and emotion regulation temporarily reduce the capacity for executive control. J. Exp. Psychol. Gen. 2007, 136:241-255.
50. Otto A.R., et al. Cognitive control predicts use of model-based reinforcement learning. J. Cogn. Neurosci. 2015, 27:319-333.
51. Schmeichel B.J., et al. Working memory capacity and the self-regulation of emotional expression and experience. J. Pers. Soc. Psychol. 2008, 95:1526-1540.
52. Krebs J.R., et al. Optimal prey selection in the great tit (Parus major). Anim. Behav. 1977, 25:30-38.
53. Krebs J.R., et al. Hunting by expectation or optimal foraging? A study of patch use by chickadees. Anim. Behav. 1974, 22:953-964.
54. Huys Q.J.M., Dayan P. A Bayesian formulation of behavioral control. Cognition 2009, 113:314-328.
55. Dayan P., et al. The misbehavior of value and the discipline of the will. Neural Netw. 2006, 19:1153-1160.
56. Hockey R. The Psychology of Fatigue: Work, Effort and Control 2013, Cambridge University Press.
57. Hockey G.R.J. A motivational control theory of cognitive fatigue. Cognitive Fatigue: Multidisciplinary Perspectives on Current Research and Future Applications 2011, 167-187. American Psychological Association. P.L. Ackerman (Ed.).
58. Miller W.R., Seligman M.E. Depression and learned helplessness in man. J. Abnorm. Psychol. 1975, 84:228-238.
59. Dolan R.J., Dayan P. Goals and habits in the Brain. Neuron 2013, 80:312-325.
60. Gillan C.M., et al. Model-based learning protects against forming habits. Cogn. Affect. Behav. Neurosci. 2015, 15:523-536.
61. Friedel E., et al. Devaluation and sequential decisions: linking goal-directed and model-based behavior. Front. Hum. Neurosci. 2014, 8:587.
62. Daw N.D., Dayan P. The algorithmic anatomy of model-based evaluation. Philos. Trans. R. Soc. Lond. B: Biol. Sci. 2014, 369:20130478.
63. Armel K.C., Rangel A. The Impact of Computation Time and Experience on Decision Values 2008, American Economic Association.
64. Armel K.C., et al. Biasing Simple Choices by Manipulating Relative Visual Attention 2008, Society for Judgment and Decision Making.
65. Sokol-Hessner P., et al. Decision value computation in DLPFC and VMPFC adjusts to the available decision time. Eur. J. Neurosci. 2012, 35:1065-1074.
66. Liljeholm M., et al. Neural correlates of the divergence of instrumental probability distributions. J. Neurosci. 2013, 33:12519-12527.
67. Robinson M.D., et al. A cognitive control perspective of self-control strength and its depletion. Soc. Personal. Psychol. Compass 2010, 4:189-200.
68. Baumeister R.F., et al. The strength model of self-control. Curr. Dir. Psychol. Sci. 2007, 16:351-355.
69. Vohs K.D., et al. Motivation, personal beliefs, and limited resources all contribute to self-control. J. Exp. Soc. Psychol. 2012, 48:943-947.
70. Eisenberger R. Learned industriousness. Psychol. Rev. 1992, 99:248-267.
71. Bandura A. Self-Efficacy: The Exercise of Control 1997, W.H. Freeman/Times Books/Henry Holt & Co.
72. Gist M.E., Mitchell T.R. Self-efficacy: a theoretical analysis of its determinants and malleability. Acad. Manage. Rev. 1992, 17:183-211.
73. Eisenberg N., et al. Effortful control and its socioemotional consequences. Handbook of Emotion Regulation 2007, 287-306. Guilford Press. J.J. Gross (Ed.).
74. Hartley C.A., Phelps E.A. Changing fear: the neurocircuitry of emotion regulation. Neuropsychopharmacology 2009, 35:136-146.
75. Ochsner K.N., et al. Functional imaging studies of emotion regulation: a synthetic review and evolving model of the cognitive control of emotion. Ann. N. Y. Acad. Sci. 2012, 1251:E1-E24.
76. Goldin P.R., et al. The neural bases of emotion regulation: reappraisal and suppression of negative emotion. Biol. Psychiatry 2008, 63:577-586.
77. Bush G., et al. Cognitive and emotional influences in anterior cingulate cortex. Trends Cogn. Sci. 2000, 4:215-222.
78. Rigoli F., et al. Aversive Pavlovian responses affect human instrumental motor performance. Front. Neurosci. 2012, 6:134.
79. Hershberger W.A. An approach through the looking-glass. Anim. Learn. Behav. 1986, 14:443-451.
80. Lesaint F., et al. Accounting for negative automaintenance in pigeons: a dual learning systems approach and factored representations. PLoS ONE 2014, 9:e111050.
81. Cavanagh J.F., et al. Frontal theta overrides Pavlovian learning biases. J. Neurosci. 2013, 33:8541-8548.
82. Lesaint F., et al. Modelling individual differences in the form of Pavlovian conditioned approach responses: a dual learning systems approach with factored representations. PLoS Comput. Biol. 2014, 10:e1003466.
83. Inzlicht M., et al. Why self-control seems (but may not be) limited. Trends Cogn. Sci. 2014, 18:127-133.
84. Huizenga H.M., et al. Muscle or motivation? A stop-signal study on the effects of sequential cognitive control. Front. Psychol. 2012, 3:126.
85. Mackworth N.H. The breakdown of vigilance during prolonged visual search. Q. J. Exp. Psychol. 1948, 1:6-21.
86. Vohs K.D., et al. Ego depletion is not just fatigue: evidence from a total sleep deprivation experiment. Soc. Psychol. Personal. Sci. 2011, 2:166-173.
87. Norman D.A., Bobrow D.G. On data-limited and resource-limited processes. Cognit. Psychol. 1975, 7:44-64.
88. Muraven M., et al. Helpful self-control: autonomy support, vitality, and depletion. J. Exp. Soc. Psychol. 2008, 44:573-585.
89. Moller A.C., et al. Choice and ego-depletion: the moderating role of autonomy. Pers. Soc. Psychol. Bull. 2006, 32:1024-1036.
90. Muraven M., et al. Lack of autonomy and self-control: performance contingent rewards lead to greater depletion. Motiv. Emot. 2007, 31:322-330.
91. Glass D.C., et al. Psychic cost of adaptation to an environmental stressor. J. Pers. Soc. Psychol. 1969, 12:200-210.
92. Glass D.C., et al. Perceived control of aversive stimulation and the reduction of stress responses. J. Pers. 1973, 41:577-595.
93. Huys Q.J.M., et al. Depression: a decision-theoretic analysis. Annu. Rev. Neurosci. 2015, 38:1-23.
94. Declerck C.H., et al. On feeling in control: a biological theory for individual differences in control perception. Brain Cogn. 2006, 62:143-176.
95. Xue G., et al. Agency modulates the lateral and medial prefrontal cortex responses in belief-based decision making. PLoS ONE 2013, 8:e65274.
96. Walton M.E., et al. Interactions between decision making and performance monitoring within prefrontal cortex. Nat. Neurosci. 2004, 7:1259-1265.
97. Kayser A.S., et al. Dopamine, locus of control, and the exploration-exploitation tradeoff. Neuropsychopharmacology 2015, 40:454-462.
98. Norman D.A., Shallice T. Attention to action. Consciousness and Self-Regulation 1986, 1-18. Springer. R.J. Davidson (Ed.).
99. Granon S., Changeux J-P. Deciding between conflicting motivations: what mice make of their prefrontal cortex. Behav. Brain Res. 2012, 229:419-426.
100. Koechlin E. An evolutionary computational theory of prefrontal executive function in decision-making. Philos. Trans. R. Soc. Lond. B: Biol. Sci. 2014, 369:20130474.