Multiple systems in decision making: A neurocomputational perspective

Current Directions in Psychological Science

Volumn 18, Issue 2, 2009, Pages 73-77

  Frank, Michael J ^a,b   Cohen, Michael X ^b   Sanfey, Alan G ^b  

^a BROWN UNIVERSITY   (United States)

^b University of Arizona   (United States)

Author keywords

Computational models; Decision making; Neuroscience

Indexed keywords

EID: 64949111498     PISSN: 09637214     EISSN: 14678721     Source Type: Journal    
DOI: 10.1111/j.1467-8721.2009.01612.x     Document Type: Article

References (23)

1. Daw, N.D., Niv, Y., & Dayan, P. (2005). (See References). Presents an elegant mathematical formulation that captures properties of a "model free" habitual system and a "model based" explicit system, and suggests that the degree to which each of these systems is recruited during decision making depends on their respective estimations of uncertainty.
2. Frank, M.J., Moustafa, A.A., Haughey, H., Curran, T., & Hutchison, K. (2007). (See References). Paper using behavioral and computational analysis to show that individuals' proficiency in different aspects of reinforcement-based decision making is predicted by specific genes that control component processes of dopaminergic function in the basal ganglia and prefrontal cortex.
3. Miller, E.K., & Cohen, J.D. (2001). (See References). A comprehensive, highly accessible overview of prefrontal cortical function, presenting a simple model that specifies its functional properties and that inspired the development of many subsequent models relying on these same properties.
4. Bechara, A., Damasio, H., Tranel, D. Anderson, S.W. (1998). Dissociation of working memory from decision making within the human prefrontal cortex. Journal of Neuroscience, 18, 428 437.
5. Daw, N.D., Niv, Y. Dayan, P. (2005). Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nature Neuroscience, 8, 1704 1711.
6. Egner, T. Hirsch, J. (2005). Cognitive control mechanisms resolve conflict through cortical amplification of task-relevant information. Nature Neuroscience, 8, 1784 1790.
7. Evans, J.S.B.T. (2003). In two minds: Dual-process accounts of reasoning. Trends in the Cognitive Sciences, 7, 454 459.
8. Fellows, L.K. Farah, M.J. (2003). Ventromedial frontal cortex mediates affective shifting in humans: Evidence from a reversal learning paradigm. Brain, 126, 1830 1837.
9. Frank, M.J. Claus, E.D. (2006). Anatomy of a decision: Striato-orbitofrontal interactions in reinforcement learning, decision making, and reversal. Psychological Reviews, 113, 300 326.
10. Frank, M.J., Moustafa, A.A., Haughey, H., Curran, T. Hutchison, K. (2007). Genetic triple dissociation reveals multiple roles for dopamine in reinforcement learning. Proceedings of the National Academy of Sciences, U.S.A., 104, 16311 16316.
11. Frank, M.J., O'Reilly, R.C. Curran, T. (2006). When memory fails, intuition reigns: Midazolam enhances implicit inference in humans. Psychological Science, 17, 700 707.
12. Gallagher, M. Schoenbaum, G. (1999). Functions of the amygdala and related forebrain areas in attention and cognition. Annals of the New York Academy of Sciences, 877, 397 411.
13. McClelland, J.L., McNaughton, B.L. O'Reilly, R.C. (1995). Why there are complementary learning systems in the hippocampus and neocortex: Insights from the successes and failures of connectionist models of learning and memory. Psychological Review, 102, 419 457.
14. McNab, F. Klingberg, T. (2008). Prefrontal cortex and basal ganglia control access to working memory. Nature Neuroscience, 11, 103 107.
15. Miller, E.K. Cohen, J.D. (2001). An integrative theory of prefrontal cortex function. Annual Review of Neuroscience, 24, 167 202.
16. Murray, E.A. Izquierdo, A. (2007). Orbitofrontal cortex and amygdala contributions to affect and action in primates. Annals of the New York Academy of Sciences, 1121, 273 296.
17. O'Reilly, R.C. Frank, M.J. (2006). Making working memory work: A computational model of learning in the prefrontal cortex and basal ganglia. Neural Computation, 18, 283 328.
18. Poldrack, R.A. Packard, M.G. (2003). Competition among multiple memory systems: Converging evidence from animal and human brain studies. Neuropsychologia, 41, 245 251.
19. Rescorla, R.A. Wagner, A.R. (1972). A theory of Pavlovian conditioning: Variation in the effectiveness of reinforcement and non-reinforcement. In A.H. Black W.F. Prokasy (Eds.), Classical conditioning II: Theory and research (pp. 64 99). New York : Appleton-Century-Crofts.
20. Rougier, N.P., Noelle, D., Braver, T.S., Cohen, J.D. O'Reilly, R.C. (2005). Prefrontal cortex and the flexibility of cognitive control: Rules without symbols. Proceedings of the National Academy of Sciences, U.S.A., 102, 7338 7343.
21. Sanfey, A.G., Loewenstein, G., McClure, S.M. Cohen, J.D. (2006). Neuroeconomics: cross-currents in research on decision-making. Trends in the Cognitive Sciences, 10, 108 116.
22. Sanfey, A.G., Rilling, J.K., Aronson, J.A., Nystrom, L.E. Cohen, J.D. (2003). The neural basis of economic decision-making in the ultimatum game. Science, 300, 1755 1757.
23. Sloman, S.A. (1996). The empirical case for two systems of reasoning. Psychological Bulletin, 119, 3 22.