Neural signature of fictive learning signals in a sequential investment task

Proceedings of the National Academy of Sciences of the United States of America

Volumn 104, Issue 22, 2007, Pages 9493-9498

  Lohrenz, Terry ^a   McCabe, Kevin ^b   Camerer, Colin F ^c   Montague, P Read ^a  

^a BAYLOR COLLEGE OF MEDICINE   (United States)

^b GEORGE MASON UNIVERSITY   (United States)

^c CALIFORNIA INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

Counterfactual signals; Decision making; Neuroeconomics; Reinforcement learning

Indexed keywords

ADULT; ARTICLE; BEHAVIOR; DECISION MAKING; DOPAMINERGIC SYSTEM; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; LEARNING; MALE; NORMAL HUMAN; PRIORITY JOURNAL; REINFORCEMENT; REWARD; BRAIN; MIDDLE AGED; NERVE CELL; PHYSIOLOGY;

ANIMALIA;

ADULT; BEHAVIOR; BRAIN; FEMALE; HUMANS; LEARNING; MALE; MIDDLE AGED; NEURONS;

EID: 34547144795     PISSN: 00278424     EISSN: None     Source Type: Journal    
DOI: 10.1073/pnas.0608842104     Document Type: Article

References (48)

1. Breiter HC, Aharon I, Kahneman D, Dale A, Shizgal P (2001) Neuron 30:619-639.
2. Knutson B, Adams CS, Fong GW, Hommer D (2001) J Neurosci 21:RC159.
3. Pagnoni G, Zink CF, Montague PR, Berns GS (2002) Nat Neurosci 5:97-98.
4. McClure SM, Berns GS, Montague PR (2003) Neuron 38:339-346.
5. O'Doherty JP, Dayan P, Friston K, Critchley H, Dolan RJ (2003) Neuron 28:329-337.
6. O'Doherty JP, Dayan P, Schultz J, Deichmann R, Friston K, Dolan R (2004) Science 304:452-454.
7. Haruno M, Kuroda T, Doya K, Toyama K, Kimura M, Samejima K, Imamizu H, Kawato M (2004) J Neurosci 24:1660-1665.
8. Kuhnen CM, Knutson B (2005) Neuron 47:763-770.
9. Sanfey AG, Rilling JK, Aronson JA, Nystrom LE, Cohen JD (2003) Science 300:1755-1758.
10. Rilling JK, Gutman DA, Zeh TR, Pagnoni GP, Berns GS, Kilts CD (2002) Neuron 35:395-405.
11. King-Casas B, Tomlin D, Annen C, Camerer CF, Quartz SR, Montague PR (2005) Science 308:78-83.
12. Singer T, Seymour B, O'Doherty JP, Stephan KE, Dolan RJ, Frith CD (2006) Nature 439:466-469.
13. Watkins CJCH (1992) PhD thesis (Univ of Cambridge, Cambridge, UK).
14. Watkins CJCH, Dayan P (1992) Mach Learn 8:279-292.
15. Montague PR, King-Casas B, Cohen JD (2006) Annu Rev Neurosci 29:417-448.
16. Montague PR, Dayan P, Sejnowski TJ (1996) J Neurosci 16:1936-1947.
17. Schultz W, Dayan P, Montague PR (1997) Science 275:1593-1599.
18. Schultz W, Dickinson A (2000) Annu Rev Neurosci 23:473-500.
19. O'Doherty J (2004) Curr Opin Neurosci 14:769-776.
20. Montague PR, Hyman SE, Cohen JD (2004) Nature 431:760-767.
21. Waelti P, Dickinson A, Schulz W (2001) Nature 412:43-48.
22. Bayer HM, Glimcher PW (2005) Neuron 47:129-141.
23. Sutton RS, Barto AG (1998) Reinforcement Learning: An Introduction (MIT Press, Cambridge, MA).
24. Bell DE (1982) Oper Res 30:961-981.
25. Loomes G, Sugden R (1982) Econ J 92:805-824.
26. Rosen NJ, Olson JM, eds (1995) What Might Have Been - The Social Psychology of Counterfactual Thinking (Erlbaum, Mahwah, NJ).
27. Haruno M, Kuroda, Doya K, Toyama K, Kimura M, Samejima K, Imamizu H, Kawato M (2004) J Neurosci 24:1660-1665.
28. Delgado MR, Miller MM, Inati S, Phelps EA (2005) NeuroImage 24:862-873.
29. Daw ND, O'Doherty JP, Dayan P, Seymour B, Dolan RJ (2006) Nature 441:876-879.
30. Li J, McClure SM, King-Casas B, Montague PR (2006) PLoS ONE 1:e103.
31. Kahneman D, Tversky A (1979) Econometrica 47:263-292.
32. Bechara A, Damasio H, Tranel D, Damasio AR (1997) Science 275:1293-1295.
33. Mellers B, Schwarz A, Ritov I (1999) J Exp Psychol Gen 128:332-345.
34. Camille N, Coricelli G, Sallet J, Pradet-Diehl P, Duhamel JR, Sirigu A (2004) Science 304:1167-1170.
35. Coricelli G, Critchley H, Joffilty M, O'Doherty JP, Sirigu A, Dolan R (2005) Nat Neurosci 8:1255-1262.
36. Camerer CF, Ho TH (1999) Econometrica 67:827-874.
37. Camerer CF (2002) Behavioral Game Theory: Experiments on Strategic Interaction (Princeton Univ Press, Princeton).
38. Rosenstein MT, Barto AG (2004) in Learning and Approximate Dynamic Programming: Scaling Up to the Real World, Si J, Barto A, Powell W, Wunsch D (Wiley, New York), pp 359-380.
39. Redish AD (2004) Science 306:1944-1947.
40. Dodd ML, Klos KJ, Bower JH, Geda YE, Josephs KA, Ahlskog JE (2005) Arch Neurol (Chicago) 62:1377-1381.
41. Schluppeck D, Glimcher P, Heeger DJ (2005) J Neurophysiol 94:1372-1384.
42. Platt ML, Glimcher PW (1999) Nature 400:233-238.
43. Glimcher PW (2003) Annu Rev Neurosci 26:133-179.
44. Sugrue L, Corrado GS, Newsome WT (2004) Science 304:1782-1787.
45. Friston KJ, Williams S, Howar R, Frackowiak RSJ, Turner R (1996) Magn Reson Med 35:346-355.
46. Evans AC, Collins DL, Mills SR, Brown ED, Kelly RL, Peters TM (1993) Nuclear Science Symposium and Medical Imaging Conference, 1993, 1993 IEEE Conference Record (IEEE, Piscataway, NJ), pp 1813-1817.
47. Ashburner J, Friston KJ (1999) Hum Brain Mapp 7:254-266.
48. Friston KJ, Holmes AP, Worsely KJ, Poline JP, Frith CD, Frackowiak RSJ (1995) Hum Brain Mapp 2:189-210.