Neuroethology of Decision Making

Primate Neuroethology

Volumn , Issue , 2010, Pages

  Lee, Daeyeol ^a  

^a YALE UNIVERSITY SCHOOL OF MEDICINE   (United States)

Author keywords

Decision making; Neuroethology; Primates; Social interaction

Indexed keywords

EID: 84856120086     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1093/acprof:oso/9780195326598.003.0027     Document Type: Chapter

References (75)

1. Averbeck, B. B., & Lee, D. (2007). Prefrontal neural correlates of memory for sequences. Journal of Neuroscience, 27, 2204-2211.
2. Averbeck, B. B., Sohn, J. W., & Lee, D. (2006). Activity in prefrontal cortex during dynamic selection of action sequences. Nature Neuroscience, 9, 276-282.
3. Barone, P., & Joseph, J. P. (1989). Prefrontal cortex and spatial sequencing in macaque monkey. Experimental Brain Research, 78, 447-464.
4. Barraclough, D. J., Conroy, M. L., & Lee, D. (2004). Prefrontal cortex and decision making in a mixed-strategy game. Nature Neuroscience, 7, 404-410.
5. Basso, M. A., & Wurtz, R. H. (1998). Modulation of neuronal activity in superior colliculus by changes in target probability. Journal of Neuroscience, 18, 7519-7534.
6. Bayer, H. M., & Glimcher, P. W. (2005). Midbrain dopamine neurons encode a quantitative reward prediction error signal. Neuron, 47, 129-141.
7. Bowman, E. M., Aigner, T. G., & Richmond, B. J. (1996). Neural signals in the monkey ventral striatum related to motivation for juice and cocaine rewards. Journal of Neurophysiology, 75, 1061-1073.
8. Byrne, R. W., & Whiten, A. (1988). Machiavellian intelligence: Social expertise and the evolution of intellect in monkeys, apes, and humans. Oxford: Oxford University Press.
9. Camerer, C. F. (2003). Behavioral game theory: Experiments in strategic interaction. Princeton: Princeton University Press.
10. Camerer, C., & Ho, T. H. (1999). Experience-weighted attraction learning in normal form games. Econometrica, 67, 827-874.
11. Cisek, P., & Kalaska, J. F. (2005). Neural correlates of reaching decisions in dorsal premotor cortex: Specification of multiple direction choices and final selection of action. Neuron, 45, 801-814.
12. Clower, W. T., & Alexander, G. E. (1998). Movement sequence-related activity reflecting numerical order of components in supplementary and presupplementary motor areas. Journal of Neurophysiology, 80, 1562-1566.
13. Cromwell, H. C., & Schultz, W. (2003). Effects of expectations for different reward magnitude on neuronal activity in the primate striatum. Journal of Neurophysiology, 89, 2823-2838.
14. Daw, N. D., O'Doherty, J. P., Dayan, P., Seymour, B., & Dolan, R. J. (2006). Cortical substrates for exploratory decisions in humans. Nature, 441, 876-879.
15. Dorris, M. C., & Glimcher, P. W. (2004). Activity in posterior parietal cortex is correlated with the relative subjective desirability of action. Neuron, 44, 365-378.
16. Erev, I., & Roth, A. E. (1998). Predicting how people play games: Reinforcement learning in experimental games with unique, mixed strategy equilibria. American Economic Review, 88, 848-881.
17. Feltovich, N. (2000). Reinforcement-based and belief-based learning models in experimental asymmetric-information games. Econometrica, 68, 605-641.
18. Frederick, S., Loewenstein, G., & O'Donoghue, T. (2002). Time discounting and time preference: A critical review. Journal of Economic Literature, 40, 351-401.
19. Fudenberg, D., & Levine, D. K. (1998). The theory of learning in games. Cambridge, MA: MIT Press.
20. Georgopoulos, A. P., Schwartz, A. B., & Kettner, R. E. (1986). Neuronal population coding of movement direction. Science, 233, 1416-1419.
21. Ghazanfar, A. A., Maier, J. X., Hoffman, K. L., & Logothetis, N. K. (2005). Multisensory integration of dynamic faces and voices in rhesus monkey auditory cortex. Journal of Neuroscience, 25, 5004-5012.
22. Graziano, M. S. A., Taylor, C. S. R., & Moore, T. (2002). Complex movements evoked by microstimulation of precentral cortex. Neuron, 34, 841-851.
23. Haruno, M., & Kawato, M. (2006). Different neural correlates of reward expectation and reward expectation error in the putamen and caudate nucleus during stimulus-actionreward association learning. Journal of Neurophysiology, 95, 948-959.
24. Hoshi, E., Sawamura, H., & Tanji, J. (2005). Neurons in the rostral cingulate motor area monitor multiple phases of visuomotor behavior with modest parametric selectivity. Journal of Neurophysiology, 94, 640-656.
25. Ito, S., Stuphorn, V., Brown, J. W., & Schall, J. D. (2003). Performance monitoring by the anterior cingulate cortex during saccade countermanding. Science, 302, 120-122.
26. Kagel, J. H., & Roth, A. E. (1995). The handbook of experimental economics. Princeton: Princeton University Press.
27. Kahneman, D., & Tversky, A. (1979). Prospect theory: An analysis of decision under risk. Econometrica, 47, 263-292.
28. Kawagoe, R., Takikawa, Y., & Hikosaka, O. (1998). Expectation of reward modulates cognitive signals in the basal ganglia. Nature Neuroscience, 1, 411-416.
29. Kawato, M., & Samejima, K. (2007). Efficient reinforcement learning: Computational theories, neuroscience and robotics. Current Opinions in Neurobiology, 17, 205-212.
30. Lee, D. (2008). Game theory and neural basis of social decision making. Nature Neuroscience, 11, 404-409.
31. Lee, D., Conroy, M. L., McGreevy, B. P., & Barraclough, D. J. (2004). Reinforcement learning and decision making in monkeys during a competitive game. Cognitive Brain Research, 22, 45-58.
32. Lee, D., McGreevy, B. P., & Barraclough, D. J. (2005). Learning and decision making in monkeys during a rock-paper-scissors game. Cognitive Brain Research 25, 416-430.
33. Leon, M. I., & Shadlen, M. N. (1999). Effect of expected reward magnitude on the response of neurons in the dorsolateral prefrontal cortex of the macaque. Neuron, 24, 415-425.
34. Matelli, M., Luppino, G., & Rizzolatti, G. (1991). Architecture of superior and mesial area 6 and the adjacent cingulate cortex in the macaque monkey. Journal of Comparative Neurology, 311, 445-462.
35. Matsumoto, M., Matsumoto, K., Abe, H., & Tanaka, K. (2007). Medial prefrontal cell activity signaling prediction errors of action values. Nature Neuroscience, 10, 647-656.
36. Matsuzaka, Y., Aizawa, H., & Tanji, J. (1992). A motor area rostral to the supplementary motor area (presupplementary motor area). in the monkey: Neuronal activity during a learned motor task. Journal of Neurophysiology, 68, 653-662.
37. Mazer, J. A., & Gallant, J. L. (2003). Goal-related activity in V4 during free viewing visual search: Evidence for a ventral stream visual salience map. Neuron, 40, 1241-1250.
38. McCoy, A. N., & Platt, M. L. (2005). Risk-sensitive neurons in macaque posterior cingulate cortex. Nature Neuroscience, 8, 1220-1227.
39. Mookherjee, D., & Sopher, B. (1994). Learning behavior in an experimental matching pennies game. Games and Economic Behavior, 7, 62-91.
40. Mookherjee, D., & Sopher, B. (1997). Learning and decision costs in experimental constant sum games. Games and Economic Behavior, 19, 97-132.
41. Nash, J. F. (1950). Equilibrium points in n-person games. Proceedings of the National Academy of Sciences, 36, 48-49.
42. Paton, J. J., Belova, M. A., Morrison, S. E., & Salzman, C. D. (2006). The primate amygdala represents the positive and negative value of visual stimuli during learning. Nature, 439, 865-870.
43. Padoa-Schioppa, C., & Assad, J. A. (2006). Neurons in the orbitofrontal cortex encode economic value. Nature, 441, 223-226.
44. Pawitan, Y. (2001). In all likelihood: Statistical modelling and inference using likelihood. Oxford: Oxford University Press.
45. Perin, C. T. (1943). A quantitative investigation of the delay-of-reinforcement gradient. Journal of Experimental Psychology, 32, 37-51.
46. Platt, M. L., & Glimcher, P. W. (1999). Neural correlates of decision variables in parietal cortex. Nature, 400, 233-238.
47. Rapoport, A., & Budescu, D. V. (1992). Generation of random series in two-person strictly competitive games. Journal of Experimental Psychology: General, 121, 352-363.
48. Roesch, M. R., & Olson, C. R. (2004). Neuronal activity related to reward value and motivation in primate frontal cortex. Science, 304, 307-310.
49. Rushworth, M. F. S., Behrens, T. E. J., Rudebeck, P. H., & Walton, M. E. (2007). Contrasting roles for cingulate and orbitofrontal cortex in decisions and social behaviour. Trends in Cognitive Science, 11, 168-176.
50. Rushworth, M. F. S., Walton, M. E., Kennerley, S. W., & Bannerman, D. M. (2004). Action sets and decisions in the medial frontal cortex. Trends in Cognitive Science, 8, 410-417.
51. Samejima, K., Ueda, Y., Doya, K., & Kimura, M. (2005). Representation of action-specific reward values in the striatum. Science, 310, 1337-1340.
52. Schultz, W. (1998). Predictive reward signal of dopamine neurons. Journal of Neurophysiology, 80, 1-27.
53. Schultz, W., Dayan, P., & Montague, P. R. (1997). A neural substrate of prediction and reward. Science, 275, 1593-1599.
54. Schweighofer, N., & Doya, K. (2003). Meta-learning in reinforcement learning. Neural Networks, 16, 5-9.
55. Seo, H., Barraclough, D. J., & Lee, D. (2007). Dynamic signals related to choices and outcomes in the dorsolateral prefrontal cortex. Cerebral Cortex, 17, i110-i117.
56. Seo, H, Barraclough, D. J., & Lee, D. (2009). Lateral intraparietal cortex and reinforcement learning during a mixed-strategy game. Journal of Neuroscience, 29, 7278-7289.
57. Seo, H., & Lee, D. (2007). Temporal filtering of reward signals in the dorsal anterior cingulate cortex during a mixed-strategy game. Journal of Neuroscience, 27, 8366-8377.
58. Seo, H, & Lee, D. (2009). Behavioral and neural changes after gains and losses of conditioned reinforcers. Journal of Neuroscience, 29, 3627-3641.
59. Shima, K., & Tanji, J. (2000). Neuronal activity in the supplementary and presupplementary motor areas for temporal organization of multiple move-ments. Journal of Neurophysiology, 84, 2148-2160.
60. Sohn, J.-W. & Lee, D. (2006). Effects of reward expectancy on sequential eye movements in monkeys. Neural Networks, 19, 1181-1191.
61. Sohn, J. W., & Lee, D. (2007). Order-dependent modulation of directional signals in the supplementary and presupplementary motor areas. Journal of Neuroscience, 27, 13655-13666.
62. Shidara, M., & Richmond, B. J. (2002). Anterior cingulate: Single neuronal signals related to degree of reward expectancy. Science, 296, 1709-1711.
63. Soltani, A., Lee, D., & Wang, X. J. (2006). Neural mechanism for stochastic behavior during a competitive game. Neural Networks, 19, 1181-1191.
64. Sugihara, T., Diltz, M. D., Averbeck, B. B., & Romanski, L. M. (2006). Integration of auditory and visual communication information in the primate ventrolateral prefrontal cortex. Journal of Neuroscience, 26, 11138-11147.
65. Sugrue, L. P., Corrado, G. S., & Newsome, W. T. (2004). Matching behavior and the representation of value in the parietal cortex. Science, 304, 1782-1787.
66. Sutton, R. S., & Barto, A. G. (1998). Reinforcement learning: An introduction. Cambridge, MA: MIT Press.
67. Tanji, J. (2001). Sequential organization of multiple movements: Involvement of cortical motor areas. Annual Review of Neuroscience, 24, 631-651.
68. Thorndike, E. L. (1911). Animal intelligence: Experimental studies. New York: Macmillan.
69. Tomasello, M., & Call, J. (1997). Primate cognition. Oxford: Oxford University Press.
70. Tremblay, L., & Schultz, W. (1999). Relative reward preference in primate orbitofrontal cortex. Nature, 398, 704-708.
71. Vinje, W. E., & Gallant, J. L. (2000). Sparse coding and decorrelation in primate visual cortex during natural vision. Science, 287, 1273-1276.
72. von Neumann, J., & Morgenstern, O. (1944). Theory of games and economic behavior. Princeton: Princeton University Press.
73. Watanabe, M. (1996). Reward expectancy in primate prefrontal neurons. Nature, 382, 629-632.
74. Whiten, A., & Byrne, R. W. (1997). Machiavellian intelligence II: Extensions and evaluations. Cambridge: Cambridge University Press.
75. Woolley, S. M. N., Fremouw, T. E., Hsu, A., & Theunissen, F. E. (2005). Tuning for spectro-temporal modulations as a mechanism for auditory discrimination of natural sounds. Nature Neuroscience, 8, 1371-1379.