Behavioral and Neural Variability Related to Stochastic Choices during a Mixed-Strategy Game

The Dynamic Brain: An Exploration of Neuronal Variability and Its Functional Significance

Volumn , Issue , 2011, Pages

  Lee, Daeyeol ^a   Seo, Hyojung ^a  

^a YALE UNIVERSITY SCHOOL OF MEDICINE   (United States)

Author keywords

Cingulate cortex; Decision making; Fano factor; Game theory; Neuroeconomics; Poisson process; Posterior parietal cortex; Prefrontal cortex; Reinforcement learning

Indexed keywords

EID: 84920753564     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1093/acprof:oso/9780195393798.003.0012     Document Type: Chapter

References (45)

1. Averbeck, B.B., Lee, D. (2006) Effects of noise correlation on information encoding and decoding. J of Neurophysiology, 95, 3633-3644.
2. Barraclough, D.J., Conroy, M.L., Lee, D. (2004) Prefrontal cortex and decision making in a mixed-strategy game. Nat Neuroscience, 7, 404-410.
3. Britten, K.H., Shadlen, M.N., Newsome, W.T., Movshon, J.A. (1992) The analysis of visual motion: a comparison of neuronal and psychophysical performance. J of Neuroscience, 12, 4745-4765.
4. Budescu, D.V. and Rapoport, A. (1994) Subjective randomization in one- and two-person games. J Beh Decis Making, 7, 261-278.
5. Camerer, C.F. (2003) Behavioral game theory: experiments in strategic interaction. Princeton, N.J.: Princeton University Press.
6. Churchland, M.M., Afshar, A., Shenoy, K.V. (2006a) A central source of movement variability. Neuron, 52, 1085-1096.
7. Churchland, M.M., Yu, B.M., Cunningham, J.P., Sugrue, L.P., Cohen, M.R., Corrado, G.S., Newsome, W.T., Clark, A.M., Hosseini, P., Scott, B.B., Bradley, D.C., Smith, M.A., Kohn, A., Movshon, J.A., Armstrong, K.M., Moore, T., Chang, S.W., Snyder, L.H., Lisberger, S.G., Priebe, N.J., Finn, I.M., Ferster, D., Ryu, S.I., Santhanam, G., Sahani, M., Shenoy, K.V. (2010) Stimulus onset quenches neural variability: a widespread cortical phenomenon. Nat Neuroscience, 13, 369-378.
8. Churchland, M.M., Yu, B.M., Ryu, S.I., Santhanam, G., Shenoy, K.V. (2006b) Neural variability in premotor cortex provides a signature of motor preparation. J of Neuroscience, 26, 3697-3712.
9. Cohen, M.R. and Newsome, W.T. (2009) Estimates of the contribution of single neurons to perception depend on timescale and noise correlation. J of Neuroscience, 29, 6635-6648.
10. Dean, A.F. (1981) The variability of discharge of simple cells in the cat striate cortex. Exp Brain Res, 44, 437-440.
11. Erev, I. and Roth, A.E. (1998) Predicting how people play games:reinforcement learning in experimental games with unique, mixed strategy equilbria. Am Econ Rev, 88, 848-881.
12. Estes, W.K. (1962) Learning theory. Annu Rev Psych, 13, 107-144.
13. Hanes, D.P. and Schall, J.D. (1996) Neural control of voluntary movement initiation. Science, 274, 427-430.
14. Hayden, B.Y., Pearson, J.M., Platt, M.L. (2009) Fictive reward signals in the anterior cingulate cortex. Science, 324, 948-950.
15. Henry, G.H., Bishop, P.O., Tupper, R.M., Dreher, B. (1973) Orientation specificity and response variability of cells in the striate cortex. Vision Res, 13, 1771-1779.
16. Kennerley, S.W. and Wallis, J.D. (2009) Evaluating choices by single neurons in the frontal lobe: Outcome value encoded across multiple decision variables. Eur J Neuroscience, 29, 2061-2073.
17. Kim, S., Hwang, J., Seo, H., Lee, D. (2009) Valuation of uncertain and delayed rewards in primate prefrontal cortex. Neural Networks, 22, 294-304.
18. Lee, D. (2008) Game theory and neural basis of social decision making. Nat Neurosci., 11, 404-409.
19. Lee, D., Conroy, M.L., McGreevy, B.P., Barraclough, D.J. (2004) Reinforcement learning and decision making in monkeys during a competitive game. Cogn Brain Res, 22, 45-58.
20. Lee, D., McGreevy, B.P., Barraclough, D.J. (2005) Learning and decision making in monkeys during a rock-paper-scissors game. Cogn Brain Res, 25, 416-430.
21. Lee, D., Port, N.L., Kruse, W., Georgopoulos, A.P. (1998) Variability and correlated noise in the discharge of neurons in motor and parietal areas of the primate cortex. J of Neuroscience, 18, 1161-1170.
22. Luce, R.D. (1986) Response times: their role in inferring elementary mental organization. Oxford: Oxford University Press.
23. Matsumoto, M., Matsumoto, K., Abe, H., Tanaka, K. (2007) Medial prefrontal cell activity signaling prediction errors of action values. Nat Neuroscience, 10, 647-656.
24. Mookherjee, D. and Sopher, B. (1994) Learning behavior in an experimental matching pennies game. Games Econ Beh, 7, 62-91.
25. Mookherjee, D. and Sopher, B. (1997) Learning and decision costs in experimental constant sum games. Games Econ Beh, 19, 97-132.
26. Nash, J.F. (1950) Equilibrium points in n-person games. Proc Natl Acad Sci, 36, 48-49.
27. Osborne, L.C., Lisberger, S.G., Bialek, W. (2005) A sensory source for motor variation. Nature, 437, 412-416.
28. Pawitan, Y. (2001) In all likelihood: statistical modelling and inference using likelihood. New York: Oxford University Press.
29. Rapoport, A. and Budescu, D.V. (1992) Generation of random series in twoperson strictly competitive games. J Exp Psychol General, 121, 352-363.
30. Rieke, F., Warland, D., de Ruyter van Steveninck, R., Bialek, W. (1997) Spikes: exploring the neural code. Cambridge, Mass.: MIT Press.
31. Rose, D. (1979) An analysis of the variability of unit activity in the cat's visual cortex. Exp Brain Res, 37, 595-604.
32. Sally, D. (1995) Conversation and cooperation in social dilemmas: A metaanalysis of experiments from 1958 to 1992. Ration Soc, 7, 58-92.
33. Schoppik, D., Nagel, K.I., Lisberger, S.G. (2008) Cortical mechanisms of smooth eye movements revealed by dynamic covariations of neural and behavioral responses. Neuron, 58, 248-260.
34. Seo H, Lee D. (2007) Temporal filtering of reward signals in the dorsal anterior cingulate cortex during a mixed-strategy game. J of Neuroscience, 27, 8366-8377.
35. Seo, H. and, Lee, D. (2008) Cortical mechanisms for reinforcement learning in competitive games. Philos Trans Roy Soc Lond B Biol Sci, 363, 3845-3857.
36. Seo, H., Barraclough, D.J., Lee, D. (2007) Dynamic signals related to choices and outcomes in the dorsolateral prefrontal cortex. Cereb Cortex, 17, i110-i117.
37. Seo, H., Barraclough. D.J., Lee, D. (2009) Lateral intraparietal cortex and reinforcement learning during a mixed-strategy game. J of Neuroscience, 29, 7278-7289.
38. Shadlen, M.N., Britten, K.H., Newsome, W.T., Movshon, J.A. (1996) A computational analysis of the relationship between neuronal and behavioral responses to visual motion. J of Neuroscience, 16, 1486-1510.
39. Shadlen, M.N. and Newsome, W.T. (1998) The variable discharge of cortical neurons: implications for connectivity, computation, and information coding. J of Neuroscience, 18, 3870-3896.
40. Softky, W.R. and Koch, C. (1993) The highly irregular firing of cortical cells is inconsistent with temporal integration of random EPSPs. J of Neuroscience, 13, 334-350.
41. Sutton, R.S. and Barto, A.G. (1998) Reinforcement learning: an introduction. Cambridge, Mass: MIT Press.
42. Todorov, E. and Jordan, M.I. (2002) Optimal feedback control as a theory of motor coordination. Nat Neuroscience, 5, 1226-1235.
43. Tolhurst, D.J., Movshon, J.A., Dean, A.F. (1983) The statistical reliability of signals in single neurons in cat and monkey visual cortex. Vision Res, 23, 775-785.
44. Tomko, G.J. and Crapper, D.R. (1974) Neuronal variability: non-stationary responses to identical visual stimuli. Brain Res, 79, 405-418.
45. Walton, M.E., Behrens, T.E.J., Buckley, M.J., Rudebeck, P.H., Rushworth, M.F.S. (2010) Separable learning systems in the macaque brain and the role of orbitofrontal cortex in contingent learning. Neuron, 65, 927-939.