Choice-correlated activity fluctuations underlie learning of neuronal category representation

Nature Communications

Volumn 6, Issue , 2015, Pages

  Engel, Tatiana A ^a,b   Chaisangmongkon, Warasinee ^a   Freedman, David J ^c   Wang, Xiao Jing ^a,d,e  

^a YALE UNIVERSITY SCHOOL OF MEDICINE   (United States)

^b Stanford University   (United States)

^c UNIVERSITY OF CHICAGO   (United States)

^d Washington Place ^*  (United States)

^e NEW YORK UNIVERSITY SHANGHAI   (China)

Author keywords

[No Author keywords available]

Indexed keywords

BEHAVIOR; COGNITION; CORRELATION; NERVOUS SYSTEM; PHENOTYPIC PLASTICITY;

ANIMAL CELL; ANIMAL EXPERIMENT; ARTICLE; CLASSIFICATION; COGNITION; FEEDBACK SYSTEM; LEARNING; NERVE CELL PLASTICITY; NONHUMAN; PARIETAL CORTEX; PROBABILITY; REWARD; SENSORY NERVE CELL; TASK PERFORMANCE; ANIMAL; BIOLOGICAL MODEL; CYTOLOGY; DECISION MAKING; DISCRIMINATION LEARNING; ELECTRODE IMPLANT; NERVE CELL; PARIETAL LOBE; PATTERN RECOGNITION; PHYSIOLOGY; RHESUS MONKEY; SENSORY FEEDBACK;

ANIMALS; CHOICE BEHAVIOR; COGNITION; DISCRIMINATION LEARNING; ELECTRODES, IMPLANTED; FEEDBACK, SENSORY; MACACA MULATTA; MODELS, NEUROLOGICAL; NEURONS; PARIETAL LOBE; PATTERN RECOGNITION, VISUAL; REWARD;

EID: 84924778329     PISSN: None     EISSN: 20411723     Source Type: Journal    
DOI: 10.1038/ncomms7454     Document Type: Article

References (70)

1. Rosch, E. Principles of categorization. in: Concepts: Core Readings (eds Margolis, E. & Laurence, S.) 189-206 (MIT Press, Cambridge, Massachusetts, 1999).
2. Ashby, F. G. & Maddox, W. T. Human category learning. Annu. Rev. Psychol. 56, 149-178 (2005).
3. Ghose, G. M., Yang, T. & Maunsell, J. H. R. Physiological correlates of perceptual learning in monkey V1 and V2. J. Neurophys. 87, 1867-1888 (2002).
4. Yang, T. & Maunsell, J. H. R. The effect of perceptual learning on neuronal responses in monkey visual area V4. J. Neurosci. 24, 1617-1626 (2004).
5. Freedman, D. J. & Assad, J. A. Experience-dependent representation of visual categories in parietal cortex. Nature 443, 85-88 (2006).
6. Fanini, A. & Assad, J. A. Direction selectivity of neurons in the macaque lateral intraparietal area. J. Neurophys. 101, 289-305 (2009).
7. Law, C.-T. & Gold, J. I. Neural correlates of perceptual learning in a sensorymotor, but not a sensory, cortical area. Nat. Neurosci. 11, 505-513 (2008).
8. Purushothaman, G. & Bradley, D. C. Neural population code for fine perceptual decisions in area MT. Nat. Neurosci. 8, 99-106 (2005).
9. Uka, T., Sasaki, R. & Kumano, H. Change in choice-related response modulation in area MT during learning of a depth-discrimination task is consistent with task learning. J. Neurosci. 32, 13689-13700 (2012).
10. Law, C.-T. & Gold, J. I. Reinforcement learning can account for associative and perceptual learning on a visual-decision task. Nat. Neurosci. 12, 655-663 (2009).
11. Rombouts, J., Bohte, S. & Roelfsema, P. Neurally plausible reinforcement learning of working memory tasks. Adv. Neural Inf. Process. Syst. 25, 1880-1888 (2012).
12. Schultz, W., Dayan, P. & Montague, P. R. A neural substrate of prediction and reward. Science 275, 1593-1599 (1997).
13. Schultz, W. Multiple dopamine functions at different time courses. Annu. Rev. Neurosci. 30, 259-288 (2007).
14. Fremaux, N., Sprekeler, H. & Gerstner, W. Functional requirements for rewardmodulated spike-timing-dependent plasticity. J. Neurosci. 30, 13326-13337 (2010).
15. Loewenstein, Y. & Seung, H. S. Operant matching is a generic outcome of synaptic plasticity based on the covariance between reward and neural activity. Proc. Natl Acad. Sci. USA 103, 15224-15229 (2006).
16. Bishop, C. M. Neural Networks for Pattern Recognition (Oxford University Press, 1995).
17. Britten, K. H., Newsome, W. T., Shadlen, M. N., Celebrini, S. & Movshon, J. A. A relationship between behavioral choice and the visual responses of neurons in macaque MT. Vis. Neurosci. 13, 87-100 (1996).
18. Nienborg, H., Cohen, M. R. & Cumming, B. G. Decision-related activity in sensory neurons: correlations among neurons and with behavior. Annu. Rev. Neurosci. 35, 463-483 (2012).
19. Engel, T. A. & Wang, X.-J. Same or different? A neural circuit mechanism of similarity-based pattern match decision making. J. Neurosci. 31, 6982-6996 (2011).
20. Wang, X. J. Probabilistic decision making by slow reverberation in cortical circuits. Neuron 36, 955-968 (2002).
21. Wong, K.-F. & Wang, X.-J. A recurrent network mechanism of time integration in perceptual decisions. J. Neurosci. 26, 1314-1328 (2006).
22. Fiorillo, C. D., Tobler, P. N. & Schultz, W. Discrete coding of reward probability and uncertainty by dopamine neurons. Science 299, 1898-1902 (2003).
23. Bayer, H. M. & Glimcher, P. W. Midbrain dopamine neurons encode a quantitative reward prediction error signal. Neuron 47, 129-141 (2005).
24. Reynolds, J. N., Hyland, B. I. & Wickens, J. R. A cellular mechanism of reward-related learning. Nature 413, 67-70 (2001).
25. Shen, W., Flajolet, M., Greengard, P. & Surmeier, D. J. Dichotomous dopaminergic control of striatal synaptic plasticity. Science 321, 848-851 (2008).
26. Dobson, A. An Introduction to Generalized Linear Models (Chapman &Hall/CRC, 2001).
27. Borg, I. & Groenen, P. J. F. Modern Multidimensional Scaling: Theory and Applications (Springer, 1997).
28. Marzban, C. The ROC curve and the area under it as performance measures. Wea. Forecasting 19, 1106-1114 (2004).
29. Shadlen, M. N., Britten, K. H., Newsome, W. T. & Movshon, J. A. A computational analysis of the relationship between neuronal and behavioral responses to visual motion. J. Neurosci. 16, 1486-1510 (1996).
30. Martinez-Trujillo, J. C. & Treue, S. Feature-based attention increases the selectivity of population responses in primate visual cortex. Curr. Biol. 14, 744-751 (2004).
31. Ardid, S., Wang, X.-J. & Compte, A. An integrated microcircuit model of attentional processing in the neocortex. J. Neurosci. 27, 8486-8495 (2007).
32. Cohen, M. R. & Newsome, W. T. Context-dependent changes in functional circuitry in visual area MT. Neuron 60, 162-173 (2008).
33. Gu, Y., Angelaki, D. E. & DeAngelis, G. C. Neural correlates of multisensory cue integration in macaque MSTd. Nat. Neurosci. 11, 1201-1210 (2008).
34. Nienborg, H. & Cumming, B. G. Decision-related activity in sensory neurons reflects more than a neuron's causal effect. Nature 459, 89-92 (2009).
35. Williams, R. J. Simple statistical gradient-following algorithms for connectionist reinforcement learning. Mach. Learn. 8, 229-256 (1992).
36. Xie, X. & Seung, H. S. Learning in neural networks by reinforcement of irregular spiking. Phys. Rev. E 69, 1-10 (2004).
37. Pfister, J. P., Toyoizumi, T., Barber, D. & Gerstner, W. Optimal spike-timingdependent plasticity for precise action potential firing in supervised learning. Neural Comput. 18, 1318-1348 (2006).
38. Seung, H. S. Learning in spiking neural networks by reinforcement of stochastic synaptic transmission. Neuron 40, 1063-1073 (2003).
39. Vasilaki, E., Fremaux, N., Urbanczik, R., Senn, W. & Gerstner, W. Spike-based reinforcement learning in continuous state and action space: when policy gradient methods fail. PLoS Comp. Biol. 5, e1000586 (2009).
40. Urbanczik, R. & Senn, W. Reinforcement learning in populations of spiking neurons. Nat. Neurosci. 12, 250-252 (2009).
41. Roelfsema, P. R. & van Ooyen, A. Attention-gated reinforcement learning of internal representations for classification. Neural Comput. 17, 2176-2214 (2005).
42. Soltani, A. & Wang, X.-J. Synaptic computation underlying probabilistic inference. Nat. Neurosci. 13, 112-119 (2010).
43. Fitzgerald, J. K., Freedman, D. J. & Assad, J. A. Generalized associative representations in parietal cortex. Nat. Neurosci. 14, 1075-1079 (2011).
44. Goodwin, S. J., Blackman, R. K., Sakellaridi, S. & Chafee, M. V. Executive control over cognition: stronger and earlier rule-based modulation of spatial category signals in prefrontal cortex relative to parietal cortex. J. Neurosci. 32, 3499-3515 (2012).
45. Toth, L. J. & Assad, J. A. Dynamic coding of behaviourally relevant stimuli in parietal cortex. Nature 415, 165-168 (2002).
46. Stoet, G. & Snyder, L. H. Single neurons in posterior parietal cortex of monkeys encode cognitive set. Neuron 42, 1003-1012 (2004).
47. Ferrera, V. P., Yanike, M. & Cassanello, C. Frontal eye field neurons signal changes in decision criteria. Nat. Neurosci. 12, 1458-1462 (2009).
48. Mante, V., Sussillo, D., Shenoy, K. V. & Newsome, W. T. Context-dependent computation by recurrent dynamics in prefrontal cortex. Nature 503, 78-84 (2013).
49. Swaminathan, S. K., Masse, N. Y. & Freedman, D. J. A comparison of lateral and medial intraparietal areas during a visual categorization task. J. Neurosci. 33, 13157-13170 (2013).
50. Sigala, N. & Logothetis, N. K. Visual categorization shapes feature selectivity in the primate temporal cortex. Nature 415, 318-320 (2002).
51. Freedman, D. J., Riesenhuber, M., Poggio, T. & Miller, E. K. A comparison of primate prefrontal and inferior temporal cortices during visual categorization. J. Neurosci. 23, 5235-5246 (2003).
52. Wallis, J. & Miller, E. From rule to response: neuronal processes in the premotor and prefrontal cortex. J. Neurophys. 90, 1790-1806 (2003).
53. Freedman, D. J., Riesenhuber, M., Poggio, T. & Miller, E. K. Categorical representation of visual stimuli in the primate prefrontal cortex. Science 291, 312-316 (2001).
54. Swaminathan, S. K. & Freedman, D. J. Preferential encoding of visual categories in parietal cortex compared with prefrontal cortex. Nat. Neurosci. 15, 315-320 (2012).
55. Cromer, J. A., Roy, J. E. & Miller, E. K. Representation of multiple, independent categories in the primate prefrontal cortex. Neuron 66, 796-807 (2010).
56. Szabo, M. et al. Learning to attend: modeling the shaping of selectivity in infero-temporal cortex in a categorization task. Biol. Cyber 94, 351-365 (2006).
57. Roelfsema, P. R., van Ooyen, A. & Watanabe, T. Perceptual learning rules based on reinforcers and attention. Trends Cogn. Sci. 14, 64-71 (2010).
58. Freedman, D. J. & Assad, J. A. A proposed common neural mechanism for categorization and perceptual decisions. Nat. Neurosci. 14, 143-146 (2011).
59. DeLa Rocha, J., Wimmer, K., Renart, A., Roxin, A. & Compte, A. in Society for Neuroscience Annual Meeting (New Orleans, LA, USA (2012).
60. Freedman, D. J. & Assad, J. A. Distinct encoding of spatial and nonspatial visual information in parietal cortex. J. Neurosci. 29, 5671-5680 (2009).
61. Rishel, C. A., Huang, G. & Freedman, D. J. Independent category and spatial encoding in parietal cortex. Neuron 77, 969-979 (2013).
62. Haefner, R. M., Gerwinn, S., Macke, J. H. & Bethge, M. Inferring decoding strategies from choice probabilities in the presence of correlated variability. Nat. Neurosci. 16, 235-242 (2013).
63. Shiozaki, H. M., Tanabe, S., Doi, T. & Fujita, I. Neural activity in cortical area V4 underlies fine disparity discrimination. J. Neurosci. 32, 3830-3841 (2012).
64. Compte, A., Brunel, N., Goldman-Rakic, P. S. & Wang, X. J. Synaptic mechanisms and network dynamics underlying spatial working memory in a cortical network model. Cerebral Cortex 10, 910-923 (2000).
65. Abbott, L. F. & Chance, F. S. In Cortical Function: a View from the Thalamus, vol. 149 of Progress in Brain Research (eds Guillery, V. C. R. & Sherman, S.) 147-155 (Elsevier, 2005).
66. Carandini, M. & Heeger, D. J. Normalization as a canonical neural computation. Nat. Rev. Neurosci. 13, 51-62 (2011).
67. Crapse, T. B. & Sommer, M. A. Corollary discharge circuits in the primate brain. Curr. Opin. Neurobiol. 18, 552-557 (2008).
68. Soltani, A. & Wang, X.-J. A biophysically based neural model of matching law behavior: melioration by stochastic synapses. J. Neurosci. 26, 3731-3744 (2006).
69. Freedman, D. & Assad, J. Distinct encoding of spatial and nonspatial visual information in parietal cortex. J. Neurosci. 29, 5671-5680 (2009).
70. Hastie, T., Tibshirani, R. & Friedman, J. H. Data Mining, Inference, and Prediction (Springer, 2009).