Reward-timing-dependent bidirectional modulation of cortical microcircuits during optical single-neuron operant conditioning

Nature Communications

Volumn 5, Issue , 2014, Pages

  Hira, Riichiro ^a,b   Ohkubo, Fuki ^a,b   Masamizu, Yoshito ^a,b   Ohkura, Masamichi ^c   Nakai, Junichi ^c   Okada, Takashi ^d   Matsuzaki, Masanori ^a,b  

^a GRADUATE UNIVERSITY FOR ADVANCED STUDIES   (Japan)

^b JAPAN SCIENCE AND TECHNOLOGY AGENCY   (Japan)

^c SAITAMA UNIVERSITY   (Japan)

^d NIPPON MEDICAL SCHOOL   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

WATER;

BEHAVIORAL ECOLOGY; CALCIUM; ENVIRONMENTAL CHANGE; NEUROLOGY; OPTICAL PROPERTY;

ANIMAL EXPERIMENT; ARTICLE; ENVIRONMENTAL CHANGE; FEMALE; FORELIMB; INSTRUMENTAL CONDITIONING; LIMB MOVEMENT; MOTOR CORTEX; MOUSE; NONHUMAN; PHOTOACTIVATION; PHOTOSTIMULATION; REWARD; ACTION POTENTIAL; ADAPTATION; ANIMAL; C57BL MOUSE; CYTOLOGY; ELECTROENCEPHALOGRAM; MALE; MOTONEURON; PHYSIOLOGY; REINFORCEMENT;

ANIMALIA; MUS;

ACTION POTENTIALS; ADAPTATION, PHYSIOLOGICAL; ANIMALS; BRAIN WAVES; CONDITIONING, OPERANT; FEMALE; MALE; MICE; MICE, INBRED C57BL; MOTOR CORTEX; MOTOR NEURONS; REINFORCEMENT (PSYCHOLOGY); REWARD;

EID: 84923272334     PISSN: None     EISSN: 20411723     Source Type: Journal    
DOI: 10.1038/ncomms6551     Document Type: Article

References (41)

1. Green, A. M. & Kalaska, J. F. Learning to move machines with the mind. Trends Neurosci. 34, 61-75 (2011).
2. Moritz, C. T., Perlmutter, S. I. & Fetz, E. E. Direct control of paralysed muscles by cortical neurons. Nature 456, 639-642 (2008).
3. Fetz, E. E. Operant conditioning of cortical unit activity. Science 163, 955-958 (1969).
4. Fetz, E. E. Volitional control of neural activity: implications for brain-computer interfaces. J. Physiol. 579, 571-579 (2007).
5. Schafer, R. J. & Moore, T. Selective attention from voluntary control of neurons in prefrontal cortex. Science 332, 1568-1571 (2011).
6. Izhikevich, E. M. Solving the distal reward problem through linkage of STDP and dopamine signaling. Cereb. Cortex 17, 2443-2452 (2007).
7. Legenstein, R., Pecevski, D. & Maass, W. A learning theory for rewardmodulated spike-timing-dependent plasticity with application to biofeedback. PLoS Comput. Biol. 4, e1000180 (2008).
8. Legenstein, R., Chase, S. M., Schwartz, A. B. & Maass, W. A reward-modulated hebbian learning rule can explain experimentally observed network reorganization in a brain control task. J. Neurosci. 30, 8400-8410 (2010).
9. Fetz, E. E. & Baker, M. A. Operantly conditioned patterns on precentral unit activity and correlated responses in adjacent cells and contralateral muscles. J. Nuerophysiol 36, 179-204 (1973).
10. Hwang, E. J., Bailey, P. M. & Andersen, R. A. Volitional control of neural activity relies on the natural motor repertoire. Curr. Biol. 23, 353-361 (2013).
11. Arduin, P.-J., Frégnac, Y., Shulz, D. E. & Ego-Stengel, V. 'Master' neurons induced by operant conditioning in rat motor cortex during a brain-machine interface task. J. Neurosci. 33, 8308-8320 (2013).
12. Dombeck, D. A., Graziano, M. S. & Tank, D. W. Functional clustering of neurons in motor cortex determined by cellular resolution imaging in awake behaving mice. J. Neurosci. 29, 13751-13760 (2009).
13. Hira, R. et al. Spatiotemporal dynamics of functional clusters of neurons in the mouse motor cortex during a voluntary movement. J. Neurosci. 33, 1377-1390 (2013).
14. Lütcke, H., Margolis, D. J. & Helmchen, F. Steady or changing? Long-term monitoring of neuronal population activity. Trends Neurosci. 36, 375-384 (2013).
15. Komiyama, T. et al. Learning-related fine-scale specificity imaged in motor cortex circuits of behaving mice. Nature 464, 1182-1186 (2010).
16. Masamizu, Y. et al. Two distinct layer-specific dynamics of cortical ensembles during learning of a motor task. Nat. Neurosci. 17, 987-994 (2014).
17. Gage, G. J., Ludwig, K. A., Otto, K. J., Ionides, E. L. & Kipke, D. R. Naive coadaptive cortical control. J. Neural Eng. 2, 52-63 (2005).
18. Gradinaru, V. et al. Targeting and readout strategies for fast optical neural control in vitro and in vivo. J. Neurosci. 27, 14231-14238 (2007).
19. Isomura, Y. et al. Reward-modulated motor information in identified striatum neurons. J. Neurosci. 33, 10209-10220 (2013).
20. Ohkura, M. et al. Genetically encoded green fluorescent Ca2+ indicators with improved detectability for neuronal Ca2+ signals. PLoS One 7, e51286 (2012).
21. Hira, R. et al. In vivo optogenetic tracing of functional corticocortical connections between motor forelimb areas. Front. Neural Circuits 7, 55 (2013).
22. Tennant, K. A. et al. The organization of the forelimb representation of the C57BL/6 mouse motor cortex as defined by intracortical microstimulation and cytoarchitecture. Cereb. Cortex 21, 865-876 (2011).
23. Vogelstein, J. T. et al. Fast nonnegative deconvolution for spike train inference from population calcium imaging. J. Neurophysiol. 104, 3691-3704 (2010).
24. O'Connor, D. H., Peron, S. P., Huber, D. & Svoboda, K. Neural activity in barrel cortex underlying vibrissa-based object localization in mice. Neuron 67, 1048-1061 (2010).
25. Schultz, W. Multiple dopamine functions at different time courses. Annu. Rev. Neurosci. 30, 259-288 (2007).
26. Chen, T.-W. et al. Ultrasensitive fluorescent proteins for imaging neuronal activity. Nature 499, 295-300 (2013).
27. Clancy, K. B., Koralek, A. C., Costa, R. M., Feldman, D. E. & Carmena, J. M. Volitional modulation of optically recorded calcium signals during neuroprosthetic learning. Nat. Neurosci. 17, 807-809 (2014).
28. Gandolfo, F., Li, C.-S., Benda, B., Schioppa, C. P. & Bizzi, E. Cortical correlates of learning in monkeys adapting to a new dynamical environment. Proc. Natl Acad. Sci. USA 97, 2259-2263 (2000).
29. Abbott, L. F. & Nelson, S. B. Synaptic plasticity: taming the beast. Nat. Neurosci. 3, 1178-1183 (2000).
30. Bao, S., Chan, V. T. & Merzenich, M. M. Cortical remodelling induced by activity of ventral tegmental dopamine neurons. Nature 412, 79-83 (2001).
31. Bao, S., Chan, V. T., Zhang, L. I. & Merzenich, M. M. Suppression of cortical representation through backward conditioning. Proc. Natl. Acad. Sci. USA 100, 1405-1408 (2003).
32. Molina-Luna, K. et al. Dopamine in motor cortex is necessary for skill learning and synaptic plasticity. PLoS One 4, e7082 (2009).
33. Garris, P. & Wightman, R. Different kinetics govern dopaminergic transmission in the amygdala, prefrontal cortex, and striatum: an in vivo voltammetric study. J. Neurosci. 14, 442-450 (1994).
34. Shen, W., Flajolet, M., Greengard, P. & Surmeier, D. J. Dichotomous dopaminergic control of striatal synaptic plasticity. Science 321, 848-851 (2008).
35. Koralek, A. C., Jin, X., Long, II J. D., Costa, R. M. & Carmena, J. M. Corticostriatal plasticity is necessary for learning intentional neuroprosthetic skills. Nature 483, 331-335 (2012).
36. Xiao, W. et al. Gene therapy vectors based on adeno-associated virus type 1. J. Virol. 73, 3994-4003 (1999).
37. Okada, T. et al. Large-scale production of recombinant viruses by use of a large culture vessel with active gassing. Hum. Gene Ther. 16, 1212-1218 (2005).
38. Okada, T. et al. Scalable purification of adeno-associated virus serotype 1 (AAV1) and AAV8 vectors, using dual ion-exchange adsorptive membranes. Hum. Gene Ther. 20, 1013-1021 (2009).
39. Masamizu, Y. et al. Local and retrograde gene transfer into primate neuronal pathways via adeno-associated virus serotype 8 and 9. Neurosci 193, 249-258 (2011).
40. Hira, R. et al. Transcranial optogenetic stimulation for functional mapping of the motor cortex. J. Neurosci. Methods 179, 258-263 (2009).
41. Thevenaz, P., Ruttimann, U. E. & Unser, M. A pyramid approach to subpixel registration based on intensity. IEEE Trans. Image Process 7, 27-41 (1998).