Temporal structure of motor variability is dynamically regulated and predicts motor learning ability

Nature Neuroscience

Volumn 17, Issue 2, 2014, Pages 312-321

  Wu, Howard G ^a   Miyamoto, Yohsuke R ^a   Castro, Luis Nicolas Gonzalez ^a   Ölveczky, Bence P ^b   Smith, Maurice A ^a,b  

^a HARVARD UNIVERSITY   (United States)

^b HARVARD UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARM MOVEMENT; ARTICLE; CLINICAL ARTICLE; HUMAN; LEARNING; LEARNING THEORY; MOTOR LEARNING; MOTOR PERFORMANCE; MOTOR SYSTEM; NERVOUS SYSTEM; PRIORITY JOURNAL; REINFORCEMENT; REWARD; TASK PERFORMANCE; TRAINING;

ADOLESCENT; ADULT; FEMALE; HUMANS; INDIVIDUALITY; LEARNING; MALE; MIDDLE AGED; MOVEMENT; NONLINEAR DYNAMICS; PREDICTIVE VALUE OF TESTS; PSYCHOMOTOR PERFORMANCE; REWARD; TIME FACTORS; YOUNG ADULT;

EID: 84893805643     PISSN: 10976256     EISSN: 15461726     Source Type: Journal    
DOI: 10.1038/nn.3616     Document Type: Article

References (50)

1. Churchland, M.M., Afshar, A. & Shenoy, K.V. A central source of movement variability. Neuron 52, 1085-1096 (2006).
2. Jones, K.E., Hamilton, A.F.C. & Wolpert, D.M. Sources of signal-dependent noise during isometric force production. J. Neurophysiol. 88, 1533-1544 (2002).
3. Schmidt, R.A., Zelaznik, H., Hawkins, B., Frank, J.S. & Quinn, J.T. Jr. Motor-output variability: a theory for the accuracy of rapid motor acts. Psychol. Rev. 47, 415-451 (1979).
4. Stein, R.B., Gossen, E.R. & Jones, K.E. Neuronal variability: noise or part of the signal? Nat. Rev. Neurosci. 6, 389-397 (2005).
5. Osborne, L.C., Lisberger, S.G. & Bialek, W. A sensory source for motor variation. Nature 437, 412-416 (2005).
6. Harris, C.M. & Wolpert, D.M. Signal-dependent noise determines motor planning. Nature 394, 780-784 (1998).
7. van Beers, R.J., Baraduc, P. & Wolpert, D.M. Role of uncertainty in sensorimotor control. Phil. Trans. R. Soc. Lond. B 357, 1137-1145 (2002).
8. Scholz, J.P. & Schöner, G. The uncontrolled manifold concept: identifying control variables for a functional task. Exp. Brain Res. 126, 289-306 (1999).
9. Todorov, E. Optimality principles in sensorimotor control. Nat. Neurosci. 7, 907-915 (2004).
10. Todorov, E. & Jordan, M.I. Optimal feedback control as a theory of motor coordination. Nat. Neurosci. 5, 1226-1235 (2002).
11. O'Sullivan, I., Burdet, E. & Diedrichsen, J. Dissociating variability and effort as determinants of coordination. PLoS Comput. Biol. 5, e1000345 (2009).
12. Charlesworth, J.D., Warren, T.L. & Brainard, M.S. Covert skill learning in a cortical-basal ganglia circuit. Nature 486, 251-255 (2012).
13. Ölveczky, B.P., Andalman, A.S. & Fee, M.S. Vocal experimentation in the juvenile songbird requires a basal ganglia circuit. PLoS Biol. 3, e153 (2005).
14. Kao, M.H., Doupe, A.J. & Brainard, M.S. Contributions of an avian basal ganglia-forebrain circuit to real-time modulation of song. Nature 433, 638-643 (2005).
15. Tumer, E.C. & Brainard, M.S. Performance variability enables adaptive plasticity of 'crystallized' adult birdsong. Nature 450, 1240-1244 (2007).
16. Sutton, R.S. & Barto, A.G. Introduction to Reinforcement Learning (MIT Press, 1998).
17. Kaelbling, L.P., Littman, M.L. & Moore, A.W. Reinforcement learning: a survey. J. Artif. Intell. Res. 4, 237-285 (1996).
18. Roberts, S. & Gharib, A. Variation of bar-press duration: where do new responses come from? Behav. Processes 72, 215-223 (2006).
19. Stahlman, W.D. & Blaisdell, A.P. The modulation of operant variation by the probability, magnitude, and delay of reinforcement. Learn. Motiv. 42, 221-236 (2011).
20. Huang, V.S., Haith, A., Mazzoni, P. & Krakauer, J.W. Rethinking motor learning and savings in adaptation paradigms: model-free memory for successful actions combines with internal models. Neuron 70, 787-801 (2011).
21. Scheidt, R.A., Reinkensmeyer, D.J., Conditt, M.A., Rymer, W.Z. & Mussa-Ivaldi, F.A. Persistence of motor adaptation during constrained, multi-joint, arm movements. J. Neurophysiol. 84, 853-862 (2000).
22. Sing, G.C., Joiner, W.M., Nanayakkara, T., Brayanov, J.B. & Smith, M.A. Primitives for motor adaptation refect correlated neural tuning to position and velocity. Neuron 64, 575-589 (2009).
23. Smith, M.A., Ghazizadeh, A. & Shadmehr, R. Interacting adaptive processes with different timescales underlie short-term motor learning. PLoS Biol. 4, e179 (2006).
24. Sing, G.C. & Smith, M.A. Reduction in learning rates associated with anterograde interference results from interactions between different timescales in motor adaptation. PLoS Comput. Biol. 6, e1000893 (2010).
25. Joiner, W.M. & Smith, M.A. Long-term retention explained by a model of short-term learning in the adaptive control of reaching. J. Neurophysiol. 100, 2948-2955 (2008).
26. Bays, P.M., Flanagan, J.R. & Wolpert, D.M. Interference between velocity-dependent and position-dependent force-felds indicates that tasks depending on different kinematic parameters compete for motor working memory. Exp. Brain Res. 163, 400-405 (2005).
27. Diedrichsen, J., Criscimagna-Hemminger, S.E. & Shadmehr, R. Dissociating timing and coordination as functions of the cerebellum. J. Neurosci. 27, 6291-6301 (2007).
28. Joiner, W.M., Ajayi, O., Sing, G.C. & Smith, M.A. Linear hypergeneralization of learned dynamics across movement speeds reveals anisotropic, gain-encoding primitives for motor adaptation. J. Neurophysiol. 105, 45-59 (2011).
29. Conditt, M.A. & Mussa-Ivaldi, F.A. Central representation of time during motor learning. Proc. Natl. Acad. Sci. USA 96, 11625-11630 (1999).
30. Andalman, A.S. & Fee, M.S. A basal ganglia-forebrain circuit in the songbird biases motor output to avoid vocal errors. Proc. Natl. Acad. Sci. USA 106, 12518-12523 (2009).
31. Warren, T.L., Tumer, E.C., Charlesworth, J.D. & Brainard, M.S. Mechanisms and time course of vocal learning and consolidation in the adult songbird. J. Neurophysiol. 106, 1806-1821 (2011).
32. Ali, F., Otchy, T.M., Pehlevan, C., Fantana, A.L., Burak, Y. & Ölveczky, B.P. The basal ganglia is necessary for learning spectral, but not temporal, features of birdsong. Neuron 80, 494-506 (2013).
33. Gonzales-Castro, L.N., Hemphill, M. & Smith, M.A. Learning to learn: environmental consistency modulates motor adaptation rates. Proc. Ann. Symp.: Advances in Comp. Motor Control 7 (2008).
34. Frank, M.J., Doll, B.B., Oas-Terpstra, J. & Moreno, F. Prefrontal and striatal dopaminergic genes predict individual differences in exploration and exploitation. Nat. Neurosci. 12, 1062-1068 (2009).
35. Della-Maggiore, V., Scholz, J., Johansen-Berg, H. & Paus, T. The rate of visuomotor adaptation correlates with cerebellar white-matter microstructure. Hum. Brain Mapp. 30, 4048-4053 (2009).
36. Tomassini, V. et al. Structural and functional bases for individual differences in motor learning. Hum. Brain Mapp. 32, 494-508 (2011).
37. Rutishauser, U., Ross, I.B., Mamelak, A.N. & Schuman, E.M. Human memory strength is predicted by theta-frequency phase-locking of single neurons. Nature 464, 903-907 (2010).
38. Berry, S.D. & Thompson, R.F. Prediction of learning rate from the hippocampal electroencephalogram. Science 200, 1298-1300 (1978).
39. Tamás Kincses, Z. et al. Model-free characterization of brain functional networks for motor sequence learning using fMRI. Neuroimage 39, 1950-1958 (2008).
40. Tchernichovski, O., Mitra, P.P., Lints, T. & Nottebohm, F. Dynamics of the vocal imitation process: how a zebra fnch learns its song. Science 291, 2564-2569 (2001).
41. Woolley, S.C. & Doupe, A.J. Social context-induced song variation affects female behavior and gene expression. PLoS Biol. 6, e62 (2008).
42. Doya, K. & Sejnowski, T. A novel reinforcement model of birdsong vocalization learning. Adv. Neural Inf. Process. Syst. 8, 101-108 (1995).
43. Fiete, I.R., Fee, M.S. & Seung, H.S. Model of birdsong learning based on gradient estimation by dynamic perturbation of neural conductances. J. Neurophysiol. 98, 2038-2057 (2007).
44. Daw, N.D., Niv, Y. & Dayan, P. Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nat. Neurosci. 8, 1704-1711 (2005).
45. Thoroughman, K.A. & Shadmehr, R. Learning of action through adaptive combination of motor primitives. Nature 407, 742-747 (2000).
46. Wagner, M.J. & Smith, M.A. Shared internal models for feedforward and feedback control. J. Neurosci. 28, 10663-10673 (2008).
47. Sober, S.J., Wohlgemuth, M.J. & Brainard, M.S. Central contributions to acoustic variation in birdsong. J. Neurosci. 28, 10370-10379 (2008).
48. Mandelblat-Cerf, Y., Paz, R. & Vaadia, E. Trial-to-trial variability of single cells in motor cortices is dynamically modifed during visuomotor adaptation. J. Neurosci. 29, 15053-15062 (2009).
49. Takikawa, Y., Kawagoe, R., Itoh, H., Nakahara, H. & Hikosaka, O. Modulation of saccadic eye movements by predicted reward outcome. Exp. Brain Res. 142, 284-291 (2002).
50. Ölveczky, B.P., Otchy, T.M., Goldberg, J.H., Aronov, D. & Fee, M.S. Changes in the neural control of a complex motor sequence during learning. J. Neurophysiol. 106, 386-397 (2011).