Structure learning in action

Behavioural Brain Research

Volumn 206, Issue 2, 2010, Pages 157-165

  Braun, Daniel A ^a   Mehring, Carsten ^b   Wolpert, Daniel M ^a  

^a UNIVERSITY OF CAMBRIDGE   (United Kingdom)

^b UNIVERSITY OF FREIBURG   (Germany)

Author keywords

Adaptive motor control; Dimensionality reduction; Learning to learn; Structure learning; Variability; Visuomotor learning

Indexed keywords

ADAPTATION; ANIMAL BEHAVIOR; BAYESIAN LEARNING; CONCEPTUAL FRAMEWORK; DECISION MAKING; HUMAN; LEARNING; LEARNING ALGORITHM; LEARNING STYLE; MOTOR CONTROL; MOTOR SYSTEM; NEUROSCIENCE; NONHUMAN; PERCEPTION; PRIORITY JOURNAL; REVIEW; SENSORIMOTOR FUNCTION; SKILL RETENTION; STIMULUS RESPONSE; TASK PERFORMANCE;

ANIMALS; COGNITION; CONCEPT FORMATION; HUMANS; LEARNING; MODELS, NEUROLOGICAL; MOTOR SKILLS;

EID: 70350336831     PISSN: 01664328     EISSN: 18727549     Source Type: Journal    
DOI: 10.1016/j.bbr.2009.08.031     Document Type: Review

References (108)

1. Ashby W.R. Design for a brain: the origin of adaptive behavior. 2nd ed. (1960), Chapman & Hall, London
2. Pearl J. Probabilistic reasoning in intelligent systems: networks of plausible inference (1988), Morgan Kaufmann Publishers, San Mateo, CA
3. Boyen X., Friedman N., and Koller D. Discovering the hidden structure of complex dynamic systems. Proceedings of the 15th annual conference on uncertainty in artificial intelligence (UAI-99) (1999), Morgan Kaufmann 91-100
4. Åström K.J., and Wittenmark B. Adaptive control. 2nd ed. (1995), Addison-Wesley, Reading, MA
5. Friedman N. The Bayesian structural EM algorithm. Proceedings of the 14th annual conference on uncertainty in artificial intelligence (UAI-98) (1998), Morgan Kaufmann 129-139
6. Jordan M.I. Learning in graphical models. 1st MIT Press ed. (1999), MIT Press, Cambridge, MA; London
7. Buntine W.L. A guide to the literature on learning probabilistic networks from data. IEEE Transactions on Knowledge and Data Engineering 8 (1996) 195-210
8. Needham C.J., Bradford J.R., Bulpitt A.J., and Westhead D.R. A primer on learning in Bayesian networks for computational biology. PLoS Computational Biology 3 (2007) e129
9. Vapnik V.N. Statistical learning theory (1998), Wiley, New York
10. Seidler R.D. Multiple motor learning experiences enhance motor adaptability. Journal of Cognitive Neuroscience 16 (2004) 65-73
11. Harlow H.F. The formation of learning sets. Psychological Review 56 (1949) 51-65
12. Dudai Y. Memory from A to Z: keywords, concepts and beyond (2004), Oxford University Press, Oxford
13. Reznikova Z.I. Animal intelligence: from individual to social cognition (2007), Cambridge University Press, Cambridge, New York
14. Schrier A.M. Learning how to learn: the significance and current status of learning set formation. Primates 25 (1984) 95-102
15. Langbein J., Siebert K., Nurnberg G., and Manteuffel G. Learning to learn during visual discrimination in group housed dwarf goats (Capra hircus). Journal of Comparative Psychology 121 (2007) 447-456
16. Bailey A.M., and Thomas R.K. The effects of nucleus basalis magnocellularis lesions in Long-Evans hooded rats on two learning set formation tasks, delayed matching-to-sample learning, and open-field activity. Behavioral Neuroscience 115 (2001) 328-340
17. Mackintosh N.J., and Little L. Intradimensional and extradimensional shift learning by pigeons. Psychonomic Science 14 (1969) 5-6
18. Roberts A.C., Robbins T.W., and Everitt B.J. The effects of intradimensional and extradimensional shifts on visual discrimination learning in humans and non-human primates. The Quarterly Journal of Experimental Psychology 40 (1988) 321-341
19. Trobalon J.B., Miguelez D., McLaren I.P., and Mackintosh N.J. Intradimensional and extradimensional shifts in spatial learning. Journal of Experimental Psychology. Animal Behavior Processes 29 (2003) 143-152
20. Garner J.P., Thogerson C.M., Wurbel H., Murray J.D., and Mench J.A. Animal neuropsychology: validation of the intra-dimensional extra-dimensional set shifting task for mice. Behavioural Brain Research 173 (2006) 53-61
21. Warren J.M. The comparative psychology of learning. Annual Review of Psychology 16 (1965) 95-118
22. Preston G.C., Dickinson A., and Mackintosh N.J. Contextual conditional discriminations. The Quarterly Journal of Experimental Psychology Section B 38 (1986) 217-237
23. Santi A. The role of physical identity of the sample and correct comparison stimulus in matching-to-sample paradigms. Journal of the Experimental Analysis of Behavior 29 (1978) 511-516
24. Edwards C.A., Jagielo J.A., Zentall T.R., and Hogan D.E. Acquired equivalence and distinctiveness in matching-to-sample by pigeons: mediation by reinforcer-specific expectancies. Journal of Experimental Psychology: Animal Behavior Processes 8 (1982) 244-259
25. Fujita K. Acquisition and transfer of a higher-order conditional discrimination performance in the Japanese monkey. Japanese Psychological Research 25 (1983) 1-8
26. Young M.E., and Wasserman E.A. Entropy detection by pigeons: response to mixed visual displays after same-different discrimination training. Journal of Experimental Psychology. Animal Behavior Processes 23 (1997) 157-170
27. Wasserman E.A., Fagot J., and Young M.E. Same-different conceptualization by baboons (Papio papio): the role of entropy. Journal of Comparative Psychology 115 (2001) 42-52
28. Wasserman E.A., Hugart J.A., and Kirkpatrick-Steger K. Pigeons show same-different conceptualization after training with complex visual stimuli. Journal of Experimental Psychology: Animal Behavior Processes 21 (1995) 248-252
29. Sappington B.F., and Goldman L. Discrimination learning and concept formation in the Arabian horse. Journal of Animal Science 72 (1994) 3080-3087
30. Delius J.D., and Habers G. Symmetry: can pigeons conceptualize it?. Behavioral Biology 22 (1978) 336-342
31. Herrnstein R.J., and Loveland D.H. Complex visual concept in the pigeon. Science (New York, NY) 146 (1964) 549-551
32. Savage-Rumbaugh E.S., Rumbaugh D.M., Smith S.T., and Lawson J. Reference: the linguistic essential. Science (New York, NY) 210 (1980) 922-925
33. Bovet D., and Vauclair J. Picture recognition in animals and humans. Behavioural Brain Research 109 (2000) 143-165
34. Bovet D., and Vauclair J. Judgment of conceptual identity in monkeys. Psychonomic Bulletin & Review 8 (2001) 470-475
35. Thompson R.K.R., and Oden D.L. Categorical perception and conceptual judgments by nonhuman primates: the paleological monkey and the analogical ape. Cognitive Science 24 (2000) 363-396
36. Brown A.L., and Kane M.J. Preschool children can learn to transfer: learning to learn and learning from example. Cognitive Psychology 20 (1988) 493-523
37. Duncan C.P. Description of learning to learn in human subjects. The American Journal of Psychology 73 (1960) 108-114
38. Hultsch D.F. Learning to learn in adulthood. Journal of Gerontology 29 (1974) 302-308
39. Halford G.S., Bain J.D., Maybery M.T., and Andrews G. Induction of relational schemas: common processes in reasoning and complex learning. Cognitive Psychology 35 (1998) 201-245
40. Tenenbaum J.B., and Griffiths T.L. Generalization, similarity, and Bayesian inference. The Behavioral and Brain Sciences 24 (2001) 629-640 [discussion 652-791]
41. Kemp C., Perfors A., and Tenenbaum J.B. Learning domain structures. Proceedings of the twenty-sixth annual conference of the cognitive science society (2004)
42. Kemp C., and Tenenbaum J.B. The discovery of structural form. Proceedings of the National Academy of Sciences of the United States of America 105 (2008) 10687-10692
43. Michel M.M., and Jacobs R.A. Parameter learning but not structure learning: a Bayesian network model of constraints on early perceptual learning. Journal of Vision 7 (2007) 4
44. Gopnik A., Glymour C., Sobel D.M., Schulz L.E., Kushnir T., and Danks D. A theory of causal learning in children: causal maps and Bayes nets. Psychological Review 111 (2004) 3-32
45. Kemp C., and Tenenbaum J.B. Structured statistical models of inductive reasoning. Psychological Review 116 (2009) 20-58
46. Tenenbaum J.B., and Griffiths T.L. Structure learning in human causal induction. Advances in neural information processing systems (2001), MIT Press
47. Steyvers M., Tenenbaum J.B., Wagenmakers E.J., and Blum B. Inferring causal networks from observations and interventions. Cognitive Science 27 (2003) 453-489
48. Griffiths T.L., and Tenenbaum J.B. Structure and strength in causal induction. Cognitive Psychology 51 (2005) 334-384
49. Pearl J. Causality: models, reasoning and inference (2000), Cambridge University Press, Cambridge; New York
50. Waldmann M.R., and Hagmayer Y. Seeing versus doing: two modes of accessing causal knowledge. Journal of Experimental Psychology. Learning, Memory, and Cognition 31 (2005) 216-227
51. Lagnado D.A., and Sloman S. The advantage of timely intervention. Journal of Experimental Psychology. Learning, Memory, and Cognition 30 (2004) 856-876
52. Lagnado D.A., and Sloman S.A. Time as a guide to cause. Journal of Experimental Psychology. Learning, Memory, and Cognition 32 (2006) 451-460
53. Acuña D., and Schrater P. Structure learning in human sequential decision-making. Advances in neural information processing systems (2008), MIT Press
54. Sastry S., and Bodson M. Adaptive Control: Stability, Convergence and Robustness (1989), Prentice-Hall Advanced Reference Series, Englewood Cliffs, NJ
55. Todorov E., and Jordan M.I. Optimal feedback control as a theory of motor coordination. Nature Neuroscience 5 (2002) 1226-1235
56. Todorov E. Optimality principles in sensorimotor control. Nature Neuroscience 7 (2004) 907-915
57. Scott S.H. Optimal feedback control and the neural basis of volitional motor control. Nature Reviews 5 (2004) 532-546
58. Diedrichsen J. Optimal task-dependent changes of bimanual feedback control and adaptation. Current Biology 17 (2007) 1675-1679
59. Liu D., and Todorov E. Evidence for the flexible sensorimotor strategies predicted by optimal feedback control. Journal of Neuroscience 27 (2007) 9354-9368
60. Guigon E., Baraduc P., and Desmurget M. Computational motor control: redundancy and invariance. Journal of Neurophysiology 97 (2007) 331-347
61. Nagengast A.J., Braun D.A., and Wolpert D.M. Optimal control predicts human performance on objects with internal degrees of freedom. PLoS Computational Biology 5 (2009) e1000419
62. Adolph K.E. Learning to move. Current Direction in Psychological Sciences 17 (2008) 213-218
63. Bock O., and Schneider S. Acquisition of a sensorimotor skill in younger and older adults. Acta Physiologica et Pharmacologica Bulgarica 26 (2001) 89-92
64. Bock O., Schneider S., and Bloomberg J. Conditions for interference versus facilitation during sequential sensorimotor adaptation. Experimental Brain Research 138 (2001) 359-365
65. Braun D.A., Aertsen A., Wolpert D.M., and Mehring C. Learning optimal adaptation strategies in unpredictable motor tasks. Journal of Neuroscience 29 (2009) 6472-6478
66. Braun D.A., Aertsen A., Wolpert D.M., and Mehring C. Motor task variation induces structural learning. Current Biology 19 (2009) 1-6
67. Welch R.B., Bridgeman B., Anand S., and Browman K.E. Alternating prism exposure causes dual adaptation and generalization to a novel displacement. Perception and Psychophysics 54 (1993) 195-204
68. Zarahn E., Weston G.D., Liang J., Mazzoni P., and Krakauer J.W. Explaining savings for visuomotor adaptation: linear time-invariant state-space models are not sufficient. Journal of Neurophysiology 100 (2008) 2537-2548
69. Seidler R.D. Older adults can learn to learn new motor skills. Behavioural Brain Research 183 (2007) 118-122
70. Roller C.A., Cohen H.S., Kimball K.T., and Bloomberg J.J. Variable practice with lenses improves visuo-motor plasticity. Brain Research 12 (2001) 341-352
71. Cohen H.S., Bloomberg J.J., and Mulavara A.P. Obstacle avoidance in novel visual environments improved by variable practice training. Perceptual and Motor Skills 101 (2005) 853-861
72. Mulavara A.P., Cohen H.S., and Bloomberg J.J. Critical features of training that facilitate adaptive generalization of over ground locomotion. Gait & Posture 29 (2009) 242-248
73. Shea J.B., and Morgan R.L. Contextual interference effects on the acquisition, retention and transfer of a motor skill. Journal of Experimental Psychology 5 (1979) 179-187
74. Abeele S., and Bock O. Mechanisms for sensorimotor adaptation to rotated visual input. Experimental Brain Research 139 (2001) 248-253
75. Bernstein N.A. The co-ordination and regulation of movements (1967), Pergamon Press, Oxford; New York
76. Scholz J.P., Schoner G., and Latash M.L. Identifying the control structure of multijoint coordination during pistol shooting. Experimental Brain Research 135 (2000) 382-404
77. Scholz J.P., and Schoner G. The uncontrolled manifold concept: identifying control variables for a functional task. Experimental Brain Research 126 (1999) 289-306
78. Latash M.L., Scholz J.P., and Schoner G. Motor control strategies revealed in the structure of motor variability. Exercise and Sport Sciences Reviews 30 (2002) 26-31
79. Todorov E., and Jordan M.I. A minimal intervention principle for coordinated movement. Advances in Neural Information Processing Systems (2003)
80. Valero-Cuevas F.J., Venkadesan M., and Todorov E. Structured variability of muscle activations supports the minimal intervention principle of motor control. Journal of Neurophysiology 102 (2009) 59-68
81. Arutyunyan G.H., Gurfinkel V.S., and Mirskii M.L. Investigation of aiming at a target. Biophysics 13 (1968) 536-538
82. Arutyunyan G.H., Gurfinkel V.S., and Mirskii M.L. Organization of movements on execution by man of an exact postural task. Biophysics 14 (1969) 1162-1167
83. Cusumano J.P., and Cesari P. Body-goal variability mapping in an aiming task. Biological Cybernetics 94 (2006) 367-379
84. Kudo K., Tsutsui S., Ishikura T., Ito T., and Yamamoto Y. Compensatory coordination of release parameters in a throwing task. Journal of Motor Behavior 32 (2000) 337-345
85. Martin T.A., Greger B.E., Norris S.A., and Thach W.T. Throwing accuracy in the vertical direction during prism adaptation: not simply timing of ball release. Journal of Neurophysiology 85 (2001) 2298-2302
86. Muller H., and Sternad D. Motor learning: changes in the structure of variability in a redundant task. Advances in Experimental Medicine and Biology 629 (2009) 439-456
87. d'Avella A., Saltiel P., and Bizzi E. Combinations of muscle synergies in the construction of a natural motor behavior. Nature Neuroscience 6 (2003) 300-308
88. Tresch M.C., Saltiel P., and Bizzi E. The construction of movement by the spinal cord. Nature Neuroscience 2 (1999) 162-167
89. Shapkova E.Y., Shapkova A.L., Goodman S.R., Zatsiorsky V.M., and Latash M.L. Do synergies decrease force variability? A study of single-finger and multi-finger force production. Experimental Brain Research 188 (2008) 411-425
90. Schmidt R.A. A schema theory of discrete motor skill learning. Psychological Review 82 (1975) 225-260
91. Schmidt R.A. Motor schema theory after 27 years: reflections and implications for a new theory. Research Quarterly for Exercise and Sport 74 (2003) 366-375
92. Shadmehr R., and Mussa-Ivaldi F.A. Adaptive representation of dynamics during learning of a motor task. Journal of Neuroscience 14 (1994) 3208-3224
93. Wolpert D.M., Ghahramani Z., and Jordan M.I. An internal model for sensorimotor integration. Science (New York, NY) 269 (1995) 1880-1882
94. Wagner M.J., and Smith M.A. Shared internal models for feedforward and feedback control. Journal of Neuroscience 28 (2008) 10663-10673
95. Tenenbaum J.B., Griffiths T.L., and Kemp C. Theory-based Bayesian models of inductive learning and reasoning. Trends in Cognitive Sciences 10 (2006) 309-318
96. Glymour C. Learning, prediction and causal Bayes nets. Trends in Cognitive Sciences 7 (2003) 43-48
97. Kording K.P., and Wolpert D.M. Bayesian integration in sensorimotor learning. Nature 427 (2004) 244-247
98. Kording K.P., and Wolpert D.M. Bayesian decision theory in sensorimotor control. Trends in Cognitive Sciences 10 (2006) 319-326
99. Ghahramani Z. Learning dynamic Bayesian networks. Lecture Notes in Computer Science 1387 (1997) 168-197
100. Niculescu-Mizil A., and Caruana R. Inductive transfer for Bayesian network structure learning. Proceedings of the Eleventh International Conference on Artificial Intelligence and Statistics (AISTATS 2007) (2007)
101. Nolfi S., and Parisi D. Learning to adapt to changing environments in evolving neural networks. Adaptive Behavior 5 (1996) 75-98
102. Davidson P.R., and Wolpert D.M. Motor learning and prediction in a variable environment. Current Opinion in Neurobiology 13 (2003) 232-237
103. Karniel A., and Mussa-Ivaldi F.A. Does the motor control system use multiple models and context switching to cope with a variable environment?. Experimental Brain Research 143 (2002) 520-524
104. Scheidt R.A., Dingwell J.B., and Mussa-Ivaldi F.A. Learning to move amid uncertainty. Journal of Neurophysiology 86 (2001) 971-985
105. Takahashi C.D., Scheidt R.A., and Reinkensmeyer D.J. Impedance control and internal model formation when reaching in a randomly varying dynamical environment. Journal of Neurophysiology 86 (2001) 1047-1051
106. Wigmore V., Tong C., and Flanagan J.R. Visuomotor rotations of varying size and direction compete for a single internal model in motor working memory. Journal of Experimental Psychology 28 (2002) 447-457
107. Witney A.G., Vetter P., and Wolpert D.M. The influence of previous experience on predictive motor control. Neuroreport 12 (2001) 649-653
108. Gallese V., and Lakoff G. The Brain's concepts: the role of the Sensory-motor system in conceptual knowledge. Cognitive Neuropsychology 22 (2005) 455-479