Kinematic motor learning

Connection Science

Volumn 23, Issue 4, 2011, Pages 239-283

  Schenck, Wolfram ^a  

^a BIELEFELD UNIVERSITY   (Germany)

Author keywords

internal models; kinematics; motor learning; neural networks; robotics

Indexed keywords

EID: 84860743577     PISSN: 09540091     EISSN: 13600494     Source Type: Journal    
DOI: 10.1080/09540091.2011.625077     Document Type: Article

References (83)

1. Arbib, M. A. 1998. "Part I: Background". In The Handbook of Brain Theory and Neural Networks, Edited by: Arbib, M. A. 1-25. Cambridge, MA: MIT Press.
2. Bakker, B., Zhumatiy, V., Grüner, G. and Schmidhuber, J. Quasi-Online Reinforcement Learning for Robots. Proceedings of the International Conference on Robotics and Automation (ICRA-06). Orlando, FL. pp.2997-3002. Piscataway, NJ: IEEE.
3. Battaglia-Mayer, A., Caminiti, R., Lacquaniti, F. and Zago, M. 2003. Multiple Levels of Representation of Reaching in the Parieto-frontal Network. Cerebral Cortex, 13(10): 1009-1022.
4. Bortz, J. 1993. Statistik für Sozialwissenschaftler, 4, Berlin: Springer.
5. Bruske, J., Hansen, M., Riehn, L. and Sommer, G. 1997. Biologically Inspired Calibration-free Adaptive Saccade Control of a Binocular Camera-head. Biological Cybernetics, 77(6): 433-446.
6. Buneo, C. A., Jarvis, M. R., Batista, A. P. and Andersen, R. A. 2002. Direct Visuomotor Transformations for Reaching. Nature, 416(6881): 632-636.
7. Carrozzo, M., McIntyre, J., Zago, M. and Lacquaniti, F. 1999. Viewer-centered and Body-centered Frames of Reference in Direct Visuomotor Transformations. Experimental Brain Research, 129(2): 201-210.
8. Chiacchio, P., Chiaverini, S., Sciavicco, L. and Siciliano, B. 1991. Closed-loop Inverse Kinematics Schemes for Constrained Redundant Manipulators with Task Space Augmentation and Task Priority Strategy. The International Journal of Robotics Research, 10(4): 410-425.
9. Dayan, P. and Hinton, G. 1997. Using Expectation-maximization for Reinforcement Learning. Neural Computation, 9(2): 271-278.
10. Dean, P., Mayhew, J. E.W., Thacker, N. and Langdon, P. M. 1991. Saccade Control in a Simulated Robot Camera-head System - Neural Net Architectures for Efficient Learning of Inverse Kinematics. Biological Cybernetics, 66(1): 27-36.
11. Dean, P., Mayhew, J. E.W. and Langdon, P. M. 1994. Learning and Maintaining Saccadic Accuracy: A Model of Brainstem-cerebellar Interactions. Journal of Cognitive Neuroscience, 6(2): 117-138.
12. Diamantaras, K. I. and Kung, S. Y. 1996. Principal Component Neural Networks, New York: Wiley.
13. Dorf, R. C. and Bishop, R. H. 2004. Modern Control Systems, 10, Englewood Cliffs, NJ: Prentice Hall.
14. Doya, K. 2000. Complementary Roles of Basal Ganglia and Cerebellum in Learning and Motor Control. Current Opinion in Neurobiology, 10(6): 732-739.
15. Doya, K. 2007. Reinforcement Learning: Computational Theory and Biological Mechanisms. HFSP Journal, 1(1): 30-40.
16. D'Souza, A., Vijayakumar, S. and Schaal, S. Learning Inverse Kinematics. Maui, Hawaii. Piscataway, NJ. International Conference on Intelligence in Robotics and Autonomous Systems (IROS 2001), pp.298-303.
17. Flanagan, J. R., Vetter, P., Johansson, R. S. and Wolpert, D. M. 2003. Prediction Precedes Control in Motor Learning. Current Biology, 13(2): 146-150.
18. Gancarz, G. and Grossberg, S. 1999. A Neural Model of Saccadic Eye Movement Control Explains Task-specific Adaptation. Vision Research, 39(18): 3123-3143.
19. Golub, G. and van Loan, C. 1996. Matrix Computations, Baltimore, MD: Johns Hopkins University Press.
20. Gomi, H. and Kawato, M. 1993. Neural Network Control for a Closed-loop System Using Feedback-error-learning. Neural Networks, 6(7): 933-946.
21. Hoffmann, H. 2004. Unsupervised Learning of Visuomotor Associations, MPI Series in Biological Cybernetics Berlin: Logos Verlag.
22. Hoffmann, H. and Möller, R. 2003. "Unsupervised Learning of a Kinematic Arm Model". In Artificial Neural Networks and Neural Information Processing - ICANN/ICONIP 2003, Edited by: Kaynak, O., Alpaydin, E., Oja, E. and Xu, L. Vol. 2714, 463-470. Berlin: Springer. Lecture Notes in Computer Science
23. Hoffmann, H., Schenck, W. and Möller, R. 2005. Learning Visuomotor Transformations for Gaze-control and Grasping. Biological Cybernetics, 93(2): 119-130.
24. Howard, I. S. and Huckvale, M. A. Training a Vocal tract Synthesizer to Imitate Speech using Distal Supervised Learning. Proceedings of the 10th International Conference on Speech and Computer (SPECOM 2005), pp.159-162. Greece: Patras.
25. Imamizu, H. and Kawato, M. 2009. Brain Mechanisms for Predictive Control by Switching Internal Models: Implications for Higher-order Cognitive Functions. Psychological Research, 73(4): 527-544.
26. Jo, S. H. 2008. Adaptive Biomimetic Control of Robot Arm Motions. Neurocomputing, 71(16-18): 3625-3630.
27. Jordan, M. I. 1996. "Computational Aspects of Motor Control and Motor Learning". In Handbook of Perception and Action, vol. 2: Motor Skills, Edited by: Heuer, H. and Keele, S. W. 87-146. New York: Academic Press.
28. Jordan, M. I. and Rumelhart, D. E. 1992. Forward Models: Supervised Learning with a Distal Teacher. Cognitive Science, 16(3): 307-354.
29. Jordan, M. I., Flash, T. and Arnon, Y. 1994. A Model of the Learning of Arm Trajectories from Spatial Deviations. Journal of Cognitive Neuroscience, 6(4): 359-376.
30. Kaelbling, L. P., Littman, M. L. and Moore, A. W. 1996. Reinforcement Learning: A Survey. Journal of Artificial Intelligence Research, 4: 237-285.
31. Kambara, H., Kim, K., Shin, D., Sato, M. and Koike, Y. 2009. Learning and Generation of Goal-directed Arm Reaching from Scratch. Neural Networks, 22(4): 348-361.
32. Kawato, M. 1990. "Feedback-error-learning Neural Network for Supervised Motor Learning". In Advanced Neural Computers, Edited by: Eckmiller, R. 365-372. Amsterdam: North-Holland/Elsevier.
33. Kawato, M. 1999. Internal Models for Motor Control and Trajectory Planning. Current Opinion in Neurobiology, 9(6): 718-727.
34. Kawato, M. and Gomi, H. 1992. A Computational Model of Four Regions of the Cerebellum Based on Feedback-error Learning. Biological Cybernetics, 68(2): 95-103.
35. Kawato, M., Furukawa, K. and Suzuki, R. 1987. A Hierarchical Neural-network Model for Control and Learning of Voluntary Movement. Biological Cybernetics, 57(3): 169-185.
36. Klarquist, W. N. and Bovik, A. C. 1998. Fovea: A Foveated Vergent Active Stereo Vision System for Dynamic Three-dimensional Scene Recovery. IEEE Transactions on Robotics and Automation, 14(5): 755-770.
37. Körding, K. P. and König, P. 2001. Supervised and Unsupervised Learning with Two Sites of Synaptic Integration. Journal of Computational Neuroscience, 11(3): 207-215.
38. Kumar, S., Behera, L. and McGinnity, T. M. 2010. Kinematic Control of a Redundant Manipulator Using an Inverse-forward Adaptive Scheme with a KSOM Based Hint Generator. Robotics and Autonomous Systems, 58(5): 622-633.
39. Kuperstein, M. Adaptive Visual-Motor Coordination in Multijoint Robots using Parallel Architecture. Raleigh, NC. Proceedings of the IEEE International Conference on Robotics and Automation, pp.1595-1602. Piscataway, NJ
40. Kuperstein, M. 1988. Neural Model of Adaptive Hand-eye Coordination for Single Postures. Science, 239(4845): 1308-1311.
41. Lalazar, H. and Vaadia, E. 2008. Neural Basis of Sensorimotor Learning: Modifying Internal Models. Current Opinion in Neurobiology, 18(6): 573-581.
42. Leigh, R. J. and Zee, D. S. 1999. The Neurology of Eye Movements, Oxford, UK: Oxford University Press.
43. Magescas, F., Urquizar, C. and Prablanc, C. 2009. Two Modes of Error Processing in Reaching. Experimental Brain Research, 193(3): 337-350.
44. Martin, P. and Millan, J. D. 2000. Robot Arm Reaching Through Neural Inversions and Reinforcement Learning. Robotics and Autonomous Systems, 31(4): 227-246.
45. Martinetz, T. and Schulten, K. 1993. A Neural-network for Robot Control - Cooperation Between Neural Units as a Requirement for Learning. Computers and Electrical Engineering, 19(4): 315-332.
46. Martinetz, T. M., Berkovich, S. G. and Schulten, K. J. 1993. Neural-Gas' Network for Vector Quantization and its Application to Time-series Prediction. IEEE Transactions on Neural Networks, 4(4): 558-569.
47. Mel, B. W. 1991. A Connectionist Model may Shed Light on Neural Mechanisms for visually guided reaching. Journal of Cognitive Neuroscience, 3(3): 273-292.
48. Miall, R. C. and Wolpert, D. M. 1996. Forward Models for Physiological Motor Control. Neural Networks, 9(8): 1265-1279.
49. Miller, W. T., Hewes, R. P., Glanz, F. H. and Kraft, L. G. 1990. Real-time Dynamic Control of an Industrial Manipulator Using a Neural-network-based Learning Controller. IEEE Transactions on Robotics and Automation, 6(1): 1-9.
50. Möller, R. 2002. Interlocking of Learning and Orthonormalization in RRLSA. Neurocomputing, 49(1-4): 429-433.
51. Möller, R. and Hoffmann, H. 2004. An Extension of Neural Gas to Local PCA. Neurocomputing, 62: 305-326.
52. Nakanishi, J. and Schaal, S. 2004. Feedback Error Learning and Nonlinear Adaptive Control. Neural Networks, 17(10): 1453-1465.
53. Oudeyer, P. Y., Kaplan, F. and Hafner, V. V. 2007. Intrinsic Motivation Systems for Autonomous Mental Development. IEEE Transactions on Evolutionary Computation, 11(2): 265-286.
54. Ouyang, S., Bao, Z. and Liao, G.-S. 2000. Robust Recursive Least Squares Learning Algorithm for Principal Component Analysis. IEEE Transactions on Neural Networks, 11(1): 215-221.
55. Pagel, M., Maël, E. and von der Malsburg, C. 1998. Self Calibration of the Fixation Movement of a Stereo Camera Head. Machine Learning, 31(1-3): 169-186.
56. Peters, J. and Schaal, S. Reinforcement Learning by Reward-Weighted Regression for Operational Space Control. Proceedings of the 24th International Conference on Machine Learning, ICML '07, pp.745-750. New York: ACM.
57. Peters, J. and Schaal, S. 2008. Learning to control in operational space. The International Journal of Robotics Research, 27(2): 197-212.
58. Piaget, J. 1952. The Origins of Intelligence in Children, New York: International University Press.
59. Psaltis, D., Sideris, A. and Yamamura, A. Neural Controllers. IEEE First International Conference on Neural Networks, pp.551-557.
60. Rumelhart, D. E., Hinton, G. and Williams, R. 1986. "Learning Internal Representations by error Propagation". In Parallel Distributed Processing: Explorations in the Microstructure of Cognition, Foundations, Edited by: Rumelhart, D. E. and McClelland, J. L. Vol. 1, 318-362. Cambridge, MA: MIT Press.
61. Sailer, U., Flanagan, J. R. and Johansson, R. S. 2005. Eye-hand Coordination During Learning of a Novel Visuomotor Task. Journal of Neuroscience, 25(39): 8833-8842.
62. Schaal, S. and Schweighofer, N. 2005. Computational Motor Control in Humans and Robots. Current Opinion in Neurobiology, 15(6): 675-682.
63. Schenck, W. 2008. Adaptive Internal Models for Motor Control and Visual Prediction, MPI Series in Biological Cybernetics Berlin: Logos Verlag.
64. Schenck, W. and Möller, R. 2004. "Staged Learning of Saccadic Eye Movements with a Robot Camera Head". In Connectionist Models of Cognition and Perception II, Edited by: Bowman, H. and Labiouse, C. 82-91. Hackensack, NJ: World Scientific.
65. Schenck, W. and Möller, R. 2006. Learning Strategies for Saccade Control. Künstliche Intelligenz,: 19-22.
66. Schenck, W. and Möller, R. 2007. "Training and Application of a Visual Forward Model for a Robot Camera Head". In Anticipatory Behavior in Adaptive Learning Systems: From Brains to Individual and Social Behavior, Edited by: Butz, M. V., Sigaud, O., Pezzulo, G. and Baldassarre, G. Vol. 4520, 153-169. Berlin: Springer. Lecture Notes in Artificial Intelligence
67. Schenck, W., Hoffmann, H. and Möller, R. Learning Internal Models for Eye-Hand Coordination in Reaching and Grasping. Proceedings of the European Cognitive Science Conference 2003, pp.289-294. Mahwah, NJ: Lawrence Erlbaum.
68. Schenck, W., Hoffmann, H. and Möller, R. 2009. "Grasping to Extrafoveal Targets: A Robotic Model". In New Ideas in Psychology (Online version; doi:10.1016/j.newideapsych.2009.07.005)
69. Schmidhuber, J. 1991. "Reinforcement Learning in Markovian and Non-Markovian Environments". In Advances in Neural Information Processing Systems 3, 500-506. San Mateo, CA: Morgan Kaufmann.
70. Schmidhuber, J. and Huber, R. 1991. Learning to Generate Artificial Fovea Trajectories for Target Detection. International Journal of Neural Systems, 2(1-2): 125-134.
71. Schultz, W., Dayan, P. and Montague, P. R. 1997. A Neural Substrate of Prediction and Reward. Science, 275(5306): 1593-1599.
72. Schweighofer, N., Spoelstra, J., Arbib, M. A. and Kawato, M. 1998. Role of the Cerebellum in Reaching Movements in Humans. II. A Neural Model of the Intermediate Cerebellum. European Journal of Neuroscience, 10(1): 95-105.
73. Shadmehr, R. and Wise, S. P. 2005. The Computational Neurobiology of Reaching and Pointing: A Foundation for Motor Learning, Cambridge, MA: MIT Press.
74. Siciliano, B. 1990. Kinematic Control of Redundant Robot Manipulators - A Tutorial. Journal of Intelligent and Robotic Systems, 3(3): 201-212.
75. Slotine, J. and Yoerger, D. 1987. A Rule-based Inverse Kinematics Algorithm for Redundant Manipulators. International Journal of Robotics and Automation, 2: 86-89.
76. Snyder, L. H. 2000. Coordinate Transformations for Eye and Arm Movements in the Brain. Current Opinion in Neurobiology, 10(6): 747-754.
77. Spong, M. W. and Vidyasagar, M. 1989. Robot Dynamics and Control, New York: Wiley.
78. Storn, R. and Price, K. 1997. Differential Evolution - A Simple and Efficient Heuristic for Global Optimization over Continuous Spaces. Journal of Global Optimization, 11(4): 341-359.
79. Vijayakumar, S., D'Souza, A. and Schaal, S. 2005. Incremental Online Learning in High Dimensions. Neural Computation, 17(12): 2602-2634.
80. Von Hofsten, C. 1982. Eye-hand Coordination in the Newborn. Development Psychology, 18(3): 450-461.
81. Williams, R. J. 1992. Simple Statistical Gradient-following Algorithms for Connectionist Reinforcement Learning. Machine Learning, 8(3-4): 229-256.
82. Wolpert, D. M., Miall, R. C. and Kawato, M. 1998. Internal Models in the Cerebellum. Trends in Cognitive Sciences, 2(9): 338-347.
83. Xie, X. H. and Seung, H. S. 2003. Equivalence of Backpropagation and Contrastive Hebbian Learning in a Layered Network. Neural Computation, 15(2): 441-454.