Learning an internal dynamics model from control demonstration

30th International Conference on Machine Learning, ICML 2013

Volumn , Issue PART 1, 2013, Pages 606-614

  Golub, Matthew D ^a   Chase, Steven M ^a   Yu, Byron M ^a  

^a CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; DEMONSTRATIONS; DYNAMICS; FEEDBACK; LEARNING SYSTEMS; SENSORY FEEDBACK;

BRAIN MACHINE INTERFACE; INTERNAL DYNAMICS; INTERNAL MODELING; INVERSE CONTROL; NEURAL CONTROL SIGNALS; NON-HUMAN PRIMATE; OPTIMAL CONTROLS; PROBABILISTIC FRAMEWORK;

CONTROLLERS;

EID: 84897478882     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (21)

1. Abbeel, P. and Ng, A.Y. Apprenticeship learning via inverse reinforcement learning. In Proc. 21st International Conf. on Machine Learning, pp. 1-8, 2004.
2. Abbeel, P., Quigley, M., and Ng, A.Y. Using inaccurate models in reinforcement learning. In Proc. 23rd International Conf. on Machine learning, pp. 1-8, 2006.
3. Anderson, B.D.O. and Moore, J.B. Optimal control: linear quadratic methods. Prentice-Hall, Inc., Upper Saddle River, NJ, USA, 1990.
4. Boyd, S., El Ghaoui, L., Feron, E., and Balakrishnan, V. Linear Matrix Inequalities in System and Control Theory. Studies in Applied Mathematics, Philadelphia, PA, 1994.
5. Chase, S.M., Kass, R.E., and Schwartz, A.B. Behavioral and neural correlates of visuomotor adaptation observed through a brain-computer interface in primary motor cortex. J. Neurophysiol., 108(2):624-644, 2012.
6. Coates, A., Abbeel, P., and Y. Ng, A.Y. Learning for control from multiple demonstrations. In Proc. 25th International Conf. on Machine Learning, pp. 144-151, 2008.
7. Crapse, T.B. and Sommer, M.A. Corollary discharge across the animal kingdom. Nat. Rev. Neurosci., 9 (8):587-600, 2008. (Pubitemid 352032115)
8. Deisenroth, M.P. and Rasmussen, C.E. Pilco: A model-based and data-efficient approach to policy search. In Proc. 28th International Conf. on Machine Learning, pp. 465-472, 2011.
9. Deisenroth, M.P., Turner, R.D., Huber, M.F., Hanebeck, U.D., and Rasmussen, C.E. Robust filtering and smoothing with gaussian processes. IEEE Trans. Automatic Control, 57(7):1865-1871, 2012.
10. Dempster, A.P., Laird, N.M., and Rubin, D.B. Maximum likelihood from incomplete data via the EM algorithm. J. Royal Stat. Soc., Series B, 39(1):1-38, 1977.
11. Ganguly, K., Dimitrov, D.F., Wallis, J.D., and Carmena, J.M. Reversible large-scale modification of cortical networks during neuroprosthetic control. Nature Neurosci., 14(5):662-667, 2011.
12. Georgopoulos, A.P., Caminiti, R., Kalaska, J.F., and Massey, J.T. Spatial coding of movement: a hypothesis concerning the coding of movement direction by motor cortical populations. Exp. Brain Res. Suppl., 7:327-336, 1983. (Pubitemid 13060611)
13. Green, A.M. and Kalaska, J.F. Learning to move machines with the mind. Trends Neurosci., 34(2):61-75, 2011.
14. Kording, K.P. and Wolpert, D.M. The loss function of sensorimotor learning. Proc. Natl. Acad. Sci., 101 (26):9839-9842, 2004. (Pubitemid 38869323)
15. Miall, R.C. and Wolpert, D.M. Forward models for physiological motor control. Neural Networks, 9(8): 1265-1279, 1996. (Pubitemid 26413051)
16. Ng, A.Y. and Russell, S. Algorithms for inverse reinforcement learning. In Proc. 17th International Conf. on Machine Learning, pp. 663-670, 2000.
17. Ratliff, N.D., Bagnell, J.A., and Zinkevich, Martin. Maximum margin planning. In Proc. 23rd International Conf. on Machine Learning, pp. 729-736, 2006.
18. Schaal, S. Is imitation learning the route to humanoid robots? Trends in Cognitive Sciences, 3(6):233-242, 1999. (Pubitemid 29261903)
19. Schwartz, A.B., R.E., Kettner, and Georgopoulos, A.P. Primate motor cortex and free arm movements to visual targets in 3-dimensional space. 1. relations between single cell discharge and direction of movement. J. Neurosci., 8(8):2913-2927, 1988.
20. Taylor, D.M., Helms Tillery, S.I., and Schwartz, A.B. Direct cortical control of 3D neuroprosthetic devices. Science, 296:1829-1832, 2002. (Pubitemid 34596262)
21. Ziebart, B.D., Maas, A.L., Bagnell, J.A., and Dey, A.K. Maximum entropy inverse reinforcement learning. In Proc. 23rd AAAI Conf. on Artificial Intelligence, pp. 1433-1438, 2008.