Scaling life-long off-policy learning

2012 IEEE International Conference on Development and Learning and Epigenetic Robotics, ICDL 2012

Volumn , Issue , 2012, Pages

  White, Adam ^a   Modayil, Joseph ^a   Sutton, Richard S ^a  

^a UNIVERSITY OF ALBERTA   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

LIFE LONG LEARNING; LIFE-TIMES; MULTI-STEP PREDICTION; PHYSICAL ROBOTS; REAL TIME; TRAINING DATA;

FORECASTING; LEARNING ALGORITHMS; REINFORCEMENT LEARNING; ROBOTICS; ROBOTS;

PERSONNEL TRAINING;

EID: 84872849054     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/DevLrn.2012.6400860     Document Type: Conference Paper

References (18)

1. Atkeson, C. G., Schaal, S. (1997). Robot learning from demonstration. In Proceedings of the 14th International Conference on Machine Learning,12-20.
2. Boots, B., Siddiqi, S., Gordon, G. (2011). An online spectral learning algorithm for partially observable nonlinear dynamical systems. In Proceedings of the 25th Conference of the Association for the Advancement of Artificial Intelligence.
3. Cummins, M., Newman, P. (2009). Highly Scalable Appearance-Only SLAM - FAB-MAP 2.0 In The Proceedings of the 4th Conference Robotics: Science and Systems.
4. Kober, J., Peters, J. (2011). Policy search for motor primitives in robotics. Machine Learning 84:171-203.
5. Littman, M. L., Sutton, R. S., Singh, S. (2002). Predictive representations of state. In Advances in Neural Information Processing Systems 14, 1555-1561.
6. Maei, H. R. (2011). Gradient Temporal-Difference Learning Algorithms. PhD thesis, University of Alberta.
7. Modayil, J., White, A., Sutton, R. S. (2012). Multi-timescale Nexting in a Reinforcement Learning Robot. In Proceedings of the 12th International Simulation of Conference on Adaptive Behavior, LNAI 7426, 299-309
8. Oudeyer, P. Y., Kaplan, F., Hafner, V. (2007). Intrinsic Motivation Systems for Autonomous Mental Development. In IEEE Transactions on Evolutionary Computation 11, 265-286
9. Pilarski, P.M., Dawson, M.R., Degris, T.,Carey, J.P., Sutton, R.S. (2012). Dynamic Switching and Real-time Machine Learning for Improved Human Control of Assistive Biomedical Robots. In Proceedings of the 4th IEEE International Conference on Biomedical Robotics and Biomechatronics, 296-302.
10. Schmidhuber J. (1991). A possibility for implementing curiosity and boredom in model-building neural controllers. In Proceedings of the 1st International Conference on Simulation of Adaptive Behavior, 222-227.
11. Singh S., Barto, A. G., Chentanez, N. (2005). Intrinsically motivated reinforcement learning. In Advances in Neural Information Processing Systems 17, 1281-1288.
12. Sutton, R. S., Barto, A. G. (1998). Reinforcement Learning: An Introduction. MIT Press.
13. Sutton, R. S., Precup D., Singh, S. (1999). Between MDPs and semi-MDPs: A framework for temporal abstraction in reinforcement learning. In Artificial Intelligence 112:181-211.
14. Sutton, R. S., Rafols, E. J., Koop, A. (2006). Temporal abstraction in temporal-difference networks. In Advances in Neural Information Processing Systems 18.
15. Sutton, R. S., Maei, H. R., Precup, D., Bhatnagar, S., Silver, D., Szepesvári, Cs., Wiewiora, E. (2009). Fast gradient-descent methods for temporal-difference learning with linear function approximation. In Proceedings of the 26th International Conference on Machine Learning.
16. Sutton, R. S., Modayil, J., Delp, M., Degris, T., Pilarski, P. M., White, A., Precup, D. (2011). Horde: A scalable real-time architecture for learning knowledge from unsupervised sensorimotor interaction. In Proceedings of the10th International Conference on Autonomous Agents and Multiagent Systems.
17. Thrun, S., Burgard, W., Fox, D. (2005). Probabilistic Robotics. MIT Press.
18. Thrun, S., Mitchell, T. (1995). Lifelong robot learning. Robotics and Autonomous Systems 15: 25-46.