Multi-armed recommendation bandits for selecting state machine policies for robotic systems

Proceedings - IEEE International Conference on Robotics and Automation

Volumn , Issue , 2013, Pages 4545-4551

  Matikainen, Pyry ^a   Furlong, P Michael ^a   Sukthankar, Rahul ^a,b   Hebert, Martial ^a  

^a CARNEGIE MELLON UNIVERSITY   (United States)

^b GOOGLE INC   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AMAZON.COM; DRIVING STATE; MULTI ARMED BANDIT; NETFLIX; RECOMMENDATION TECHNIQUES; ROBOTIC SYSTEMS; STATE MACHINE;

ROBOTICS;

EID: 84887305101     PISSN: 10504729     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICRA.2013.6631223     Document Type: Conference Paper

References (18)

1. Matikainen. P. Sukthankar. R. Hebert. M.: Model recommendation for action recognition. In: CVPR. (2012)
2. Robbins. H.: Some aspects of the sequential design of experiments. Bulletin of the American Mathematical Society 58 (1952) 527-535
3. Berry. D. Fristedt. B.: Bandit Problems: Sequential Allocation of Experiments. 1985. Chapman and Hall. London (1985)
4. Bell. R.M. Koren. Y.: Scalable collaborative filtering with jointly derived neighborhood interpolation weights. In: ICDM. (2007)
5. Koren. Y.: Factorization meets the neighborhood: a multifaceted collaborative filtering model. In: ACM KDD. (2008)
6. Koren. Y.: Factor in the neighbors: Scalable and accurate collaborative filtering. ACM Transactions Knowledge Discovery Data 4 (2010) 1:1-1:24
7. Li. H. Liao. X. Carin. L.: Multi-task reinforcement learning in partially observable stochastic environments. Journal of Machine Learning Research (2009)
8. Rosman. B. Ramamoorthy. S.: A multitask representation using reusable local policy templates. In Proc. AAAI Spring Symposium on Designing Intelligent Robots: Reintegrating AI (2012)
9. Wilson. A. Fern. A. Ray. S. Tadepalli. P.: Multi-task reinforcement learning: A hierarchical bayesian approach. In: Proceedings of the International Conference on Machine Learning. (2007)
10. Tanaka. F. Yamamura. M.: Multitask reinforcement learning on the distribution of MDPs. In: Proceedings of IEEE International Symposium on Computational Intelligence in Robotics and Automation. Volume 3. (2003) 1108-1113
11. Sallans. B. Hinton. G.E. Mahadevan. S.: Reinforcement learning with factored states and actions. Journal of Machine Learning Research 5 (2004) 1063-1088
12. Parr. R. Russell. S.: Reinforcement learning with hierarchies of machines. In: Advances in Neural Information Processing Systems 10. MIT Press (1997) 1043-1049
13. Wong. S. MacDonald. B.: A topological coverage algorithm for mobile robots. In: Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). Volume 2. (2003) 1685-1690 vol.2
14. Choset. H. Pignon. P.: Coverage path planning: The Boustrophedon cellular decomposition. In: International Conference on Field and Service Robotics. (1997)
15. Mackenzie. D. Balch. T.R.: Making a clean sweep: Behavior based vacuuming (1993)
16. Lai. T. Robbins. H.: Asymptotically efficient adaptive allocation rules. Advances in applied mathematics 6 (1985) 4-22
17. Auer. P. Cesa-Bianchi. N. Fischer. P.: Finite-time analysis of the multiarmed bandit problem. Machine learning 47 (2002) 235-256
18. Yue. Y. Hong. S.A. Guestrin. C.: Hierarchical exploration for accelerating contextual bandits. In: ICML. (2012)