Clustering via Dirichlet process mixture models for portable skill discovery

Advances in Neural Information Processing Systems 24: 25th Annual Conference on Neural Information Processing Systems 2011, NIPS 2011

Volumn , Issue , 2011, Pages

  Niekum, Scott ^a   Barto, Andrew G ^a  

^a University of Massachusetts Amherst   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

MIXTURES;

AGENT SPACE; CLUSTERINGS; DIRICHLET PROCESS MIXTURE MODEL; DISCOVERY ALGORITHM; REINFORCEMENT LEARNINGS; SINGLE STATE; STATE-SPACE; SUBGOALS; TERMINATION CONDITION;

REINFORCEMENT LEARNING;

EID: 85162360219     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (22)

1. Bram Bakker and Jürgen Schmidhuber. Hierarchical reinforcement learning based on subgoal discovery and subpolicy specialization. In Proc. of the 8th Conference on Intelligent Autonomous Systems, pages 438-445, 2004.
2. A. G. Barto, S. Singh, and N. Chentanez. Intrinsically motivated learning of hierarchical collections of skills. In Proc. of the International Conference on Developmental Learning, pages 112-119, 2004.
3. Bruce L. Digney. Learning hierarchical control structures for multiple tasks and changing environments. In Proc. of the 5th Conference on the Simulation of Adaptive Behavior. MIT Press, 1998.
4. W. R. Gilks and P. Wild. Adaptive Rejection Sampling for Gibbs Sampling. Journal of the Royal Statistical Society, Series C, 41(2):337-348, 1992.
5. M. Halkidi and M. Vazirgiannis. Npclu: An approach for clustering spatially extended objects. Intell. Data Anal., 12:587-606, December 2008.
6. Engin Ipek, Onur Mutlu, Jose F. Martinez, and Rich Caruana. Self-optimizing memory controllers: A reinforcement learning approach. Computer Architecture, International Symposium on, 0:39-50, 2008.
7. Anders Jonsson and Andrew Barto. Causal graph based decomposition of factored mdps. J. Mach. Learn. Res., 7:2259-2301, December 2006.
8. G.D. Konidaris, S. Osentoski, and P.S. Thomas. Value function approximation in reinforcement learning using the fourier basis. In Proceedings of the Twenty-Fifth Conference on Artificial Intelligence, 2011.
9. George Konidaris and Andrew G. Barto. Building portable options: Skill transfer in reinforcement learning. In Proc. of the 20th International Joint Conference on Artificial Intelligence, pages 895-900, 2007.
10. George Konidaris and Andrew G. Barto. Skill discovery in continuous reinforcement learning domains using skill chaining. In Advances in Neural Information Processing Systems 22, pages 1015-1023, 2009.
11. Amy McGovern and Andrew G. Barto. Automatic discovery of subgoals in reinforcement learning using diverse density. In ICML, pages 361-368, 2001.
12. Brett Moore, Periklis Panousis, Vivek Kulkarni, Larry Pyeatt, and Anthony Doufas. Reinforcement learning for closed-loop propofol anesthesia: A human volunteer study. In Innovative Applications of Artificial Intelligence, 2010.
13. R.M. Neal. Markov chain sampling methods for Dirichlet process mixture models. Journal of computational and graphical statistics, 9(2):249-265, 2000.
14. Andrew Y. Ng, Michael I. Jordan, and Yair Weiss. On spectral clustering: Analysis and an algorithm. In Advances in Neural Information Processing Systems, pages 849-856. MIT Press, 2001.
15. Marc Pickett and Andrew G. Barto. Policyblocks: An algorithm for creating useful macro-actions in reinforcement learning. In ICML, pages 506-513, 2002.
16. Carl Edward Rasmussen. The infinite Gaussian mixture model. In Advances in Neural Information Processing Systems 12, pages 554-560. MIT Press, 2000.
17. Özgür Ş imşek and Andrew G. Barto. Using relative novelty to identify useful temporal abstractions in reinforcement learning. In Proc. of the Twenty-First International Conference on Machine Learning, pages 751-758, 2004.
18. Özgür Ş imşek and Andrew G. Barto. Skill characterization based on betweenness. In NIPS, pages 1497-1504, 2008.
19. Richard Sutton, Doina Precup, and Satinder Singh. Between MDPs and semi-MDPs: A framework for temporal abstraction in reinforcement learning. Artificial Intelligence, 112:181-211, 1999.
20. Richard S. Sutton and Andrew G. Barto. Reinforcement Learning: An Introduction. MIT Press, 1998.
21. Sebastian Thrun and Anton Schwartz. Finding structure in reinforcement learning. In Advances in Neural Information Processing Systems 7, pages 385-392. MIT Press, 1995.
22. Aaron Wilson, Alan Fern, Soumya Ray, and Prasad Tadepalli. Multi-task reinforcement learning: A hierarchical bayesian approach. In In: ICML 07: Proceedings of the 24th international conference on Machine learning, page 1015. ACM Press, 2007.