Sample aware embedded feature selection for reinforcement learning

GECCO'12 - Proceedings of the 14th International Conference on Genetic and Evolutionary Computation

Volumn , Issue , 2012, Pages 887-894

  Loscalzo, Steven ^a,b   Wright, Robert ^a,b   Acunto, Kevin ^a   Yu, Lei ^a  

^a BINGHAMTON UNIVERSITY   (United States)

^b AIR FORCE RESEARCH LABORATORY   (United States)

Author keywords

evolutionary policy search; feature selection; reinforcement learning

Indexed keywords

CURSE OF DIMENSIONALITY; DATA SAMPLE; FEATURE SELECTION ALGORITHM; HIGH-DIMENSIONAL; LEARNING PROCESS; NEAR-OPTIMAL POLICIES; OBSERVED SAMPLES; OPTIMAL CONTROL POLICY; POLICY SEARCH; REAL-WORLD SCENARIO; SELECTION TECHNIQUES; STATE SPACE;

FEATURE EXTRACTION; REINFORCEMENT LEARNING;

EVOLUTIONARY ALGORITHMS;

EID: 84864683716     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2330163.2330286     Document Type: Conference Paper

References (16)

1. A. Castelletti, S. Galelli, M. Restelli, and R. Soncini-Sessa. Tree-based variable selection for dimensionality reduction of large-scale control systems. In IEEE Symposium on ADPRL, pages 62-69. IEEE, April 2011.
2. P. Devijver and J. Kittler. Pattern Recognition: A Statistical Approach. Prentice Hall International, 1982.
3. F. J. Gomez and R. Miikkulainen. Solving non-markovian control tasks with neuroevolution. In In Proceedings of the 16th IJCAI, pages 1356-1361. Morgan Kaufmann, 1999.
4. I. Guyon and A. Elisseeff. An introduction to variable and feature selection. Journal of Machine Learning Research, 3:1157-1182, 2003.
5. H. Hachiya and M. Sugiyama. Feature selection for reinforcement learning: Evaluating implicit state-reward dependency via conditional mutual information. In Proceedings of ECML, pages 474-489, 2010.
6. L. P. Kaelbling, M. Littman, and A. Moore. Reinforcement learning: A survey. Journal of Artificial Intelligence Research, 4:237-285, 1996.
7. H. Liu and H. Motoda, editors. Feature Extraction, Construction and Selection: A Data Mining Perspective. Boston: Kluwer Academic Publishers, 1998. 2nd Printing, 2001.
8. H. Liu and L. Yu. Toward integrating feature selection algorithms for classification and clustering. IEEE Transactions on Knowledge and Data Engineering, 17(4):491-502, 2005.
9. A. Nouri and M. Littman. Dimension reduction and its application to model-based exploration in continuous spaces. Machine Learning, 81:85-98, 2010. 10.1007/s10994-010-5202-y.
10. H. Peng, F. Long, and C. Ding. Feature selection based on mutual information: criteria of max-dependency, max-relevance, and min-redundancy. IEEE Trans. on Pattern Analysis and Machine Intelligence, 27:1226-1238, 2005.
11. K. O. Stanley and R. Miikkulainen. Efficient reinforcement learning through evolving neural network topologies. In Proceedings of GECCO, page 9, San Francisco, 2002. Morgan Kaufmann.
12. R. Sutton and A. Barto. Reinforcement learning: an introduction. MIT Press, 1998.
13. M. Tan, M. Hartley, M. Bister, and R. Deklerck. Automated feature selection in neuroevolution. Evolutionary Intelligence, 1(4):271-292, 2009.
14. S. Whiteson and P. Stone. Evolutionary function approximation for reinforcement learning. Journal of Machine Learning Research, 7:877-917, May 2006.
15. S. Whiteson, P. Stone, and K. O. Stanley. Automatic feature selection in neuroevolution. In Proceedings of GECCO, pages 1225-1232, 2005.
16. R. Wright, S. Loscalzo, and L. Yu. Embedded incremental feature selection for reinforcement learning. In ICAART 2011, pages 263-268, 2011.