Higher order Q-Learning

IEEE SSCI 2011: Symposium Series on Computational Intelligence - ADPRL 2011: 2011 IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning

Volumn , Issue , 2011, Pages 128-134

  Edwards, Ashley ^a   Pottenger, William M ^b  

^a University of Georgia ^*  (United States)

^b RUTGERS UNIVERSITY   (United States)

Author keywords

Artificial intelligence; Bayesian methods; Higher Order Learning; Intelligent agent; Machine learning; Q learning; Reinforcement learning; Statistical relational learning

Indexed keywords

BAYESIAN METHODS; HIGHER ORDER; MACHINE-LEARNING; Q-LEARNING; STATISTICAL RELATIONAL LEARNING;

ARTIFICIAL INTELLIGENCE; BAYESIAN NETWORKS; LEARNING ALGORITHMS; REINFORCEMENT LEARNING;

DYNAMIC PROGRAMMING;

EID: 80052206811     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ADPRL.2011.5967385     Document Type: Conference Paper

References (24)

1. Ganiz, M. C., Lytkin, N. I. and Pottenger, W. M. (2009) Leveraging Higher Order Dependencies Between Features for Text Classification. Proceedings of the European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases (ECML PKDD). Bled, Slovenia, September.
2. Dearden, R., Friedman, N., and Russell, S. (1998). Bayesian QLearning. Proceedings of the Fifteenth National Conference on Artificial Intelligence. Menlo Park, CA: AAAI Press.
3. Duff, M, and Barto, Andrew (1997). Local bandit approximation for optimal learning problems. Advances in Neural Information Processing Systems, volume 9, pp. 1019-1025. The MIT Press.
4. Sutton, R. S. and Barto, A. G. (1998). Reinforcement Learning: An Introduction. Cambridge, MA: MIT Press.
5. Sutton, R.S. (1999). Reinforcement Learning. In Rob Wilson and Frank Keil (Eds.) The MIT Encyclopedia of the Cognitive Sciences, MIT Press.
6. Getoor, L., Diehl, C.P. (2005). Link Mining: A Survey. SIGKDD Explorations. 7(2), 3-12.
7. Bhagat, S., Rozenbaum, I. and Cormode, G. (2007). Applying linkbased classification to label blogs. WebKDD/SNA-KDD '07: Proceedings of the 9th WebKDD and 1st SNA-KDD 2007 workshop on Web mining and social network analysis, pages 92-101, New York, NY, USA. (Pubitemid 351665614)
8. Chakrabarti, S., Dom, B., & Indyk, P. (1998). Enhanced Hypertext Classification Using Hyper-Links, In Proceedings of ACM SIGMOD Conference, pp. 307-318. (Pubitemid 128655978)
9. Neville, J. and Jensen, D. (2000). Iterative Classification in Relational Data. In Proc. AAAI-2000 Workshop on Learning Statistical Models from Relational Data, pp. 13-20.
10. Lu, Q. and Getoor, L. (2003). Link-based Classification. Proceedings of the Twentieth international conference on machine learning (ICML-2003), Washington DC.
11. Neville, J., Jensen, D. (2004). Dependency Networks for Relational Data. Proceedings of the Fourth IEEE International Conference on Data Mining (ICMD'04), pp. 170-177, Brighton, UK (Pubitemid 40731028)
12. Taskar, B., Abbeel, P., Koller, D. (2002). Discriminative Probabilistic Models for Relational Data. In Proceedings of Uncertainty in Artificial Intelligence conference UAI02, Edmonton, Canada.
13. Taskar, B., Segal, E., Koller, D. (2001). Probabilistic Classification and Clustering in Relational Data. In Proc. 17th International Joint Conference on Artificial Intelligence, pp. 870-878, 2001.
14. Ganiz, M. C. (2008). Higher-Order Path Analysis for Supervised Machine Learning. Ph.D. Dissertation, Lehigh University.
15. Ganiz, M., Pottenger, W.M., Yang, X. (2006). Link Analysis of Higher-Order Paths in Supervised Learning Datasets, In the Proceedings of the Workshop on Link Analysis, Counterterrorism and Security, 2006 SIAM Conference on Data Mining, Bethesda, MD.
16. Ganiz, M., Pottenger, W.M., and George C. (2010). Higher Order Naive Bayes: A Novel Non-IID Approach to Text Classification. IEEE Transactions of Knowledge and Data Engineering, 2010. (forthcoming)
17. Menon, V. and Pottenger, W. M. (2009). A Higher Order Collective Classifier for Detecting and Classifying Network Events. Proceedings of the IEEE International Conference on Intelligence and Security Informatics 2009 (ISI 2009).
18. Li, S., Janneck, C., Belapurkar, A., Ganiz, M. C., Yang, X., Dilsizian, M. D., Wu, T., Bright, J, and Pottenger, W. M. (2007). Mining Higher-Order Association Rules from Distributed Named Entity Databases, In the Proceedings of the IEEE International Conference on Intelligence and Security Informatics 2007 (ISI 2007), New Brunswick, NJ, May.
19. Kontostathis, A. and Pottenger, W.M. (2006). A Framework for Understanding LSI Performance. Information Processing & Management, 42(1), pp. 56-73.
20. Bradford, R. (2006a). Relationship Discovery in Large Text Collections Using Latent Semantic Indexing. Proceedings of the Fourth Workshop on Link Analysis, Counterterrorism and Security. SIAM Data Mining Conference, Bethesda, MD, 20-22 April.
21. Bradford, R. (2006b). Application of Latent Semantic Indexing in Generating Graphs of Terrorist Networks. IEEE International Conference on Intelligence and Security Informatics (ISI 2006). San Diego, CA, USA, May 23-24.
22. Bradford, R. (2008). Exploiting Sensitive Information in Background Mode using Latent Semantic Indexing. Proceedings of the Sixth Workshop on Link Analysis, Counterterrorism and Security. SIAM Data Mining Conference, Atlanta, GA, 26 April.
23. Pottenger, W.M. (Nov 12, 2009). Exploiting Essential Elements of Information from Significant Activity Reports (SIGACTS) for Forensic Analysis. Retrieved Dec 13, 2010 from WWW:http://www.dodsbir.com/selections/abs083/ afabs083.htm
24. Conn, K. (2005). "Supervised reinforcement Learning for a Mobile Robot in a Real world Environment", Master's Thesis, Department of Electrical Engineering, Vanderbilt University.