Two steps reinforcement learning

International Journal of Intelligent Systems

Volumn 23, Issue 2, 2008, Pages 213-245

  Fernández, Fernando ^a   Borrajo, Daniel ^a  

^a UNIVERSIDAD CARLOS III DE MADRID   (Spain)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; APPROXIMATION THEORY; DECISION TREES; INTELLIGENT SYSTEMS; STATE SPACE METHODS;

PROTOTYPE CLASSIFIERS; SPACE DISCRETIZATION; VALUE FUNCTIONS;

REINFORCEMENT LEARNING;

EID: 38949129339     PISSN: 08848173     EISSN: 1098111X     Source Type: Journal    
DOI: 10.1002/int.20255     Document Type: Conference Paper

References (43)

1. Sutton RS, Barto AG. Reinforcement learning: An introduction. Cambridge, MA: MIT Press, 1998.
2. Kaelbling LP, Littman ML, Moore AW. Reinforcement learning: A survey. Int J Artif Intelli Res 1996;4:237-285.
3. Watkins CJCH. Learning from delayed rewards. PhD thesis, Cambridge University, Cambridge, England, 1989.
4. Bellman R. Dynamic programming. Princeton, NJ. Princeton University Press; 1957.
5. Boyan JA, Moore AW. Generalization in reinforcement learning: Safely approximating the value function. Adva Neural Inform Process Syst 1995;7.
6. Munos R, Moore A. Variable resolution discretization in optimal control. Machine Learning 2002;49(2/3):291-323.
7. Santamaría JC, Sutton RS, Ram A. Experiments with reinforcement learning in problems with continuous state and action spaces. Adaptive Behavior 1998;6(2): 163-218.
8. Munos R. A study of reinforcement learning in the continuous case by the means of viscosity solutions. Machine Learning 1999;40:265-299.
9. Fernández F, Borrajo D. On determinism handling while learning reduced state space representations. In: Proc Eur Conf on Artificial Intelligence (ECAI 2002), Lyon (France); July 2002. pp 280-284.
10. Moore AW. Variable resolution dynamic programming: Efficiently learning action maps in multivariate real-valued spaces. In: Proc Eighth Int Machine Learning Workshop, 1991.
11. Reynolds SI. Reinforcement learning with exploration. PhD thesis, University of Birmingham, 2002.
12. Monson CK, Wingate D, Seppi KD, Peterson TS. Variable resolution discretization in the joint space,. In: Proc Int Conf on Machine Learning and Applications (ICMLA 2004), 2004.
13. Moore AW, Atkeson CG. The parti game algorithm for variable resolution reinforcement learning in multidimensional state-spaces. Machine Learning 1995;21(3):199-233.
14. Uther WTB. Tree based hierarchical reinforcement learning. PhD thesis, Carnegie Mellon University, August 2002.
15. Bertsekas DP, Tsitsiklis JN. Neuro-Dynamic programming. Bellmon, Athena Scientific; MA 1996.
16. Tsitsiklis JN, Van Roy B. Feature-based methods for large scale dynamic programming. Machine Learning, 1996;22:59-94.
17. Baird LC. Gradient descent for general reinforcement learning. Neural Infor Process Syst 1998; 11.
18. Tesauro G. Practical issues in temporal difference learning. Machine Learning, 1992;8:257-277.
19. Aha D. Lazy learning. Boston, MA: Kluwer Academic Publishers; 1997.
20. Smart WD, Kaelbling LP. Practical reinforcement learning in continuous spaces. In: Proc Int Conf of Machine Learning, 2000; pp 903-907.
21. Touzet C. Neural reinforcement learning for behaviour synthesis. Robotics and Auton Syst, 1997;22:251-281.
22. Fernández F, Borrajo D. VQQL. Applying vector quantization to reinforcement learning. In: RoboCup-99: Robot Soccer World Cup III, Lecture Notes in Artificial Intelligence, vol 1856 Springer Verlag; Berlin; 2000. pp 292-303.
23. Fernández F, Parker L. Learning in large cooperative multi-robot domains. Int J Robot Automation 2001;16(4):217-226.
24. Lloyd SP. Least squares quantization in PCM. IEEE Trans Infor Theory 1982;28:127-135.
25. Gersho A, Gray RM. Vector quantization and signal compression. Boston, MA: Kluwer Academic Publishers, 1992.
26. Kitano H, Tambe M, Stone P, Veloso M, Coradeschi S, Osawa H, Matsubara H, Noda I, Asada M. The Robocup synthetic agent challenge. In: Proc Fifteenth Int Joint Conference on Artificial Intelligence (IJCAI97), San Francisco, CA, 1997. pp 24-49.
27. Parker LE. Distributed algorithms for multi-robot observation of multiple moving targets. Auton Robots 2002; 12(3):231-255.
28. Parker LE, Touzet C, Fernández F Techniques for learning in multi-robot teams, In: Robot teams: from Diversity to polymorphism A. K. Peters Publishers, 2002; pp 191-236.
29. Fernández F, Borrajo D, Parker L. A reinforcement learning algorithm in cooperative multirobot domains. J Intel Robot Syst 2005;43(2-4):161-174.
30. Ernst D. Tree-based batch mode reinforcement learning. J Machine Learning Res 2005;6:503-556.
31. Forbes JRN. Reinforcement learning for autonomous vehicles. PhD thesis, Graduate Division of the University of California at Berkeley, 2002.
32. Modha DS, Spangler WS. Feature weighting in k-means clustering. Machine Learning 2003;52:217-237.
33. Smart WD. Making reinforcement learning work on real robots. PhD thesis, Department of Computer Science at Brown University, Providence, RI, May 2002.
34. Quinlan JR. Induction of decision trees. Machine Learning 1986;1(1):81-106.
35. Frank E, Witten IH. Generating accurate rule sets without global optimization. In: Proc Fifteenth Int Conf on Machine Learning 1998.
36. Witten IH, Frank E. Data mining. Practical machine learning tools and techniques with Java implementations. San Francisco, CA Morgan Kaufmann; 2000.
37. Fernández F, Isasi P. Automatic finding of good classifiers following a biologically inspired metaphor. Comput Inform 2002; 21(3):205-220.
38. Fernández F, Isasi P. Evolutionary design of nearest prototype classifiers. J Heuristics 2004; 10(4):431-454.
39. Reynolds SI. Adaptive resolution model-free reinforcement learning: Decision boundary partitioning. In: Proc Int Conf Machine Learning 2000; pp 783-790.
40. Anderson C, Crawford-Hines S. Multigrid Q-learning. Technical report, Colorado State University, Boulder, CO, 1994.
41. Kushner HJ. Numerical methods for stochastic control problems in continuous time. SIAM J. Control Optim 28, 1990.
42. Shibata T, Kato T, Wad T. K-d decision tree: An accelerated and memory efficient nearest neighbor classifier. In: Proc Third IEEE Int Conf on Data Mining 2003; pp 641-644.
43. Dzeroski S, De Raedt L, Driessens K. Relational reinforcement learning. Machine Learning 43, 2001.