Control delay in reinforcement learning for real-time dynamic systems: A memoryless approach

IEEE/RSJ 2010 International Conference on Intelligent Robots and Systems, IROS 2010 - Conference Proceedings

Volumn , Issue , 2010, Pages 3226-3231

  Schuitema, Erik ^a   Buşoniu, Lucian ^b   Babuška, Robert ^b   Jonker, Pieter ^a  

^a DELFT UNIVERSITY OF TECHNOLOGY   (Netherlands)

^b DELFT UNIVERSITY OF TECHNOLOGY   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

CONTROL DELAY; LEARNING PERFORMANCE; MEMORYLESS; REAL SYSTEMS; REAL-TIME DYNAMICS; ROBOTIC SYSTEMS; TEMPORAL DIFFERENCE LEARNING; TIME STEP;

COMPUTATIONAL COMPLEXITY; INTELLIGENT ROBOTS; REAL TIME SYSTEMS; REINFORCEMENT LEARNING; ROBOTICS; TIME DELAY;

LEARNING ALGORITHMS;

EID: 78651479757     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IROS.2010.5650345     Document Type: Conference Paper

References (8)

1. K. V. Katsikopoulos and S. E. Engelbrecht, "Markov decision processes with delays and asynchronous cost collection," IEEE Transactions on Automatic Control, vol. 48, no. 4, pp. 568-574, 2003.
2. T. J. Walsh, A. Nouri, L. Li, and M. L. Littman, "Learning and planning in environments with delayed feedback," Autonomous Agents and Multi-Agent Systems, vol. 18, no. 1, pp. 83-105, 2009.
3. R. S. Sutton and A. G. Barto, "Reinforcement learning: An introduction," 1998.
4. S. P. Singh, T. Jaakkola, and M. I. Jordan, "Learning without stateestimation in partially observable markovian decision processes," in Proceedings of the 11th International Conference on Machine Learning, 1994, pp. 284-292.
5. J. Loch and S. Singh, "Using eligibility traces to find the best memoryless policy in partially observable markov decision processes," in Proceedings of the 15th International Conference on Machine Learning, 1998, pp. 141-150.
6. S. Singh, T. Jaakkola, M. L. Littman, and C. Szepesvari, "Convergence results for single-step on-policy reinforcement-learning algorithms," Machine Learning, vol. 38, no. 3, pp. 287-308, 2000.
7. L. Busoniu, D. Ernst, B. De Schutter, and R. Babuska, "Fuzzy approximation for convergent model-based reinforcement learning," in IEEE International Conference on Fuzzy Systems, FUZZ-IEEE, 2007.
8. E. Schuitema, M. Wisse, and P. Jonker, "The design of LEO: a 2D bipedal walking robot for online autonomous reinforcement learning," in Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, Taipei, Taiwan, October 2010.