Batch reinforcement learning for optimizing longitudinal driving assistance strategies

IEEE SSCI 2011: Symposium Series on Computational Intelligence - CIVTS 2011: 2011 IEEE Symposium on Computational Intelligence in Vehicles and Transportation Systems

Volumn , Issue , 2011, Pages 73-79

  Pietquin, Olivier ^a   Tango, Fabio ^b   Aras, Raghav ^a  

^a CNRS   (France)

^b CENTRO RICERCHE FIAT   (Italy)

Author keywords

[No Author keywords available]

Indexed keywords

ACTION SELECTION; ASSISTANCE SYSTEM; ASSISTIVE; BATCH REINFORCEMENT LEARNING; CAR SIMULATOR; HUMAN DRIVERS; LEADING VEHICLE; LONGITUDINAL DRIVING; MACHINE LEARNING METHODS; OPEN PROBLEMS; OPTIMAL COMBINATION; WARNING SIGNALS;

ARTIFICIAL INTELLIGENCE; AUTOMOBILE SIMULATORS; OPTIMIZATION;

REINFORCEMENT LEARNING;

EID: 79961195324     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CIVTS.2011.5949533     Document Type: Conference Paper

References (21)

1. E. Muhrer and M. Vollrath, "Results from accident analysis," ISI-PADAS project deliverable, Tech. Rep. Task 1.22, 2009.
2. M. Vollrath et al., "Ableitung von anforderungen an ein fahrerassistenzsystem aus sicht der verkehrssicherheit," Bundesanstalt für Straßenwesen, Fahrzeugtechnik, Tech. Rep. F 60, 2006.
3. S. Briest and M. Vollrath, "In welchen situationen machen fahrer welche fehler? ableitung von anforderungen an fahrerassistenzsysteme durch," in In-Depth- Unfallanalysen. In VDI (Ed.), Integrierte Sicherheit und Fahrerassistenzsysteme, 2006, pp. 449 - 463. (Pubitemid 44770067)
4. R. J. Kiefer, J. Salinger, and J. J. Ference, "Status of nhtsa's rear-end crash prevention research program," National Highway Traffic and Safety Administration, Tech. Rep. 05-0282, 2005.
5. J. D. Lee, D. V. McGehee, T. L. Brown, and M. L. Reyes, "CollisionWarning Timing, Driver Distraction, and Driver Response to Imminent Rear-End Collisions in a High-Fidelity Driving Simulator," Human Factors: The Journal of the Human Factors and Ergonomics Society, vol. 44, no. 2, pp. 314-334, Summer 2002. (Pubitemid 35315402)
6. R. S. Sutton and A. G. Barto, Reinforcement Learning: An Introduction (Adaptive Computation and Machine Learning), 3rd ed. The MIT Press, March 1998.
7. R. Bellman, "A markovian decision process," Journal of Mathematics and Mechanics, vol. 6, pp. 679-684, 1957.
8. K.-D. Kuhnert and M. Krödel, "Autonomous vehicle steering based on evaluative feedback by reinforcement learning," in Machine Learning and Data Mining in Pattern Recognition, ser. Lecture Notes in Computer Science, P. Perner and A. Imiya, Eds. Springer Berlin / Heidelberg, 2005, vol. 3587, pp. 405- 414.
9. T. Martinez-Marin, "A reinforcement learning algorithm for optimal motion of car-like vehicles," in Proceedings of the 7th International IEEE Conference on Intelligent Transportation Systems, oct. 2004, pp. 47 - 51. (Pubitemid 40196647)
10. S.-Y. Oh, J.-H. Lee, and D.-H. Choi, "A new reinforcement learning vehicle control architecture for vision-based road following," IEEE Transactions on Vehicular Technology, vol. 49, no. 3, pp. 997 -1005, may. 2000.
11. R. Bellman, Dynamic Programming, 6th ed. Dover Publications, 1957.
12. M. L. Puterman, Markov Decision Processes: Discrete Stochastic Dynamic Programming. Wiley-Interscience, April 1994.
13. G. Tesauro, "Temporal Difference Learning and TD-Gammon," Communications of the ACM, vol. 38, no. 3, March 1995.
14. S. J. Bradtke and A. G. Barto, "Linear Least-Squares algorithms for temporal difference learning," Machine Learning, vol. 22, no. 1-3, pp. 33-57, 1996. (Pubitemid 126724362)
15. M. G. Lagoudakis and R. Parr, "Least-squares policy iteration," Journal of Machine Learning Research, vol. 4, pp. 1107-1149, 2003.
16. G. Gordon, "Stable Function Approximation in Dynamic Programming," in Proceedings of the International Conference on Machine Learning (IMCL 95), 1995.
17. C. Watkins, "Learning from delayed rewards," Ph.D. dissertation, University of Cambidge, 1989.
18. M. Geist and O. Pietquin, "Kalman Temporal Differences," Journal of Artificial Intelligence Research (JAIR), 2010.
19. Y. Engel, S. Mannor, and R. Meir, "Reinforcement Learning with Gaussian Processes," in Proceedings of the International Conference on Machine Learning (ICML 05), 2005.
20. A. L. Strehl and M. L. Littman, "An Analysis of Model-Based Interval Estimation for Markov Decision Processes," Journal of Computer and System Sciences, 2006.
21. C. Atkeson and J. Santamaria, "A comparison of direct and model-based reinforcement learning," in Proceedings of the IEEE International Conference onRobotics and Automation, vol. 4, Apr. 1997, pp. 3557 -3564 vol.4.