Reinforcement learning: Introduction to theory and potential for transport applications

Canadian Journal of Civil Engineering

Volumn 30, Issue 6, 2003, Pages 981-991

  Abdulhai, Baher ^a   Kattan, Lina ^a  

^a UNIVERSITY OF TORONTO   (Canada)

Author keywords

Artificial intelligence; Intelligent transportation systems; Machine learning; Reinforcement learning; Traffic control

Indexed keywords

CIVIL ENGINEERING; INTELLIGENT NETWORKS; LEARNING ALGORITHMS; REINFORCEMENT; TRAFFIC CONTROL;

INTELLIGENT TRANSPORT SYSTEMS (ITS); REINFORCEMENT LEARNING (RL);

TRANSPORTATION;

ARTIFICIAL NEURAL NETWORK; INTELLIGENT TRANSPORTATION SYSTEM; TRANSPORTATION PLANNING;

EID: 1842427901     PISSN: 03151468     EISSN: None     Source Type: Journal    
DOI: 10.1139/l03-014     Document Type: Article

References (28)

1. Artificial intelligence depot [online]. Available from http://reinforcementlearning.ai-depot.com/ [accesssed on December 2001].
2. Abdulhai, B., Pringle, R., and Karakoulas, G.J. 2001. Reinforcement learning for ITS: Introduction and a case study on adaptive traffic signal control transportation research board, Transportation Research Board 80th Annual Meeting, Washington, D.C., 7-11 January 2001.
3. Abdulhai, B., Pringle, R., and Karakoulas, G.J. 2003. Reinforcement learning for true adaptive traffic signal control. ASCE Journal of Transportation Engineering. 129(3): 278-285.
4. Ballard, D. 1997. An introduction to natural computation. The MIT Press, Cambridge, Mass.
5. Baird, L. 1995. Residual algorithms reinforcement learning with function approximation. In Proceedings of the 12th International Conference on Machine Learning, San Francisco, Calif., 9-12 July 1995. Morgan Kaufman Publishers. San Francisco, Calif. pp. 30-37.
6. Bertsekas, D.P., and Tsitsiklis, J.N. 1996. Neuro-dynamic programming. Athena Scientific, Belmont, Mass.
7. Bingham, E. 2001. Reinforcement learning in neurofuzzy traffic signal control. European Journal of Operation Research, 131: 232-241.
8. Crites, R.H., and Barto, A.G. 1996. 9. Improving elevator performance using reinforcement learning. In Advances in neural information processing systems. MIT Press, Cambridge, Mass. pp. 1017-1023.
9. Durango, P., and Madanat, M. 2001. Reinforcement learning models for transportation infrastructure management, Proceedings of the Second Berkeley-Tottori Joint Seminar on Evolution Processes of Transportation Systems: Analysis and Policy Implementation.
10. Jang, J., Sun, C., and Mizutani, E. 1997. Neuro-fuzzy and soft computing. Prentice Hall.
11. Langley, P. [online]. Available from http://newatlantis.isle.org/~langley/ [accessed on December 2001].
12. Mitchel, T. 1997. Machine learning, McGraw-Hill.
13. Martin, A., and Brauer, W. 2000. Fuzzy model-based reinforcement learning, European Symposium on Intelligent Techniques (ESIT), Aachen, Germany, 14-15 September 2000, pp. 14-15.
14. Moriarty, D., and Langley, P. 1998a. Learning cooperative lane selection strategies for highways. In Proceedings of the Fifteenth National Conference on Artificial Intelligence, Menlo Park, Calif., AAAI Press, pp. 684-691.
15. Moriarty, D., and Langley, P. 1998b. Distributed learning of lane-selection strategies for traffic management technical report. 98-2. Daimler-Benz Research and Technology Center, Palo Alto, Calif.
16. Moriarty, D.E., Handley, S., and Langley, P. 1998. Learning distributed strategies for traffic control. In Proceedings of the Fifth International Conference of the Society for Adaptive Behavior Zurich, Switzerland. pp. 437-446.
17. Narendra, K., and Thathachar, M. 1989. Learning Automata an introduction. Prentice-Hall.
18. Peeta. 2001. Foundations of dynamic traffic assignment: the past, the present and the future. Networks and Spatial Economics, 1: 223-265.
19. Pendrith, M.D. 2000. Distributed reinforcement learning for a traffic engineering application In Proceedings of the 4th International Conference on Autonomous Agents, Barcelona, Spain. ACM, New York, N.Y., pp. 404-411.
20. Perez, A. 1998. Introduction to reinforcement learning [online]. Available from http://lslwww.epfl.ch/~aperez/RL/RL.html [accessed on December 2001].
21. Russel, S., and Norvig, P. 1995. Artificial intelligence: a modern approach. Prentice Hall Series in Artificial Intelligence, Englewood Cliffs, N.J.
22. Sutton, R. 1988. Learning to predict by the methods of temporal differences. Machine Learning, 3: 9-44.
23. Sutton, R. 1999. Reinforcement learning: past, present and future? [online]. Available from http://www-anw.cs.umass.edu/~rich/ Talks/SEAL98/SEAL98.html [accessed on December 2001].
24. Sutton, R., and Barto, A. 1998. Reinforcement learning: an introduction. MIT Press, Cambridge Mass.
25. Tesauro, G.J. 1995. Temporal difference learning and TD-Gammon. Communications of the ACM, 38: 58-68.
26. Thorpe, T.L. 1997. Vehicle traffic light control using SARSA. Master's Project Report. Computer Science Department, Colorado State University, Colo.
27. Wiering, M.A. 2000. Learning to control traffic lights with multi-agent reinforcement learning, First World Congress of the Game Theory Society Games 2000, Utrecht, Netherlands, Basque Country University and Foundation B.B.V. Bilbao, Spain.
28. Zhang, W., and Dietterich, T. 1996. High-performance job-shop scheduling with a time-delay TDλ network. Advances in neural information processing systems, 8: 1024-1030.