Reinforcement learning for true adaptive traffic signal control

Journal of Transportation Engineering

Volumn 129, Issue 3, 2003, Pages 278-285

  Abdulhai, Baher ^a   Pringle, Rob ^a   Karakoulas, Grigoris J ^a  

^a UNIVERSITY OF TORONTO   (Canada)

Author keywords

Adaptive systems; Intelligent transportation systems; Traffic control; Traffic management; Traffic signal controllers

Indexed keywords

ADAPTIVE SYSTEMS; ARTIFICIAL INTELLIGENCE; INTELLIGENT VEHICLE HIGHWAY SYSTEMS; LEARNING SYSTEMS; OPTIMAL CONTROL SYSTEMS; REAL TIME SYSTEMS;

ADPATIVE TRAFFIC SIGNAL CONTROL;

HIGHWAY TRAFFIC CONTROL;

INTELLIGENT TRANSPORTATION SYSTEM; LEARNING; TRAFFIC MANAGEMENT; TRANSPORTATION PLANNING;

EID: 0037616356     PISSN: 0733947X     EISSN: None     Source Type: Journal    
DOI: 10.1061/(ASCE)0733-947X(2003)129:3(278)     Document Type: Article

References (20)

1. Abdulhai, B., and Ritchie, S. G. (1999a). "Enhancing the universality and transferability of freeway incident detection using a Bayesian-based neural network." Transportation Research-Part C, 7, 261-280.
2. Abdulhai, B., and Ritchie, S. G. (1999b). "Towards adaptive incident detection algorithms." Proc., 6th World Congress on Intelligent Transport Systems.
3. Albus, J. S. (1975a). "Data storage in the Cerebellar Model Articulation Controller (CMAC)." J. Dyn. Syst., Meas., Control, 97, 228-233.
4. Albus, J. S. (1975b). "A new approach to manipulator control: The cerebellar model articulation controller (CMAC)." J. Dyn. Syst., Meas., Control, 97, 220-227.
5. Bertsekas, D. P., and Tsitsiklis, J. N. (1996). Neuro-dynamic programming, Athena Scientific, Belmont, Mass.
6. Bingham, E. (1998). "Neurofuzzy traffic signal control." Master's thesis, Dept. of Engineering Physics and Mathematics, Helsinki Univ. of Technology, Helsinki, Finland.
7. Bretherton, D. (1996). "Current developments in SCOOT: Version 3." Transportation Research Record 1554, Transportation Research Board, Washington, D.C., 48-52.
8. Bretherton, D., Wood, K., and Raha, N. (1998). "Traffic monitoring and congestion management in the SCOOT urban traffic control system." Transportation Research Record 1634, Transportation Research Board, Washington, D.C., 118-122.
9. Gartner, N. H., and Al-Malik, M. (1996). "Combined model for signal control and route choice in urban traffic networks." Transportation Research Record 1554, Transportation Research Board, Washington, D.C., 27-35.
10. Hunt, P. B., Robertson, D. I., Bretherton, D., and Winton, R. I. (1981). "SCOOT-A traffic responsive method of coordinating signals." Laboratory Rep. 1014, Transport and Road Research Laboratory.
11. Kaelbling, L. P., Littman, M. L., and Moore, A. W. (1996). "Reinforcement learning: A survey." J. Artif. Intell. Res., 4, 237-285.
12. Sadek, A. W., Smith, B. L., and Demetsky, M. J. (1998). "Artificial intelligence-based architecture for real-time traffic flow management." Transportation Research Record 1651, Transportation Research Board, Washington, D.C., 53-58.
13. Sen, S., and Head, K. L. (1997). "Controlled optimization of phases at an intersection." Transp. Sci., 31(1), 5-17.
14. Smith, R. (1998). "Intelligent motion control with an artificial cerebellum." PhD thesis, Dept. of Electrical and Electronic Engineering, Univ. of Auckland, Auckland, New Zealand.
15. Spall, J. C., and Chin, D. C. (1997). "Traffic-responsive signal timing for system-wide traffic control." Transp. Res., Part C: Emerg. Technol., 5(3/4), 153-163.
16. Sutton, R. S., and Barto, A. G. (1998). Reinforcement learning-An introduction, MIT Press, Cambridge, Mass.
17. Thorpe, T. L. (1997). "Vehicle traffic light control using SARSA." Master's Project Rep., Computer Science Dept., Colorado State Univ., Fort Collins, Colo.
18. Watkins, C. J. C. H. (1989). "Learning from delayed rewards." PhD thesis, King's College, Univ. of Cambridge, Cambridge, U.K.
19. Watkins, C. J. C. H., and Dayan, P. (1992). "Q-learning." Mach. Learn., 8, 279-292.
20. Yagar, S., and Dion, F. (1996). "Distributed approach to real-time control of complex signalized networks." Transportation Research Record 1554, Transportation Research Board, Washington, D.C., 1-8.