Urban traffic signal control using reinforcement learning agents

IET Intelligent Transport Systems

Volumn 4, Issue 3, 2010, Pages 177-188

  Balaji, P G ^a   German, X ^a   Srinivasan, D ^a  

^a NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

Author keywords

[No Author keywords available]

Indexed keywords

ACTUATED CONTROL; ADJACENT INTERSECTIONS; CENTRAL BUSINESS DISTRICTS; HIERARCHICAL MULTI-AGENT SYSTEM; MEAN TIME DELAYS; MULTI-AGENT; MULTI-AGENT REINFORCEMENT LEARNING; MULTIAGENT ARCHITECTURE; PARAMICS SOFTWARE; REINFORCEMENT LEARNING AGENT; SIGNAL CONTROL; SINGAPORE; TRAFFIC DATA; TRAFFIC PATTERN; TRAFFIC SIGNAL CONTROL; TRAVEL TIME; URBAN ARTERIAL ROAD; URBAN TRAFFIC SIGNAL CONTROL;

DELAY CONTROL SYSTEMS; INTELLIGENT AGENTS; MOTOR TRANSPORTATION; MULTI AGENT SYSTEMS; REINFORCEMENT LEARNING; SOFTWARE AGENTS; TRAFFIC SIGNALS;

STREET TRAFFIC CONTROL;

EID: 77956287357     PISSN: 1751956X     EISSN: None     Source Type: Journal    
DOI: 10.1049/iet-its.2009.0096     Document Type: Article

References (23)

1. Koonce, P.: ' Traffic signal timing manual ', (US Department of Transportation FHWA-HOP-08-024, Federal Highway Administration, 2008)
2. Sanchez, J.J., Galan, M., and Rubio, E.: ' Genetic algorithms and cellular automata: a new architecture for traffic light cycles optimization ', Proc. Congress on Evolutionary Computation, 19-23 June 2004, Piscataway, NJ, USA, 2004, p. 1668-1674
3. Hoar, R., Penner, J., and Jacob, C.: ' Evolutionary swarm traffic: if ant roads had traffic lights ', Proc. 2002 World Congress on Computational Intelligence - WCCI'02, 12-17 May 2002, Piscataway, NJ, USA, 2002, p. 1910-1915
4. Ishihara, H., and Fukuda, T.: ' Traffic signal networks simulator using emotional algorithm with individuality ', Proc. IEEE Intelligent Transportation Systems, 25-29 August, 2001, Oakland, CA, USA, p. 1034-1039
5. Srinivasan, D., Choy, M.C., and Cheu, R.L.: ' Neural networks for real-time traffic signal control ', IEEE Trans. Intell. Transp. Syst., 2006, 7, p. 261-272 10.1109/TITS.2006.874716 1524-9050
6. Hunt, P.B., Robertson, D.I., Bretherton, R.D., and Winton, R.I.: ' SCOOT - a traffic responsive method of coordinating signals ', (United Kingdom, 1981)
7. Peck, C., Gorton, P.T.W., and Liren, D.: ' Application of SCOOT in developing countries ', Third Int. Conf. on Road Traffic Control, 1-3 May 1990, London, England, p. 104-109
8. Sims, A.G., and Dobinson, K.W.: ' The Sydney Coordinated Adaptive Traffic (SCAT) system philosophy and benefits ', IEEE Trans. Veh. Technol., 1980, t-29, p. 130-137 0018-9545
9. Lowrie, P.R.: ' The Sydney Coordinated Adaptive Traffic System-principles, methodology, algorithms ', Int. Conf. on Road Traffic Signalling, 30 March-1 April 1982, London, UK, p. 67-70
10. Keong, C.K.: ' The GLIDE system - Singapore's urban traffic control system ', Transp. Rev., Transnatl. Transdiscipl. J., 1993, 13, p. 295-305
11. Bazzan, A.L.C.: ' A distributed approach for coordination of traffic signal agents ', Auton. Agents Multi-Agent Syst., 2005, 10, p. 131-64 10.1007/s10458-004-6975-9 1387-2532
12. Roozemond, D.A.: ' Using intelligent agents for pro-active, real-time urban intersection control ', Eur. J. Oper. Res., 2001, 131, p. 293-301 0377-2217
13. Mizuno, K., and Nishihara, S.: ' Distributed constraint satisfaction for urban traffic signal control ', Second Int. Conf. on Knowledge Science, Engineering and Management. KSEM 2007, 28-30 November 2007, Berlin, Germany, 2007, p. 73-84
14. De Oliveira, D., and Bazzan, A.L.C.: ' Traffic lights control with adaptive group formation based on swarm intelligence ', Ant Colony Optimization and Swarm Intelligence. Proc. Fifth Int. Workshop, ANTS 2006, 4-7 September 2006, Berlin, Germany, p. 520-521
15. Choy, M.C., Cheu, R.L., Srinivasan, D., and Logi, F.: ' Real-time coordinated signal control through use of agents with online reinforcement learning ', Transportation Research Board Meeting (82nd), Washington, DC, 2003, p. 64-75
16. Camponogara, E., and Kraus, W.: ' Distributed learning agents in urban traffic control ', Prog. Artif. Intell., 2003, 2902, p. 324-335
17. Watkins, C., and Dayan, P.: ' Technical note: Q-learning ', Mach. Learn., 1992, 8, p. 279-292 0885-6125
18. Little, J.D.C.: ' A proof for the queuing formula: L=lambda W ', Oper. Res., 1961, 9, p. 383-387 0030-364X
19. 'Highway capacity manual - HCM2000' (Transportation Research Board, National Research Council, 2000)
20. Balaji, P.G., Srinivasan, D., and Chen-Khong, T.: ' Coordination in distributed multi-agent system using type-2 fuzzy decision systems ', IEEE 16th Int. Conf. on Fuzzy Systems (FUZZ-IEEE), 1-6 June 2008, Piscataway, NJ, USA, p. 2291-2298
21. Choy, M.C., Srinivasan, D., and Cheu, R.L.: ' Neural networks for continuous online learning and control ', IEEE Trans. Neural Netw., 2006, 17, p. 1511-1531 1045-9227
22. Srinivasan, D., and Choy, M.: ' Distributed problem solving using evolutionary learning in multi-agent systems ', Adv. Evol. Comput. Syst. Des., 2007, 66, p. 211-227
23. Choy, M.C., Srinivasan, D., and Cheu, R.L.: ' Cooperative, hybrid agent architecture for real-time traffic signal control ', IEEE Trans. Syst. Man Cybern. A (Syst. Hum.), 2003, 33, p. 597-607