Reinforcement learning-based control of traffic lights in non-stationary environments: A case study in a microscopic simulator

CEUR Workshop Proceedings

Volumn 223, Issue , 2006, Pages

  De Oliveira, Denise ^a   Bazzan, Ana L C ^a   Da Silva, Bruno C ^a   Basso, Eduardo W ^a   Nunes, Luis ^b,c   Rossetti, Rosaldo ^b   De Oliveira, Eugénio ^b   Da Silva, Roberto ^a   Lamb, Luis ^a  

^a FEDERAL UNIVERSITY OF RIO GRANDE DO SUL   (Brazil)

^b UNIVERSITY OF PORTO   (Portugal)

^c INSTITUTO UNIVERSITÁRIO DE LISBOA ISCTE IUL   (Portugal)

Author keywords

[No Author keywords available]

Indexed keywords

CONTEXT DETECTION; NON-STATIONARITIES; NON-STATIONARY ENVIRONMENT; OPERATIONAL TASKS; PRIORITIZED SWEEPING; REALISTIC SCENARIO; REINFORCEMENT LEARNING APPROACH; TRAFFIC SIMULATORS;

MULTI AGENT SYSTEMS; VEHICLE ACTUATED SIGNALS;

REINFORCEMENT LEARNING;

EID: 78650472600     PISSN: 16130073     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (13)

1. Bazzan, A. L. C. A distributed approach for coordination of traffic signal agents. Autonomous Agents and Multiagent Systems 10, 1 (March 2005), 131-164.
2. Bazzan, A. L. C, de Oliveira, D., Klügl, F., and Nagel, K. Effects of co-evolution in a complex traffic network. (submitted).
3. Camponogara, E., and Jr., W. K. Distributed learning agents in urban traffic control. In EPIA (2003), F. Moura-Pires and S. Abreu, Eds, pp. 324-335.
4. Choi, S. P. M., Yeung, D.-Y., and Zhang, N. L. Hidden-mode markov decision processes for nonstationary sequential decision making. In Sequence Learning - Paradigms, Algorithms, and Applications (London, UK, 2001), Springer-Verlag, pp. 264-287.
5. de Oliveira, D., and Bazzan, A. L. C. Traffic lights control with adaptive group formation based on swarm intelligencetraffic lights control with adaptive group formation based on swarm intelligence. In Proceedings of the 5th International Workshop on Ant Colony Optimization and Swarm Intelligence, ANTS 2006 (Brussels, September 2006), M. Dorigo, L. M. Gambardella, M. Birattari, A. Martinoli, R. Poli, and T. Stuetzle, Eds, Lecture Notes in Computer Science, Springer, pp. 520-521.
6. Doya, K., Samejima, K., Katagiri, K., and Kawato, M. Multiple model-based reinforcement learning. Neural Computation 14, 6 (2002), 1347-1369.
7. Nagel, K., and Schreckenberg, M. A cellular automaton model for freeway traffic. Journal de Physique I 2 (1992), 2221.
8. Nunes, L., and Oliveira, E. C. Learning from multiple sources. In Proceedings of the 3rd International Joint Conference on Autonomous Agents and Multi Agent Systems, AAMAS (New York, USA, July 2004), vol. 3, New York, IEEE Computer Society, pp. 1106-1113.
9. Oliveira, D., Bazzan, A. L. C, and Lesser, V. Using cooperative mediation to coordinate traffic lights: a case study. In Proceedings of the 4th International Joint Conference on Autonomous Agents and Multi Agent Systems (AAMAS) (July 2005), New York, IEEE Computer Society, pp. 463-470.
10. Silva, B. C, Oliveira, D. d., Bazzan, A. L. C, and Basso, E. W. Adaptive traffic control with reinforcement learning. In Proceedings of the 4th Workshop on Agents in Traffic and Transportation (AAMAS 2006) (May 2006), A. L. C. Bazzan, B. C. Draa, and F. Kl, Eds, pp. 80-86.
11. Silva, B. C. d., Basso, E. W, Bazzan, A. L. C, and Engel, P. M. Dealing with non-stationary environments using context detection. In Proceedings of the 23rd International Conference on Machine Learning (ICML 2006) (June 2006), W. W. Cohen and A. Moore, Eds, ACM Press, pp. 217-224.
12. Silva, B. C. d., Junges, R., Oliveira, D. d, and Bazzan, A. L. C. ITSUMO: an intelligent transportation system for urban mobility. In Proceedings of the 5th International Joint Conference On Autonomous Agents And Multiagent Systems (AAMAS 2006) - Demonstration Track (May 2006), P. Stone and G. Weiss, Eds, ACM Press, pp. 1471-1472.
13. Sutton, R. S. Planning by incremental dynamic programming. In Proceedings of the Eighth International Workshop on Machine Learning (1991), Morgan Kaufmann, pp. 353-357.