Multiagent reinforcement learning for Urban traffic control using coordination graphs

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 5211 LNAI, Issue PART 1, 2008, Pages 656-671

  Kuyer, Lior ^a   Whiteson, Shimon ^a   Bakker, Bram ^a   Vlassis, Nikos ^b  

^a UNIVERSITY OF AMSTERDAM   (Netherlands)

^b TECHNICAL UNIVERSITY OF CRETE   (Greece)

Author keywords

Coordination graphs; Max plus; Multiagent systems; Reinforcement learning; Traffic control

Indexed keywords

AGENTS; DATABASE SYSTEMS; EDUCATION; ELECTRIC SHIP EQUIPMENT; GRAPH THEORY; LEARNING SYSTEMS; REINFORCEMENT; REINFORCEMENT LEARNING; ROBOT LEARNING; STREET TRAFFIC CONTROL; TRAFFIC CONGESTION; TRAFFIC SURVEYS; TREES (MATHEMATICS);

AGENT CONTROLS; COORDINATION GRAPHS; CYCLIC GRAPHS; EMPIRICAL EVIDENCES; HEURISTIC PROTOCOLS; JOINT ACTIONS; MAX-PLUS; MULTIAGENT REINFORCEMENT LEARNINGS; MULTIAGENT SYSTEMS; OPTIMAL ACTIONS; STRUCTURED GRAPHS; TRAFFIC FLOWS; TRAFFIC JAMS; TRAFFIC LIGHTS; TRAFFIC NETWORKS; URBAN TRAFFIC CONTROLS;

COMPUTER NETWORKS;

EID: 56049125779     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-540-87479-9_61     Document Type: Conference Paper

References (17)

1. Abdulhai, B., et al.: Reinforcement Learning for True Adaptive Traffic Signal Control. ASCE Journal of Transportation Engineering 129(3), 278-285 (2003)
2. Moore, A.W., Atkenson, C.G.: Prioritized Sweeping: Reinforcement Learning with less data and less time. Machine Learning 13, 103-130 (1993)
3. Bakker, B., Steingrover, M., Schonten, R., Nijhuis, E., Kester, L.: Cooperative multi-agent reinforcement learning of traffic lights. In: Gama, J., Camacho, R., Brazdil, P.B., Jorge, A.M., Torgo, L. (eds.) ECML 2005. LNCS (LNAI), vol. 3720. Springer, Heidelberg (2005)
4. Bellman, R.E.: Dynamic Programming. Princeton University Press, Princeton (1957)
5. Chiu, S.: Adaptive Traffic Signal Control Using Fuzzy Logic. In: Proceedings of the IEEE Intelligent Vehicles Symposium, pp. 98-107 (1992)
6. Crick, C., Pfeffer, A.: Loopy belief propagation as a basis for communication in sensor networks. In: Proceedings of Uncertainty in Artificial Intelligence (UAI) (2003)
7. Foy, M.D., Benekohal, R.F., Goldberg, D.E.: Signal timing determination using genetic algorithms. Transportation Research Record No. 1365, 108-115
8. Kschischang, F.R., Frey, B.J., Loeliger, H.A.: Factor graphs and the sum-product algorithm. IEEE Transactions on Information Theory 47, 498-519 (2001)
9. Guestrin, C., Lagoudakis, M.G., Parr, R.: Coordinated reinforcement learning. In: Proceedings Nineteenth International Conference on Machine Learning, pp. 227-234 (2002)
10. Kok, J.R., Vlassis, N.: Collaborative Multiagent Reinforcement Learning by Payoff Propagation. J. Mach. Learn. Res. 7, 1789-1828 (2006)
11. Shoufeng, M., et al.: Agent-based learning control method for urban traffic signal of single intersection. Journal of Systems Engineering 17(6), 526-530 (2002)
12. Spall, J.C., Chin, D.C.: Traffic-Responsive Signal Timing for System-wide Traffic Control. Transportation Research Part C: Emerging Technologies 5(3), 153-163 (1997)
13. Thorpe, T.L., Andersson, C.: Traffic light control using sarsa with three state representations. Technical report, IBM corporation (1996)
14. Wiering, M.: Multi-Agent Reinforcement Learning for Traffic Light Control. In: Proc. 17th International Conf. on Machine Learning, pp. 1151-1158 (2000)
15. Vlassis, N.: A Concise Introduction to Multiagent Systems and Distributed Artificial Intelligence. Synthesis Lectures in Artificial Intelligence and Machine Learning. Morgan & Claypool Publishers, San Francisco (2007)
16. Yedidia, J.S., Freeman, W.T., Weiss, Y.: Understanding belief propagation and its generalizations. In: Exploring Artificial Intelligence in the New Millennium, ch. 8, pp. 239-269 (2003)
17. Zhang, N.L., Poole, D.: Exploiting causal independence in Bayesian network inference. Journal of Artificial Intelligence Research 5, 301-328 (1996)