Distributed W-learning: Multi-policy optimization in self-organizing systems

SASO 2009 - 3rd IEEE International Conference on Self-Adaptive and Self-Organizing Systems

Volumn , Issue , 2009, Pages 20-29

  Dusparic, Ivana ^a   Cahill, Vinny ^a  

^a University of Limerick   (Ireland)

Author keywords

[No Author keywords available]

Indexed keywords

AGENT-BASED SYSTEMS; COLLABORATIVE AGENTS; GLOBAL KNOWLEDGE; LOCAL INTERACTIONS; OPERATING ENVIRONMENT; POLICY OPTIMIZATION; PUBLIC TRANSPORT VEHICLES; ROUND ROBIN; SELF ORGANIZING; SELF-OPTIMIZATION; SELF-ORGANIZING SYSTEMS; TRAFFIC CONTROLLERS; URBAN TRAFFIC CONTROL; WAITING TIME;

CYBERNETICS; OPTIMIZATION; REINFORCEMENT; TRAFFIC CONTROL;

LEARNING ALGORITHMS;

EID: 73649130992     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/SASO.2009.23     Document Type: Conference Paper

References (27)

1. G. Di Marzo Serugendo, M.-P. Gleizes, and A. Karageorgos, "Self-organization in multi-agent systems," Knowledge Engineering Review, vol. 20, no. 2, pp. 165-189, 2005.
2. A. Montresor, H. Meling, and O. Baboglu, "Messor: Load-balancing through a swarm of autonomous agents," in AP2PC '02, ser. Lecture Notes in Artificial Intelligence, G. Moro and M. Koubarakis, Eds., no. 2530. Bologna, Italy: Springer-Verlag, pp. 125-137.
3. B. A. Kadrovach and G. B. Lamont, "A particle swarm model for swarm-based networked sensor systems." in SAC, 2002, pp. 918-924.
4. H. J. Goldsby, B. H. C. Cheng, P. K. McKinley, D. B. Knoester, and C. A. Ofria, "Digital evolution of behavioral models for autonomic systems," in ICAC '08. IEEE Computer Society, pp. 87-96.
5. J. Dowling, "The decentralised coordination of self-adaptive components for autonomic distributed systems," Ph.D. dissertation, Trinity College Dublin, 2005.
6. G. Tesauro, "Reinforcement learning in autonomic computing: A manifesto and case studies," IEEE Internet Computing, vol. 11, no. 1, pp. 22-30, 2007.
7. M. Humphrys, "Action selection methods using reinforcement learning," Ph.D. dissertation, University of Cambridge, 1996.
8. I. Dusparic and V. Cahill, "Distributed W-learning: An algorithm for multi-policy optimization in decentralized autonomic systems (poster)," in Proceedings of the 6th International Conference on Autonomic Computing and Communications, 2009.
9. K. Sycara, "Multiagent systems," AI Magazine, vol. 19, no. 2, 1998.
10. I. Dusparic and V. Cahill, "Using reinforcement learning for multi-policy optimization in decentralized autonomic systems - an experimental evaluation," in The Proceedings of the 6th International Conference on Autonomic and Trusted Computing, 2009.
11. R. S. Suton and A. G. Barto, Reinforcement Learning: An Introduction. Cambridge, Massachusetts: A Bradford Book. The MIT Press, 1998.
12. C. J. C. H. Watkins and P. Dayan, "Technical note: Q-learning," Machine Learning, vol. 8, no. 3, pp. 279-292, May 1992.
13. B. Abdulhai, R. Pringle, and G. Karakoulas, "Reinforcement learning for the true adaptive traffic signal control," Journal of Transportation Engineering, vol. 129, no. 3, pp. 278-285, May/June 2003.
14. H. Cuayáhuitl, S. Renals, O. Lemon, and H. Shimodaira, "Learning multi-goal dialogue strategies using reinforcement learning with reduced state-action spaces," in International Journal of Game Theory, 2006, pp. 547-565.
15. L. Panait and S. Luke, "Cooperative multi-agent learning: The state of the art," AAMAS '05, vol. 11, no. 3, pp. 387-434.
16. B. C. da Silva, D. de Oliveira, A. L. Bazzan, and E. W. Basso, "Adaptive traffic control with reinforcement learning," in AAMAS '06, May.
17. E. Bitting and A. A. Ghorbani, "Cooperative multiagent systems for the optimization of urban traffic," in IAT '04. Washington, DC, USA: IEEE Computer Society, pp. 176-182.
18. M. D. Pendrith, "Distributed reinforcement learning for a traffic engineering application," in AGENTS '00. New York, NY, USA: ACM Press, pp. 404-411.
19. A. Salkham, R. Cunningham, A. Garg, and V. Cahill, "A collaborative reinforcement learning approach to urban traffic control optimization," in IAT '08.
20. M. Wiering, "Multi-agent reinforcement learning for traffic light control," in ICML '00. Morgan Kaufmann, San Francisco, CA, pp. 1151-1158.
21. D. Meignan, O. Simonin, and A. Koukam, "Simulation and evaluation of urban bus-networks using a multiagent approach," Simulation Modelling Practice and Theory, vol. 15, no. 6, pp. 659-671, July 2007.
22. E. Oliveira and N. Duarte, "Making way for emergency vehicles," in Proceedings of the 2005 European Simulation and Modelling Conference, pp. 128-135.
23. M. Tan, "Multi-agent reinforcement learning: Independent vs. cooperative agents," in ICML '93.
24. V. Reynolds, V. Cahill, and A. Senart, "Requirements for an ubiquitous computing simulation and emulation environment," in InterSense '06. NY, USA: ACM.
25. P. Lowrie, "SCATS: The sydney co-ordinated adaptive traffic system - principles, methodology, algorithms," in Proceedings of the IEE International Conference on Road Traffic Signalling, 1982.
26. S. Richter, "Learning traffic control - towards practical traffic control using policy gradients," Albert-Ludwigs-Universitat Freiburg, Tech. Rep., 2006.
27. A. L. Bazzan, "A distributed approach for coordination of traffic signal agents," Autonomous Agents and Multi-Agent Systems, vol. 10, no. 1, pp. 131-164, 2005.