Emergent consensus in decentralised systems using collaborative reinforcement learning

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 3460 LNCS, Issue , 2005, Pages 63-80

  Dowling, Jim ^a   Cunningham, Raymond ^a   Harrington, Anthony ^a   Curran, Eoin ^a   Cahill, Vinny ^a  

^a TRINITY COLLEGE DUBLIN   (Ireland)

Author keywords

[No Author keywords available]

Indexed keywords

AD HOC NETWORKS; COMPUTER SUPPORTED COOPERATIVE WORK; DECENTRALIZED CONTROL; LEARNING ALGORITHMS; LEARNING SYSTEMS; OPTIMIZATION;

COLLABORATIVE REINFORCEMENT LEARNING (CRL); ENVIRONMENTAL CONDITIONS; SYSTEM-WIDE PROPERTIES;

INFORMATION SYSTEMS;

EID: 33750224958     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/11428589_5     Document Type: Conference Paper

References (39)

1. Montresor, A., Meling, H., Babaoglu, O.: Towards self-organizing, self-repairing and resilient distributed systems. Future Directions in Distributed Computing, vol LNCS 2584 (2003).
2. Visscher, P.: How self-organization evolves. Nature, vol.421 799-800 (2003).
3. Camazine, S., Deneubourg, J., Franks, N., Sneyd, J., Theraulaz, G., Bonabeau, E.: Self-Organization in Biological Systems. Princeton University Press (2003).
4. Gelernter, D., Carriero, N.: Coordination languages and their significance. Commun. ACM vol.35 no.2 97-107 (1992).
5. Goldin, D. and Keil, K.: Toward domain-independent formalization of indirect interaction. 2nd Int'l workshop on Theory and Practice of Open Computational Systems (TAPOCS) (2004).
6. Efstratiou, C., Friday, A., Davies, N., Cheverst, K.: Utilising the event calculus for policy driven adaptation in mobile systems. Proceedings of the 3rd International Workshop on Policies for Distributed Systems and Networks (2002) IEEE Computer Society 13-24 June (2002).
7. Dorigo, M. Di Caro, G.: The ant colony optimization meta-heuristic. New Ideas in Optimization (1999).
8. Andrzejak, A., Graupner, S., Kotov, V., Trinks, H.: Adaptive control overlay for service management. Workshop on the Design of Self-Managing Systems. International Conference on Dependable Systems and Networks (2003).
9. De Wolf, T. and Holvoet, T.: Towards autonomic computing: agent-based modelling, dynamical systems analysis, and decentralised control. Proceedings of IEEE International Conference on Industrial Informatics 470-479 (2003).
10. Boutilier, C., Das, R., Kephart, J., Tesauro, G., Walsh, W.: Cooperative negotiation in autonomic systems using incremental utility elicitation. Uncertainty in Artificial Intelligence (2003).
11. Khare, R., Taylor, R.N.: Extending the representational state transfer (rest) architectural style for decentralized systems. Proceedings of the International Conference on Software Engineering (ICSE) (2004).
12. Curran, E., Dowling, J.: Sample: An on-demand probabilistic routing protocol for ad-hoc networks. Technical Report Department of Computer Science Trinity College Dublin (2004).
13. Jelasity, M., Montresor A., Babaoglu, O.: A modular paradigm for building selforganizing peer-to-peer applications. Proceedings of ESOP03 International Workshop on Engineering Self-Organising Applications (2003).
14. Panagiotis, T., Demosthenis, T., Mackie-Mason, J.-K.: A market-based approach to optimal resource allocation in integrated-services connection-oriented networks. Operations Research vol.50 4 July-August 2002.
15. Littman, M., Boyan, J.: A distributed reinforcement learning scheme for network routing. Technical Report CS-93-165 (1993).
16. Di Caro, G., Dorigo, M.: AntNet: Distributed Stigmergetic Control for Communications Networks. Journal of Artificial Intelligence Research vol 9 317-365 (1998).
17. Sutton, R., Barto, A.: Reinforcement Learning. MIT Press (1998).
18. Bonabeau, E., Dorigo, M., Theraulaz, G.: Swarm Intelligence: from natural to artificial systems. New York Oxford University Press (1999).
19. Crites, R., Barto, A.: Elevator group control using multiple reinforcement learning agents. Machine Learning volume 33 2-3 235-262 (1998).
20. Kaelbling, L., Littman, M., Moore, A. Reinforcement learning: A survey. Journal of Artificial Intelligence Research vol 4 237-285 (1996).
21. Perkins, C.: Ad Hoc On Demand Distance Vector (AODV) Routing. IETF Internet Draft November (1997).
22. Johnson, D., Maltz, D., Broch, J.: DSR: The dynamic source routing protocol for multihop wireless ad hoc networks. Ad Hoc Networking 139-172 Addison-Wesley (2001).
23. NS-2 network simulator. Information Sciences Institute (2003).
24. Broch, J., Maltz, D., Johnson, D., Hu, J., Jetcheva, J.: A Performance Comparison of Multi-Hop Wireless Ad Hoc Network Routing Protocols. Mobile Computing and Networking 85-97 (1998).
25. Li, J., Blake, C., De Couto, D., Lee, H., Morris, R.: Capacity of ad hoc wireless networks. Proceedings of the 7th International Conference on Mobile Computing and Networking 61-69 (2001).
26. Klein, L.: Sensor Technologies and Data Requirements for ITS. Artech House (2001).
27. Hoar, R., Penner, J., Jacob, C.: Evolutionary Swarm Traffic: If Ant Roads had Traffic Lights. Proceedings of the IEEE Conference on Evolutionary Computation Honolulu Hawaii 1910-1916 (2002).
28. Abdulhai, B., Pringle, R., Karakoulas, G.: Reinforcement Learning for True Adaptive Traffie Signal Control. Transportation Engineering vol.129 May (2003).
29. Findler, N.: Harmonization for Omnidirectional Progression in Urban Traffic Control. Computer-Aided Civil and Infrastructure Engineering vol 14 Honolulu Hawaii 369-377 (1999).
30. Pendrith, M.: Distributed Reinforcement Learning for a Traffic Engineering Application. Proceedings of the Fourth Internation Conference on Autonomous Agents Barcelona Spain (2000).
31. Dublin Transportation Office: DTO Strategy Update - Full Report - Platform For Change. Available on: http://www.dto.ie/strategy.htm (2001).
32. Guestrin, C., Lagoudakis, M., Parr, R.: Coordinated reinforcement learning. Proceedings of The Nineteenth International Conference on Machine Learning 227-234 (2002).
33. Schneider, J., Wong, W., Moore, A. and Riedmiller, M.: Distributed value functions. Proceedings of the Sixteenth International Conference on Machine Learning 371-378 Morgan Kaufmann Publishers 1999.
34. Stone, P.: TPOT-RL applied to network routing. Proceedings of the Seventeenth International Conference on Machine Learning (2000).
35. Mariano, C, Morales, E.: A new distributed reinforcement learning algorithm for multiple objective optimization problems. Advances in Artificial Intelligence, International Joint Conference 7th Ibero-American Conference on AI 15th Brazilian Symposium on AI (2000).
36. Yagar, S. Dion, F.: Distributed Approach to Real-Time Control of Complex Signalized Networks. Transportation Research Record Vol.1 1-8 (1996).
37. Hunt, P. Robertson, R. Winton, R. Bretherton, R.: SCOOT- A Traffic Responsive Method of Coordinating Signals. Road Research Laboratory, TRRL Report 1014 (1981).
38. Sims, A.: The Sydney Coordinated Adaptive Traffic System. Proceedings of the ASCE Engineering Foundations Conference on Research Priorities in Computer Control of Urban Traffic Systems (1979).
39. Lo, H., Chow, A.: Control Strategies for Oversaturated Traffic. Transportation Engineering vol.130 July (2004).