An analytic modelling approach for network routing algorithms that use "ant-like" mobile agents

Computer Networks

Volumn 49, Issue 2, 2005, Pages 243-268

  Bean, Nigel ^a   Costa, Andre ^a,b  

^a UNIVERSITY OF ADELAIDE   (Australia)

^b UNIVERSITY OF MELBOURNE   (Australia)

Author keywords

Adaptive routing; Ant based routing; Reinforcement learning; Wardrop equilibria

Indexed keywords

ALGORITHMS; COMPUTER SIMULATION; DATA COMMUNICATION EQUIPMENT; PROBABILITY; PROBLEM SOLVING; REAL TIME SYSTEMS; TELECOMMUNICATION TRAFFIC; VECTORS;

ADAPTIVE ROUTING; ANT-BASED ROUTING; REINFORCEMENT LEARNING; WARDROP EQUILIBRIA;

ROUTERS;

EID: 22944481457     PISSN: 13891286     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.comnet.2005.01.008     Document Type: Article

References (40)

1. D. Bertsekas, and J. Gallager Data Networks 1992 Prentice Hall Englewood Cliffs, NJ
2. R.S. Sutton, and A.G. Barto Reinforcement Learning: An Introduction 1998 MIT Press Cambridge, MA
3. J. Boyan, and M. Littman Packet routing in dynamically changing networks: a reinforcement learning approach Advances in Neural Information Processing Systems Vol. 6 1993 Morgan Kaufmann San Francisco, CA pp. 671-678
4. P. Choi, and D. Yeung Predictive Q-routing: a memory-based reinforcement learning approach to adaptive traffic control S. Touretzky M. Mozer E. Hasselmo Advances in Neural Information Processing Systems Vol. 8 1996 MIT Press Cambridge, MA 945 951
5. V.S. Borkar, and P. Kumar Dynamic cesaro-wardrop equilibration in networks IEEE Transactions on Automatic Control 48 3 2003 382 396
6. E. Bonebeau, M. Dorigo, and T. Theraulaz From Natural to Artificial Swarm Intelligence 1999 Oxford University Press New York
7. M. Dorigo, and T. Stutzle Ant Colony Optimization 2004 MIT Press Cambridge
8. E. Bonebeau, F. Henaux, S. Guerin, D. Snyers, P. Kuntz, and G. Theraulaz Routing in telecommunications networks with "smart ant-like agents Proceedings of IATA '98, Second Int. Workshop on Intelligent Agents for Telecommunication Applications Lecture Notes in AI Vol. 1437 1998 Springer Berlin
9. G. Di Caro, and M. Dorigo AntNet: Distributed stigmergetic control for communications networks Journal of Artificial Intelligence Research 9 1998 317 365
10. M. Huesse, D. Snyers, S. Guerin, and P. Kuntz Adaptive agent-driven load balancing in communication networks Advances in Complex Systems 1 1998 237 254
11. R. Schoonderwoerd, O. Holland, J. Bruten, and L. Rothkrantz Ant-based load balancing in telecommunications networks Adaptive Behaviour 5 1996 169 207
12. T. White, B. Pagurek, and F. Oppacher Connection management using adaptive mobile agents Proceedings of the International Conference on Parallel and Distributed Processing Techniques and Applications 1998 CSREA Press
13. K. Sim, and W. Sun Ant colony optimisation for routing and load-balancing: survey and new directions IEEE Transactions on Systems, Man and Cybernetics - Part A: Systems and Humans 33 2003 560 573
14. S. Thomas IP Switching and Routing Essentials 2002 Wiley New York
15. M. Osborne, and A. Rubenstein A Course in Game Theory 1994 MIT Press Cambridge, MA
16. D. Bertsekas Nonlinear Programming 1999 Athena Scientific Belmont, MA
17. J.G. Wardrop Some theoretical aspects of road traffic research Proc. Institution of Civil Engineers, Part II 1 1952 325 362
18. E. Bonebeau, M. Dorigo, and T. Theraulaz Inspiration for optimisation from social insect behaviour Nature 406 2000 39 42
19. J. Deneubourg, S. Aron, S. Goss, and J. Pasteels The self-organizing exploratory behaviour of the argentine ant Journal of Insect Behaviour 3 1990 159 168
20. M. Millonas Swarms, phase, transitions and collective intelligence Artificial Life III, SFI Studies in the Science of Complexity 1994 Addison-Wesley Reading, MA
21. G. Di Caro, M. Dorigo, and L. Gambardella Ant algorithms for discrete optimization Artificial Life 5 1999 137 172
22. A. Costa, Analytic Modelling of Agent-based Network Routing Algorithms, PhD Thesis, School of Applied Mathematics, University of Adelaide, 2003.
23. L. Kleinrock Queueing Systems Vol. 1 1975 Wiley New York
24. D. Bertsekas, and J. Tsitsiklis Neuro-Dynamic Programming 1996 Athena Scientific Belmont, MA
25. M. Puterman Markovian Decision Problems 1994 Wiley New York
26. N. Dunford, and J. Schwartz Linear Operators 1958 Interscience Publishers New York
27. D. Bertsekas Dynamic Programming and Optimal Control, Vol. II 1995 Athena Scientific Belmont, MA
28. S. Dafermos, and F. Sparrow The traffic assignment problem for a general network Journal of Research of the National Bureau of Standards 73 1969 91 118
29. T. Boulogne, E. Altman, H. Kameda, and O. Pourtallier Mixed equilibria for multiclass routing games IEEE Transactions on Automatic Control 47 2002 913 916
30. Y. Korilis, and A. Lazar On the existence of equilibria in noncooperative optimal flow control Journal of the ACM 42 3 1995 584 613
31. A. Orda, R. Rom, and N. Shimkin Competitive routing in multi-user communications networks IEEE/ACM Transactions on Networking 1 1993 510 521
32. A. Haurie, and P. Marcotte On the relationship between nash-cournot and wardrop equilibria Networks 15 1985 295 308
33. D. Bertsekas, E. Gafni, and R. Gallagher Second derivative algorithms for minimum delay distributed routing in networks IEEE Transactions on Communications 32 1984 911 919
34. D. Cantor, and M. Gerla Optimal routing in a packet-switched network IEEE Transactions on Computers 23 1974 1062 1068
35. C. Cassandras, V. Abidi, and D. Towsley Distributed routing with on-line marginal delay estimation IEEE Transactions on Communications 38 1990 348 359
36. R. Gallagher A minimum delay routing algorithm using distributed computation IEEE Transactions on Communications 25 1979 73 85
37. D. Bertsekas Dynamic behavior of shortest path routing algorithms for communication networks IEEE Transactions on Automatic Control 27 1982 60 74
38. H. Kushner Stochastic Approximation Algorithms and Applications 1997 Springer New York
39. V.S. Borkar Asynchronous stochastic approximations SIAM Journal on Control and Optimization 36 3 1998 840 851
40. V. Konda, and J. Tsitsiklis Actor-critic algorithms SIAM Journal on Control and Optimisation 42 4 2003 1143 1166