A comparison of PSO and Reinforcement Learning for multi-robot obstacle avoidance

2013 IEEE Congress on Evolutionary Computation, CEC 2013

Volumn , Issue , 2013, Pages 149-156

  Di Mario, Ezequiel ^a   Talebpour, Zeynab ^a   Martinoli, Alcherio ^a  

^a EPFL   (Switzerland)

Author keywords

[No Author keywords available]

Indexed keywords

CONTINUOUS STATE SPACE; CONTROLLER DESIGNS; LEARNING TECHNIQUES; PARAMETER SPACES; PERFORMANCE METRICS; Q-LEARNING APPROACH; ROBOTIC CONTROLLERS; UNCERTAIN ENVIRONMENTS;

ALGORITHMS; BENCHMARKING; INDUSTRIAL ROBOTS; MULTIPURPOSE ROBOTS; PARTICLE SWARM OPTIMIZATION (PSO);

REINFORCEMENT LEARNING;

EID: 84881576671     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CEC.2013.6557565     Document Type: Conference Paper

References (24)

1. K. A. De Jong, "An Analysis of the Behavior of a Class of Genetic Adaptive Systems," Ph. D. dissertation, University of Michigan, 1975.
2. D. Floreano and F. Mondada, "Evolution of homing navigation in a real mobile robot," IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, vol. 26, no. 3, pp. 396-407, 1996.
3. J. Pugh and A. Martinoli, "Distributed scalable multi-robot learning using particle swarm optimization," Swarm Intelligence, vol. 3, no. 3, pp. 203-222, May 2009.
4. B. Huang, G. Cao, and M. Guo, "Reinforcement Learning Neural Network to the Problem of Autonomous Mobile Robot Obstacle Avoidance," in International Conference on Machine Learning and Cybernetics, 2005, pp. 85-89.
5. J. Kennedy and R. Eberhart, "Particle swarm optimization," in IEEE International Conference on Neural Networks, 1995, pp. 1942-1948 vol. 4.
6. R. Poli, "Analysis of the publications on the applications of particle swarm optimisation," Journal of Artificial Evolution and Applications, vol. 2008, no. 2, pp. 1-10, 2008.
7. J. Chang, S. Chu, and J. Roddick, "A parallel particle swarm optimization algorithm with communication strategies," Journal of Information Science, pp. 809-818, 2005.
8. S. B. Akat and V. Gazi, "Decentralized asynchronous particle swarm optimization," in IEEE Swarm Intelligence Symposium. IEEE, Sep. 2008.
9. J. Rada-Vilela, M. Zhang, and W. Seah, "Random Asynchronous PSO," The 5th International Conference on Automation, Robotics and Applications, pp. 220-225, Dec. 2011.
10. M. Turduev and Y. Atas, "Cooperative Chemical Concentration Map Building Using Decentralized Asynchronous Particle Swarm Optimization Based Search by Mobile Robots," in IEEE/RSJ International Conference on Intelligent Robots and Systems, 2010, pp. 4175-4180.
11. L. Marques, U. Nunes, and A. T. Almeida, "Particle swarm-based olfactory guided search," Autonomous Robots, vol. 20, no. 3, pp. 277-287, May 2006.
12. J. Hereford and M. Siebold, "Using the particle swarm optimization algorithm for robotic search applications," in IEEE Swarm Intelligence Symposium, 2007, pp. 53-59.
13. Y. Jin and J. Branke, "Evolutionary Optimization in Uncertain EnvironmentsA Survey," IEEE Transactions on Evolutionary Computation, vol. 9, no. 3, pp. 303-317, Jun. 2005.
14. K. E. Parsopoulos and M. N. Vrahatis, "Particle Swarm Optimizer in Noisy and Continuously Changing Environments," in Artificial Intelli-gence and Soft Computing, M. H. Hamza, Ed. IASTED/ACTA Press, 2001, pp. 289-294.
15. H. Pan, L. Wang, and B. Liu, "Particle swarm optimization for function optimization in noisy environment," Applied Mathematics and Compu-tation, vol. 181, no. 2, pp. 908-919, Oct. 2006.
16. J. Pugh, Y. Zhang, and A. Martinoli, "Particle swarm optimization for unsupervised robotic learning," in IEEE Swarm Intelligence Symposium, 2005, pp. 92-99.
17. E. Di Mario and A. Martinoli, "Distributed Particle Swarm Optimization for Limited Time Adaptation in Autonomous Robots," in International Symposium on Distributed Autonomous Robotic Systems 2012; Springer Tracts in Advanced Robotics 2014 (to appear). [Online]. Available: http://infoscience. epfl. ch/record/182403
18. R. Sutton and A. Barto, Reinforcement learning: An introduction, ser. Adaptive Computation and Machine Learning. MIT Press, 1998, vol. 9, no. 5.
19. J. Kober and J. Peters, "Reinforcement Learning in Robotics : A Survey," Reinforcement Learning, pp. 579-610, 2012.
20. W. Smart and L. Pack Kaelbling, "Effective reinforcement learning for mobile robots," in IEEE International Conference on Robotics and Automation, 2002, pp. 3404-3410.
21. T. Yasuda and K. Ohkura, "A reinforcement learning technique with an adaptive action generator for a multi-robot system," From Animals to Animats 10, pp. 250-259, 2008.
22. M. Mataríc, "Reinforcement learning in the multi-robot domain," Au-tonomous Robots, vol. 4, no. 1, pp. 73-83, 1997.
23. H. Iima, Y. Kuroe, and K. Emoto, "Swarm reinforcement learning methods for problems with continuous state-action space," in IEEE International Conference on Systems, Man, and Cybernetics, Oct. 2011, pp. 2173-2180.
24. O. Michel, "Webots: Professional Mobile Robot Simulation," Advanced Robotic Systems, vol. 1, no. 1, pp. 39-42, 2004.