Efficient evaluation functions for evolving coordination

Evolutionary Computation

Volumn 16, Issue 2, 2008, Pages 257-288

  Agogino, A ^a   Tumer, K ^b  

^a NASA AMES RESEARCH CENTER   (United States)

^b OREGON STATE UNIVERSITY   (United States)

Author keywords

Distributed control; Evolution strategies; Fitness evaluation

Indexed keywords

ALGORITHM; ARTICLE; BIOLOGY; EVALUATION; EVOLUTION; METHODOLOGY; MOTION; ROBOTICS; STATISTICAL MODEL; STATISTICS;

ALGORITHMS; COMPUTATIONAL BIOLOGY; EVOLUTION; MODELS, STATISTICAL; MOTION; ROBOTICS;

EID: 47749108686     PISSN: 10636560     EISSN: 15309304     Source Type: Journal    
DOI: 10.1162/evco.2008.16.2.257     Document Type: Article

References (39)

1. Agah, A., and Bekey, G. A. (1996). A genetic algorithm-based controller for decentralized multi-agent robotic systems. Proceedings of the IEEE International Conference of Evolutionary Computing (pp. 431-436).
2. Agogino, A., Stanley, K., and Miikkulainen, R. (2000). Online interactive neuro-evolution. Neural Processing Letters, 11:29-38.
3. Agogino, A., and Tumer, K. (2004a). Efficient evaluation functions for multi-rover systems. Proceedings of the Genetic and Evolutionary Computation Conference (pp. 1-12).
4. Agogino, A., and Tumer, K. (2004b). Unifying temporal and structural credit assignment problems. Proceedings of the Third International Joint Conference on Autonomous Agents and Multi-Agent Systems (pp. 980-987).
5. Agogino, A., and Tumer, K. (2005). Multi agent reward analysis for learning in noisy domains. Proceedings of the Fourth International Joint Conference on Autonomous Agents and Multi-Agent Systems (pp. 81-88).
6. Agogino, A., and Tumer, K. (2006). Distributed evaluation functions for fault tolerant multi rover systems. Proceedings of the Genetic and Evolutionary Computation Conference (pp. 1079-1086).
7. Agogino, A., Tumer, K., and Miikkulainen, R. (2005). Efficient credit assignment through evaluation function decomposition. Proceedings of the Genetic and Evolutionary Computation Conference (pp. 1309-1316).
8. Dorigo, M., and Stützle, T. (2004). Ant Colony Optimization. Bradford Books, Denver.
9. Farritor, S., and Dubowsky, S. (2002). Planning methodology for planetary robotic exploration. ASME Journal of Dynamic Systems, Measurement and Control, volume 124 (pp. 698-701).
10. Floreano, D., and Mondada, F. (1994). Automatic creation of an autonomous agent: Genetic evolution of a neural-network driven robot. Proceedings of the Third International Conference on Simulation of Adaptive Behavior (pp. 421-430). MIT Press, Cambridge, MA.
11. Globus, A., Crawford, J., Lohn, J., and Pryor, A. (2003). Scheduling earth observing satellites with evolutionary algorithms. Proceedings of International Conference on Space Mission Challenges for Information Technology (SMC-IT) (pp 836-843).
12. Gomez, F., and Miikkulainen, R. (1999). Solving non-Markovian control tasks with neuroevolution. Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI-99) (pp. 1356-1361).
13. Gomez, F., and Miikkulainen, R. (2003). Active guidance for a unless rocket through neuroevolution. Proceedings of the Genetic and Evolutionary Computation Conference (pp. 2084-2095).
14. Hardin, G. (1968). The tragedy of the commons. Science, 162:1243-1248.
15. Harrald, P., and Fogel, D. (1996). Evolving continuous behaviors in the iterated prisoner's dilemma. BioSystems: Special Issue on the Prisoner's Dilemma, 37(1-2):135-145.
16. Haykin, S. (1994). Neural Networks: A Comprehensive Foundation. Macmillan, New York.
17. Hoen, P. J., and de Jong, E. (2004). Evolutionary multi-agent systems. Proceedings of the Eighth International Conference on Parallel Problem Solving from Nature (pp. 872-881).
18. Hoffmann, F., Koo, T.-J., and Shakernia, O. (1999). Evolutionary design of a helicopter autopilot. Advances in Soft Computing-Engineering Design and Manufacturing, Part 3: Intelligent Control (pp. 201-214).
19. Lamma, E., Riguzzi, F., and Pereira, L. M. (2001). Belief revision by multi-agent genetic search. Proceedings of the Second International Workshop on Computational Logic for Multi-Agent Systems.
20. Martinoli, A., Ijspeert, A. J., and Mondala, F. (1999). Understanding collective aggregation mechanisms: From probabilistic modeling to experiments with real robots. Robotics and Autonomous Systems, 29:51-63.
21. Mataric, M. J. (1998). Coordination and learning in multi-robot systems. IEEE Intelligent Systems (pp. 6-8).
22. Miglino, O., Lund, H. H., and Nolfi, S. (1995). Evolving mobile robots in simulated and real environments. Artificial Life, 2(4):417-434.
23. Mikami, S., Mitsuo, W., and Kakazu, Y. (1996). Combining reinforcement learning with GA to find co-ordinated control rules for multi-agent system. Proceedings of the IEEE International Conference on Evolutionary Computation (pp. 356-361).
24. Mundhe, M., and Sen, S. (2000). Evolving agent societies that avoid social dilemmas. Proceedings of the Genetic and Evolutionary Computation Conference (pp. 809-816).
25. Panait, L., Luke, S., and Wiegand, R. P. (2006). Biasing revolutionary search for optimal multi-agent behaviors. IEEE Transactions on Evolutionary Computation, 10:629-645.
26. Potter, M. A., and de Jong, K. A. (2000). Cooperative coevolution: An architecture for evolving coadapted subcomponents. Evolutionary Computation, 8(1):1-29.
27. Sen, S., Debnath, S., and Mundhe, M. (2003). Evolving coordinated agents. Advances in evolutionary computing: Theory and applications (pp. 559-577).
28. Stanley, K., and Miikkulainen, R. (2002). Efficient reinforcement learning through evolving neural network topologies. Proceedings of the Genetic and Evolutionary Computation Conference (GECCO-2002) (pp. 569-577).
29. Tumer, K., and Agogino, A. (2004). Overcoming communication restrictions in collectives. Proceedings of the International Joint Conference on Neural Networks, volume 2 (pp. 1127-1132).
30. Tumer, K., and Agogino, A. (2006a). Robust coordination of a large set of simple rovers. Proceedings of the IEEE Aerospace Conference.
31. Tumer, K., and Agogino, A. K. (2006b). Efficient reward functions for adaptive multi-rover systems. In K. Tuyls, P. J. Hoen, S. Sen, and K. Verbeeck (Eds.), Learning and Adaptation in Multi Agent Systems (pp. 177-191). Springer, Berlin.
32. Tumer, K., and Agogino, A. K. (2007). Coordinating multi-rover systems: Evaluation functions for dynamic and noisy environments. In S. Yang, (Ed.), Evolutionary Computation in Dynamic and Uncertain Environments (pp. 371-388). Springer, Berlin.
33. Tumer, K., and Wolpert, D. (Eds.). (2004a). Collectives and the Design of Complex Systems. Springer, Berlin.
34. Tumer, K., and Wolpert, D. (2004b). A survey of collectives. Collectives and the Design of Complex Systems (pp. 1-42). Springer, Berlin.
35. Tumer, K., and Wolpert, D. H. (2000). Collective intelligence and Braess' paradox. Proceedings of the Seventeenth National Conference on Artificial Intelligence (pp. 104-109).
36. Whitley, D., Gruau, F., and Pyeatt, L. (1995). Cellular encoding applied to neurocontrol. Proceedings of the Sixth International Conference on Genetic Algorithms (pp. 460-469).
37. Wolpert, D. H., and Tumer, K. (2001). Optimal payoff functions for members of collectives. Advances in Complex Systems, 4(2/3):265-279.
38. Wu, A., Schultz, A., and Agah, A. (1999). Evolving control for distributed micro air vehicles. IEEE International Symposium on Computational Intelligence in Robotics and Automation (pp. 174-179).
39. Yao, X., and Darwen, P. (1994). An experimental study of n-person iterated prisoner's dilemma games. Informatica, 18:435-450.