Measuring generalization performance in coevolutionary learning

IEEE Transactions on Evolutionary Computation

Volumn 12, Issue 4, 2008, Pages 479-505

  Chong, Siang Yew ^a   Tiño, Peter ^a   Yao, Xin ^a  

^a UNIVERSITY OF BIRMINGHAM   (United Kingdom)

Author keywords

Chebyshev's inequality; Coevolutionary learning; Evolutionary computation; Generalization; Iterated prisoner's dilemma (IPD)

Indexed keywords

ARTIFICIAL INTELLIGENCE; CLUSTER ANALYSIS; EDUCATION; ESTIMATION; LEARNING SYSTEMS; MAXIMUM LIKELIHOOD ESTIMATION; RANDOM VARIABLES; RESEARCH; TESTING;

AVERAGE PERFORMANCE; CHEBYSHEV'S INEQUALITY; COEVOLUTIONARY LEARNING; EVOLUTIONARY COMPUTATION; EVOLUTIONARY PROCESSES; GENERALIZATION; GENERALIZATION PERFORMANCE; HUMAN EXPERTISE; INPUT-OUTPUT; ITERATED PRISONER'S DILEMMA; ITERATED PRISONER'S DILEMMA (IPD); MACHINE-LEARNING; MATHEMATICAL ANALYSES; PERFORMANCE CRITERION; SMALL SAMPLES; TEST STRATEGIES; TRAINING PROCESSES; TRAINING SAMPLES; TRUE VALUE;

GAME THEORY;

EID: 49049100073     PISSN: 1089778X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TEVC.2007.907593     Document Type: Article

References (59)

1. X. Yao, "Introduction," Informatica (Special Issue on Evol. Comput.), vol. 18, pp. 375-376, 1994.
2. R. Axelrod, "The evolution of strategies in the iterated prisoner's dilemma," in Genetic Algorithms and, Simulated Annealing, L. D. Davis, Ed. New York: Morgan Kaufmann, 19887, ch. 3, pp. 32-41.
3. K. Chellapilla and D. B. Fogel, "Evolution, neural networks, games, and intelligence," Proc. IEEE, vol. 87, no. 9, pp. 1471-1496, Sept. 1999.
4. D. B. Fogel, "An introduction to simulated evolutionary optimization," IEEE Trans. Neural Netw., vol. 5, no. 1, pp. 3-14, 1994.
5. T. Back, U. Hammel, and H. P. Schwefel, "Evolutionary computation: Comments on the History and current state," IEEE Trans. Evol. Comput., vol. 1, no. 1, pp. 3-17, Apr. 1997.
6. X. Yao, Evolutionary Computation: Theory and Applications. Singapore: World Scientific, 1999.
7. S. Luke and R. P. Wiegand, "When coevolutionary algorithms exhibit evolutionary dynamics," in Proc. Workshop on Understanding Coevolution: Theory and Analysis of Coevolutionany Algorithms (GECCO'02 A. Barry, Ed., 2002, pp. 236-241.
8. E. Popovici and K. D. Jong, "Relationships between internal and external metrics in co-evolution," in Proc. IEEE 2005 Congr. Evol. Comput. (CEC'05), Edinburgh, U.K., Sep. 2-5, 2005, pp. 2800-2807.
9. S. Nolfi and D. Floreano, "Co-evolving predator and prey robots: Do "arms races" arise in artificial evolution?," Artif. Life, vol. 4, no. 4, pp. 311-335, 1998.
10. S. G. Ficici and j. B. Pollack, "Challenges in coevolutionary learning: Arms-race dynamics, open-endedness, and mediocre stable states," in Proc. 6th Int. Conf. Artif. Life, C. Adami, R. K. Belew, H. Kitano, and C. Taylor, Eds., 1998, pp. 238-247.
11. R. A. Watson and J. B. Pollack, "Coevolutionary dynamics in a minimal substrate," in Proc. 2001 Genetic Evol. Comput. Conf (GECCO'01), CA, 2001, pp. 702 709.
12. E. D. de Jong and J. B. Pollack, "Ideal evaluation from coevolution," Evol. Comput., vol. 12, no. 2, pp. 159-192, 2004.
13. J. Cartlidge and S. Bullock, "Combating coevolutionary disengagement by reducing parasite, virulence," Evol. Comput., vol. 12, no. 2, pp. 193-222, 2004.
14. J. Noble, "Finding robust tex-as hold'em poker strategies using Pareto coevolution and deterministic crowding," in Proc. 2002 Int. Conf. Mach. Learn. Appl. (ICMLA'02), NV, 2002, pp. 233-239.
15. K. O. Stanley and R. Miikkulainen, "Competitive coevolution through evolutionary complexification," J. Artif. Intell. Res., vol. 21, pp. 63-100, 2004.
16. S. Y. Chong, M. K. Tan, and J. D. White, "Observing the evolution of neural networks learning to play the game of Othello," IEEE Trans. Evol. Comput., vol. 9, no. 3, pp. 240-251, Jun. 2005.
17. T. P. Runarsson and S. M. Lucas, "Coevolution versus self-play temporal difference learning for acquiring position evaluation in small-board go," IEEE Trans. Fvol. Comput., vol. 9, no. 6, pp. 540-551, Dec. 2005.
18. W. D. Hillis, "Co-evolving parasites improve simulated evolution as an optimization procedure," Physica D, vol. 42, pp. 228-234, 1990.
19. H. Juille and J. B. Pollack, "Co-evolving the "ideal" trainer: Application to the discovery of cellular automata rules," in Proc. 3rd Annu. Conf. Genetic Programming 1998, J. R. Koza, W. Banzhaf, K. Cheilapilla, K. Deb, M. Dorigo, D. B. Fogel, M. H. Garzon, D. E. Goldberg, H. Iba, and R. Riolo, Eds., 1998, pp. 519-527.
20. J. Werfel, M. Mitchell, and J. P. Crutchfield, "Resource sharing and coevolution in evolving cellular automata," IEEE Trans. Evol. Computl., vol. 4, no. 4, pp. 388-393, Nov. 2000.
21. P. J. Darwen and X. Yao, "Co-evolution in iterated prisoner's dilemma with intermediate levels of cooperation: Application to missile defense,"] Int. J. Comput. Intell. Appl., vol. 2, no. 1, pp. 83-107, 2002.
22. C. D. Rosin and R. K. Belew, "New methods for competitive coevolution," Evol. Comput., vol. 5, no. 1, pp. 1-29, 1997.
23. S. G. Ficici, "Solution concepts in coevolutionary algorithms," Ph.D. dissertation, Brandeis Univ., Waltham, MA, 2004.
24. S. G. Ficici and J. B. Pollack, "Pareto optimality in coevolutionary learning," in Proc. 6th Eur. Conf. Advances in Artif. Life (ECAL'01),, Prague, Czech Republic, Sep. 10-14, 2001, vol. 2159, Lecture Notes in Computer Science, pp. 316-325.
25. S. Y. Chong and X. Yao, "Behavioral diversity, choices, and noise in the iterated prisoners dilemma," IEEE Trans. Evol. Comput., vol. 9, no. 6, pp. 540-551, Dec. 2005.
26. P. J. Darwen and X. Yao, "Why more choices cause less cooperation in iterated prisoner's dilemma," in Proc. IEEE 2001 Congr. Evol. Comput. (CEC'01), Seoul, Korea, May 27-30, 2002, pp. 987-994.
27. S. G. Ficici, O. Melnik, and J. B. Pollack, "A game-theoretic and dynamical -systems analysis of selection methods in coevolution," IEEE Trans. Evol. Comput., vol. 9, no. 6, pp. 580-602, Dec. 2005.
28. D. Cliff and G. F. Miller, "Tracking the red queen: Measurements of adaptive progress in co-evolutionary simulations," in Proc. 3rd Eur. Conf. Advances in Artif. Life, 1995, vol. 929, Lecture Notes in Computer Science, pp. 200-218, Springer-Verlag.
29. D. Floreano and S. Nolfi, "God save the red queen! competition in co-evolutionary robotics," in Proc. 2nd Annu. Conf. Genetic Programming, J. R. Koza, K. Deb, M. Dorigo, D. B. Fogel, M. Garzon, H. Iba, and R. L. Riolo, Eds., 1997, pp- 398-406.
30. K. O. Stanley and R. Miikkulainen, "The dominance tournament method of monitoring progress in coevolution," in Proc. 2002 Genetic Evol. Comput. Conf. (GECCO'002) Bird of a Feather Workshop:, New York, 2002, pp. 242-248.
31. A. Barder-Natal and J. B. Pollack, "Towards metrics and visualizations sensitive to coevolutionary failures," AAAI Tech. Rep. FS-05-03, Co-evol. Coadaptive Syst., AAAI Fall Symp., 2005, Washington, DC.
32. C. M. Bishop, Neural Networks for Pattern Recognition. Oxford, U.K.: Oxford Univ. Press, 1995.
33. X. Yao, Y. Liu, and P. J. Darwen, "How to make best use of evolutionary learning," in Complex Systems - From Local Interactions to Global Phenomena, R. Stacker, H. Jelinck, B. Burnota, and T. Bossomaier, Eds. Amsterdam, The Netherlands: IOS Press, 1996, pp. 229-242.
34. P. J. Darwen and X. Yao, "On evolving robust strategies for iterated prisoner's dillemma," in Progress in Evolutionary Computation, ser. Lecture Notes in Attificial intelligence. New Yolk: Springer, 1995, vol. 956, pp. 276-292.
35. P. J. Darwen, "Co-evolutionary learning by automatic modularization with speciation," Ph.D. dissertation, Univ. New South Wales, Sydney, Australia, Nov. 1996.
36. P. J. Darwen and X. Yao, "Speciation as automatic categorical modularization," IEEE Trans. Evol. Comput., vol. 1, no. 2, pp. 101-108, Jul. 1997.
37. Y. G. Seo, S. B. Cho, and X. Yao, "Emergence, of cooperative, coalition in NIPD game with localization of interaction and learning," in Proc. IEEE 1999 Cangr. Evol. Comput. (CEEC'99 . Piscataway, NJ: IEEE Press, 1999, pp. 877-884.
38. C. D. Rosin, "Coevolultionary search among adversaries," Ph.D. dissertation, Univ. California, San Diego, CA, 1997.
39. R. P. Wiegand and M. A. Potter, "Robustness in cooperative coevolution," in Proc. 20006 Conf. Genetic Evol. Comput. (GLUCCO'06) Seattle, WA, 2006, pp. 369-376.
40. M. Bowling, "Convergence and no-regret in multiagent learning," in Advances in Neural Inf. Process. Syst., 2005, vol. 1. 17, pp. 209-216.
41. R. Powers and Y. Shoham, Computing best-response strategies via sampling Comput. Sci. Dept., Stanford Univ., Stanford, C A, 2003, Tech. Rep.
42. S. G. Ficici and J. B. Pollack, "A game-theoretic memory mechanism for coevolution," in Proc. 2003 Conf. Genetic Evol. Comput. (GECCO'03) 2003, vol. 2723, Lecture Notes in Computer Science, pp. 286-297.
43. E. D. de Jong, "The incremental Pareto-coevolution archive," in Proc. 2004 Conf. Genetic Evol. Comput. (GECCO'04), 2004, pp. 525-536.
44. E. D. de Jong "The maxsolve algorithm for coevolution," in Proc. 2005 Conf. Genetic Evol. Compui. (GECCO'05), New York, 2005, pp. 483-489.
45. B. V. Gnedenko and G. V. Gnedenko, Theory of Probability. New York: Taylor & Francis, 1998.
46. H. I. Jacobson, "The maximum variance of restricted unimodal distributions," Ann. Math. Stat., vol. 40, no. 5, pp. 1746-1752, 1969.
47. R. Axelrod, The Evolutian of Cooperation. New York: Basic Books, 1984.
48. R. Axelrod, "Effective choice in the prisoner's dilemma," J. Conflict Resolution, vol. 24, no. 1, pp. 3-25, Mar. 1980.
49. R. Axelrod, "More effective choice in the prisoner's dilemma," J. Conflict Resolution, vol. 24, no. 3, pp. 379-403, Sept. 1910.
50. X. Yao and P. J. Darwen, "How important is your reputation in a multi-agent environment," in Proc. IEEE 19999 Conf. Syst., Man, Cybern. (SMC'99), Tokyo, Japan, Oct. 12-15, 1999, pp. 575-580.
51. P. J. Darwen and X. Yao, "Does extra genetic diversity maintain escalation in a co-evolutionary arms race," Int. J. Knowledge-Based Intell. Eng. Syst., vol. 4, no. 3, pp. 191-200, July 2000.
52. D. B. Fogel, "The evolution of intelligent decision making in gaming," Int. J. Cybern. Systems, vol. 22, pp. 223-236, 1991.
53. D. B. Fogel, "Evolving behaviors in the iterated prisoner's dilemma," Evol. Compu., vol. 1, no. 1, pp. 77-97, 1993.
54. D. B. Fogel, "On the relationship between the duration of an encounter and the evolution of cooperation in the iterated prisoner's dilemma," Evol. Comput., vol. 1, no. 1, pp. 349-363, 1996.
55. B. A. Julstro,m "Effects of contest length and noise on reciprocal altruism, cooperation, and payoffs in the iterated prisoner's dilemma," in Proc. 7th Int. Conf. Genetic Algorithms (ICGA1'97 , 1997, pp. 386-392.
56. R. Axelrod and W. D. Hamilton, "The evolution of cooperation," Science, vol. 211, pp. 1390-1396, 1981.
57. P. G. Harrald and D. B. Fogel, "Evolving continuous behaviors in the iterated prisoner's dilemma," BioSystems: Special Issue on the Prisoner's Dilemma, vol. 37, pp. 135-145, 1996.
58. N. Franken and A. P. Engelbrecht, "Particle swarm optimization approaches to coevolve strategies for the iterated prisoner's dilemma," IEEE Trans. Evol. Comput., vol. 9, no. 6, pp. 562-579, Dec. 2005.
59. M. A. Potter and K. A. D. Jong, "Cooperative coevolution: An architecture for evolving coadapted subcomponents," Evol. Comput. vol. 8, no. 1, pp. 1-29, 2000.