Observing the evolution of neural networks learning to play the game of Othello

IEEE Transactions on Evolutionary Computation

Volumn 9, Issue 3, 2005, Pages 240-251

  Chong, Siang Y ^a   Tan, Mei K ^b   White, Jonathon D ^c  

^a UNIVERSITY OF BIRMINGHAM   (United Kingdom)

^b MULTIMEDIA UNIVERSITY   (Malaysia)

^c YUAN ZE UNIVERSITY   (Taiwan)

Author keywords

Artificial intelligence; Coevolution; Evolutionary computation; Neural networks; Othello

Indexed keywords

ARTIFICIAL INTELLIGENCE; COMPUTER SIMULATION; EVOLUTIONARY ALGORITHMS; EXPERT SYSTEMS; GAME THEORY; LEARNING SYSTEMS;

COEVOLUTION; EXPERT KNOWLEDGE BASED EVALUATION FUNCTION; OTHELLO;

NEURAL NETWORKS;

EID: 21044442867     PISSN: 1089778X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TEVC.2005.843750     Document Type: Article

References (47)

1. K. Chellapilla and D. B. Fogel, "Evolution, neural networks, games, and intelligence," Proc. IEEE, vol. 87, no. 9, pp. 1471-1496, Sep. 1999.
2. D. B. Fogel, Blondie24: Playing at the Edge of A1. San Mateo, CA: Morgan Kaufmann, 2002.
3. K. Chellapilla and D. B. Fogel, "Anaconda defeats Hoyle 6-0: A case study competing an evolved checkers program against commercially available software," in Proc. 2000 Congr. Evol. Comput., 2000, pp. 857-863.
4. K. Chellapilla and D. B. Fogel, "Evolving neural networks to play checkers without expert knowledge," IEEE Trans. Neural Netw., vol. 10, no. 6, pp. 1382-1391, 1999.
5. D. E. Moriarty and R. Miikkulainen, "Improving game-tree search with evolutionary neural networks," in Proc. 1st IEEE Conf. Evol. Comput., IEEE World Congr. Comput. Intell., 1994, pp. 496-501.
6. D. E. Moriarty and R. Miikkulainen, "Discovering complex Othello strategies through evolutionary neural networks," Connection Sci., vol. 7, no. 3, pp. 195-209, 1995.
7. D. B. Fogel, "An introduction to simulated evolutionary optimization," IEEE Trans. Neural Netw., vol. 5, no. 1, pp. 3-14, Jan. 1994.
8. D. B. Fogel, Evolutionary Computation: Toward a New Philosophy of Machine Intelligence. Piscataway, NJ: IEEE Press, 1995.
9. T. Back, Evolutionary Algorithms in Theory and Practice. New York: Oxford Univ. Press, 1996.
10. T. Back, U. Hammel, and H. P. Schwefel, "Evolutionary computation: Comments on the history and current state," IEEE Trans. Evol. Comput., vol. 1, no. 1, pp. 3-17, Apr. 1997.
11. D. B. Fogel, "Using evolutionary programming to construct neural networks that are capable of playing tic-tac-toe," in Proc. 1995 IEEE Int. Conf. Neural Netw., 1995, pp. 875-880.
12. B. Fullmer and R. Miikkulainen, "Using marker-based genetic encoding of neural networks to evolve finite-state behavior," in Proc. 1st Eur. Conf. Arti. Life, Toward a Practice of Autonomous Syst., F. J. Varela and P. Bourgine, Eds., 1992, pp. 255-262.
13. G. Weiss, "Neural networks and evolutionary computation part I: Hybrid approaches in artificial intelligence," in Proc. 1st IEEE Conf. Evol. Comput., IEEE World Congr Comput. Intell., 1994, pp. 268-272.
14. X. Yao, "Evolving artificial neural networks," Proc. IEEE, vol. 87, no. 9, pp. 1423-1447, Sep. 1999.
15. X. Yao and Y. Liu, "A new evolutionary system for evolving artificial neural networks," IEEE Trans. Neural Netw., vol. 8, no. 3, pp. 694-713, May 1997.
16. K. Chellapilla and D. B. Fogel, "Exploring self-adaptive methods to improve the efficiency of generating approximate solutions to traveling salesman problems using evolutionary programming," in Evolutionary Programming VI, P. J. Angeline, R. G. Reynolds, J. R. McDonnell, and R. Eberhart, Eds. Berlin, Germany: Springer-Verlag, 1997, pp. 361-371.
17. V. W. Porto, M. Hardt, D. B. Fogel, K. Kreutz-Delgado, and L. J. Fogel, "Evolving tactics in computer-generated forces," in Proc. AeroSense'99 Symp. Enabling Technol. Simulation Sci. III, A. Sisti, Ed., 1999, pp. 75-80.
18. D. B. Fogel, P. J. Angeline, V. W. Porto, E. C. Wasson, and E. M. Boughton, "Using evolutionary computation to learn about detecting breast cancer," in Proc. 1999 Cong. Evol. Comput., 1999, pp. 1749-1754.
19. A. V. Leouski and P. E. Utgoff, "What a Neural Network can Learn About Othello," University of Massachusetts, Amherst, MA, Tech. Rep. 96-10, 1996.
20. P. S. Rosenbloom, "A world-championship-level Othello program," Artif. Intell., vol. 19, pp. 279-320, 1982.
21. K. F. Lee and S. Mahajan, "The development of a world class Othello program," Artif. Intell., vol. 43, pp. 21-36, 1990.
22. M. Buro, "Improving heuristic mini-max search by supervised learning," Artif. Intell., vol. 134, pp. 85-99, 2002.
23. J. Schaeffer and H. J. van den Herik, "Games, computers, and artificial intelligence," Artif. Intell., vol. 134, pp. 1-7, 2002.
24. H. J. van den Herik, J. W. H. M. Uiterwijk, and J. van Rijswijck, "Games solved: Now and in the future," Artif. Intell., vol. 134, pp. 277-311, 2002.
25. H. Kaindl, "Tree searching algorithms," in Computers, Chess, and Cognition, T. A. Marsland and J. Schaeffer, Eds. New York: Springer-Verlag, 1990, pp. 133-168.
26. J. B. Pollack and A. D. Blair, "Coevolution in the successful learning of backgammon strategy," Mach. Learn., vol. 32, no. 3, pp. 225-240, 1995.
27. D. B. Fogel and P. G. Harrald, "Evolving continuous behaviors in the iterated prisoner's dilemma," in Proc. 3rd Annu. Conf. Evol. Program., A. V. Sebald and L. J. Fogel, Eds., 1994, pp. 119-130.
28. P. Darwen and X. Yao, "Coevolution in iterated prisoner's dilemma with intermediate levels of cooperation: Application to missile defense," Int. J. Comput. Intell. Applicat., vol. 2, no. 1, pp. 83-107, 2002.
29. K. V. Price, "An introduction to differential evolution," in New Ideas in Optimization, D. Corne, M. Dorigo, and F. Glover, Eds. New York: McGraw-Hill, 1999, pp. 79-108.
30. A. Jain and D. B. Fogel, "Case studies in applying fitness distribution in evolutionary algorithms II. Comparing the improvements from crossover and Gaussian mutation on simple neural networks," in Proc. IEEE 1st Symp. Combin. Evol. Comput. Neural Netw., X. Yao and D. B. Fogel, Eds., 2000, pp. 91-97.
31. A. E. Eiben, R. Hinterding, and Z. Michalewicz, "Parameter control in evolutionary algorithms," IEEE Trans. Evol. Comput., vol. 3, no. 2, pp. 124-141, Jul. 1999.
32. H. P. Schwefel, Numerical Optimization of Computer Models. New York: Wiley, 1981.
33. X. Yao, Y. Liu, and G. Lin, "Evolutionary programming made faster," IEEE Trans. Evol. Comput., vol. 3, no. 2, pp. 82-102, Jul. 1999.
34. K. Chellapilla, "Combining mutation operators in evolutionary programming," IEEE Trans. Evol. Comput., vol. 2, no. 3, pp. 91-96, Sep. 1998.
35. K. Chellapilla and D. B. Fogel, "Fitness distributions in evolutionary computation: Analysis of local extrema in the continuous domain," in Proc. 1999 Congr. Evol. Comput., 1999, pp. 1885-1892.
36. T. Bäck, "Selective pressure in evolutionary algorithms: A characterization of selection mechanism," in Proc. 1st IEEE Conf. Evol. Comput., IEEE World Congr. Comput. Intell., 1994, pp. 57-62.
37. D. Billman and D. Shaman, "Strategy knowledge and strategy change in skilled performance: A study of the game Othello," Amer. J. Psychol., vol. 103, no. 2, pp. 145-166, 1990.
38. K. A. De Jong and W. M. Spears, "An analysis of the interacting roles of population size and crossover in genetic algorithms," in Proc. Int. Workshop Parallel Problem Solving from Nature (PPSN), 1990, pp. 38-47.
39. D. B. Fogel, G. B. Fogel, and K. Ohkura, "Multiple-vector self-adaptation in evolutionary algorithms," BioSystems, vol. 61, no. 2-3, pp. 155-162, 2001.
40. P. Darwen and X. Yao, "On evolving robust strategies for iterated prisoner's dilemma," in Progress in Evolutionary Computation, ser. Lecture Notes in Artificial Intelligence, 1995, vol. 956, pp. 276-292.
41. P. Darwen and X. Yao, "Every niching method has its niche: Fitness sharing and implicit sharing compared," in Lecture Notes in Computer Science, 1996, vol. 1141, Proc. Parallel Problem Solving from Nature (PPSN IV), pp. 398-407.
42. P. J. Angeline and J. B. Pollack, "Competitive environments evolve better solutions for complex tasks," in Proc. 5th Int. Conf. Genetic Algorithms, S. Forest, Ed., 1993, pp. 264-270.
43. X. Yao and P. Darwen, "An experimental study of n-person iterated prisoner's dilemma games," Informatica, vol. 18, no. 4, pp. 435-450, 1994.
44. C. Rosin and R. Belew, "New methods for competitive coevolution," Evol. Comput., vol. 5, no. 1, pp. 1-29, 1997.
45. X. Yao, Y. Liu, and P. Darwen, "How to make best use of evolutionary learning," in Complex Systems - From Local Interactions to Global Phenomena, R. Stocker, H. Jelinck, B. Burnota, and T. B. Maier, Eds. Amsterdam, The Netherlands: IOS Press, 1996, pp. 229-242.
46. P. Darwen and X. Yao, "Speciation as automatic categorical modularization," IEEE Trans. Evol. Comput., vol. 1, no. 2, pp. 101-108, Jul. 1997.
47. J. Ilonen, J. I.-K. Kamarainen, and J. Lampinen, "Differential evolution training algorithm for feed-forward neural networks," Neural Process. Lett., vol. 17, pp. 93-105, 2003.