Training artificial neural networks using lévy group search optimizer

Journal of Multiple-Valued Logic and Soft Computing

Volumn 16, Issue 6, 2010, Pages 527-545

  He, Shan ^a  

^a UNIVERSITY OF BIRMINGHAM   (United Kingdom)

Author keywords

Animal Behavior; Evolutionary Algorithm; Group Search Optimizer; L vy Flight; Optimization; Swarm Intelligence

Indexed keywords

ANIMAL BEHAVIOR; ARTIFICIAL NEURAL NETWORK; BENCHMARK FUNCTIONS; CLEVELAND; CONNECTION WEIGHTS; FLIGHT OPTIMIZATION; FORECASTING PROBLEMS; GAUSSIAN RANDOM WALK; GENERALIZATION PERFORMANCE; HEART DISEASE; RANDOM SEARCHES; REAL-WORLD PROBLEM; RESOURCE SEARCH; SEARCH OPTIMIZER; SEARCHING BEHAVIOR; SOPHISTICATED MACHINES; SUNSPOT NUMBER; SWARM INTELLIGENCE; TRAINING ALGORITHMS; UNCERTAIN ENVIRONMENTS;

ANIMALS; CELLULAR AUTOMATA; LEARNING ALGORITHMS; OPTIMIZATION;

NEURAL NETWORKS;

EID: 77953822092     PISSN: 15423980     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (39)

1. C. J. Barnard and R. M. Sibly. Producers and scroungers:Ageneral model and its applicationto captive flocks of house sparrows. Animal Behaviour 29 (1981), 543-550.
2. J.W. Bell. Searching Behaviour - The Behavioural Ecology of Finding Resources. Chapmanand Hall Animal Behaviour Series. Chapman and Hall, 1990.
3. X. Cai, J. Zeng, Z. H. Cui, and Y. Tan. Particle swarm optimization using Lévy probabilitydistribution. In Kang, L and Liu, Y and Zeng, S (eds). Advances in Computation andIntelligence, Proceedings, vol.4683 of Lecture Notes in Computer Science, pp. 353-361,Heidelberger Platz 3, D-14197 Berlin, Germany. Springer-Verlag Berlin. 2nd InternationalSymposium on Intelligence Computation and Application (ISICA 2007), Wuhan, PeoplesR China, Sep. 21-23, 2007.
4. E. Cantu-Paz and C. Kamath. An empirical comparison of combinations of evolutionaryalgorithms and neural networks for classification problems. IEEE Transactions on Systems,Man, and Cybernetics-Part B: Cybernetics 35(5) (2005), 915-927.
5. T. Caraco. Time budgeting and group size: A test of theory. Ecology 60 (1979), 618-627.
6. M. R. Chen, Y. Z. Lu, and G. Yang. Population-based extremal optimization with adaptive Lévy mutation for constrained optimization. In Computational Intelligence and Security, 2006 International Conference on, vol. 1, November, 2006, pp. 258-261.
7. M. Clerc, J. Kennedy. The particle swarm: Explosion, stability, and convergence in a multidimensionalcomplex space. IEEE Transactions on Evolutionary Computation, 6(1) (2002),58-73.
8. I. D. Couzin, J. Krause, N. R. Franks, and S. A. Levin. Effective leadership and decisionmakingin animal groups on the move. Nature 434 (Feb. 2005), 513-516.
9. T. G. Dirtterich. An experimental comparison of three methods for constructing ensemblesof decision trees: Bagging, boosting, and randomization. Machine Learning, 40(12) (2000),139-157.
10. A. F.G. Dixon.Anexperimental study of the searching behaviour of the predatory coccinellidbeetle adalia decempunctata. Journal of Animal Ecology 28 (1959), 259-281.
11. D. B. Dusenbery. Ranging strategies. Journal of Theoretical Biology 136 (1989), 309-316.
12. S. Dzeroski and B. Zenko. Is combining classifiers with stacking better than selecting thebest one? Machine Learning, 54(3) (2004), 255-273.
13. D. B. Fogel. Evolutionary computation: Toward a new philosophy of machine intelligence.IEEE Press, New York, 1995.
14. D. B. Fogel, L. J. Fogel, and V.W. Porto. Evolving neural networks. Biological Cybernetics63 (1990), 487-493.
15. L. J. Fogel, A. J. Owens, and M. J. Walsh. Artificial intelligence through a simulation ofevolution. In M. Maxfield, A. Callahan, and L. J. Fogel (eds), Biophysics and CyberneticSystems: Proc. of the 2nd Cybernetic Sciences Symposium. Washington, D.C. SpartanBooks, 1965, pp. 131-155.
16. N. Garcia-Pedrajas, C. Hervas-Martinez, and J. Munoz-Perez. Covnet: A cooperativecoevolutionary model for evolving artificial neural networks. IEEE Transactions on NeuralNetworks 14(3) (May 2003), 575-596.
17. T. Van Gestel, et. al. Benchmarking least squares support vector machine classifiers.Machine Learning, 54(1) (2004), 5-32.
18. D. G. C. Harper. Competitive foraging in mallards: 'ideal free' ducks. Animal Behaviour 30(1988), 575-584.
19. S. Haykin. Neural Networks. A Comprehensive Foundation. Prentice Hall, New Jersey,USA, 1999.
20. S. He, Q. H. Wu, and J. R. Saunders. Group search optimizer - an optimization algorithminspired by animal searching behavior. IEEE Transaction on Evolutionary Computation13(9) (Oct. 2009), 973-990.
21. J. H. Holland. Adaption in Natural and Artificial Systems. Ann Arbor, 1975.
22. M. Islam, X. Yao, and K. Murase. A constructive algorithm for training cooperative neuralnetwork ensembles. IEEE Transactions on Neural Networks, 14(4) (2003), 820-834.
23. J. Kennedy and R.C. Eberhart. Particle swarm optimization. In IEEE internationalConference on Neural Networks, vol.4, pp. 1942-1948. IEEE Press, 1995.
24. C.Y. Lee, X.Yao. Evolutionary programming using mutations based on the Lévy probabilitydistribution. Evolutionary Computation, IEEE Transactions on 8(1) (Feb. 2004), 1-13.
25. F. H. F. Leung, H. K. Lam, S. H. Ling, and P. K. S. Tam. Tuning of the structure andparameters of a neural network using an improved genetic algorithm. IEEE Transactionson Neural Networks 14(1) (Jan. 2003), 79-88.
26. R. N. Mantegna. Fast, accurate algorithm for numerical simulation of lévy stable stochasticprocesses. Phys. Rev. E 49(5) (May 1994), 4677-4683.
27. W. J. O'Brien, B. I. Evans, and G. L. Howick. A new view of the predation cycle of aplanktivorous fish, white crappie (pomoxis annularis). Canadian Journal of Fisheries andAquatic Sciences 43 (1986), 1894-1899.
28. G. A. Parker and J. Maynard Smith. Optimality theory in evolutionary biology. Nature348(1) (Nov. 1990), 27-33.
29. L. Prechelt. Problem1 - a set of neural network benchmark problems and benchmarkingrules. Technical report, Fakultat fur Infromatik Universitat Karlsruhe, 76128 Karlsruhe,Germany, September 1995.
30. A. M. Reynolds, C. J. Rhodes. The lÉvy flight paradigm: Random search patterns andmechanisms. Ecology 90(4) (April 2009), 877-887.
31. T. J. Richer, T.M. Blackwell. The Lévy particle swarm. In Evolutionary Computation, 2006.CEC 2006. IEEE Congress on, 2006, pp. 808-815.
32. H.-P. Schwefel. Evolution and optimum seeking.Wiley, New York, 1995.
33. D. W. Sims, et al. Scaling laws of marine predator search behavior. Nature 451 (2008),1098-1102.
34. L. Todorovski, S. Dzeroski. Combining classifiers with meta decision trees. MachineLearning 50(3) (2003), 223-249.
35. G. M. Viswanathan, S. V. Buldyrev, S. Havlin, M. G. da Luz, E. Raposo, and H. E. Stanley.Optimizing the success of random searches. Nature 401 (1999), 911-914.
36. D. H. Wolpert. A mathematical theory of generalization. Complex Systems 4(2) (1990),151-249.
37. X. Yao. Evolving artificial neural networks. Proceeding of the IEEE, 87(9) (Sep. 1999),1423-1447.
38. X. Yao, Y. Liu. A new evolutionary system for evolving artificial neural networks. IEEETransactions on Neural Networks 8(3) (May 1997), 694-713.
39. X. Yao and Y. Liu. Making use of population information in evolutionary artificial neuralnetworks. IEEE Transaction on Systems, Man and Cybernetics, Part B: Cybernetics 28(3)(1998), 417-425.