Improved group search optimizer based on cooperation among groups for feedforward networks training with weight decay

Conference Proceedings - IEEE International Conference on Systems, Man and Cybernetics

Volumn , Issue , 2011, Pages 2133-2138

  Silva, D N G ^a   Pacifico, L D S ^a   Ludermir, T B ^a  

^a FEDERAL UNIVERSITY OF PERNAMBUCO   (Brazil)

Author keywords

Artificial Neural Networks; Evolutionary computing; Group search optimization; Search space bounds

Indexed keywords

ARCHITECTURE DESIGNS; BENCHMARK DATASETS; COMPLEX TASK; CONNECTION WEIGHTS; DIVIDE AND CONQUER; ENGINEERING PROBLEMS; EVOLUTIONARY COMPUTING; FEED-FORWARD NETWORK; GENERALIZATION PERFORMANCE; GLOBAL SEARCHING; LEVENBERG-MARQUARDT; OPTIMIZATION ALGORITHMS; SEARCH OPTIMIZATION; SEARCH OPTIMIZER; SEARCH SPACES; WEIGHT DECAY;

BEHAVIORAL RESEARCH; BENCHMARKING; CYBERNETICS; EVOLUTIONARY ALGORITHMS; NEURAL NETWORKS; OPTIMIZATION;

FEEDFORWARD NEURAL NETWORKS;

EID: 83755206516     PISSN: 1062922X     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICSMC.2011.6083987     Document Type: Conference Paper

References (32)

1. C. J. Barnard and R. M. Sibly, "Producers and Scroungers: A General Model and Its Application to Captive Flocks of House Sparrows", in: Animal Behaviour, vol. 29, pp. 543-550, 1981.
2. S. He, Q. H. Wu, and J. R. Saunders, "A novel group search optimizer inspired by animal behavioural ecology," in: 2006 IEEE Congress on Evolutionary Computation (CEC 2006), Sheraton Vancouver Wall Centre, Vancouver, BC, Canada., July 2006, pp. Tue PM-10-6.
3. S. He, H. Wu and J. R. Saunders, "Group Search Optimizer: An Optimization Algorithm Inspired by Animal Searching Behaviour", in: IEEE Transactions on Evolutionary Computation, vol. 13, no. 5, pp. 973-990, 2009.
4. S. He, Q. H. Wu and J. R. Saunders, "Breast Cancer Diagnosis Using an Artificial Neural Network Trained by Group Search Optimizer", in: Transactions of the Institute of Measurement and Control, vol. 31, no. 6, pp. 517-531, 2009.
5. Q. H. Wu, Z. Lu, M. S. Li and T. Y. Ji, "Optimal Placement of FACTS Devices by a Group Search Optimizer with Multiple Producers", in: 2008 Congress on Evolutionary Computation (CEC 2008), Hong Kong, pp. 1033-1039, 2008.
6. thIEEE International Conference on Emerging Technologies and Factory Automation (ETFA 2008), pp. 1260-1266, 2008.
7. W. J. O'Brien, B. I. Evans and G. L. Howick, "A New View of the Predation Cycle of a Planktivorous Fish, White Crappie (Pomoxis Annularis)", in: Canadian J. Fisheries Aquatic Sci., vol. 43, pp. 1894-1899, 1986.
8. I. D. Couzin, J. Krause, N. R. Franks and S. A. Levin, "Effective Leadership and Decision-Making in Animal Groups on the Move", Nature, vol. 434, pp. 513-516, 2005. (Pubitemid 40204306)
9. C. L. Higgins and R. E. Strauss, "Discrimination and classification of foraging path produced by search-tactic models," Behavior Ecology, vol. 15, pp. 248-254, 2003.
10. A. F. Dixon, "An Experimental Study of the Searching Behaviour of the Predatory Cocconellid Beetle Adalia Decempunctata", in: J. Animal Ecology, vol. 28, pp. 259-2281, 2003.
11. J. Kennedy and R. Eberhart, "Particle Swarm Optimization", in: Proc. IEEE Intl. Conf. on Neural Networks (Perth, Australia), IEEE Service Center, Piscataway, NY, IV: 1942-1948, 1995.
12. J. Kennedy and R. Eberhart. "Swarm Intelligence", Morgan Kaufmann Publishers, Inc, San Francisco, CA, 2001.
13. P. N. Suganthan, "Particle Swarm Optimizer with Neighborhood Operator", in: Proc.Congr. Evolutionary Computation, Washington, DC, pp. 1958-1961, 1999.
14. F. van den Bergh. "An Analysis of Particle Swarm Optimizers", PhD dissertation, Faculty of Natural and Agricultural Sciences, Univ. Pretoria, Pretoria, South Africa, 2002.
15. F. van den Bergh and A. P. Engelbrecht, "A Cooperative Approach to Particle Swarm Optimization", IEEE Transactions on Evolutionary Computation, vol. 8, no. 3, pp. 225-239, 2004.
16. M. Carvalho, T. B. Ludemir, "An Analysis of PSO Hybrid Algorithms for Feed-Forward Neural Networks Training", Proceedings of the Ninth Brazilian Symposium on Neural Networks - SBRN'06, pp. 6-11, 2006.
17. M. Carvalho, T. B. Ludemir, "Particle Swarm Optimization of Feed-Foward Neural Networks with Weight Decay", in: Proceedings of the Sixth International Conference on Hybrid Intelligent Systems (HIS'06), pp. 5-5, 2006.
18. ndEdition, Prentice Hall, 1998.
19. G. E. Hinton, "Learning Distributed Representation of Concepts", in: Annual Conference of Cognitive Science Society, pp. 1-12, 1986.
20. A. S. Weigend, D. E. Rumelhart and B. A. Huberman, "Generalization by Weight Elimination with Application to Forecasting", in: Proceedings of the 1990 conference on Advances in neural information processing systems III (NIPS III), pp. 875-882, 1990.
21. C. Zanchettin and T. B. Ludermir, "Global Optimization Methods for Designing and Training Feedforward Artificial Neural Networks", in: Dynamics of Continuous, Discrete & Impulsive Systems (DCDIS) A Supplement, Advances in Neural Networks, vol. 14 (S1), pp. 328-337, 2007.
22. S. H. Clearwater, T. Hong and B. A. Huberman, "Cooperative Problem Solving", in: Computation: The Micro and Macro View, Singapore: World Scientific, pp. 33-70, 1992.
23. M. A. Potter and A. de Jong, "A Cooperative Coevolutionary Approach to Function Optimization", in: The Third Parallel Problem Solving from Nature, Berlin, Germany:Springer-Verlag, pp. 249-257, 1994.
24. Y. Ong, A. Keane and P. Nair, "Surrogate-Assisted Coevolutionary Search", in: Proceeding of the 9th International Conference on Neural Information Processing, pp. 1140-1145, 2002.
25. ndEdition, Book Series on Genetic Algorithms and Evolutionary Computation, Norwell, MA:Kluwer, vol. I, 2000.
26. E. Eiben and J. E. Smith, "Introduction to Evolutionary Computing", Natural Computing Series, MIT Press, Springer, Berlin, 2003.
27. S. Kirkpatrick, C. D. Gellat Jr. and M. P. Vecchi, "Optimization by Simulated Annealing", Science, vol. 220, pp. 671-680, 1983.
28. F. Glover, "Future Paths for Integer Programming and Links to Artificial Intelligence", Computers and Operation Research, vol. 13, pp. 533-549, 1986. (Pubitemid 17480188)
29. M. Dorigo, V. Maniezzo and A. Colorni, "Ant System: Optimization by a Colony of Cooperative Agents", IEEE Transactions on Systems, Man and Cybernetics - Part B, vol. 26, no. 1, pp.29-41, 1996.
30. Q. Y. Zhu, A. K. Qin, P. N. Suganthan and G. B. Huang, "Evolutionary Extreme Learning Machine", Pattern Recognition, vol. 38, pp. 1759-1763, 2005.
31. Y. Xu, and Y. Shu, "Evolutionary Extreme Learning Machine - Based on Particle Swarm Optimization", Advances in Neural Networks - ISNN 2006, in: Lecture Notes in Computer Science, vol. 3971, pp. 644-652, 2006. (Pubitemid 44046173)
32. A. Frank and A. Asuncion, UCI Machine Learning Repository, Univ. California, Sch. Inform. Comput. Sci., Irvine, CA, 2011 [Online]. Available: http://archive.ics.uci.edu/ml.