Designing beta basis function neural network for optimization using particle swarm optimization

Proceedings of the International Joint Conference on Neural Networks

Volumn , Issue , 2008, Pages 2564-2571

  Dhahri, H ^a   Alimi, Adel M ^b   Karray, F ^c  

^a Meknassy Secondary School   (Tunisia)

^b UNIVERSITY OF SFAX   (Tunisia)

^c UNIVERSITY OF WATERLOO   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

EVOLUTIONARY ALGORITHMS; NEURAL NETWORKS; OPTIMIZATION; PARTICLE SWARM OPTIMIZATION (PSO); PROBLEM SOLVING; VEGETATION;

BASIS FUNCTIONS; DATA SETS; EVOLUTIONARY METHODS; GLOBAL OPTIMIZATION METHODS; GRADIENT INFORMATIONS; HIGHLY EFFICIENT; LOCAL OPTIMUMS; NETWORK STRUCTURES; OPTIMIZATION METHODOLOGIES; OPTIMIZATION PROBLEMS; PARTICLE SWARM OPTIMIZATION ALGORITHMS; PARTICLE SWARMS;

GLOBAL OPTIMIZATION;

EID: 56349165732     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IJCNN.2008.4634157     Document Type: Conference Paper

References (44)

1. M.A Alimi., R. Hassine, and M. Selmi," Beta Fuzzy Logic Systems: Approximation Properties in the SISO Case", International Journal of Applied Mathematics & Computer Science, Special Issue on Neuro-Fuzzy and Soft Computing edited by D. Rutkowska and L.A. Zadeh, vol. 10, no. 4, pp. 857-875. 2000.
2. M.A. Alimi, On-Line Analysis of Handwritten Arabic. "A New Approach to Recognize Segmented Characters From Cursive Script" Les Annales Maghrébines de l'Ingénieur, vol. 14, no. 1, pp. 7-27. 2000.
3. H. Dhahri, and M.A. Alimi, "the Modified Differential Evolution and the RBF (MDE-RBF) Neural Network for Time Series Prediction", Proc. International. Joint Conference on Neural Networks: IJCNN'06, Vancouver, July, pp 5245-5250, 2006;
4. H. Dhahri, and M.A. Alimi, "Hierarchical Learning Algorithm for the Beta Basis Function Neural Network", Proc. Third International Conference on Systems, Signals & Devices: SSD'5, Tunisia.
5. M.T. Hamdani, and M.A. Alimi, "How are beta_SVM good kernels ", Proc. World Computer Congress: WCC'2004, Toulouse, France, pp. 283-292, 2004.
6. C. Aouiti, M.A. Alimi., and A. Maalej, "A Genetic Designed Beta Basis Function Neural Network for Approximating Multi-Variables Functions", in V. Kurkova et al. (eds.) Artificial Neural Nets and Genetic Algorithmes, Springer-Verlag, Wien, pp. 383-386 2001.
7. H. Bezine, M.A. Alimi, and N. Derbel, "Handwriting Trajectory Movements Controlled by a Beta-Elliptic Model", Proc. 7th International Conference on Document Analysis and Recognition: ICDAR'2003, Edinburgh, UK, August, pp. 1228-1232. 2003.
8. C. Aouiti, M.A Alimi., F. Karray, and A. Maalej "A Hierarchical Genetic Algorithm For The Design Of Beta Basis Function Neural Network", Proc. International Joint Conference on Neural Networks: IJCNN'2002, Honolulu, Hawaii, May. 2002.
9. H. Dhahri, and M.A. Alimi, "Automatic Basis Selection for the Beta Basis Function Networks", Proc. International Workshop on Nature Inspired Cooperative Strategies for Optimization: NICSO'07, Acireale, November.
10. S. Chen, S.A. Billings, W. Luo, "Orthogonal least squares methods and their application to non-linear system identification", Int. J.Control 50 (5) (1989) 1873-1896.
11. S. Chen, C.F.N. Cowan, P.M. Grant, "Orthogonal least squares learning algorithm for radial basis function networks", IEEE Trans. Neural Networks 2 (2) pp 302-309. 1991.
12. Y. Hwang, S. Bang, "An efficient method to construct a radial basis function neural network classifier", Neural Networks 10 (8) 1495-1503. 1997.
13. M.A. Alimi "The Beta System: Toward a Change in Our Use of Neuro-Fuzzy Systems", International Journal of Management, Invited Paper, June, pp. 15-19., 2000.
14. D.E. Rumelhart, G.E. Hinton, R.J. Williams," Learning representations by back propagating errors",Nature 323 pp. 533-536. 1986
15. G.,Hong, and W. Hongwei Wang, "Fuzzy prediction of chaotic time series based on singular value decomposition", Applied Math. and Comp..,Vol. 185 (2), pp. 1171-1185, 2007.
16. M. Njah, Alimi M.A., Chtourou M. and Tourki R. (2002), "Algorithm of Maximal Descent AMD for training Radial Basis Function Neural Networks», Proc. IEEE International Conference on Systems, Man and Cybernetics: SMC2002, Hammamet, Tunisia, October.
17. S. Chen, C.F.N. Cowan, P.M. Grant, "Orthogonal least squares learning algorithm for radial basis function networks", IEEE Trans. Neural Networks 2 (2) pp. 302-309. 1991
18. M.J.L. Orr, Introduction to radial basis function networks, Technical Report, Centre for Cognitive Science, University of Edinburgh, April 1996.
19. F. Girosi, "Some extensions of radial basis functions and their applications in artificial intelligence", Compute. Math. Appl. 24 (12) pp.61-80. 1992
20. M. W. Mak, K.W. Cho, "Genetic evolution, of radial basis function centers for pattern classification", in: Proceedings of the 1998 IEEE International Joint Conference on Neural Networks, vol. 1, 1998, pp.669-673.
21. B.A. Whitehead, T.D. Choate," Evolving space-filling curves to distribute radial basis functions over an input space", IEEE Trans. Neural Networks 5 (1) pp. 15-23. 1993
22. B.A. Whitehead, T.D. Choate," Cooperative-competitive genetic evolution of radial basis function centers and widths for time series prediction", IEEE Trans. Neural Networks 7 (4)pp. 869-880. 1995.
23. D. Wettschereck, T. Dietterich, "Improving the performance of radial basis function networks by learning center locations", in: J.E. Moody, S.J. Hanson, R.P. Lippmann (Eds.), "Advances in Neural Information Processing Systems", vol. 4, Morgan Kaufmann, Loas Altos, CA, pp. 1133-1140. 1992.
24. J. Moody, C. Darken, "Fast learning in networks of locally-tuned processing units", Neural Comput. 1 (2) pp.281-294. 1989.
25. V. Kadirkamanathan, M. Niranjan, "A function estimation approach to sequential learning with neural networks," Technical Report, CUED/F-INFENG/TR.111, Cambridge University Engineering Department, Cambridge, England, September 1992.
26. Y. Hwang, S. Bang, "An efficient method to construct a radial basis function neural network classifier, Neural Networks 10 (8) pp. 1495-1503. 1997
27. N. Benoudjit, C. Arcnambeau, A. Lendasse, M.V.J.A. Lee, "Width optimization of the Gaussian kernels in radial basis function networks", in: Proceedings of the European Symposium on Artificial Neural Networks, Bruges, Belgium, pp. 425-432. 2002.
28. B. Carse, A.G. Pipe, T.C. Fogarty, T. Hill, "Evolving radial basis function neural networks using a genetic algorithm", in: Proceedings of the IEEE International Conference on Evolutionary Computation, vol. 1, IEEE, Silver spring, MD, pp. 300-305, 1995.
29. S. Chen, C.F.N. Cowan, P.M. Grant, "Orthogonal least squares algorithm for training multi-output radial basis function networks", in: IEEE Proceedings, vol. Part F 139, pp. 378-384, 1992.
30. M. Orr, "Regularization in the selection of radial basis function centers", Neural Comput. 7 (3,)pp. 606-623, 1995.
31. S. Chen, C.F.N. Cowan, P.M. Grant, "Orthogonal least squares learning algorithm for radial basis function networks", IEEE Trans. Neural Networks 2 (2),pp 302-309, 1991
32. M.J.L. Orr, "Optimizing the widths of radial basis functions", in: Vth Brazilian Symposium on Neural Networks, IEEE, Belo Horizonte, Brazil, pp. 26-29, 1998.
33. R. Storn, K.Price, "Differential evolution-a simple and efficient adaptive scheme for global optimization over continuous spaces", Technical Report TR-95-012, ICSI, 1999.
34. J.H. Holland, "Adaptation in Natural and Artificial Systems". University of Michigan Press, Ann Harbor, 1975.
35. J. Kennedy, R.C Eberhart, "Particle swarm optimization". In: Proceedings of the 1995 IEEE International Conference on Neural Networks. IEEE Press, Piscataway, NJ, vol. 4, pp. 1942-1948, 1995.
36. T. Krink, B. Filipic, G. Fogel, R. Thomsen, "Noisy optimization problems-a particular challenge for differential evolution" In: Proceedings of the Sixth Congress on Evolutionary Computation (CEC-2004). IEE. Press, Piscataway, NJ, USA, pp. 332-339.
37. M. Lzvbjerg, T. Krink, 2002. "Extending particle swarms with self-organized criticality". In: Proceedings of the Fourth Congress on Evolutionary Computation (CEC-2002). IEE Press, Piscataway, NJ, USA, vol. 2, pp. 1588-1593.
38. M.C. Mackey, L. Glass, "Oscillation and chaos in physiological control systems", Science 197 (1977) 287-289.
39. B.A. Whitehead, T.D. Choate, "Cooperative-competitive genetic evolution of radial basis function centers and widths for time series prediction", IEEE Trans. Neural Networks 7 (4),pp.869-880, 1995.
40. G.P. Liu, V. Kadirkamanathan, "Multi objective criteria for neural network structure selection and identification of nonlinear systems using genetic algorithms", in: IEE Proceedings Part P: Control Theory and Applications, vol. 146(5), pp. 373-382, 1999;
41. E.G.M. de Lacerda, A.C.P.L.F. de Carvalho, T.B. Ludermir, "Evolutionary optimization of RBF networks", in: VIth Brazilian Symposium on Neural Networks, Sociedade Brasileira de Computaca "o (SBC), vol. I, IEEE, Silverspring, MD, pp. 219-224, 2000.
42. G. Huang, P. Saratchandran and N. Sundararajan, "A Generalized Growing and Pruning RBF Neural Network for Function Approximation", IEEE Trans.Neural Netw. 16, 1 2005.
43. G. Yen and H. Lu, "Hierarchical Genetic Algorithm for near optimal Feedforward Neural Network Design", Int. Jour, of Neu.Syst, Vol. 12, 31-43, 2000.
44. R. Hassine, F. Karray, A.M Alimi,.et el.," Approximation properties of fuzzy systems for smooth functions and their first-order derivative", IEEE Transactions on Systems, Man, and Cybernetics Part A: Systems and Humans., vol. 33 (2), pp. 160-168, 2003.