A hybrid training algorithm for feedforward neural networks

Neural Processing Letters

Volumn 24, Issue 2, 2006, Pages 107-117

  Nasr, Mounir Ben ^a   Chtourou, Mohamed ^a  

^a UNIVERSITY OF SFAX   (Tunisia)

Author keywords

Feedforward neural network; Gradient descent method; Hybrid training; Self organizing map; Supervised and unsupervised learning

Indexed keywords

BACKPROPAGATION (BP) ALGORITHMS; GRADIENT DESCENT METHOD; HYBRID ALGORITHMS; HYBRID TRAINING;

BACKPROPAGATION; COMPUTER SIMULATION; FEEDFORWARD NEURAL NETWORKS; FUNCTION EVALUATION; GRADIENT METHODS; LEARNING SYSTEMS; PATTERN RECOGNITION; PROBLEM SOLVING; SELF ORGANIZING MAPS;

ALGORITHMS;

EID: 33750016365     PISSN: 13704621     EISSN: 1573773X     Source Type: Journal    
DOI: 10.1007/s11063-006-9013-x     Document Type: Article

References (20)

1. Rumelhart, D. E., Hinton, G. E. and Williams, R. J.: Learning internal representations by error propagation, Parallel Distributed Processing: Explorations in the Micro structures of Cognition, Vol. 1, pp. 318-362, MIT Press, Cambridge, MA (1986)
2. Lera, G. and Pinzolas, M.: Neighborhood Based Levenberg-Marquardt Algorithm for Neural Network Training, IEEE Transactions on Neural Networks 13(5) (2002), 1200-1203.
3. Silva, F. and Almeida, L.: Speeding-Up Backpropagation, In: R. Eckmiller (ed.), Advanced Neural Computers, pp. 151-156, North-Holland, Amsterdam, 1990.
4. Scalero, R. S. and Tepedelenlioglu, N.: A fast algorithm for training feedforward neural networks, IEEE Transactions on Signal Processing 40(1) (1992), 202-210.
5. Fahlman, S. E.: Faster learning variations on back propagation, An Empirical Study, In: Proceedings of the 1988 Connectionist Models Summer School, pp. 38-51, Carnegie Mellon University.
6. Rojas, R.: Neural Networks : A Systematic. Introduction, Springer-Verlag, Berlin 1996.
7. Jacobs, R. A.: Increased rates of convergence through learning rate adaptation. Neural Networks 1 (1988), 295-307.
8. Najim, K., Chtourou, M. and Thibault, J.: Neural network synthesis using learning automata, Journal of Systems Engineering 2(4) (1992), 192-197.
9. Poznyak, A. S., Najim, K. and Chtourou, M.: Use of recursive stochastic algorithm for neural network synthesis, Applied Math Modelling 17 (1993), 444-448.
10. Nickolai, S. R.: The layer-wise method and the backpropagation hybrid approch to learning a feedforward neural network, IEEE Transactions on Neural Networks 11(2) (2000), 295-305.
11. Abid, S., Fnaiech, F. and Najim, M.: A fast feedforward training algorithm using a modified form of the standard backpropagation algorithm, IEEE Transactions on Neural Networks 12(2) (2001), 424-430.
12. Oscar, F. R., Deniz, E. and Jose, C. P.: Accelerating the convergence speed of neural networks learning methods using least squares, In: Proceedings of the ESANN'2003, pp. 255-260, Belgium, 2003.
13. Bilski, I: The UD RLS algorithm for training feedforward neural networks, Internat. Journal of Applied Mathematical Computer Science 15(1) (2005), 115-123.
14. Liu, P. and Li, H.: Efficient learning algorithms for three-layer regular feedforward fuzzy neural networks, IEEE Transactions on Neural Networks 15(3) (2004), 545-558.
15. Bortoletti, A., Di Flore, C., Fanelli, S. and Zellini, P.: A new class of Quasi-Newtonian methods for optimal learning in MLP-networks, IEEE Transactions on Neural Networks 14(2) (2003), 263-273.
16. Hornik, K., Stinchcombe, M. and White, H.: Multilayer feedforward networks are universal approximators, Neural Networks 2 (1989), 359-366.
17. Kohonen, T: The self-organizing map, Proceedings of the IEEE 78(9) (1990), 1464-1480.
18. Azimi-Sadjadi, I. M. R. and Liou, R. I: Fast learning process of multilayer neural nets using recursive least squares method, IEEE Transactions on Signal Processing 40(2) (1992), 443-446.
19. Alexander, G. P., Benito, F., Amir, F. A., Jayakumar, M. and Wei, K.T.: An accelerated learning algorithm for multilayer networks, IEEE Transactions on Neural Networks 5(3) (1994), 493-497.
20. Mackey, M. C. and Class, L.: Oscillation and chaos in physiological control system, Sience 197 (1977), 287-289.