A modified conjugate gradient formula for back propagation neural network algorithm

Journal of Computer Science

Volumn 5, Issue 11, 2009, Pages 849-856

  Al Bayati, Abbas Y ^a   Sulaiman, Najmaddin A ^b   Sadiq, Gulnar W ^c  

^a UNIVERSITY OF MOSUL   (Iraq)

^b SALAHADDIN UNIVERSITY   (Iraq)

^c UNIVERSITY OF SULAIMANI   (Iraq)

Author keywords

Back propagation algorithm; Conjugate gradient algorithm; Neural network algorithm; Search directions

Indexed keywords

EID: 77952261780     PISSN: 15493636     EISSN: None     Source Type: Journal    
DOI: 10.3844/jcssp.2009.849.856     Document Type: Article

References (16)

1. Rumelhart, D.E., G.E. Hinton and R.J. Williams, 1986. Learning Internal Representations by Error Propagation. In: Parallel Distributed Processing, Rumelhart, D.E. and J.L. McClelland (Eds.). MIT Press, ISBN: 0-262-68053-X, pp: 318-362.
2. Gori, M. and A. Tesi, 1992. On the problem of local minima in back-propagation. IEEE Trans. Patt. Anal. Mach. Intel., 14: 76-86. http://doi.ieeecomputersociety.org/10.1109/34.107014
3. Bishop, C.M., 1995. Neural Network for Pattern Recognition. Oxford University Press, ISBN: 10: 0198538642, pp: 504.
4. Fletcher, R. and M.J.D. Powell, 1963. A rapidly convergent descent method for minimization. Comput. J., 6: 163-168. http://comjnl.oxfordjournals.org/cgi/content/abstract/6/2/163
5. Fletcher, R. and C.M. Reeves, 1964. Function minimization by conjugate gradients. Comput. J., 7: 149-160. DOI: 10.1093/comjnl/7.2.149
6. Hestenes, M.R. and E. Stiefel, 1952. Methods of conjugate gradients for solving linear systems. J. Res. Natl. Bureau Stand., 49: 409-435. http://nvl.nist.gov/pub/nistpubs/jres/049/6/V49.N06.A08.pdf
7. Huang, H.Y., 1970. A unified approach to quadratically convergent algorithms for function minimization. J. Optim. Theor. Appli., 5: 405-423. DOI: 10.1007/BF00927440
8. Thimm, G., P. Moerland and E. Fiesler, 1996. The Interchangeability of learning rate and gain in back propagation neural networks. Neural Comput., 8: 451-460. DOI: 10.1162/neco.1996.8.2.451
9. Maier, H.R. and G.C. Dandy, 1998. The effect of internal parameters and geometry on the performance of back-propagation neural networks. Environ. Model. Software, 13: 193-209. DOI: 10.1016/S1364-8152(98)00020-6
10. Eom, K., K. Jung and H. Sirisena, 2003. Performance Improvement of Back propagation algorithm by automatic activation function gain tuning using fuzzy logic. Neurocomputing, 50: 439-460. DOI: 10.1016/S0925-2312(02)00576-3
11. Prechelt, L., 1994. A set of neural network bencmark problems and benchmarking rules. Technical Report 2194. http://page.mi.fuberlin.de/prechelt/Biblio/1994-21.pdf
12. Nawi, N.M., M.R. Ransing and R.S. Ransing, 2006. An improved learning algorithm based on conjugate gradient methods for back propagation neural network. Proc. Word Acad. Sci. Eng. Technol., 4: 46-54. http://www.waset.org/ijci/v4/v4-1-6.pdf
13. Fisher, R.A., 1936. The use of multiple measurements in taxonomic problems. Ann. Eugen., 7: 179-188. http://www.mendeley.com/c/85931226/Fisher-1936-The-use-of-multiple-measurements-intaxonomic-problems/
14. Al Bayati, A., 1993. A new non-quadratic model for unconstrained nonlinear optimization. Mutah. J. Res. Stud., 8: 131-155.
15. Tassopoulus, A. and C. Story, 1984. A variablemetric method using a nonquadratic model. J. Optim. Theor. Appli., 43: 383-393. DOI: 10.1007/BF00934462
16. Boland, W.R., E.R. Kamgnia and J.S. Kowallik, 1979. A conjugate gradient optimization method invariant to non-linear scaling. J. Optim. Theor. Appli., 27: 221-230. http://www.springerlink.com/index/T514NN45788701V4.pdf