The parallel approach to the conjugate gradient learning algorithm for the feedforward neural networks

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 8467 LNAI, Issue PART 1, 2014, Pages 12-21

  Bilski, Jarosław ^a   Smola̧g, Jacek ^a   Galushkin, Alexander I ^b  

^a CZESTOCHOWA UNIVERSITY OF TECHNOLOGY   (Poland)

^b MOSCOW INSTITUTE OF PHYSICS AND TECHNOLOGY   (Russian Federation)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; CONJUGATE GRADIENT METHOD; LEARNING ALGORITHMS; PARALLEL ARCHITECTURES; SOFT COMPUTING;

GRADIENT LEARNING ALGORITHM; LEARNING PERFORMANCE; PARALLEL NEURAL NETWORKS; PARALLEL STRUCTURES; SPEED UP;

FEEDFORWARD NEURAL NETWORKS;

EID: 84902602840     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-319-07173-2_2     Document Type: Conference Paper

References (30)

1. Bilski, J.: The UD RLS algorithm for training the feedforward neural networks. International Journal of Applied Mathematics and Computer Science 15(1), 101-109 (2005)
2. Bilski, J., Litwiński, S., Smola̧g, J.: Parallel realisation of QR algorithm for neural networks learning. In: Rutkowski, L., Siekmann, J.H., Tadeusiewicz, R., Zadeh, L.A. (eds.) ICAISC 2004. LNCS (LNAI), vol. 3070, pp. 158-165. Springer, Heidelberg (2004) (Pubitemid 38835815)
3. Bilski, J., Smola̧g, J.: Parallel realisation of the RTRN neural network learning. In: Rutkowski, L., Tadeusiewicz, R., Zadeh, L.A., Zurada, J.M. (eds.) ICAISC 2008. LNCS (LNAI), vol. 5097, pp. 11-16. Springer, Heidelberg (2008)
4. Bilski, J., Smola̧g, J.: Parallel realisation of the recurrent Elman neural network learning. In: Rutkowski, L., Scherer, R., Tadeusiewicz, R., Zadeh, L.A., Zurada, J.M. (eds.) ICAISC 2010, Part II. LNCS (LNAI), vol. 6114, pp. 19-25. Springer, Heidelberg (2010)
5. Bilski, J., Smola̧g, J.: Parallel realisation of the recurrent multi layer perceptron learning. In: Rutkowski, L., Korytkowski, M., Scherer, R., Tadeusiewicz, R., Zadeh, L.A., Zurada, J.M. (eds.) ICAISC 2012, Part I. LNCS (LNAI), vol. 7267, pp. 12-20. Springer, Heidelberg (2012)
6. Bilski, J., Smola̧g, J.: Parallel approach to learning of the recurrent Jordan neural network. In: Rutkowski, L., Korytkowski, M., Scherer, R., Tadeusiewicz, R., Zadeh, L.A., Zurada, J.M. (eds.) ICAISC 2013, Part I. LNCS (LNAI), vol. 7894, pp. 32-40. Springer, Heidelberg (2013)
7. Charalambous, C.: Conjugate gradient algorithm for efficient training of artificial neural networks. IEE Proc.-G 139(3), 301-310 (1992)
8. Fahlman, S.: Faster learning variations on backpropagation: An empirical study. In: Proceedings of Connectionist Models Summer School, Los Atos (1988)
9. Fletcher, R., Powell, M.J.D.: A rapidly convergent descent method for minimization. Computer Journal 6, 163-168 (1963)
10. Fletcher, R., Reeves, C.M.: Function minimization by conjugate gradients. Computer Journal 7, 149-154 (1964)
11. Korytkowski, M., Rutkowski, L., Scherer, R.: On combining backpropagation with boosting. In: IEEE International Joint Conference on Neural Network (IJCNN) Proceedings, Vancouver, July 16-21, vols. 1-10, pp. 1274-1277 (2006)
12. Hagan, M.T., Menhaj, M.B.: Training feedforward networks with the Marquardt algorithm. IEEE Transactions on Neural Networks 5(6) (1994)
13. Li, X., Er, M.J., Lim, B.S., et al.: Fuzzy regression modelling for tool performance prediction and degradation detection. International Journal of Neural Systems 20(5), 405-419 (2010)
14. Nocedal, J., Wright, S.J.: Conjugate Gradient Methods in Numerical Optimization, pp. 497-528. Springer, New York (2006)
15. Polak, E.: Computational methods in optimization: a unified approach. Academic Press, New York (1971)
16. Riedmiller, M., Braun, H.: A direct method for faster backpropagation learning: The RPROP Algorithm. In: IEEE International Conference on Neural Networks, San Francisco (1993)
17. Rumelhart, D.E., Hinton, G.E., Williams, R.J.: Learning internal representations by error propagation. In: Rumelhart, D.E., McCelland, J. (ed.) Parallel Distributed Processing, vol. 1, ch. 8. The MIT Press, Cambridge (1986)
18. Rutkowski, L.: Multiple Fourier series procedures for extraction of nonlinear regressions from noisy data. IEEE Transactions on Signal Processing 41(10), 3062-3065 (1993)
19. Rutkowski, L.: Non-parametric learning algorithms in the time-varying environments. Signal Processing 18(2), 129-137 (1989)
20. Rutkowski, L.: Generalized regression neural networks in time-varying environment. IEEE Trans. Neural Networks 15, 576-596 (2004)
21. Rutkowski, L., Cpałka, K.: Compromise approach to neuro-fuzzy systems. In: Sincak, P., Vascak, J., Kvasnicka, V., Pospichal, J. (eds.) Intelligent Technologies - Theory and Applications, vol. 76, pp. 85-90. IOS Press (2002)
22. Rutkowski, L., Cpałka, K.: Neuro-fuzzy systems derived from quasi-triangular norms. In: Proceedings of the IEEE International Conference on Fuzzy Systems, Budapest, July 26-29, vol. 2, pp. 1031-1036 (2004)
23. Rutkowski, L., Przybył, A., Cpałka, K.: Novel Online Speed Profile Generation for industrial machine tool based on flexible neuro-fuzzy approximation. IEEE Transactions on Industrial Electronics 59(2), 1238-1247 (2012)
24. Smola̧g, J., Bilski, J.: A systolic array for fast learning of neural networks. In: Proc. of V Conf. Neural Networks and Soft Computing, Zakopane, pp. 754-758 (2000)
25. Smola̧g, J., Rutkowski, L., Bilski, J.: Systolic array for neural networks. In: Proc. of IV Conf. Neural Networks and Their Applications, Zakopane, pp. 487-497 (1999)
26. Starczewski, J.T.: A type-1 approximation of interval type-2 FLS. In: Di Gesù, V., Pal, S.K., Petrosino, A. (eds.) WILF 2009. LNCS, vol. 5571, pp. 287-294. Springer, Heidelberg (2009)
27. Tadeusiewicz, R.: Neural Networks, AOW RM (1993) (in Polish)
28. Werbos, J.: Backpropagation through time: What it does and how to do it. Proceedings of the IEEE 78(10) (1990)
29. Wilamowski, B.M., Yo, H.: Neural network learning without backpropagation. IEEE Transactions on Neural Networks 21(11), 1793-1803 (2010)
30. Żurada, J.: Introduction to Artificial Neural Systems. West Publishing Company (1992)