New developments on backpropagation network training

IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences

Volumn E83-A, Issue 6, 2000, Pages 1032-1038

  Sureerattanan, Songyot ^a   Phien, Huynh Ngoc ^a  

^a ASIAN INSTITUTE OF TECHNOLOGY   (Thailand)

Author keywords

Backpropagation; Conjugate gradient; Kaiman filter

Indexed keywords

ARTIFICIAL INTELLIGENCE; BACKPROPAGATION; COMPUTER SIMULATION; CONVERGENCE OF NUMERICAL METHODS; KALMAN FILTERING; LEARNING ALGORITHMS; LEARNING SYSTEMS;

BACKPROPAGATION NETWORK TRAINING; CONJUGATE GRADIENT METHODS;

MULTILAYER NEURAL NETWORKS;

EID: 0034205065     PISSN: 09168508     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (15)

1. D.E. Rumelhart, G.E. Hinton, and R.J. Williams, "Learning internal representations by error propagation," in Parallel Distributed Processing: Exploration in the Microstructure of Cognition: vol.1: Foundations, eds. D.E. Rumelhert and J.L. McClelland, pp.318-362, The MIT Press, Cambridge, Massachusetts, 1986.
2. R. Tawcl, "Does the neuron 'learn' like the synapse?" in Advances in Neural Information Processing System l, cd. D. Touretzky, pp.169-176, Morgan-Kaufmann, 1989.
3. R.S. Scalero and N. Tcpedelcnlioglu, "A fast new algorithm for training feedforward neural networks," IEEE Trans. Signal Processing, vol.40, no.l, pp.202-210, 1992.
4. C.S. Leung and S. Park, "A fast algorithm for training neural networks," Proc. IASTED Int. Conf. Modelling and Simulation, Pittsburgh, PA, U.S.A., pp.616-619, 1993.
5. S. Sureerattanan and H.N. Phien, "Speeding up the convergence of backpropagation networks," Proc. 1998 IEEE Asia-Pacific Conf. on Circuits and Systems: Microelectronics and Integrating Systems, pp.651-654, Chiangmai, Thailand, 1998.
6. T.F. Edgar and D.H. Himmelblau, Optimization of Chemical Processes, McGraw-Hill, New York, USA, 1988.
7. R. Fletcher and C.M. Reeves, "Function minimization by conjugate gradients," Computer Journal, vol.7, pp.149-154, 1964.
8. E. Polak and G. Ribiere, "Note sur la convergence de methods de directions conjugres," Revue Française Informat. Recherche Opérationnelle, vol.16, pp.35-43, 1969.
9. M.R. Hestencs and E. Stiefel, "Methods of conjugate gradients for solving linear systems," J. Res. Nat. Bur. Standards Sec. B, vol.48, pp.409-43G, 1952.
10. S. Sureerattanan and H.N. Phien, "Back-propagation networks for daily streamflow forecasting," Water Resources Journal, no. 195, pp.1-7, 1997.
11. J.E. Nash and J.V. Sutcliffee, "River flow forecasting through conceptual models," Journal of Hydrology, vol.10, pp.282-290, 1970.
12. J.E. Dennis and R.B. Schnabel, Numerical Methods for Unconstrained Optimization and Nonlinear Equations, Prentice-Hall, New Jersey, USA, 1983.
13. K. Hornik, M. Stinchcombe, and H. White, "Multilayer feedforward networks are universal approximators," Neural Networks, vol.2, pp.359-366, 1989.
14. D.W. Patterson, Artificial Neural Networks: Theory and Applications, Prentice Hall, Singapore, 1996.
15. D. Gao and S. Wu, "An optimization method for the topological structures of feed-forward multi-layer neural networks," Pattern Recognition, vol.31, no.9, pp.1337-1342, 1998.