Extended least squares based algorithm for training feedforward networks

IEEE Transactions on Neural Networks

Volumn 8, Issue 3, 1997, Pages 806-810

  Yam, Jim Y F ^a   Chow, Tommy W S ^a  

^a CITY UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; BACKPROPAGATION; CONVERGENCE OF NUMERICAL METHODS; ITERATIVE METHODS; LEARNING SYSTEMS; LEAST SQUARES APPROXIMATIONS;

LEVENBERG-MARQUARDT ALGORITHM;

FEEDFORWARD NEURAL NETWORKS;

EID: 0031139318     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/72.572119     Document Type: Article

References (14)

1. D. E. Rumelhart, G. E. Hinton, and R. J. Williams, "Learning internal representations by error backpropagation," in Parallel Distributed Processings, D. E. Rumelhart and J. L. McClelland, Eds. Cambridge, MA: MIT Press, 1986.
2. R. A. Jacobs, "Increased rates of convergence through learning rate adaptation," Neural Networks, vol. 1, pp. 295-307, 1988.
3. T. Tollenaere, "Super SAB: Fast adaptive back propagation with good scaling properties," Neural Networks, vol. 3, pp. 561-573, 1990.
4. Y. F. Yam and T. W. S. Chow, "Extended backpropagation algorithm," Electron. Lett., vol. 29, no. 19, pp. 1701-1702, 1993.
5. C. T. Leung, T. W. S. Chow, and Y. F. Yam, "A novel least third-order cumulants objective function," Neural Processing Lett., vol. 3, no. 2, pp. 91-96, June 1996.
6. E. Barnard, "Optimization for training neural nets," IEEE Trans. Neural Networks, vol. 3, pp. 232-240, 1992.
7. M. T. Hagan and M. B. Menhaj, "Training feedforward networks with the Marquardt algorithm," IEEE Trans. Neural Networks, vol. 5, pp. 989-993, Nov. 1994.
8. D. A. Karras and S. J. Perantonis, "An efficient constrained training algorithm for feedforward networks," IEEE Trans. Neural Networks, vol. 6, pp. 1420-1434, Nov. 1995.
9. S. Ergezinger and E. Thomsen, "An accelerated learning algorithm for multilayer perceptrons: Optimization layer by layer," IEEE Trans. Neural Networks, vol. 6, pp. 31-42, Jan. 1995.
10. F. Biegler-König and F. Bärmann, "A learning algorithm for multilayered neural networks based on linear least squares problems," Neural Networks, vol. 6, pp. 127-131, 1993.
11. Y. F. Yam and T. W. S. Chow, "Accelerated training algorithm for feedforward neural networks based on least squares method," Neural Processing Lett., vol. 2, no. 4, pp. 20-25, July 1995.
12. G. H. Golub and C. F. Van Loan, Matrix Computations, 2nd ed. Baltimore, MD: Johns Hopkins Univ. Press, 1989.
13. M. C. Mackey and L. Glass, "Oscillations and chaos in physiological control systems," Science, vol. 197, pp. 287-289, 1977.
14. T. Fröhlinghaus, A. Weichert, and P. Ruján, "Hierarchical neural networks for time-series analysis and control," Network 5, pp. 101-116, 1994.