Fast Learning Process of Multilayer Neural Networks Using Recursive Least Squares Method

IEEE Transactions on Signal Processing

Volumn 40, Issue 2, 1992, Pages 446-450

  Azimi Sadjadi, Mahmood R ^a   Liou, Ren Jean ^a  

^a Department of Environmental and Radiological Health Sciences   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

LEARNING SYSTEMS; MATHEMATICAL TECHNIQUES - ALGORITHMS;

BACKPROPAGATION ALGORITHMS; LEARNING ALGORITHMS; MULTILAYER NEURAL NETWORKS; PERCEPTRON;

NEURAL NETWORKS;

EID: 0026820187     PISSN: 1053587X     EISSN: 19410476     Source Type: Journal    
DOI: 10.1109/78.124956     Document Type: Article

References (12)

1. D. E. Rumelhart and J. L. McClelland, “Parallel distributed Processing: Explorations in the microstructure of cognition,” vol. 1. Cambridge, MA: M.I.T. Press.
2. D. C. Plaut, S. J. Nowlan, and G. E. Hinton. “Experiments on learning by backpropagation,” Int. Rep., Comput. Sci. Dep., Camegie-Mellon Univ., June 1986.
3. R. Lippmann, “An introduction to computing with neural nets,” IEEE ASSP Mag., vol. 4, pp. 4–22, Apr. 1987.
4. R. Hecht-Nielsen, “Theory of backpropagation neural networks,” in Proc. IEEE Int. Conf. Neural Networks (Washington DC), Jan. 1989, 1-593-605.
5. M. R. Azimi-Sadjadi and S. Citrin, “Fast learning process of multilayer neural nets using recursive least squares technique,” in Proc. IEEE Int. Conf. Neural Networks (Washington DC), May 1989.
6. M. R. Azimi-Sadjadi, S. Citrin, and S. Sheedvash, “Supervised learning process of multilayer perceptron neural networks using fast recursive least squares,” in Proc. IEEE Int. Conf. Acoust., Speech, Signal Processing (ICASSP‘90) (New Mexico), Apr. 1990, pp. 1381 — 1384.
7. S. Singhal and L. Wu, “Training multilayer perceptrons with the extended Kalman algorithm,” in Advances in Neural Information Processing Systems I. Morgan Kaufman, 1989.
8. D. R. Hush and J. M. Salas, “Improving the learning rate of backpropagation with the gradient reuse algorithm,” in Proc. IEEE Int. Conf. Neural Networks, 1988, pp. 1441–1447.
9. F. Palmieri and S. Shah, “Fast training of multilayer perceptron using multilinear parametrization,” in Proc. IEEE Int. Joint Conf Neural Networks (Washington DC), Jan. 15–19, 1990.
10. R. A. Jacobs, “Increased rates of convergence through learning rate adaptation,” Neural Networks, vol. 1, pp. 295–307, 1988.
11. S. Haykin, Adaptive Filter Theory. Englewood Cliffs, NJ: Prentice-Hall, 1986.
12. G. C. Goodwin and K. S. Sin, Adaptive Filtering, Prediction, and Control. Englewood Cliffs, NJ: Prentice-Hall, 1984.