Optimal convergence of on-line backpropagation

IEEE Transactions on Neural Networks

Volumn 7, Issue 1, 1996, Pages 251-254

  Gori, Marco ^a   Maggini, Marco ^a  

^a UNIVERSITY OF FLORENCE   (Italy)

Author keywords

[No Author keywords available]

Indexed keywords

BACKPROPAGATION; LEARNING ALGORITHMS; LEARNING SYSTEMS; OPTIMIZATION; VECTORS;

ONLINE BACKPROPAGATION; OPTIMAL CONVERGENCE; PATTERN MODE BACKPROPAGATION;

FEEDFORWARD NEURAL NETWORKS;

EID: 0029732480     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/72.478415     Document Type: Article

References (16)

1. M. Minsky and S. Papert, Perceptrons - Expanded Edition. Cambridge, MA: MIT Press, 1988.
2. P. Baldi and K. Hornik, "Neural networks and principal component analysis: Learning from examples without local minima," Neural Networks, vol. 2, pp. 53-58, 1989.
3. E. D. Sontag and H. J. Sussman, "Backpropagation separates when perceptrons do," in Proc. Int. Joint Conf. Neural Networks, vol. 1, Washington D.C., June 1989, pp. 639-642.
4. M. Gori and A. Tesi, "On the problem of local minima in backpropagation," IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-14, pp. 76-86, Jan. 1992.
5. X. H. Yu, "Can backpropagation error surface not have local minima?" IEEE Trans. Neural Networks, vol. 3, pp. 1019-1020, Nov. 1992.
6. M. Bianchini, P. Frasconi, and M. Gori, "Learning without local minima in radial basis function networks," IEEE Trans. Neural Networks, vol. 6, no. 3, pp. 749-756, May 1995.
7. M. Bianchini, M. Gori, and M. Maggini, "On the problem of local minima in recurrent neural networks," IEEE Trans. Neural Networks, vol. 5, pp. 167-177, Mar. 1994.
8. D. Rumelhart, J. McClelland, and the PDP Research Group, Parallel Distributed Processing: Explorations in the Microstructure of Cognition, vol. 1. Cambridge, MA: MIT Press, 1986.
9. F. Rosenblatt, "On the optimal convergence of reinforcement procedures in simple perceptrons," Cornell Aeronautical Lab., Buffalo, NY, Tech. Rep. VG-1196-G-4, Feb. 1960.
10. S. Gallant, "Optimal linear discriminants," in Proc. 8th Int. Conf. Pattern Recognition, Paris, France, Oct. 28-31, pp. 849-852, 1986.
11. S. D. Wang and C. H. Hsu, "Terminal attractor learning algorithms for backpropagation neural networks," in Proc. Int. Joint Conf. Neural Networks, Singapore, pp. 183-189, Nov. 1991.
12. A. G. Parlos, B. Fernandes, A. F. Atiya, J. Muthusami, and W. K. Tsai, "An accelerated learning algorithm for multilayer perceptron networks," IEEE Trans. Neural Networks, vol. 5, pp. 493-497, May 1994.
13. Y. le Cun, B. Boser, J. Denker, D. Henderson, R. Howard, W. Hubbard, and L. Jackel, "Handwritten digit recognition with a backpropagation network," in Advances in Neural Information Processing Systems, D. Touretzky, Ed., vol. 2. San Mateo, CA: Morgan Kaufmann, 1990, pp. 396-404.
14. N. J. Nilsson, Learning Machines. New York: McGraw-Hill, 1965.
15. F. Jordan and G. Clement, "Using the symmetries of multilayered networks to reduce the weight space," in Proc. Int. Joint Conf. Neural Networks, vol. 2, Seattle, WA, July 8-12, 1991, pp. 391-396.
16. A. M. Chen, H. Lu, and R. Hecht-Nielsen, "On the geometry of feedforward neural network error surfaces," Neural Computa., vol. 5, no. 6, pp. 910-927, 1993.