Variational foundations of online backpropagation

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 8131 LNCS, Issue , 2013, Pages 82-89

  Frandina, Salvatore ^a   Gori, Marco ^a   Lippi, Marco ^a   Maggini, Marco ^a   Melacci, Stefano ^a  

^a UNIVERSITY OF SIENA   (Italy)

Author keywords

dissipative systems; local minima; on line Backpropagation; principle of least action; regularization

Indexed keywords

ALL-AT-ONCE; DISSIPATIVE SYSTEMS; LOCAL MINIMUMS; ONLINE LEARNING; OPTIMIZATION PROBLEMS; PRINCIPLE OF LEAST ACTION; REAL-WORLD PROBLEM; REGULARIZATION;

BACKPROPAGATION; DATA HANDLING; NEURAL NETWORKS;

BATCH DATA PROCESSING;

EID: 84884955557     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-40728-4_11     Document Type: Conference Paper

References (9)

1. Bottou, L., Bousquet, O.: The tradeoffs of large-scale learning. Advances in Neural Information Processing Systems 20, 161-168 (2008)
2. Bryson, A., Ho, Y.C.: Applied optimal control: optimization, estimation, and control. Blaisdell Publishing Company (1969)
3. Gnecco, G., Gori, M., Sanguineti, M.: Learning with boundary conditions. Neural computation 25(4), 1029-1106 (2013)
4. Gori, M., Maggini, M.: Optimal convergence of on-line backpropagation. IEEE Transactions on Neural Networks 7(1), 251-254 (1996)
5. Gori, M., Tesi, A.: On the problem of local minima in backpropagation. IEEE Transactions on Pattern Analysis and Machine Intelligence 14(1), 76-86 (1992)
6. Herrera, L., Nunez, L., Patino, A., Rago, H.: A variational principle and the classical and quantum mechanics of the damped harmonic oscillator. American Journal of Physics 53(3), 273 (1985)
7. Hornik, K.: Approximation capabilities of multilayer feedforward networks. Neural Networks 4(2), 251-257 (1991)
8. Rumelhart, D.E., Hintont, G.E., Williams, R.J.: Learning representations by backpropagating errors. Nature 323(6088), 533-536 (1986)
9. Werbos, P.J.: Prediction and analysis in the behavioral sciences. Tech. rep., Harvard University (1974)