Training RBF networks with selective backpropagation

Neurocomputing

Volumn 62, Issue 1-4, 2004, Pages 39-64

  Vakil Baghmisheh, Mohammad Taghi ^a   Pavešić, Nikola ^a  

^a UNIVERSITY OF LJUBLJANA   (Slovenia)

Author keywords

Backpropagation with selective training; Farsi optical character recognition; Neural networks; Overtraining; Radial basis functions

Indexed keywords

ALGORITHMS; BACKPROPAGATION; CONVERGENCE OF NUMERICAL METHODS; FUNCTIONS; LEARNING SYSTEMS; PROBLEM SOLVING;

CONVERGENCE SPEED; RADIAL BASIS FUNCTION (RBF); SELECTIVE BACKPROPAGATION;

NEURAL NETWORKS;

ALGORITHM; ANALYTICAL ERROR; ANALYTICAL PARAMETERS; ARTICLE; ARTIFICIAL NEURAL NETWORK; CLUSTER ANALYSIS; CONTROLLED STUDY; EMPIRICISM; LEARNING; LINEAR SYSTEM; MATHEMATICAL COMPUTING; NORMAL DISTRIBUTION; PREDICTION; PRIORITY JOURNAL; SENSITIVITY ANALYSIS; SIMULATION; TIME; VALIDATION PROCESS;

EID: 8644254218     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neucom.2003.11.011     Document Type: Article

References (21)

1. Aizerman M.A. Braverman E.M. Rozonoer I.E. Theoretical foundations of the potential function method in pattern recognition learning Automat. Remote Control 25 1964 821-837
2. Amari S. Murata N. Muller K.R. Finke M. Yang H.H. Asymptotic statistical theory of overtraining and cross-validatio IEEE Trans. Neural Networks 8 5 1997 985-996
3. T. Andersen, T. Martinez, Cross validation and MLP architecture selection, Proceedings of International Joint Conference on Neural Networks, IJCNN'99, Cat. No. 99CH36339, Vol. 3 (part 3), 1999, pp. 1614-1619
4. Bashkirov O.A. Braverman E.M. Muchnik I.B. Potential function algorithms networks for pattern recognition learning machines Automat. Remote Control 25 1964 629-631
5. Broomhead D.S. Lowe D. Multivariable functional interpolation and adaptive networks Complex Systems 2 1988 321-355
6. Cover T.M. Geometrical and statistical properties of systems of linear inequalities with application in pattern recognition IEEE Trans. Electron. Comput. EC-14 1965 326-334
7. Diamantaras K.I. Kung S.Y. Principal Component Neural Networks: Theory and Applications 1996 Wiley New York
8. S.C. Fahlman, An empirical study of learning speed in backpropagation networks, Technical Report CMU-CS -88-162, Carnegie Mellon University, Pittsburgh, PA 15213, September 1988
9. Haykin S. Neural Networks: A Comprehensive Foundation 1999 Prentice-Hall Englewood Cliffs, NJ, USA
10. G. Jondarr, Backpropagation family album, Technical Report, Department of Computing, Macquarie University, New South Wales, August 1996
11. Looney C.G. Pattern Recognition Using Neural Networks 1997 Oxford University Press New York
12. McCulloch W.S. Pitts W. A logical calculus of the ideas imminent in nervous activity Bull. Math. Biophy. 5 1943 115-133
13. D.B. Parker, Learning logic, Invention Report S81-64, File 1, Office of Technology Licensing, Stanford University, March 1982
14. Prechelt L. Automatic early stopping using cross validation: quantifying the criteria Neural Networks 11 4 1998 761-767
15. Rumelhart D.E. McClelland J.L. Parallel Distributed Processing: Exploration in the Microstructure of Cognition 1986 MIT Press Cambridge, MA
16. Theodoridis S. Koutroumbas K. Pattern Recognition 1999 Academic Press USA
17. M.T. Vakil-Baghmisheh, N. Pavešic, Backpropagation with declining learning rate, Proceeding of the 10th Electrotechnical and Computer Science Conference, Portorož, Slovenia, Vol. B, September 2001, pp. 297-300
18. M.T. Vakil-Baghmisheh, Farsi character recognition using artificial neural networks, Ph.D. Thesis, Faculty of Electrical Engineering, University of Ljubljana, Slovenia, October 2002
19. M.T. Vakil-Baghmisheh, N. Pavešić, A fast simplified fuzzy ARTMAP network, Neural Process. Lett., 2003, in press
20. Wasserman P.D. Advanced Methods in Neural Computing 1993 Van Nostrand Reinhold New York
21. P.J. Werbos, Beyond regression: New tools for prediction and analysis in the behavioral science, Ph.D. Thesis, Harvard University, Cambridge, MA, 1974