Convergence of back-propagation in neural networks using a log-likelihood cost function

Electronics Letters

Volumn 26, Issue 23, 1990, Pages 1964-1965

  Holt, M J J ^a   Semnani, S ^a  

^a LOUGHBOROUGH UNIVERSITY   (United Kingdom)

Author keywords

Back propagation; Convergence; Neural networks

Indexed keywords

COMPUTER PROGRAMMING--ALGORITHMS; PATTERN RECOGNITION;

BACK PROPAGATION ALGORITHM; COST FUNCTIONS; LOG-LIKELIHOOD COST FUNCTION;

NEURAL NETWORKS;

EID: 0025703365     PISSN: 00135194     EISSN: None     Source Type: Journal    
DOI: 10.1049/el:19901270     Document Type: Article

References (8)

1. Lippman, R. P.: ‘An introduction to computing with Neural Nets’, IEEE ASSP Mag., 1987, 4-22
2. Rumelhart, D. E., Hinton, G. E., and Williams, R. J.: ‘Learning representations by back-propagating errors’, Nature, 1986, 323, 533-536
3. Baum, E. B., and Wilczek, F.: ‘Supervised learning of probability distributions by neural networks’. Proc. IEEE Conf. Neural Information Processing Systems, Denver, 1987
4. Hinton, G. E.: ‘Connectionist learning procedures’. Technical Report CMU-CS-87-115, Carnegie Mellon University, 1987
5. Solla, S. A., Levin, E., and Fleisher, M.:‘Accelerated learning in neural networks’, Complex Systems, 1988, 2, 625-640
6. Jacobs, R. A.: ‘Increased rates of convergence through learning rate adaption’, Neural Networks, 1988, 1-4, 295-308
7. Parker, D.: ‘Optimal algorithms for adaptive networks: secondorder back-propagation, second-order direct propagation and second-order Hebbian learning’. Proc. 1st IEEE Int. Conf. Neural Networks, San Diego, 1987, 593-600
8. Hoptroff, R. G., and Hall, T. J.: ‘Learning by diffusion for multilayer perceptrons’, Electron. Lett., 1989, 25, 531-533