Revisiting squared-error and cross-entropy functions for training neural network classifiers

Neural Computing and Applications

Volumn 14, Issue 4, 2005, Pages 310-318

  Kline, Douglas M ^a   Berardi, Victor L ^b  

^a UNIVERSITY OF NORTH CAROLINA WILMINGTON   (United States)

^b KENT STATE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 27744480560     PISSN: 09410643     EISSN: None     Source Type: Journal    
DOI: 10.1007/s00521-005-0467-y     Document Type: Article

References (21)

1. Arotaritei D, Negoita Gh M (2002) Optimisation of Recurrent NN by GA with Variable Length Genotype. In: McKay B, Slaney J (eds) AI2002: advances in artificial intelligence. Springer, Berlin Heidelberg New York, pp 691-692
2. Baum EB, Wilczek F (1988) Supervised learning of probability distributions by neural networks. In: Anderson D (ed) Neural information processing systems. American Institute of Physics, New York, pp 52-61
3. Berardi VL, Zhang GQ (1999) The effect of misclassification costs on neural network classifiers. Decis Sci 30(3):659-682
4. Bishop CM (1995a) Neural networks for pattern recognition. Clarendon, Oxford
5. Bourlard H, Wellekens CJ (1989) Links between Markov models and multilayer perceptrons. In: Toretzky DS (ed) Advances in neural information processing systems, vol 1. Morgan Kaufmann, San Mateo, pp 502-510
6. Cybenko G (1989) Approximation by superpositions of a sigmoidal function. Math Control Signals Syst 2:303-314
7. Duda RO, Hart P (1973) Pattern classification and scene analysis. Wiley, New York
8. Fagarasan F, Negoita Gh M (1995) A genetic-based method for learning the parameter of a fuzzy inference system. In: Kasabov N, Coghill G (eds) Artificial neural networks and expert systems. IEEE Computer Society, Los Alamitos, pp 223-226
9. Frean M (1990) The upstart algorithm: a method for constructing and training feedforward neural networks. Neural Comput 2(2):198-209
10. Hampshire JB, Waibel A (1990) Connectionist architectures for multi-speaker phoneme recognition. In: Toretzky DS (ed) Advances in neural information processing systems, vol 2. Morgan Kaufmann, San Mateo, pp 203-210
11. Hornik K (1991) Approximation capabilities of multilayer feedforward networks. Neural Netw 4:251-257
12. Hung MS, Hu MY, Patuwo BE, Shanker M (1996) Estimating posterior probabilities in classification problems with neural networks. Int J Comput Intell Organ 1:49-60
13. Mezard M, Nadal JP (1989) Learning in feedforward layered networks: the tiling algorithm. J Phys A 22:21921-2203
14. Papoulis A (1964) Probability, random variables, and stochastic processes, 1st edn. McGraw Hill, New York, p 175
15. Richard MD, Lippmann RP (1991) Neural network classifiers estimate Bayesian a-posteriori probabilities. Neural comput 3:461-483
16. Rumelhart DE, Hinton GE, Williams RJ (1986a) Learning internal representations by error propagation. In: Rumelhart DE, McClelland JL, the PDP group (eds) Parallel distributed processing: exploration in the microstructure of cognition, Foundations. MIT Press, Cambridge, MA, pp 318-362
17. Rumelhart DE, Hinton GE, Williams RJ (1986b) Learning representation by backpropagating errors. Nat (Lond) 323:533-536
18. Shoemaker PA (1991) A note on least-squares learning procedures and classification by neural networks. IEEE Trans Neural Netw 2(1):158-160
19. Wan EA (1990) Neural network classification: a Bayesian interpretation. IEEE Trans Neural Netw 1(4):303-375
20. White H (1989) Learning in artificial neural networks: a statistical perspective. Neural Comput 1:425-464
21. White H (1990) Connectionists nonparametric regression: multilayer feedforward networks can learn arbitrary mappings. Neural Netw 3:535-549