Loss functions to combine learning and decision in multiclass problems

Neurocomputing

Volumn 69, Issue 1-3, 2005, Pages 3-17

  Guerrero Curieses, Alicia ^a   Alaiz Rodríguez, Rocío ^b   Cid Sueiro, Jesús ^c  

^a UNIVERSIDAD REY JUAN CARLOS   (Spain)

^b UNIVERSITY OF LEÓN   (Spain)

^c UNIVERSIDAD CARLOS III DE MADRID   (Spain)

Author keywords

Asymmetric classification problems; Learning objective functions; Local estimation; Posterior class probabilities

Indexed keywords

DECISION THEORY; LEARNING ALGORITHMS; LEARNING SYSTEMS; MATRIX ALGEBRA; OPTIMIZATION; PROBABILITY; RANDOM PROCESSES;

ASYMMETRIC CLASSIFICATION PROBLEMS; LEARNING OBJECTIVE FUNCTIONS; LOCAL ESTIMATION; POSTERIOR CLASS PROBABILITIES;

NEURAL NETWORKS;

ACCURACY; ALGORITHM; ANALYTICAL PARAMETERS; ARTICLE; CLASSIFICATION; CONTROLLED STUDY; DATA ANALYSIS; DECISION MAKING; DECISION SUPPORT SYSTEM; ENTROPY; EXPERIMENTATION; LEARNING; MACHINE; PRIORITY JOURNAL; PROBABILITY; PROBLEM SOLVING; SAMPLING; STATISTICAL ANALYSIS;

EID: 27844489518     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neucom.2005.02.011     Document Type: Article

References (22)

1. J. Alba L. Docío D. Docampo O. Márquez Growing mixtures network for classification applications Signal Process. 76 1 1999 43-60
2. J. Arribas J. Cid-Sueiro Designing neural networks to estimate posterior class probabilities, in: The Fourth World Multiconference on Systemics, Cybernetics and Informatics and the Sixth International Conference on Information Systems Analysis and Synthesis Orlando, USA 2000
3. L. Bobrowsky J. Sklansky Linear classifiers by window training IEEE Trans. Syst. Sci. Cybernet. 25 1995 1-9
4. J. Cid-Sueiro J. Arribas S. Urbán-Muñoz A. Figueiras-Vidal Cost functions to estimate a posteriori probabilities in multi-class problems IEEE Trans. Neural Networks 10 3 1999 645-656
5. J. Cid-Sueiro, A. Figueiras-Vidal, On the structure of strict sense bayesian cost functions and its applications, IEEE Trans. Neural Networks 12(3) (2001).
6. J. Cid-Sueiro J. Sancho-Gómez Satured perceptrons for maximum margin and minimum misclassification error Neural Process. Lett. 14 2001 217-226
7. H. Do-Tu M. Installe Learning algorithms for non-parametric solution to be minimum error classification problem IEEE Trans. Comput. 27 7 1978 648-659
8. A. Guerrero-Curieses J. Cid-Sueiro Estimating posterior probabilities for terrain classification with a softmax-based neural network, in: Proceedings of The EOS/SPIE Symposium on Remote Sensing Barcelona, Spain 2000 pp. 4145-4170
9. T. Joachims, in: B. Schölkopf, C. Burges, A. Smola (Eds.), Making large-scale SVM learning practical. Advances in kernel methods - support vector learning, Technical Report, MIT-Press, Cambridge, 1999.
10. B. Juang S. Katagiri Discriminative learning for minimum error classification IEEE Trans. Signal Process. 40 12 1992 3043-3054
11. J. Kapur H. Kesavan Entropy Optimization Principles with Applications 1993 Academic Press San Diego, CA
12. F. Melgani, L. Bruzzone, Support vector machines for classification of hyperspectral remote-sensing images, in: Proceedings of the 2002 IEEE International Geoscience and Remote Sensing Symposium, 2002. IGARSS '02, vol. 1, 2002, pp. 506-508.
13. D. Michie, D. Spiegelhalter, C.C. Taylor, Machine Learning, Neural and Statistical Classification, (originally published in 1994 by Ellis Horwood). Now available at: http://www.amsta.leeds.ac.uk/charles/statlog/ indexdos.html.
14. J. Miller, R. Goodman, P. Smyth, Objective functions for probability estimation, in: Proceedings of the International Conference on Neural Networks, vol. 1, 1991, pp. 881-886.
15. B. Pearlmutter J. Hampshire Equivalence proofs for multilayer perceptron classifiers and the Bayesian discriminant function, in: Proceedings of the 1990 Connectionist Models Summer School 1990 Morgan Kauffmann San Diego, CA pp. 159-172
16. S. Raudys Evolution and generalization of a single neurone I. Single layer perceptron as seven statistical classifiers Neural Networks 11 1998 283-296
17. S. Raudys Evolution and generalization of a single neurone II. Complexity of statistical classifiers and sample size considerations Neural Networks 11 1998 297-313
18. M. Richard R. Lippmann Neural network classifiers estimate Bayesian a posteriori probabilities Neural Comput. 3 4 1991 461-483
19. D. Ruck S. Rogers M. Kabrisky M. Oxley B. Suter The multilayer perceptron as an approximation to a bayes optimal discriminant function IEEE Trans. Neural Networks 1 4 1990 296-298
20. M. Saerens Non-mean square error criteria for the training of learning machines, in: Proceedings of the 13th International Conference on Machine Learning (ICML'96) Bari, Italy 1996 pp. 427-434
21. V.N. Vapnik The Nature of the Statistical Learning Theory 1995 Springer New York
22. V.N. Vapnik Statistical Learning Theory 1998 Wiley New York