Any reasonable cost function can be used for a posteriori probability approximation

IEEE Transactions on Neural Networks

Volumn 13, Issue 5, 2002, Pages 1204-1210

  Saerens, Marco ^a,b   Latinne, Patrice ^a   Decaestecker, Christine ^a  

^a UNIVERSITÉ LIBRE DE BRUXELLES   (Belgium)

^b Smals Belgium   (Belgium)

Author keywords

A posteriori probabilities; Bayes decision making; Cost function; Loss function; Training criterion

Indexed keywords

APPROXIMATION THEORY; COMPUTER SIMULATION; DECISION MAKING; PATTERN RECOGNITION; PROBABILITY;

TRANSFORMATION MAPPINGS;

LEARNING SYSTEMS;

EID: 0036738964     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2002.1031952     Document Type: Article

References (11)

1. C. Bishop, Neural Networks for Pattern Recognition. Oxford, U.K.: Oxford Univ. Press, 1995.
2. T. Fomby, R. C. Hill, and S. Johnson, Advanced Econometric Methods. New York: Springer-Verlag, 1984.
3. J.B. Hampshire and B. Pearlmutter, "Equivalence proofs for multi-layer perceptron classifiers and the Bayesian discriminant function", in Proc. 1990 Connectionist Models Summer School, D. Touretzky, J. Elman, T. Sejnowski, and G. Hinton, Eds. San Mateo, CA, 1990, pp. 159-172.
4. D. Lindley, "Scoring rules and the inevitability of probability (with discussions)", Int. Statist. Rev., vol. 50, pp. 1-26, 1982.
5. M. D. Richard and R. P. Lippmann, "Neural network classifiers estimate Bayesian a posteriori probabilities", Neural Comput., vol. 3, pp. 461-483, 1991.
6. P. McCullagh and J. A. Nelder, Generalized Linear Models, 2nd ed. London, U.K.: Chapman and Hall, 1990.
7. J.W. Miller, R. Goodman, and P. Smyth, "Objective functions for probability estimation", Proc. IEEE Int. Joint Conf. Neural Networks, pp. I-881-I-886, 1991.
8. _, "On loss functions which minimize to conditional expected values and posterior probabilities", IEEE Trans. Inform. Theory, vol. 39, pp. 1404-1408, July 1993.
9. M. Saerens, "Non mean square error criteria for the training of learning machines", in Proc. 13th Int. Conf. Machine Learning (ICML), Bari, Italy, July 1996, pp, 427-434.
10. _, "Building cost functions minimizing to some summary statistics", IEEE Trans. Neural Networks, vol. 11, pp. 1263-1271, Nov. 2000.
11. S. Wolfram, The Mathematica Book, 4th ed. Cambridge, U.K.: Wolfram and Cambridge Univ. Press, 1999.