A review of Bayesian neural networks with an application to near infrared spectroscopy

IEEE Transactions on Neural Networks

Volumn 7, Issue 1, 1996, Pages 56-72

  Thodberg, Hans Henrik ^a  

^a DANISH MEAT RESEARCH INSTITUTE   (Denmark)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; APPROXIMATION THEORY; BACKPROPAGATION; ERRORS; INFRARED SPECTROSCOPY; LEARNING SYSTEMS; MEATS; OILS AND FATS; OPTIMIZATION; REGRESSION ANALYSIS; SPURIOUS SIGNAL NOISE;

BAYESIAN NEURAL NETWORKS; ERROR BARS; NEAR INFRARED SPECTROSCOPY; POSTERIOR WEIGHT DISTRIBUTION; RANDOM NOISE;

NEURAL NETWORKS;

EID: 0029754435     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/72.478392     Document Type: Review

References (25)

1. H. H. Thodberg, "A Bayesian approach to pruning of neural networks," submitted to IEEE Trans. Neural Networks, 1993.
2. D. J. C. MacKay, "Bayesian interpolation," Neural Computa., vol. 4, pp. 415-447, 1992.
3. _, "A practical Bayesian framework for backpropagation networks," Neural Computa., vol. 4, pp. 448-472, 1992.
4. _, "Information-based objective functions for active data selection," Neural Computa., vol. 4, pp. 590-604, 1992.
5. _, "The evidence framework applied to classification networks," Neural Computa., vol. 4, pp. 720-736, 1992.
6. S. F. Gull, "Bayesian inductive inference and maximum entropy," in Maximum Entropy and Bayesian Methods in Science and Engineering, Vol. I: Foundations, G. J. Ericson and C. R. Smith, Eds. Norwell, MA: Kluwer, 1988.
7. G. E. P. Box and G. C. Tiao, Bayesian Inference in Statistical Analysis. Reading, MA: Addison-Wesley, 1973.
8. J. O. Berger, Statistical Decision Theory and Bayesian Analysis. New York: Springer-Verlag, 1985.
9. W. L. Buntine and A. S. Weigend, "Bayesian backpropagation," Complex Syst., vol. 5, pp. 603-643, 1991.
10. D. H. Wolpert, "On the use of evidence neural networks," in Neural Information Processing Systems, vol. 5, C. L. Giles, S. J. Hanson, and J. D. Cowan, Eds. San Mateo, CA: Morgan Kaufmann, 1993, pp. 539-546.
11. D. J. C. MacKay, "Hyperparameters: Optimize or integrate out?" in Maximum Entropy and Bayesian Methods, G. Heidbreder, Ed. Dordrecht, The Netherlands: Kluwer, 1995.
12. R. M. Neal, "Bayesian learning for neural networks," Ph.D. dissertation, Comput. Sci. Dep., Univ. Toronto, 1995.
13. N. R. Draper and H. Smith, Applied Regression Analysis, 2nd ed. New York: Wiley, 1981.
14. L. K. Hansen and P. Salamon, "Neural network ensembles," IEEE Trans. Pattern Anal. Machine Intell., vol. 12, pp. 993-1001, 1990.
15. R. M. Neal, "Bayesian learning via stochastic dynamics," in Neural Information Processing Systems, vol. 5, C. L. Giles, S. J. Hanson, and J. D. Cowan, Eds. San Mateo, CA: Morgan Kaufmann, 1993;
16. "Bayesian training of backpropagation networks by the hybrid MonteCarlo method," Dep. Comput. Sci., Univ. Toronto, CRG-TR-92-1, 1992.
17. H. H. Thodberg, "Improving generalization of neural networks through pruning," Int. J. Neural Syst., vol. 1, pp. 317-325, 1991.
18. C. Bishop, "Exact calculation of the Hessian matrix for the multilayer perceptron," Neural Computa., vol. 4, pp. 494-501, 1992.
19. W. H. Press, B. P. Flannery, S. A. Teukolsky, and W. T. Vetterling, Numerical Recipes in C. Cambridge, U.K.: Cambridge Univ. Press, 1988.
20. C. Borggaard and H. H. Thodberg, "Optimal minimal neural interpretation of spectra," Analytic Chemistry, vol. 64, pp. 545-551, 1992.
21. A. S. Weigend, B. A. Huberman, and D. E. Rumelhart, "Predicting the future: A connectionist approach," Int. J. Neural Syst., vol. 1, pp. 193-209, 1990.
22. J. Moody, "The effective number of parameters: An analysis of generalization and regularization in nonlinear learning systems," in Neural Information Processing Systems, vol. 4, J. E. Moody, J. Hanson, and R. P. Lippmann, Eds. San Mateo, CA: Morgan Kaufmann, 1992.
23. D. J. C. MacKay, "Bayesian model comparison and backprop nets," in Neural Information Processing Systems, vol. 4, J. E. Moody, J. Hanson, and R. P. Lippmann, Eds. San Mateo, CA: Morgan Kaufmann, 1992, pp. 839-846.
24. _, "Bayesian methods for adaptive models," Ph.D. dissertation, California Inst. Tech., Pasadena, 1991, ch. 6.
25. _, "Bayesian nonlinear modeling for the energy prediction competition," in Maximum Entropy and Bayesian Methods, G. Heidbreder, Ed. Dordrecht, The Netherlands: Kluwer, 1995.