Bayesian neural networks for classification: How useful is the evidence framework?

Neural Networks

Volumn 12, Issue 6, 1999, Pages 877-892

  Penny, W D ^a   Roberts, S J ^a  

^a IMPERIAL COLLEGE LONDON   (United Kingdom)

Author keywords

Bayesian; Classification; Committees; Evidence; Feature selection; Model selection; Multi layer perceptron; Regularization

Indexed keywords

FEATURE EXTRACTION;

AUTOMATIC RELEVANCE DETERMINATION (ARD);

MULTILAYER NEURAL NETWORKS;

ARTICLE; ARTIFICIAL NEURAL NETWORK; BAYES THEOREM; CALCULATION; CLASSIFICATION; LEARNING; MATHEMATICS; MODEL; PATTERN RECOGNITION; PREDICTION; PRIORITY JOURNAL;

EID: 0032803502     PISSN: 08936080     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0893-6080(99)00040-4     Document Type: Article

References (24)

1. Bishop C.M. Neural networks for pattern recognition. 1995;Oxford University Press, Oxford.
2. Breiman, L. (1996). Bias, Variance and Arcing classifiers, Technical Report 460, Statistics Department, University of California.
3. Coetzee F.M., Stonick V.L. 488 solutions to the XOR problem. Mozer M.C. Neural information processing systems - natural and synthetic. 1996.
4. Husmeier, D., Penny, W.D., Roberts, S.J. (1998). An empirical evaluation of Bayesian sampling with hybrid Monte Carlo for training neural network classifiers, submitted for publication.
5. MacKay D.J.C. The evidence framework applied to classification problems. Neural Computation. 4:(5):1992;720-736.
6. MacKay D.J.C. Bayesian interpolation. Neural Computation. 4:(3):1992;415-447.
7. MacKay D.J.C. Hyperparameters: optimise or integrate out? Heidbreder G. Maximum entropy and Bayesian methods, Santa Barbara 1993. 1994;Kluwer, Dordrecht.
8. MacKay D.J.C. Bayesian non-linear modelling for the 1993 energy prediction competition. Heidbreder G. Maximum entropy and Bayesian methods, Santa Barbara 1993. 1995;Kluwer, Dordrecht.
9. Penny W.D., Frost D. Neural networks in clinical medicine. Medical Decision Making. 16:(4):1996;386-398.
10. Gutjahr, S., Nautze, C. (1997). Extended Bayesian learning, Proceedings of ESANN 97, European Symposium on Artificial neural networks, Bruges, pp. 321-326.
11. Neal R. Bayesian learning for neural networks. 1996;Springer, New York.
12. Neal, R. (1997). Monte Carlo implementation of Gaussian process models for Bayesian regression and classification, Technical Report 9702, Department of Statistics, University of Toronto.
13. Oldfield, M.J. (1995). Advances in probabilistic modelling. PhD thesis, Trinity College, Cambridge.
14. Press W.H., Teukolsky S.A., Vetterling W.T., Flannery B.P. Numerical recipes in C. 1992;Cambridge University Press, Cambridge.
15. Ripley B.D. Neural networks and related methods for classification. Journal of the Royal Statistical Society B. 56:(3):1994;409-456.
16. Ripley B.D. Pattern recognition and neural networks. 1996;Cambridge University Press, Cambridge.
17. Roberts, S.J., Penny, W. (1997). Novelty, confidence and errors in connectionist systems, Technical Report, Department of Electrical Engineering, Imperial College. Available from http://www.ee.ic.ac.uk/research/neural/wpenny.html.
18. Robinson, A.J., Fallside, F. (1988). A dynamic connectionist model for phoneme recognition, Proceedings of nEuro 1988, Paris.
19. Sigillito V.G., Wing S.P., Hutton L.V., Baker K.B. Classification of radar returns from the ionosphere using neural networks. Johns Hopkins APL Technical Digest. 10:(3):1989;262-266.
20. Spyers-Ashby J.M., Bain P., Roberts S.J. A comparison of fast Fourier transform (FFT) and autoregressive (AR) spectral estimation techniques for the analysis of tremor data. Journal of Neuroscience Methods. 83:1998;35-43. Special issue on Waveform and Systems Analysis, M. Gresty (Ed.).
21. Sykacek, P., Dorffner, G., Rappelsberger, P., Zeitlhofer. J. (1997). Evaluating confidence measures in a neural network based sleep stager, Technical Report TR-97-21, OFAI, 1997.
22. Thodberg H.H. A review of Bayesian neural networks with an application to near infrared spectroscopy. IEEE Transactions on Neural Networks. 7:1995;56-72.
23. Walker A.M. On the asymptotic behaviour of posterior distributions. Journal of the Royal Statistical Society B. 31:(1):1969;80-88.
24. Williams P.M. Bayesian regularization and pruning using a Laplace prior. Neural Computation. 7:(1):1995;117-143.