Comparison of approximate methods for handling hyperparameters

Neural Computation

Volumn 11, Issue 5, 1999, Pages 1035-1068

  MacKay, David J C ^a  

^a UNIVERSITY OF CAMBRIDGE   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0000597408     PISSN: 08997667     EISSN: None     Source Type: Journal    
DOI: 10.1162/089976699300016331     Document Type: Article

References (31)

1. Bishop, C. M. (1995). Neural networks for pattern recognition. New York: Oxford University Press.
2. Box, G. E. P., & Tiao, G. C. (1973). Bayesian inference in statistical analysis. Reading, MA: Addison-Wesley.
3. Bretthorst, G. (1988). Bayesian spectrum analysis and parameter estimation. Berlin: Springer-Verlag. Available online at: bayes.wustl.edu.
4. Bryan, R. (1990). Solving oversampled data problems by maximum entropy. In P. Fougere (Ed.), Maximum entropy and Bayesian methods, Dartmouth, U.S.A., 1989 (pp. 221-232). Norwell, MA: Kluwer.
5. Buntine, W., & Weigend, A. (1991). Bayesian back-propagation. Complex Systems, 5, 603-643.
6. Dempster, A., Laird, N., & Rubin, D. (1977). Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society B, 39, 1-38.
7. Feynman, R. P. (1972). Statistical mechanics. Reading, MA: Addison-Wesley.
8. Gull, S. F. (1988). Bayesian inductive inference and maximum entropy. In G. Erickson & C. Smith (Eds.), Maximum entropy and Bayesian methods in science and engineering, Vol. 1: Foundations (pp. 53-74). Dordrecht: Kluwer.
9. Gull, S. F. (1989). Developments in maximum entropy data analysis. In J. Skilling (Ed.), Maximum entropy and Bayesian methods, Cambridge 1988 (pp. 53-71). Dordrecht: Kluwer.
10. Hinton, G. E., & Sejnowski, T. J. (1986). Learning and relearning in Boltzmann machines. In D. E. Rumelhart & J. E. McClelland (Eds.), Parallel distributed processing (pp. 282-317). Cambridge, MA: MIT Press.
11. Hinton, G. E., & van Camp, D. (1993). Keeping neural networks simple by minimizing the description length of the weights. In Proc. 6th Annu. Workshop on Comput. Learning Theory (pp. 5-13). New York: ACM Press.
12. MacKay, D. J. C. (1991). Bayesian methods for adaptive models. Unpublished doctoral dissertation, California Institute of Technology.
13. MacKay, D. J. C. (1992a). Bayesian interpolation. Neural Computation, 4(3), 415-447.
14. MacKay, D. J. C. (1992b). The evidence framework applied to classification networks. Neural Computation, 4(5), 698-714.
15. MacKay, D. J. C. (1992c). A practical Bayesian framework for backpropagation networks. Neural Computation, 4(3), 448-472.
16. MacKay, D. J. C. (1995). Developments in probabilistic modelling with neural networks - Ensemble learning. In Neural Networks: Artificial Intelligence and Industrial Applications. Proceedings of the 3rd Annual Symposium on Neural Networks, Nijmegen, Netherlands, 14-15 September 1995 (pp. 191-198). Berlin: Springer-Verlag.
17. MacKay, D. J. C. (1996). Bayesian non-linear modelling for the 1993 energy prediction competition. In G. Heidbreder (Ed.), Maximum entropy and Bayesian methods, Santa Barbara 1993 (pp. 221-234). Dordrecht: Kluwer.
18. Neal, R. M. (1993a). Bayesian learning via stochastic dynamics. In C. L. Giles, S. J. Hanson, & J. D. Cowan (Eds.), Advances in neural information processing systems, 5 (pp. 475-482). San Mateo, CA: Morgan Kaufmann.
19. Neal, R. M. (1993b). Probabilistic inference using Markov chain Monte Carlo methods (Tech. Rep. No. CRG-TR-93-1). Department of Computer Science, University of Toronto.
20. Neal, R. M. (1996). Bayesian learning for neural networks. New York: Springer-Verlag .
21. Neal, R. M., & Hinton, G. E. (1998). A new view of the EM algorithm that justifies incremental, sparse, and other variants. In M. I. Jordan (Ed.), Learning in graphical models (pp. 355-368). Dordrecht: Kluwer Academic Press.
22. Reif, F. (1965). Fundamentals of statistical and thermal physics. New York: McGraw-Hill.
23. Ripley, B. D. (1996). Pattern recognition and neural networks. Cambridge: Cambridge University Press.
24. Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986). Learning representations by back-propagating errors. Nature, 323, 533-536.
25. Skilling, J. (1993). Bayesian numerical analysis. In W. T. Grandy, Jr., & P. Milonni (Eds.), Physics and probability. Cambridge: Cambridge University Press.
26. Strauss, C. E. M., Wolpert, D. H., & Wolf, D. R. (1993). Alpha, evidence, and the entropic prior. In A. Mohammed-Djafari (Ed.), Maximum entropy and Bayesian methods, Paris 1992. Dordrecht: Kluwer.
27. Thodberg, H. H. (1996). Review of Bayesian neural networks with an application to near infrared spectroscopy. IEEE Transactions on Neural Networks, 7(1), 56-72.
28. Wahba, G. (1975). A comparison of GCV and GML for choosing the smoothing parameter in the generalized spline smoothing problem. Numer. Math., 24, 383-393.
29. Weigend, A. S., Rumelhart, D. E., & Huberman, B. A. (1991). Generalization by weight-elimination with applications to forecasting. In D. Touretzky & R. Lippmann (Eds.), Advances in neural information processing systems, 3 (pp. 875-882). San Mateo, CA: Morgan Kaufmann.
30. Weir, N. (1991). Applications of maximum entropy techniques to HST data. In P. Grosbol & R. Warmels (Eds.), Proceedings of the ESO/ST-ECF Data Analysis Workshop, April 1991 (pp. 115-129). Garching: European Southern Observatory/Space Telescope - European Coordinating Facility.
31. Wolpert, D. H. (1993). On the use of evidence in neural networks. In C. L. Giles, S. J. Hanson, & J. D. Cowan (Eds.), Advances in neural information processing systems, 5 (pp. 539-546). San Mateo, CA: Morgan Kaufmann.