Evidence evaluation for bayesian neural networks using contour Monte Carlo

Neural Computation

Volumn 17, Issue 6, 2005, Pages 1385-1410

  Liang, Faming ^a  

^a TEXAS A AND M UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 18444399665     PISSN: 08997667     EISSN: None     Source Type: Journal    
DOI: 10.1162/0899766053630323     Document Type: Article

References (35)

1. Berg, B. A., & Neuhaus, T. (1991). Multicanonical algorithms for 1st order phase-transitions. Physics Letters B, 267, 249-253.
2. Bishop, C. M. (1995). Neural networks for pattern recognition. Oxford: Oxford University Press.
3. Box, G. E. P., & Jenkins, G. M. (1970). Time series analysis, forecast and control. San Francisco: Holden Day.
4. Casella, G., & Berger, R. L. (2002). Statistical inference (2nd ed.). Duxbury, MA: Thomson Learning.
5. Chatfield, C. (2001). Time-series forecasting. London: Chapman & Hall.
6. Dénison, D., Holmes, C., Mallick, B., & Smith, A. F. M. (2002). Bayesian methods for nonlinear classification and regression. New York: Wiley.
7. Faraway, J., & Chatfield, C. (1998). Time series forecasting with neural networks: A comparative study using the airline data. Appl. Statist., 47, 231-250.
8. Fisher, R. A. (1936). The use of multiple measurements in taxonomic problem. Annals of Eugenics, 7, 179-188.
9. Gelman, A., & Meng, X. L. (1998). Simulating normalizing constants: From importance sampling to bridge sampling to path sampling. Statistical Science, 13, 163-185.
10. Geman, S., & Geman, D. (1984). Stochastic relaxation, Gibbs distributions and the Bayesian restoration of images. IEEE Transactions on Pattern Analysis and Machine Intelligence 6, 721-741.
11. Green, P. J. (1995). Reversible jump Markov chain Monte Carlo computation and Bayesian model determination. Biometrika, 57, 97-109.
12. Grenander, U., & Miller, M. (1994). Representations of knowledge in complex systems (with discussion). J. Roy. Statist. Soc. B, 56, 549-603.
13. Hastings, W. K. (1970). Monte Carlo sampling methods using Markov chains and their applications. Biometrika, 57, 97-109.
14. Hurvich, C. M., & Tsai, C. L. (1989). Regression and time series model selection in small samples. Biometrika, 76, 297-307.
15. Ishikawa, M. (2000). Structural learning and rule discovery. In I. Cloeth & J. M. Zurada (Eds.), Knowledge-based neurocomputing (pp. 153-206). Cambridge, MA: MIT Press.
16. Kass, R. E., & Raftery, A. E. (1995). Bayes factors. J. Amer. Statist. Assoc., 90, 773-795.
17. Kutner, M. H., Nachtsheim, C. J., & Neter, J. (2004). Applied regression models (4th ed.). New York: McGraw-Hill.
18. Liang, F. (2003). Contour Monte Carlo: Theoretical results, practical considerations, and applications (Tech. Rep.). College Station: Department of Statistics, Texas A&M University.
19. Liang, F. (2004). Annealing contour Monte Carlo for structure optimization in an off-lattice protein model. Journal of Chemical Physics, 120, 6756-6763.
20. Liu, J. S. (2001). Monte Carlo strategies in scientific computing. New York: Springer.
21. MacKay, D. J. C. (1992a). The evidence framework applied to classification problems. Neural Computation, 4, 720-736.
22. MacKay, D. J. C. (1992b). A practical Bayesian framework for back-propagation networks. Neural Computation, 4, 448-472.
23. MacKay, D. J. C. (1995). Bayesian non-linear modeling for the 1993 energy prediction competition. In G. Heidbreder (Ed.), Maximum entropy and Bayesian methods, Santa Barbara 1993. Dordrecht: Kluwer.
24. Metropolis, N., Rosenbluth, A. W., Rosenbluth, M. N., Teller, A. H., & Teller, E. (1953). Equation of state calculations by fast computing machines. Journal of Chemical Physics, 21, 1087-1091.
25. Müller, P., & Insua, D. R. (1998). Issues in Bayesian analysis of neural network models. Neural Computation, 10, 749-770.
26. Neal, R. M. (1993). Probabilistic inference using Markov chain Monte Carlo methods (Tech. Rep. No. CRG-TR-93-1). Toronto: Department of Computer Science, University of Toronto.
27. Neal, R. M. (1996). Bayesian learning for neural networks. New York: Springer.
28. Penny, W. D., & Roberts, S. J. (1999). Bayesian neural networks for classification: How useful is the evidence framework? Neural Networks, 12, 877-892.
29. Perrone, M. P., & Cooper, L. N. (1993). When networks disagree: Ensemble methods for hybrid neural networks. In R. J. Mammone (Ed.), Artificial neural networks for speech and vision (pp. 126-142). London: Chapman & Hall.
30. Phillips, D. B., & Smith, A. F. M. (1996). Bayesian model comparison via jump diffusions. In W. R. Gilks, S. T. Richardson, & D. J. Spiegelhalter (Eds.), Markov chain Monte Carlo in practice (pp. 215-240). London: Chapman & Hall.
31. Ripley, B. D. (1994). Neural networks and related methods for classification. Journal of the Royal Statistical Society, B, 409-456.
32. Sugiura, N. (1978). Further analysis of the data by Akaike's information criterion and the finite corrections. Communications in Statistics - Theory and Methods, 7, 13-26.
33. Thodberg, H. H. (1995). A review of Bayesian neural networks with an application to near infrared spectroscopy. IEEE Transactions on Neural Networks, 7, 56-72.
34. Walker, A. M. (1969). On the asymptotic behavior of posterior distributions. Journal of the Royal Statistical Society B, 31, 80-88.
35. Wang, F., & Landau, D. P. (2001). Efficient, multiple-range random walk algorithm to calculate the density of states. Physical Review Letters, 86, 2050-2053.