Applications of Hybrid Monte Carlo to Bayesian Generalized Linear Models: Quasicomplete Separation and Neural Networks

Journal of Computational and Graphical Statistics

Volumn 8, Issue 4, 1999, Pages 779-799

  Ishwaran, Hemant ^a  

^a LERNER RESEARCH INSTITUTE   (United States)

Author keywords

Bayesian hierarchical models; Feedforward neural networks; Leapfrog algorithm; Markov chain Monte Carlo; Random walk Metropolis Hastings

Indexed keywords

EID: 8644257632     PISSN: 10618600     EISSN: 15372715     Source Type: Journal    
DOI: 10.1080/10618600.1999.10474849     Document Type: Article

References (32)

1. Agresti, A. (1996), An Introduction to Categorical Data Analysis, New York: Wiley.
2. Albert, A., and Anderson, J. A. (1984), “On the Existence of Maximum Likelihood Estimates in Logistic Regression Models,” Biometrika, 71, 1-10.
3. Brockmann, H. J. (1996), “Satellite Male Groups in Horseshoe Crabs, Limulus polyphemus,” Ethology, 102, 1-21.
4. Cybenko, G. (1989), “Approximations by Superpositions of a Sigmoidal Function,” Mathematics of Control Signals, and Systems, 2, 303-314.
5. Daniels, M. J. (1998), “Computing Posterior Distributions for Covariance Matrices,” in Computing Science, (vol. 30), Proceedings of the 30th Symposium on the Interface, ed. S. Weisberg, pp. 192-196.
6. Dellaportas, P., and Smith, A. F. M. (1993), “Bayesian Inference for Generalized Linear and Proportional Hazards Models via Gibbs Sampling,” Applied Statistics, 42, 443-459.
7. Duane, S. (1985), “Stochastic Quantization Versus the Microcanonical Ensemble: Getting the Best of Both Worlds,” Nuclear Physics B, 257, 652-662.
8. Duane, S., and Kogut, J. B. (1986), “The Theory of Hybrid Stochastic Algorithms,” Nuclear Physics B, 275, 398-420.
9. Duane, S., Kennedy, A. D., Pendleton, B. J., and Roweth, D. (1987), “Hybrid Monte Carlo,” Physics Letters B, 195, 216-222
10. Funahashi, K. (1989), “On the Approximate Realization of Continuous Mappings by Neural Networks,” Neural Networks, 2, 183-192.
11. Gilks, W. R., and Wild, P. (1992), “Adaptive Rejection Sampling for Gibbs Sampling,” Applied Statistics, 41, 337-348.
12. Gilks, W. R., Best, N., and Tan, K. K. C. (1995), “Adaptive Rejection Metropolis Sampling within Gibbs Sampling,” Applied Statistics, 44, 455-472.
13. Goorin, A. M., Perez-Atayde, A., Gebhardt, M., Andersen, J. W., Wilkinson, R. H., Delorey, M. J., Watts, H., Link, M., Jaffe, N., Frei, E., and Abelson, H. T. (1987), “Weekly High-Dose Methotrexate and Doxorubicin for Osteosarcoma: The Dana-Farber Cancer Institute/The Children’s Hospital-Study III,” Journal of Clinical Oncology, 5, 1178-1184.
14. Gustafson, P. (1997), “Large Bayesian Hierarchical Analysis of Multivariate Survival Data,” Biometrika, 83, 230-242.
15. Homik, K., Stinchcombe, M., and White, H. (1989), “Multilayer Feedforward Networks are Universal Approximators,” Neural Networks, 2, 359-366.
16. Horowitz, A. M. (1991), “A Generalized Guided Monte Carlo Algorithm,” Physics Letters B, 268, 247-252.
17. Hwang, J. T., and Ding A. A. (1997), “Prediction Intervals for Artificial Neural Networks,” Journal of the American Statistical Association, 92, 748-757.
18. Kennedy, A. D. (1990), “The Theory of Hybrid Stochastic Algorithms,” in Probabilistic Methods in Quantum Field Theory and Quantum Gravity, eds. P. H. Damgaard et al., New York: Plenum Press, pp. 209-223.
19. Mallick, B. K., and Gelfand, A. E. (1994), “Generalized Linear Models With Unknown Link Functions,” Biometrika, 81, 237-245.
20. McCullagh, P., and Nelder, J. A. (1989), Generalized Linear Models (2nd ed), London: Chapman and Hall.
21. MacKay, D. J. C. (1992), “A Practical Bayesian Framework for Backpropagation Networks,” Neural Computation, 4, 448-472.
22. Mehta, C. R., and Patel, N. R. (1995), “Exact Logistic Regression: Theory and Examples,” Statistics in Medicine, 14, 2143-2160.
23. Neal, R. M. (1994), “An Improved Acceptance Procedure for the Hybrid Monte Carlo Algorithm,” Journal of Computational Physics, 111, 194-203
24. Neal, R. M. (1996), Bayesian Learning for Neural Networks, New York: Springer-Verlag.
25. Nelder, J. A., and Wedderbum, R. W. M. (1972), “Generalized Linear Models,” Journal of the Royal Statistical Society, Ser. A, 135, 370-384
26. Raftery, A. E. (1996) “Approximate Bayes Factors and Accounting for Model Uncertainty in Generalized Linear Models,” Biometrika, 83, 251-266.
27. Roberts, G. O., and Rosenthal, J. S. (1995), “Optimal Scaling of Discrete Approximations to Langevin Diffusions,” University of Cambridge Research Report 95-11.
28. Rossky, P. S., Doll, J. D., and Friedman, H. L. (1978), “Brownian Dynamics as Smart Monte Carlo Simulation,” Journal of Chemical Physics, 69, 4628-4633.
29. Santner, T. J., and Duffy, D. E. (1986), “A Note on A. Albert and J. A. Anderson’s Conditions for the Existence of Maximum Likelihood Estimates in Logistic Regression Models,” Biometrika, 73, 755-758.
30. SAS Institute, Inc. (1996), SAS/STAT Software: Changes and Enhancements Through Release 6.11, Cary, NC: SAS Institute Inc.
31. Sussmann, H. J. (1992), “Uniqueness of the Weights for Minimal Feedforward Nets With a Given Input-Output Map,” Neural Networks, 5, 589-593.
32. Zeger, S. L., and Karim, M. R. (1991), “Generalized Linear Models With Random Effects: A Gibbs Sampling Approach,” Journal of the American Statistical Association, 86, 79-86.