Exact Hamiltonian Monte Carlo for truncated multivariate gaussians

Journal of Computational and Graphical Statistics

Volumn 23, Issue 2, 2014, Pages 518-542

  Pakman, Ari ^a   Paninski, Liam ^a  

^a Och Spine at New York Presbyterian Hospitals   (United States)

Author keywords

Bayesian modeling; Markov chain Monte Carlo

Indexed keywords

EID: 84901815853     PISSN: 10618600     EISSN: 15372715     Source Type: Journal    
DOI: 10.1080/10618600.2013.788448     Document Type: Article

References (41)

1. Albert, J., and Chib, S. (1993), "Bayesian Analysis of Binary and Polychotomous Response Data, " Journal of the American Statistical Association, 88, 669-679. [519,529]
2. Ashford, J., and Sowden, R. (1970), "Multi-Variate Probit Analysis, " Biometrics, 26, 535-546. [532]
3. Bannerman, M. N., Sargant, R., and Lue, L. (2011), "DynamO: A Free O(N) General Event-Driven Molecular Dynamics Simulator, " Journal of Computational Chemistry, 32, 3329-3338. [527]
4. Bien, J., Taylor, J., and Tibshirani, R. (2012), "A Lasso for Hierarchical Interactions, " Arxiv preprint arXiv:1205.5050. [540]
5. Chen, M. T, and Deely, J. (1992), "Application of a New Gibbs Hit-and-Run Sampler to a Constrained Linear Multiple Regression Problem, " Technical Report 92-21, Purdue University, Center for Statistical Decision Sciences and Department of Statistics. [519]
6. Chu, E., and George, A. (1999), Inside the FFT Black Box: Serial and Parallel Fast Fourier Transform Algorithms, Boca Raton, FL: CRC Press. [536]
7. Cox, D., and Wermuth, N. (2002), "On Some Models for Multivariate Binary Variables Parallel in Complexity With the Multivariate Gaussian Distribution, " Biometrika, 89, 462-469. [519]
8. Damien, P., and Walker, S. (2001), "Sampling Truncated Normal, Beta, and Gamma Densities, " Journal of Computational and Graphical Statistics, 10, 206-215. [519,528]
9. De Boor, C. (2001), A Practical Guide to Splines, New York: Springer Verlag. [534,535]
10. Duane, S., Kennedy, A., Pendleton, B., and Roweth, D. (1987), "Hybrid Monte Carlo, " Physics Letters B, 195, 216-222. [519]
11. Ellis, N., and Maitra, R. (2007), "Multivariate Gaussian Simulation Outside Arbitrary Ellipsoids, " Journal of Computational and Graphical Statistics, 16, 692-708. [524]
12. Emrich, L., and Piedmonte, M. (1991), "AMethod forGeneratingHigh-DimensionalMultivariate BinaryVariates, " The American Statistician, 45, 302-304. [519]
13. Gelfand, A., Smith, A., and Lee, T. (1992), "Bayesian Analysis of Constrained Parameter and Truncated Data Problems Using Gibbs Sampling, " Journal of the American Statistical Association, 87, 523-532. [518]
14. Gelman, A., Carlin, J., Stern, H., and Rubin, D. (2004), Bayesian Data Analysis, Boca Raton, FL: CRC Press. [518]
15. Geweke, J. (1991), "Efficient Simulation From the Multivariate Normal and Student-t Distributions Subject to Linear Constraints and the Evaluation of Constraint Probabilities, " in Computing Science and Statistics: Proceedings of the 23rd Symposium on the Interface, pp. 571-578. [519]
16. Geweke, J., Keane, M., and Runkle, D. (1994), "Alternative Computational Approaches to Inference in the Multinomial Probit Model, " The Review of Economics and Statistics, 76, 609-632. [532]
17. Glasserman, P. (2003), Monte Carlo Methods in Financial Engineering (vol. 53), New York: Springer. [532]
18. Green, P., and Silverman, B. (1994), Nonparametric Regression and Generalized Linear Models: A Roughness Penalty Approach (vol. 58), London: Chapman & Hall/CRC. [533,534]
19. Hammersley, J., and Morton, K. (1956), "A New Monte Carlo Technique: Antithetic Variates, " in Mathematical Proceedings of the Cambridge Philosophical Society (vol. 52), New York: Cambridge University Press, pp. 449-475. [527]
20. Hans, C. (2009), "Bayesian Lasso Regression, " Biometrika, 96, 835-845. [538]
21. Herbison-Evans, D. (1994), "Solving Quartics and Cubics for Graphics, " Technical Report TR-94-487, Sydney, Australia: Basser Department of Computer Science, University of Sydney. [525]
22. Hoffman, M., and Gelman, A. (2011), "The No-U-Turn Sampler: Adaptively Setting Path Lengths in Hamiltonian Monte Carlo, " Arxiv preprint arXiv:1111.4246. [520]
23. Izaguirre, J., and Hampton, S. (2004), "Shadow Hybrid Monte Carlo: An Efficient Propagator in Phase Space of Macromolecules, " Journal of Computational Physics, 200, 581-604. [520]
24. Jeffreys, H. (1946), "An Invariant Form for the Prior Probability in Estimation Problems, " Proceedings of the Royal Society of London. Series A, Mathematical and Physical Sciences, 186, pp. 453-461. [535]
25. Kennedy, A. (1990), "The Theory of Hybrid Stochastic Algorithms, " in NATO ASIB Proceedings of 224: Probabilistic Methods in Quantum Field Theory and Quantum Gravity, Vol. 1, p. 209. [520]
26. Kennedy, A., and Bitar, K. (1994), "An Exact Local Hybrid Monte Carlo Algorithm for Gauge Theories, " Nuclear Physics B-Proceedings Supplements, 34, 786-788. [520]
27. Kotecha, J., and Djuric, P. (1999), "Gibbs Sampling Approach for Generation of Truncated Multivariate Gaussian Random Variables, " in IEEE International Conference on Acoustics, Speech, and Signal Processing: Proceedings, 1999 (Vol. 3), pp. 1757-1760. [519]
28. LeBlanc, M., and Tibshirani, R. (1998), "Monotone Shrinkage of Trees, " Journal of Computational and Graphical Statistics, 7, 417-433. [540]
29. Liu, J. (2008), Monte Carlo Strategies in Scientific Computing, New York: Springer. [526]
30. Neal, R. (2010), "MCMC Using Hamiltonian Dynamics, " Handbook of Markov Chain Monte Carlo, 54, 113-162. [520]
31. Neelon, B., and Dunson, D. (2004), "Bayesian Isotonic Regression and Trend Analysis, " Biometrics, 60, 398-406. [519]
32. Paninski, L., Pillow, J., and Simoncelli, E. (2004), "Maximum Likelihood Estimation of a Stochastic Integrateand-Fire Neural Encoding Model, " Neural Computation, 16, 2533-2561. [519,532]
33. Park, T., and Casella, G. (2008), "The Bayesian Lasso, " Journal of the American Statistical Association, 103, 681-686. [520,538,540]
34. Polson, N., and Scott, J. (2011), "The Bayesian Bridge, " Arxiv preprint arXiv:1109.2279. [519,538]
35. Ramsay, J., Hooker, G., and Graves, S. (2009), Functional Data Analysis With R and MATLAB, New York: Springer Verlag. [535]
36. Rasmussen, C. (2003), "Gaussian Processes to Speed Up Hybrid Monte Carlo for Expensive Bayesian Integrals, " in Bayesian Statistics 7: Proceedings of the 7th Valencia International Meeting, New York: Oxford University Press, pp. 651-659. [520]
37. Robert, C. (1995), "Simulation of Truncated Normal Variables, " Statistics and Computing, 5, 121-125. [519]
38. Robert, C., and Casella, G. (2004), Monte Carlo Statistical Methods, New York: Springer Verlag. [518]
39. Rodriguez-Yam, G., Davis, R., and Scharf, L. (2004), "Efficient Gibbs Sampling of Truncated Multivariate Normal With Application to Constrained Linear Regression, " unpublished manuscript. Available at http://www.stat.columbia.edu/rdavis/papers/CLR.pdf. [519,528]
40. Tibshirani, R. (1996), "Regression Shrinkage and Selection via the Lasso, " Journal of the Royal Statistical Society, Series B, 58, 267-288. [538]
41. Tobin, J. (1958), "Estimation of Relationships for Limited Dependent Variables, " Econometrica: Journal of the Econometric Society, 24-36. [518,530]