Nonparametric Bayesian models through probit stick-breaking processes

Bayesian Analysis

Volumn 6, Issue 1, 2011, Pages 145-178

  Rodríguez, Abel ^a   Dunson, David B ^b  

^a University of California Santa Cruz   (United States)

^b DUKE UNIVERSITY   (United States)

Author keywords

Data augmentation; Mixture model; Nonparametric bayes; Random probability measure; Spatial data; Stick breaking prior; Time series

Indexed keywords

EID: 79955855266     PISSN: 19360975     EISSN: 19316690     Source Type: Journal    
DOI: 10.1214/11-BA605     Document Type: Article

References (64)

1. Agresti, A. (1990). Categorical Data Analysis. New York: Wiley.
2. Albert, J. H. and Chib, S. (2001). "Sequential ordinal modeling with applications to survival data." Biometrics, 57: 829-836.
3. Banerjee, S. and Gelfand, A. E. (2003). "On smoothness properties of spatial processes." Journal of Multivariate Analysis, 84: 85-100.
4. Blackwell, D. and MacQueen, J. B. (1973). "Ferguson Distribution via Pffiolya Urn Schemes." The Annals of Statistics, 1: 353-355.
5. Caron, F., Davy, M., and Doucet, A. (2007). "Generalized Pffiolya urn for time-varying Dirichlet process mixtures." In Proceedings of the Twenty-Third Conference An-nual Conference on Uncertainty in Artifficial Intelligence (UAI-07), 33-40. Corvallis, Oregon: AUAI Press.
6. Caron, F., Davy, M., Doucet, A., Duos, E., and Vanheeghe, P. (2008). "Bayesian inference for linear dynamic models with Dirichlet process mixtures." IEEE Transactions on Signal Processing, 56: 71-84.
7. Carter, C. K. and Kohn, R. (1994). "On Gibbs sampling for state space models." Biometrika, 81: 541-553.
8. Chib, S. and Hamilton, B. H. (2002). "Semiparametric Bayes Analysis of Longitudinal Data Treatment Models." Journal of Econometrics, 110: 67-89.
9. Chung, Y. and Dunson, D. B. (2009). "Nonparametric Bayes conditional distribution modeling with variable selection." Journal of American Statistical Association, 104: 1646-1660.
10. DeIorio, M., Müuller, P., Rosner, G. L., and MacEachern, S. N. (2004). "An ANOVA Model for Dependent Random Measures." Journal of the American Statistical Association, 99: 205-215.
11. Duan, J. A., Guindani, M., and Gelfand, A. E. (2007). "Generalized Spatial Dirichlet Process Models." Biometrika, 94: 809-825.
12. Dunson, D. (2006). "Bayesian dynamic modeling of latent trait distributions." Biostatistics, 7: 551-568.
13. Dunson, D. B., Herring, A. H., and Mulheri-Engel, S. A. (2008). "Bayesian selection and clustering of polymorphisms in functionally-related genes." Journal of the Royal Statistical Society, 103: 534-546.
14. Dunson, D. B., Pillai, N., and Park, J.-H. (2007). "Bayesian density regression." Journal of the Royal Statistical Society, Series B., 69: 163-183.
15. Escobar, M. D. (1994). "Estimating Normal Means with a Dirichlet Process Prior." Journal of the American Statistical Association, 89: 268-277.
16. Escobar, M. D. andWest, M. (1995). "Bayesian Density Estimation and Inference Using Mixtures." Journal of American Statistical Association, 90: 577-588.
17. Ferguson, T. S. (1973). "A Bayesian Analysis of Some Nonparametric Problems." Annals of Statistics, 1: 209-230.
18. Ferguson, T. S. (1974). "Prior Distributions on Spaces of Probability Measures." Annals of Statistics, 2: 615-629.
19. Figueiredo, M. A., Cheng, D. S., and Murino, V. (2007). "Clustering Under Prior Knowledge with Application to Image Segmentation." In Schüolkopf, B., Platt, J., and Hoffiman, T. (eds.), Advances in Neural Information Processing Systems 19, 401-408. Cambridge, MA: MIT Press.
20. Figueiredo, M. A. T. (2005). "Bayesian image segmentation using Gaussian ffield priors." In Rangarajan, A., Vemuri, B., and Yuille, A. L. (eds.), Energy Minimization Methods in Computer Vision and Pattern Recognition, 74-89. Springer - Verlag, Berlin Heidelberg.
21. Früuhwirth-Schnatter, S. (1994). "Data augmentation and dynamic linear models." Journal of Time Series Analysis, 15: 183-202.
22. Gelfand, A. E. and Kottas, A. (2002). "A Computational Approach for Full Nonparameteric Bayesian Inference under Dirichlet Process Mixture Modles." Journal of Computational and Graphical Statistics, 11: 289-305.
23. Gelfand, A. E., Kottas, A., and MacEachern, S. N. (2005). "Bayesian Nonparametric Spatial Modeling With Dirichlet Process Mixing." Journal of the American Statistical Association, 100: 1021-1035.
24. Gelman, A. and Rubin, D. (1992). "Inferences from iterative simulation using multiple sequences." Statistical Science, 7: 457-472.
25. Griffin, J. (2008). "The Ornstein-Uhlenbeck Dirichlet process and other time-varying processes for Bayesian nonparametric inference." Technical report, Institute of Mathematics, Statistics and Actuarial Science, University of Kent.
26. Griffin, J. E. and Steel, M. F. J. (2006). "Order-Based Dependent Dirichlet Processes." Journal of the American Statistical Association, 101: 179-194.
27. Griffin, J. E. and Steel, M. F. J. (2010). "Stick-breaking autoregressive processes." Journal of Econometrics, (Forthcoming).
28. Han, D. F., Li, W. H., and Li, Z. C. (2008). "Semantic image classiffication using statistical local spatial relations model." Multimedia Tools and Applications, 39: 169-188.
29. Hirano, K. (2002). "Semiparametric Bayesian Inference in Autoregressive Panel Data Models." Econometrica, 70: 781-799.
30. Hjort, N. (2000). "Bayesian analysis for a generalized Dirichlet process prior." Technical report, University of Oslo.
31. Ishwaran, H. and James, L. F. (2001). "Gibbs Sampling Methods for Stick-Breaking Priors." Journal of the American Statistical Association, 96: 161-173.
32. Ishwaran, H. and James, L. F. (2003). "Some further developments for stick-breaking priors: ffinite and inffinite clustering and classiffication." Sankya, 65: 577-592.
33. Ishwaran, H. and Zarepour, M. (2002). "Dirichlet Prior Sieves in Finite Normal Mixtures." Statistica Sinica, 12: 941-963.
34. Jacquier, E., Polson, N. G., and Rossi, P. E. (1994). "Bayesian Analysis of Stochastic Volatility Models." Journal of business and Economic Statistics, 12: 371-389.
35. Kacperczyk, M., Damien, P., and Walker, S. G. (2003). "A new class of Bayesian Semiparametric Models with Applications to Option Pricing." Technical report, University of Michigan Bussiness School.
36. Kaufman, K. (1996). Lives of North American Birds. Houghton Miffiin.
37. Kent, J. T. (1989). "Continuity properties for random fields." Annals of Probability, 17: 1432-1440.
38. Kim, S., Shephard, N., and Chib, S. (1998). "Stochastic Volatility: Likelihood Inference and Comparison with ARCH Models." Review of Economic Studies, 65.
39. Kottas, A., Branco, M. D., and Gelfand, A. E. (2002). "A Nonparametric Bayesian Modeling Approach for Cytogenetic Dosimetry." Biometrics, 58: 593-600.
40. Laws, D. J. and O'Hagan, A. (2002). "A Hierarchical Bayes Model for Multilocation Auditing." Journal of the Royal Statistical Society, Series D, 51: 431-450.
41. Lo, A. Y. (1984). "On a class of Bayesian Nonparametric Estimates: I. Density Estimates." Annals of Statistics, 12: 351-357.
42. MacEachern, S. N. (1999). "Dependent Nonparametric Processes." In ASA Proceedings of the Section on Bayesian Statistical Science, 50-55.
43. MacEachern, S. N. (2000). "Dependent Dirichlet Processes." Technical report, Ohio State University, Department of Statistics.
44. Medvedovic, M. and Sivaganesan, S. (2002). "Bayesian Inffinite Mixture Model-Based Clustering of Gene Expression Proffiles." Bioinformatics, 18: 1194-1206.
45. Müuller, P., Quintana, F., and Rosner, G. (2004). "Hierarchical Meta-Analysis over Related Non-parametric Bayesian Models." Journal of Royal Statistical Society, Series B, 66: 735-749.
46. Mulliere, P. and Tardella, L. (1998). "Approximating distributions of random functionals of Ferguson-Dirichlet priors." The Canadian Journal of Statistics, 26: 283-297.
47. Murray, I. and Adams, R. P. (2010). "Slice sampling covariance hyperparameters of latent Gaussian models." In Advances in Neural Information Processing Systems 23.
48. Murray, I., Adams, R. P., and MacKay, J. C. (2010). "Elliptical slice sampling." Journal of Machine Learning Research, 9: 541-548.
49. Ongaro, A. and Cattaneo, C. (2004). "Discrete random probability measures: a general framework for nonparametric Bayesian inference." Statistics and Probability Letters, 67: 33-45.
50. Orbanz, P. and Buhlmann, J. M. (2008). "Nonparametric Bayesian image segmentation." International Journal of Computer Vision, 77: 23-45.
51. Papaspiliopoulos, O. (2009). "A note on posterior sampling from Dirichlet process mixture models." Technical report, Department of Economics, Universitat Pompeu Fabra.
52. Pitman, J. (1995). "Exchangeable and Partially Exchangeable Random Partitions." Probability Theory and Related Fields, 102: 145-158.
53. Pitman, J. (1996). "Some Developments of the Blackwell-MacQueen Urn Scheme." In Ferguson, T. S., Shapeley, L. S., and MacQueen, J. B. (eds.), Statistics, Probability and Game Theory. Papers in Honor of David Blackwell, 245-268. Hayward, CA:IMS.
54. Robert, C. P. and Casella, G. (1999). Monte Carlo Statistical Methods. Springer -Verlag.
55. Roberts, G. and Papaspiliopoulos, O. (2008). "Retrospective Markov chain Monte Carlo methods for Dirichlet process hierarchical models." Biometrika, 95: 169-186.
56. Rodriguez, A., Dunson, D. B., and Gelfand, A. E. (2008). "The nested Dirichlet process, with Discussion." Journal of American Statistical Association, 103: 1131-1154.
57. Rodriguez, A., Dunson, D. B., and Taylor, J. (2009). "Bayesian hierarchically weighted ffinite mixtures models for samples of distributions." Biostatistics, 10: 155-171.
58. Rodriguez, A. and Ter Horst, E. (2008). "Bayesian dynamic density estimation." Bayesian Analysis, 3: 339-366.
59. Rodriguez, A. and ter Horst, E. (2010). "Measuring expectations in options markets: An application to the S&P500 index." Quantitative Finance, doi:10.1080/ 14697680903193397.
60. Sethuraman, J. (1994). "A Constructive Deffinition of Dirichlet Priors." Statistica Sinica, 4: 639-650.
61. Sudderth, E. B. and Jordan, M. I. (2008). "Shared segmentation of natural scenes using dependent Pitman-Yor processes." In Proceedings of Neural Information Proceesing Systems 20.
62. Teh, Y. W., Jordan, M. I., Beal, M. J., and Blei, D. M. (2006). "Sharing Clusters among Related Groups: Hierarchical Dirichlet Processes." Journal of the American Statistical Association, 101: 1566-1581.
63. Walker, S. G. (2007). "Sampling the Dirichlet mixture model with slices." Commnuni-cations in Statistics, Part B - Simulation and Computation, 36: 45-54.
64. West, M. and Harrison, J. (1997). Bayesian Forecasting and Dynamic Models. Springer - Verlag, New York, second edition edition.