Posterior simulation in countable mixture models for large datasets

Journal of the American Statistical Association

Volumn 105, Issue 490, 2010, Pages 775-786

  Guha, Subharup ^a  

^a UNIVERSITY OF MISSOURI   (United States)

Author keywords

Data squashing; Dirichlet process; Generalized P lya urn process; Hidden Markov model; Markov chain Monte Carlo; Semiparametric Bayes

Indexed keywords

EID: 78649420241     PISSN: 01621459     EISSN: None     Source Type: Journal    
DOI: 10.1198/jasa.2010.tm09340     Document Type: Article

References (65)

1. Albert, J. H., and Chib, S. (1993), "Bayes Inference via Gibbs Sampling of Autoregressive Time Series Subject to Markov Mean and Variance Shifts," Journal of Business & Economic Statistics, 11, 1-15. [776]
2. Antoniak, C. E. (1974), "Mixtures of Dirichlet Processes With Applications to Bayesian Nonparametric Problems," The Annals of Statistics, 2, 1152- 1174. [776]
3. Beal, M. J., Ghahramani, Z., and Rasmussen, C. (2002), "The Infinite Hidden MarkovModel," in Advances in Neural Information Processing Systems 14, eds. T. G. Dietterich, S. Becker, and Z. Ghahramani, Cambridge, MA: MIT Press, pp. 577-584. [777]
4. Blackwell, D., and MacQueen, J. B. (1973), "Ferguson Distributions via Pólya Urn Schemes," The Annals of Statistics, 1, 353-355. [776,777]
5. Blei, D. M., and Jordan, M. I. (2005), "Variational Inference for Dirichlet Process Mixtures," Bayesian Analysis, 1, 1-23. [777]
6. Blei, D. M., Griffiths, T. L., Jordan, M. I., and Tenenbaum, J. B. (2004), "Hierarchical Topic Models and the Nested Chinese Restaurant Process," in Advances in Neural Information Processing Systems 16, Cambridge, MA: MIT Press. [777]
7. Bush, C. A., and MacEachern, S. N. (1996), "A Semi-Parametric Bayesian Model for Randomized Block Designs," Biometrika, 83, 275-285. [776, 780]
8. Chib, S. (1996), "Calculating Posterior Distributions and Modal Estimates in Markov Mixture Models," Journal of Econometrics, 75, 79-97. [783]
9. DeIorio, M., Müller, P., Rosner, G. L., and MacEachern, S. N. (2004), "An ANOVA Model for Dependent Random Measures," Journal of the American Statistical Association, 99, 205-215. [777]
10. Dey, D., Müller, P., and Sinha, D. (1998), Practical Nonparametric and Semiparametric Bayesian Statistics, New York: Springer-Verlag. [776]
11. Diebolt, J., and Robert, C. P. (1994), "Estimation of Finite Mixture Distributions Through Bayesian Sampling," Journal of the Royal Statistical Society, Ser. B, 56, 363-375. [776]
12. Duan, J. A., Guindani, M., and Gelfand, A. E. (2007), "Generalized Spatial Dirichlet Process Models," Biometrika, 94, 809-825. [777]
13. DuMouchel,W., Volinsky, C., Johnson, T., Cortes, C., and Pregibon, D. (1999), "Squashing Flat Files Flatter," in Proceedings of the Fifth ACM Conference on Knowledge Discovery and Data Mining, New York: ACM, pp. 6-15. [775,777]
14. Dunson, D. B., Pillai, N., and Park, J. (2007), "Bayesian Density Regression," Journal of the Royal Statistical Society, Ser. B, 69, 163-183. [777]
15. Durbin, R., Eddy, S., Krogh, A., and Michison, G. (1998), Biological Sequence Analysis, Cambridge, U.K.: Cambridge University Press. [776]
16. Escobar, M. D. (1994), "Estimating Normal Means With a Dirichlet Process Prior," Journal of the American Statistical Association, 89, 268-277. [776]
17. Escobar, M. D., and West, M. (1995), "Bayesian Density Estimation and Inference Using Mixtures," Journal of the American Statistical Association, 90, 577-588. [776,780]
18. Ferguson, T. S. (1973), "A Bayesian Analysis of Some Nonparametric Problems," The Annals of Statistics, 1, 209-230. [776]
19. Freedman, D. (1963), "On the Asymptotic Behavior of Bayes Estimates in the Discrete Case," The Annals of Mathematical Statistics, 34, 1386-1403. [776]
20. Frühwirth-Schnatter, S. (2006), Finite Mixture and Markov Switching Models, New York: Springer Science + Business Media LLC. [776]
21. Gelfand, A. E., Kottas, A., and MacEachern, S. N. (2005), "Bayesian Nonparametric Spatial Modeling With Dirichlet Process Mixing," Journal of the American Statistical Association, 100, 1021-1035. [777]
22. Ghosal, S., Ghosh, J. K., and Ramamoorthi, R. V. (1999), "Posterior Consistency of Dirichlet Mixtures in Density Estimation," The Annals of Statistics, 27 (1), 143-158. [776]
23. Griffin, J. E., and Steel, M. F. J. (2006), "Order-Based Dependent Dirichlet Processes," Journal of the American Statistical Association, 101, 179-194. [777]
24. Guha, S. (2008), "Posterior Simulation in the Generalized Linear Mixed Model With Semiparametric Random Effects," Journal of Computational and Graphical Statistics, 17, 410-425. [776,778,784]
25. Guha, S., Li, Y., and Neuberg, D. (2008), "Bayesian Hidden Markov Modeling of Array CGH Data," Journal of the American Statistical Association, 103, 485-497. [775,782,785]
26. Ishwaran, H., and James, L. (2001), "Gibbs Sampling Methods for Stick- Breaking Priors," Journal of the American Statistical Association, 96, 161- 173. [776,777]
27. Ishwaran, H., and Zarepour,M. (2002), "Dirichlet Prior Sieves in Finite Normal Mixtures," Statistica Sinica, 12, 941-963. [776]
28. Jain, S., and Neal, R. M. (2004), "A Split-Merge Markov Chain Monte Carlo Procedure for the Dirichlet Process Mixture Model," Journal of Computational and Graphical Statistics, 13, 158-182. [776]
29. Kullback, S., and Leibler, R. A. (1951), "On Information and Sufficiency," The Annals of Mathematical Statistics, 22, 79-86. [779]
30. Lee, K., Mengersen, K. L., Marin, J.-M., and Robert, C. P. (2008), "Bayesian Inference on Mixtures of Distributions," in Proceedings of the Platinum Jubilee of the Indian Statistical Institute. [776]
31. Lijoi, A., Mena, R. H., and Prünster, I. (2005), "Hierarchical Mixture Modeling With Normalized Inverse-Gaussian Priors," Journal of the American Statistical Association, 100, 1278-1291. [777]
32. MacDonald, I. L., and Zucchini, W. (1997), Hidden Markov and Other Models for Discrete-Value Time Series, Boca Raton: Chapman & Hall. [776]
33. MacEachern, S. N. (1994), "Estimating Normal Means With a Conjugate Style Dirichlet Process Prior," Communications in Statistics: Simulation and Computation, 23, 727-741. [776]
34. -(1999), "Dependent Nonparametric Processes," in Proceedings of the Section on Bayesian Statistical Science, Alexandria, VA: American Statistical Association, pp. 50-55. [777]
35. -(2000), "Dependent Dirichlet Processes," technical report, Ohio State University, Dept. of Statistics. [777]
36. MacEachern, S. N., and Müller, P. (1998), "Estimating Mixture of Dirichlet Process Models," Journal of Computational and Graphical Statistics, 7, 223-238. [776,778]
37. Madigan, D., Raghavan, N., DuMouchel, W., Nason, M., Posse, C., and Ridgeway, G. (2002), "Likelihood-Based Data Squashing: A Modeling Approach to Instance Construction," Data Mining and Knowledge Discovery, 6, 173-190. [775,777]
38. Müller, P., Quintana, F., and Rosner, G. (2004), "A Method for Combining Inference Across Related Nonparametric Bayesian Models," Journal of the Royal Statistical Society, Ser. B, 66, 735-749. [777]
39. Neal, R. M. (2000), "Markov Chain Sampling Methods for Dirichlet Process Mixture Models," Journal of Computational and Graphical Statistics, 9, 283-297. [776,778]
40. Olshen, A. B., Venkatraman, E. S., Lucito, R., andWigler, M. (2004), "Circular Binary Segmentation for the Analysis of Array-Based DNA Copy Number Data," Biostatistics, 4, 557-572. [783]
41. Owen, A. (2003), "Data Squashing by Empirical Likelihood," Data Mining and Knowledge Discovery, 7, 101-113. [777]
42. Papaspiliopoulos, O., and Roberts, G. (2008), "Retrospective MCMC for Dirichlet Process Hierarchical Models," Biometrika, 95, 169-186. [777]
43. Pennell, M. L., and Dunson, D. B. (2007), "Fitting Semiparametric Random Effects Models to Large Data Sets," Biostatistics, 4, 821-834. [777,778, 780]
44. Pinkel, D., and Albertson, D. G. (2005), "Array Comparative Genomic Hybridization and Its Applications in Cancer," Nature Genetics, 37 (Suppl.), 11-17. [782]
45. Pinkel, D., Segraves, R., Sudar, D., Clark, S., Poole, I., Kowbel, D., Collins, C., Kuo, W., Chen, C., Zhai, Y. et al. (1998), "High Resolution Analysis of DNA Copy Number Variation Using Comparative Genomic Hybridization to Microarrays," Nature Genetics, 20, 207-211. [782]
46. Pitman, J., and Yor, M. (1997), "The Two-Parameter Poisson-Dirichlet Distribution Derived From a Stable Subordinator," The Annals of Probability, 25, 855-900. [777]
47. Quintana, F. A., and Newton, M. A. (2000), "Computational Aspects of Nonparametric Bayesian Analysis With Applications to the Modeling of Multiple Binary Sequences," Journal of Computational and Graphical Statistics, 9, 711-737. [776]
48. Rabiner, L. R. (1989), "A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition," Proceedings of the IEEE, 77, 257- 286. [776]
49. Ripley, B. D. (1987), Stochastic Simulation, New York: Wiley. [783]
50. Robert, C. P., and Titterington, D. M. (1998), "Reparametrization Strategies for Hidden MarkovModels and Bayesian Approaches to Maximum Likelihood Estimation," Statistics and Computing, 8, 145-158. [776]
51. Robert, C. P., Celeux, G., and Diebolt, J. (1993), "Bayesian Estimation of Hidden Markov Chains: A Stochastic Implementation," Statistics & Probability Letters, 16, 77-83. [776]
52. Robert, C. P., Ryden, T., and Titterington, D. M. (1999), "Convergence Controls for MCMC Algorithms,With Applications to Hidden Markov Chains," Journal of Statistical Computing and Simulation, 64, 327-355. [783]
53. Rodriguez, A., Dunson, D. B., and Gelfand, A. E. (2008), "The Nested Dirichlet Process" (with discussion), Journal of the American Statistical Association, 103, 1131-1144. [777]
54. Scott, S. (2002), "Bayesian Methods for Hidden Markov Models: Recursive Computing in the 21st Century," Journal of the American Statistical Association, 97, 337-351. [783]
55. Sethuraman, J. (1994), "A Constructive Definition of Dirichlet Priors," Statistica Sinica, 4, 639-650. [776,783]
56. Sethuraman, J., and Tiwari, R. C. (1982), "Convergence of Dirichlet Measures and the Interpretation of Their Parameter," in Statistical Decision Theory and Related Topics III, Vol. 2, eds. S. S. Gupta and J.O. Berger, NewYork: Academic Press, pp. 305-315. [776,783]
57. Snijders, A. M., Nowak, N., Segraves, R., Blackwood, S., Brown, N., Conroy, J., Hamilton, G., Hindle, A. K., Huey, B., Kimura, K., Law, S., Myambo, K., Palmer, J., Ylstra, B., Yue, J. P., Gray, J. W., Jain, A. N., Pinkel, D., and Albertson, D. G. (2001), "Assembly of Microarrays for Genome-Wide Measurement of DNA Copy Number," Nature Genetics, 29, 263-264. [782]
58. Solinas-Toldo, S. et al. (1997), "Matrix-Based Comparative Genomic Hybridization: Biochips to Screen for Genomic Imbalances," Genes, Chromosomes and Cancer, 20, 399-407. [782]
59. Teh, Y. W., Jordan, M. I., Beal, M. J., and Blei, D. M. (2006), "Hierarchical Dirichlet Processes," Journal of the American Statistical Association, 101, 1566-1581. [777,784]
60. Titterington, D. M., Smith, A. F.M., and Makov, U. E. (1985), Statistical Analysis of Finite Mixture Distributions, Chichester, U.K.: Wiley. [776]
61. Tomlinson, G., and Escobar, M. (2003), "Analysis of Densities," talk given at the Joint Statistical Meeting, 2003, San Francisco, CA. [777]
62. Tonon, G., Wong, K. K., Maulik, G., Brennan, C., Feng, B., Zhang, Y., Khatry, D. B., Protopopov, A., You, M. J., Aguirre, A. J., Martin, E. S., Yang, Z., Ji, H., Chin, L., and DePinho, R. A. (2005), "High Resolution Genomic Profiles of Human Lung Cancer," Proceedings of the National Academy of Sciences, 102, 9625-9630. [783,785]
63. Walker, S. G., Damien, P., Laud, P. W., and Smith, A. F. M. (1999), "Bayesian Nonparametric Inference for Random Distributions and Related Functions," Journal of the Royal Statistical Society, Ser. B, 61, 485-527. [776]
64. West, M., Müller, P., and Escobar, M. D. (1994), "Hierarchical Priors and Mixture Models, With Application in Regression and Density Estimation," in Aspects of Uncertainty: A Tribute to D. V. Lindley, eds. A. F. M. Smith and P. Freeman, New York: Wiley, pp. 363-368. [776]
65. Yang, G. L., and Le Cam, L. M. (2000), Asymptotics in Statistics: Some Basic Concepts, Berlin: Springer. [779]