A comparison of hybrid strategies for Gibbs sampling in mixed graphical models

Computational Statistics and Data Analysis

Volumn 21, Issue 3, 1996, Pages 343-365

  Brewer, M J ^a   Aitken, C G G ^c   Talbot, M ^b  

^a UNIVERSITY OF ABERDEEN   (United Kingdom)

^b SASS   (United Kingdom)

^c NONE

Author keywords

Auxiliary variables; Gibbs sampling; Graphical models; Hybrid strategies; Markov chain Monte Carlo; Metropolis Hastings

Indexed keywords

ALGORITHMS; COMPUTER SIMULATION; ESTIMATION; GRAPHIC METHODS; MARKOV PROCESSES; MATHEMATICAL MODELS; MONTE CARLO METHODS; PROBABILITY;

CONTINUOUS VARIABLES; GAMMA CONDITIONAL DISTRIBUTIONS; GIBBS SAMPLING; GRAPHICAL MODELS; HYBRID STRATEGIES; MARGINAL PROBABILITIES;

STATISTICAL METHODS;

GIBBS SAMPLING; GRAPHICAL MODEL;

EID: 0029667027     PISSN: 01679473     EISSN: None     Source Type: Journal    
DOI: 10.1016/0167-9473(94)00017-4     Document Type: Article

References (37)

1. Aitken, C.G.G. and A. Gammerman, An illustrative example of the use of probabilistic reasoning in agricultural forecasting, Technical Appendix to progress report: DOSES Project B6, Likely Phase 2 (1990) 3-11.
2. Besag, J. and P.J. Green, Spatial statistics and Bayesian computation, J. Roy. Statist. Soc. Ser. B, 55 (1993) 25-38.
3. Besag, J., P.J. Green, H. Higdon and K. Mengersen, Bayesian computation and stochastic systems, Statist. Sci., 10 (1995) (to appear).
4. Brewer, M.J., Some topics on graphical models in statistics, Ph.D. thesis (Department of Mathematics and Statistics, University of Edinburgh, Scotland, 1994).
5. Brewer, M.J. and C.G.G. Aitken, Contribution to discussion of Gilks et al. (1993) below, J. Roy. Statist. Soc., Ser. B, 55 (1993) 69-70.
6. Brewer, M.J., C.G.G. Aitken, Z. Luo and A. Gammerman, Stochastic simulation in mixed graphical association models, in: Y. Dodge and J. Whittaker (Eds.) Computational statistics, Vol. 1 (Neuchâtel, Switzerland, 1992) 257-262.
7. Brewer, M.J., Z. Luo and A. Gammerman, Using multiple chains for Gibbs sampling in mixed graphical association models, in: R. Dutter and W. Grossman (Eds.) Short communications in computational statistics (Vienna, Austria, 1994) 195-196.
8. Buntine, W., Learning with graphical models, Technical Report FIA-94-03 (NASA Ames Research Center, USA, 1994).
9. Cooper, G., The computational complexity of probabilistic inference using Bayesian belief networks, Artificial Intelligence, 42 (1990) 393-405.
10. Cousins, S.B., W. Chen and M.E. Frisse, A tutorial introduction to stochastic simulation algorithms for belief networks, Artificial Intelligence in Medicine, 5 (1993) 315-340.
11. Dagum, P. and R.M. Chavez, Approximating probabilistic inference in Bayesian belief networks, IEEE Trans. Pattern Anal. Machine Intelligence, 15 (1993) 246-255.
12. Dagum, P. and M. Luby, Approximating probabilistic inference in Bayesian belief networks is NP-hard, Artificial Intelligence, 60 (1993) 141-153.
13. Gelfand, A.E. and A.F.M. Smith, Sampling based approaches to calculating marginal densities, J. Amer. Statist. Assoc., 85 (1990) No. 410, 398-409.
14. Gelman, A. and D.B. Rubin, Inference from iterative simulation using multiple sequences, Statist. Sci., 7 (1992) 457-472.
15. Geman, S. and D. Geman, Stochastic relaxation, Gibbs distributions and the Bayesian restoration of images, IEEE Trans. Pattern Anal. Machine Intelligence, 6 (1984) 721-741.
16. Geyer, C.J., Practical Markov chain Monte Carlo, Statist. Sci., 7 (1992) 473-482.
17. Gilks, W.R., D.G. Clayton, D.J. Spiegelhalter, N.G. Best, A.J. McNeil, L.D. Sharples, and A.J. Kirby, Modelling complexity: applications of Gibbs sampling in medicine, J. Roy. Statist. Soc. Ser. B, 55 (1993) 39-52.
18. Gilks, W.R., A. Thomas, and D.J. Spiegelhalter, A language and program for complex Bayesian modelling, The Statistician, 43 (1994) 169-178.
19. Gilks, W.R. and P. Wild, Adaptive rejection sampling for Gibbs sampling, Appl. Statist., 41 (1992) 337-348.
20. Henrion, M., Propagating uncertainty by logic sampling in Bayes' networks, Department of Engineering and Public Policy (Carnegie-Mellon University, USA, 1986).
21. Lauritzen, S.L., Propagation of probabilities, means and variances in mixed graphical association models, J. Amer. Statist. Assoc., 87 (1992) 1098-1108.
22. Lauritzen, S.L., A.P. Dawid, B.N. Larsen, and H.-G. Leimer, Independence properties of directed Markov fields, Networks, 20 (1990) 491-505.
23. Lauritzen, S.L. and D.J. Spiegelhalter, Local computations with probabilities on graphical structures and their application to expert systems, J. Roy. Statist. Soc. Ser. B, 50 (1988) 157-224.
24. Lauritzen, S.L. and N. Wermuth, Graphical models for associations between variables, some of which are qualitative, and some quantitative, Ann. Statist., 17 (1989) 131-157.
25. Neal, R.M., Probabilistic inference using Markov chain Monte Carlo methods, Technical Report CRG-TR-93-1, Department of Computer Science (University of Toronto, Canada, 1993).
26. Normand, S.-L., Comment to: Spiegelhalter, D.J., Dawid, A.P. and Lauritzen, S.L., Bayesian analysis in expert systems, Statist. Sci., 8 (1993) 263-265.
27. Pearl, J., Evidential reasoning using stochastic simulation of causal models, Artificial Intelligence, 32 (1987) 245-257.
28. Pearl, J., Probabilistic reasoning in intelligent systems (Morgan Kaufmann, San Mateo, CA, USA, 1988) 210-225.
29. Ripley, B.D., Stochastic simulation (Wiley, Chichester, England, 1987) 88-92.
30. Ritter, C. and M.A. Tanner, Facilitating the Gibbs sampler: the Gibbs stopper and the Griddy Gibbs sampler, J. Amer. Statist. Assoc., 87 (1992) 861-868.
31. Smith, A.F.M. and G.O. Roberts, Bayesian computation via the Gibbs sampler and related Markov chain Monte Carlo methods, J. Roy. Statist. Soc. Ser. B, 55 (1993) 3-24.
32. Spiegelhalter, D.J. and S.L. Lauritzen, Sequential updating of conditional probabilities on directed graphical structures, Networks, 20 (1990) 579-605.
33. Swendsen, R.H. and J.-S. Wang, Nonuniversal critical dynamics in Monte Carlo simulations, Physical Review Letters 58 (1987) 86-88.
34. Talbot, M., C.G.G. Aitken, J. Calzdilla, D. Conniffe, F. Eicker, A. Gammerman, A. Unwin, and G. Wright, Linking informal knowledge and expertise to forecasting models, in: New techniques and technologies for statistics (Bonn, Germany, 1992) 88-94.
35. Wermuth, N. and S.L. Lauritzen, On substantive research hypotheses, conditional independence graphs and graphical chain models, J. Roy. Statist. Soc. Ser. B, 52 (1990) 21-50.
36. Whittaker, J., Graphical models in applied mathematical multivariate statistics (Wiley, Chichester, England, 1990).
37. York, J., Use of the Gibbs sampler in expert systems, Artificial Intelligence, 56 (1992) 115-130.