A Graphical Diagnostic for Identifying Influential Model Choices in Bayesian Hierarchical Models

Scandinavian Journal of Statistics

Volumn 38, Issue 3, 2011, Pages 529-550

  Scheel, Ida ^a   Green, Peter J ^b   Rougier, Jonathan C ^b  

^a UNIVERSITY OF OSLO   (Norway)

^b UNIVERSITY OF BRISTOL   (United Kingdom)

Author keywords

Chain graph; Graphical diagnostic; Hierarchical model; Local critique plot; Model criticism; Model diagnostic

Indexed keywords

EID: 80051899452     PISSN: 03036898     EISSN: 14679469     Source Type: Journal    
DOI: 10.1111/j.1467-9469.2010.00717.x     Document Type: Article

References (31)

1. Bayarri, M. J. & Berger, J. O. (1999). Quantifying surprise in the data and model verification. In Bayesian statistics 6 (eds M. Bernardo, J. O. Berger, A. P. Dawid & A. F. M. Smith ), 53-82. Oxford University Press, Oxford, UK.
2. Bayarri, M. J. & Berger, J. O. (2000). P values for composite null models (with discussion). J. Amer. Statist. Assoc. 95, 1127-1142.
3. Bayarri, M. J. & Castellanos, M. E. (2007). Bayesian checking of the second levels of hierarchical models. Statist. Sci. 22, 322-343.
4. Berger, J. O., Liseo, B. & Wolpert, R. L. (1999). Integrated likelihood methods for eliminating nuisance parameters. Statist. Sci. 14, 1-28.
5. Besag, J., York, J. & Mollié, A. (1991). Bayesian image restoration, with two applications in spatial statistics. Ann. Inst. Statist. Math. 43, 1-59.
6. Box, G. E. P. (1980). Sampling and Bayes' inference in scientific modelling and robustness. J. Roy. Statist. Soc. Ser. A 143, 383-430.
7. Chaloner, K. (1994). Residual analysis and outliers in Bayesian hierarchical models. In Aspects of uncertainty: a tribute to D. V. Lindley (eds P. R. Freeman & A. F. M. Smith ), 149-157. Wiley, Chichester, UK.
8. Dahl, F. A., Gåsemyr, J. & Natvig, B. (2007). A robust conflict measure of inconsistencies in Bayesian hierarchical models. Scand. J. Statist. 34, 816-828.
9. Dey, D. K., Gelfand, A. E., Swartz, T. B. & Vlachos, P. K. (1998). A simulation-intensive approach for checking hierarchical models. Test 7, 325-346.
10. Evans, M. & Moshonov, H. (2006). Checking for prior-data conflict. Bayesian Anal. 1, 893-914.
11. Evans, M. & Moshonov, H. (2007). Checking for prior-data conflict with hierarchically specified priors. In Bayesian statistics and its applications (eds A. K. Upadhyay, U. Singh & D. Dey ), 145-159. Anamaya Publishers, New Delhi.
12. Gåsemyr, J. & Natvig, B. (2009). Extensions of a conflict measure of inconsistencies in Bayesian hierarchical models. Scand. J. Statist. 36, 822-838.
13. Gelman, A., Meng, X. L. & Stern, H. (1996). Posterior predictive assessment of model fitness via realized discrepancies. Statist. Sinica 6, 733-760.
14. Green, P. J. & Richardson, S. (2002). Hidden Markov models and disease mapping. J. Amer. Statist. Assoc. 97, 1055-1070.
15. Guttman, I. (1967). The use of the concept of a future observation in goodness-of-fit problems. J. Roy. Statist. Soc. Ser. B Statist. Methodol. 29, 83-100.
16. Hjort, N. L., Dahl, F. A. & Steinbakk, G. H. (2006). Post-processing posterior predictive p values. J. Amer. Statist. Assoc. 101, 1157-1174.
17. Johnson, V. E. (2007a). Bayesian model assessment using pivotal quantities. Bayesian Anal. 2, 719-734.
18. Johnson, V. E. (2007b). Comment: Bayesian checking of the second levels of hierarchical models. Statist. Sci. 22, 353-358.
19. Lauritzen, S. L. (1996). Graphical models. Oxford University Press, Oxford, UK.
20. Lunn, D. J., Thomas, A., Best, N. & Spiegelhalter, D. (2000). WinBUGS - a Bayesian modelling framework: concepts, structure, and extensibility. Statist. Comput. 10, 325-337.
21. Marshall, E. C. & Spiegelhalter, D. J. (2003). Approximate cross-validatory predictive checks in disease mapping models. Statist. Med. 22, 1649-1660.
22. Marshall, E. C. & Spiegelhalter, D. J. (2007). Identifying outliers in Bayesian hierarchical models: a simulation-based approach. Bayesian Anal. 2, 409-444.
23. Meng, X. L. (1994). Posterior predictive p values. Ann. Statist. 22, 1142-1160.
24. O'Hagan, A. (2003). HSSS model criticism. In Highly structured stochastic systems (eds P. J. Green, S. Richardson & N. L. Hjort ), 423-444. Oxford University Press, Oxford, UK.
25. O'Hagan, A. & Forster, J. (2004). Kendall's advanced theory of statistics, Vol. 2B: Bayesian inference, 2nd edn, Arnold, London.
26. Rezvani, A., Mollié, A., Doyon, F. & Sancho-Garnier, H. (1997). Atlas de la Mortalité par Cancer en France, Période 1986-1993. Editions INSERM, Paris.
27. Rubin, D. B. (1984). Bayesian justifiable and relevant frequency calculations for the applied statistician. Ann. Statist. 12, 1151-1172.
28. Scheel, I., Green, P. J. & Rougier, J. C. (2009). Applications of the local critique plot. Statistical Research Report, Department of Mathematics, University of Oslo, No. 7. Available at
29. Spiegelhalter, D. J., Best, N. G., Carlin, B. P. & van der Linde, A. (2002). Bayesian measures of model complexity and fit. J. Roy. Statist. Soc. Ser. B Statist. Methodol. 64, 583-616.
30. Steinbakk, G. H. & Storvik, G. O. (2009). Posterior predictive p-values in Bayesian hierarchical models. Scand. J. Statist. 36, 320-336.
31. Thomas, A., Best, N., Lunn, D., Arnold, R. & Spiegelhalter, D. (2004). GeoBUGS user manual, Version 1.2. Available at