Model selection and accounting for model uncertainty in graphical models using occam’s window

Journal of the American Statistical Association

Volumn 89, Issue 428, 1994, Pages 1535-1546

  Madigan, David ^a   Raftery, Adrian E ^a  

^a UNIVERSITY OF WASHINGTON   (United States)

Author keywords

Chordal graph; Contingency table; Decomposable log linear model; Expert system; Hyper Markov distribution; Recursive causal model

Indexed keywords

EID: 84950945692     PISSN: 01621459     EISSN: 1537274X     Source Type: Journal    
DOI: 10.1080/01621459.1994.10476894     Document Type: Article

References (52)

1. Anderson, L. R., Krebs, J. H., and Anderson, J. D. (1991), “STENO: An Expert System for Medical Diagnosis Based on Graphical Models and Model Search,” Journal of Applied Statistics, 18, 139–153.
2. Berger, J. O., and Delampady, M. (1987), “Testing Precise Hypotheses” (with discussion), Statistical Science, 2, 317–352.
3. Berger, J. O., and Sellke, T. (1987), “Testing a Point Null Hypothesis: The Irreconcilability of P Values and Evidence” (with discussion), Journal of the American Statistical Association, 82, 112–139.
4. Bishop, Y. M. M., Fienberg, S. E., and Holland, P. W. (1975), Discrete Multivariate Analysis, Cambridge, MA: MIT Press.
5. Chaloner, K. M., and Duncan, G. T. (1987), “Some Properties of the Dirichlet-Multinomial Distribution and Its Use in Prior Elicitation,” Communications in Statistics, Part A—Theory and Methods, 16, 511–523.
6. Cooper, G. F., and Herskovits, E. (1992), “A Bayesian Method for the Induction of Probabilistic Networks From Data,” Machine Learning, 9, 309–347.
7. Critchlow, D. E. (1985), Metric Methods for Analyzing Partially Ranked Data, New York: Springer-Verlag.
8. Dawid, A. P. (1984), “Statistical Theory—The Prequential Approach,” Journal of the Royal Statistical Society, Ser. A, 147, 278–292.
9. —— (1986), “Probability Forecasting.” in Encyclopedia of Statistical Sciences (Vol. 7), eds. Kotz, S., and Johnson, N. L., New York: John Wiley, pp. 210–218.
10. Dawid, A. P., and Lauritzen, S. L. (1993), “Hyper-Markov Laws in the Statistical Analysis of Decomposable Graphical Models,” The Annals of Statistics, 21, 1272–1317.
11. Edwards, D. (1990), “Hierarchical Mixed Interaction Models,” Journal of the Royal Statistical Society, Ser. B, 52, 3–20.
12. Edwards, D., and Havránek, T. (1985), “A Fast Procedure for Model Search in Multidimensional Contingency Tables,” Biometrika, 72, 339–351.
13. Evett, I. W. (1991), “Implementing Bayesian Methods in Forensic Science,” paper presented to the Fourth Valencia International Meeting on Bayesian Statistics.
14. Fenech, A., and Westfall, P. (1988), “The Power Function of Conditional Log-Linear Model Tests,” Journal of the American Statistical Association, 83, 198–203.
15. Fowlkes, E. B., Freeny, A. E., and Landwehr, J. M. (1988), “Evaluating Logistic Models for Large Contingency Tables,” Journal of the American Statistical Association, 83, 611–622.
16. Frydenberg, M., and Lauritzen, S. L. (1989), “Decomposition of Maximum Likelihood in Mixed Graphical Interaction Models,” Biometrika, 76, 539–555.
17. Gabriel, K. R. (1969), “Simultaneous Test Procedures—Some Theory of Multiple Comparisons,” Annals of Mathematical Statistics, 40, 224–250.
18. Glymour, C., Scheines, R., Spirtes, P., and Kelly, K. (1987), Discovering Causal Structure, New York: Academic Press.
19. Gokhale, D. V., and Kullback, S. (1978), The Information in Contingency Tables, New York: Marcel Dekker.
20. Good, I. J. (1952), “Rational Decisions,” Journal of the Royal Statistical Society, Ser. B, 14, 107–114.
21. Goodman, L. A. (1970), “The Multivariate Analysis of Qualitative Data: Interaction Among Multiple Classifications,” Journal of the American Statistical Association, 65, 226–256.
22. —— (1971), “The Analysis of Multidimensional Contingency Tables: Stepwise Procedures and Direct Estimation Methods for Building Models for Multiple Classifications,” Technometrics, 13, 33–61.
23. —— (1973), “Guided and Unguided Methods for the Selection of Models for a Set of T Multidimensional Contingency Tables,” Journal of the American Statistical Association, 68, 165–175.
24. Haberman, S. J. (1974), The Analysis of Frequency Data, IMS Monographs, Chicago: University of Chicago Press.
25. Havránek, T. (1984), “A Procedure for Model Search in Multidimensional Contingency Tables,” Biometrics, 40, 95–100.
26. Hodges, J. S. (1987), “Uncertainty, Policy Analysis and Statistics” (with discussion), Statistical Science, 2, 259–291.
27. Jeffreys, H. (1961), Theory of Probability (3rd ed.), Oxford, U.K.: Oxford University Press.
28. Kass, R. E., and Raftery, A. E. (1995), “Bayes Factors,” submitted to Journal of the American Statistical Association.
29. Kiiveri, H., Speed, T. P., and Carlin, J. B. (1984), “Recursive Causal Models,” Journal of the Australian Mathematical Society, Ser. A, 36, 30–52.
30. Kotz, S., and Johnson, N. L. (eds.) (1985), Encyclopedia of Statistical Sciences (Vol. 6), New York: John Wiley, pp. 578–579.
31. Kreiner, S. (1987), “Analysis of Multidimensional Contingency Tables by Exact Conditional Tests: Techniques and Strategies,” Scandinavian Journal of Statistics, 14, 97–112.
32. Lauritzen, S. L., and Spiegelhalter, D. J. (1988), “Local Computations with Probabilities on Graphical Structures and Their Application to Expert Systems” (with discussion), Journal of the Royal Statistical Society, Ser. B, 50, 157–224.
33. Linhart, H., and Zucchini, W. (1986), Model Selection, New York: John Wiley.
34. Madigan, D., and Raftery, A. E. (1991), “Model Selection and Accounting for Model Uncertainty in Graphical Models Using Occam’s Window,” Technical Report 213, University of Washington, Dept. of Statistics.
35. Miller, A. J. (1984), “Selection of Subsets of Regression Variables” (with discussion), Journal of the Royal Statistical Society, Ser. A, 147, 389–425.
36. Moulton, B. R. (1991), “A Bayesian Approach to Regression Selection and Estimation with Application to a Price Index for Radio Services,” Journal of Econometrics, 49, 169–193.
37. Pearl, J., and Verma, T. S. (1991), “A Theory of Inferred Causation,” in Knowledge Representation and Reasoning: Proceedings of the Second International Conference, eds. J. A. Allen, R. Fikes, and E. Sandewall, San Mateo, CA, Morgan Kaufmann, pp. 441–452.
38. Raftery, A. E. (1986a), “A Note on Bayes Factors for Log-Linear Contingency Table Models with Vague Prior Information,” Journal of the Royal Statistical Society, Ser. B, 48, 249–250.
39. —— (1986b), “Choosing Models for Cross-Classifications,” American Sociological Review, 51, 145–146.
40. —— (1988), “Approximate Bayes Factors for Generalized Linear Models,” Technical Report 121, University of Washington, Dept. of Statistics.
41. —— (1993), “Approximate Bayes Factors and Accounting for Model Uncertainty in Generalized Linear Models,” Technical Report 255, University of Washington, Dept. of Statistics.
42. Regal, R. R., and Hook, E. B. (1991), “The Effects of Model Selection on Confidence Intervals for the Size of a Closed Population,” Statistics in Medicine, 10, 717–721.
43. Sakamoto (1984), “Efficient Use of Akaike’s Information Criterion on High-Dimensional Contingency Table Analysis,” Metron, 40, 257–275.
44. Spiegelhalter, D. J., and Cowell, R. G. (1991), “Learning in Probabilistic Expert Systems,” in Bayesian Statistics 4, eds. J. M. Bernardo, J. O. Berger, A. P. Dawid, and A. F. M. Smith, Oxford: Clarendon Press, pp. 447–466.
45. Spiegelhalter, D. J., and Lauritzen, S. L. (1990a), “Sequential Updating of Conditional Probabilities on Directed Graphical Structures,” Networks, 20, 579–605.
46. —— (1990b), “Techniques for Bayesian Analysis in Expert Systems,” Annals of Mathematics and Artificial Intelligence, 2, 353–366.
47. Spiegelhalter, D. J., and Smith, A. F. M. (1982), “Bayes Factors for Linear and Log-Linear Models With Vague Prior Information,” Journal of the Royal Statistical Society, Ser. B, 44, 377–387.
48. Upton, G. J. G. (1991), “The Exploratory Analysis of Survey Data Using Log-Linear Models,” The Statistician, 40, 169–182.
49. Wermuth, N. (1976), “Model Search Among Multiplicative Models,” Biometrics, 32, 253–263.
50. Wermuth, N., and Lauritzen, S. L. (1990), “On Substantive Research Hypotheses, Conditional Independence Graphs and Graphical Chain Models,” Journal of the Royal Statistical Society, Ser. B, 52, 21–50.
51. Whittaker, J. (1984), “Fitting All Possible Decomposable and Graphical Models to Multiway Contingency Tables,” in Compstat 84, eds. T. Havránek et al., Vienna: Physica-Verlag, pp. 401–406.
52. —— (1990), Graphical Models in Applied Multivariate Statistics, Chichester, U.K.: John Wiley.