Learning probabilistic networks

Knowledge Engineering Review

Volumn 13, Issue 4, 1998, Pages 321-351

  Krause, Paul J ^a  

^a PHILIPS RESEARCH LABORATORIES   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

GRAPH THEORY; KNOWLEDGE ENGINEERING; MATHEMATICAL MODELS; PROBABILITY;

LEARNING PROBABILISTIC NETWORKS;

LEARNING SYSTEMS;

EID: 0032273105     PISSN: 02698889     EISSN: None     Source Type: Journal    
DOI: 10.1017/s0269888998004019     Document Type: Article

References (104)

1. Akaike, H, 1974. "A new look at statistical model identification" IEEE Trans. Automatic Control 19 716-723.
2. Aliferis, CF and Cooper, GF, 1994. "An evaluation of an algorithm for inductive learning of Bayesian belief networks using simulated data sets" Uncertainty in Artificial Intelligence - Proceedings of the 10th Conference 8-14.
3. Allen, J, Fikes, R and Sandewall, E, 1991. KR-91, Principles of Knowledge Representation and Reasoning: Proceedings of the Second International Conference Morgan Kauffman.
4. Angrist, JD, Imbens, GW and Rubin, DB, 1996. "Identification of causal effects using instrumental variables" J. American Statistical Association 91 444-455.
5. Badsberg, J, 1992. "Model search in contingency tables in CoCo" in Dodge, Y and Wittaker, J (eds), Computational Statistics Physica Verlag, pp. 251-256.
6. Bernardo, JM and Giron, FJ, 1988. "A Bayesian analysis of simple mixture problems" in Bernardo, JM, DeGroot, MH, Lindley, DV and Smith, AFM (eds), Bayesian Statistics 3 Oxford University Press, pp. 67-78.
7. Bernardo, JM and Smith, AEM, 1994. Bayesian Theory John Wiley.
8. Besnard, P and Hanks, S, 1995. Uncertainty in Artificial Intelligence: Proceedings of the Eleventh Conference Morgan Kaufmann.
9. Buntine, W, 1991. "Theory refinement in Bayesian networks" Proc. Seventh Conference on Uncertainty in Artificial Intelligence Morgan Kaufmann, pp. 52-60.
10. Buntine, W, 1994. "Operations for learning with graphical models" J. Artificial Intelligence Research 2 159-225.
11. Buntine, W, 1996. "A guide to the literature on learning probabilistic networks from data" IEEE Trans. Knowledge and Data Engineering 8 195-210.
12. Chickering, D, 1995. "A transformational characterisation of equivalent Bayesian network structures" in Besnard, P and Hanks, S (eds), Uncertainty in Artificial Intelligence: Proceedings of the Eleventh Conference Morgan Kaufmann, pp. 87-98.
13. Chickering, D, 1996. "Learning equivalence classes of Bayesian-network structures" in Horvitz, E and Jensen, F (eds.), Uncertainty in Artificial Intelligence: Proceedings of the Twelfth Conference Morgan Kaufmann.
14. Chung, KL, 1979. Elementary Probability Theory with Stochastic Processes Springer-Verlag.
15. Çinlar, E, 1975. Introduction to Stochastic Processes Prentice Hall.
16. Cook, TD and Campbell, DT, 1979. Quasi-Experimentation: Design & Analysis Issues for Field Settings Rand McNally College Publishing Co.
17. Cooper, GF and Herskovits, E, 1992a. "Bayesian Method for the Induction of Probabilistic Networks from Data" Technical Report SMI-91-1, Section on Medical Informatics, Stanford University.
18. Cooper, GF and Herskovits, E, 1992b. "Bayesian method for the induction of probabilistic networks from data" Machine Learning 9 309-347.
19. Cowell, RG, Dawid, AP and Sebastiani, P, 1996. "A comparison of sequential learning methods for incomplete data" in Bayesian Statistics 5 Clarendon Press, pp. 533-542.
20. Cox, D, 1993. "Causality and graphical models" Bull. Int. Stat. Inst., Proc. 49th Session 1, 365-372.
21. Dawid, AP, 1979. "Conditional independence in statistical theory" J. Roy. Statist. Soc. B 49 1-31.
22. Dawid, AP and Lauritzen, SL, 1993. "Hyper Markov laws in the statistical analysis of decomposable graphical models" Annals of Statistics 21 1272-1317.
23. DeGroot, MH, 1970. Optimal Statistical Decisions McGraw-Hill.
24. Dempster, A, Laird, N and Rubin, D, 1977. "Maximum likelihood from incomplete data via the EM algorithm" J. Roy. Statist. Soc. B 39 1-38.
25. Druzdzel, MJ and van der Gaag, LC, 1995. "Elicitation of probabilities for belief networks: Combining qualitative and quantitative information" in Besnard, P and Hanks, S (eds), Uncertainly in Artificial Intelligence: Proceedings of the Eleventh Conference Morgan Kaufmann, pp. 141-148.
26. Dubois D, Wellman, MP, D'Ambrosio, BD and Smets, P, 1992. Uncertainty in Artificial Intelligence: Proceedings of the Eighth Conference Morgan Kaufmann.
27. Edwards, D, 1995. Introduction to Graphical Modelling Springer-Verlag.
28. Friedman, N and Goldszmidt, M, 1996a. "Learning Bayesian networks with local structure" in Horvitz E and Jensen, F (eds), Uncertainty in Artificial Intelligence: Proceedings of the Twelfth Conference, Morgan Kaufmann
29. Friedman, N and Goldszmidt, M, 1996b. "Building classifiers using Bayesian networks" Proceedings of AAAI-96 AAAI Press, pp. 1277-1284.
30. Geiger, D and Pearl, J, 1988. "On the logic of causal models" Proc. 4th Workshop on Uncertainty in AI, St Paul, Minn, pp. 136-147.
31. Geiger, D and Heckerman, D, 1995. "A characterisation of the Dirichlet distribution with application to learning Bayesian networks" in Besnard, P and Hanks, S (eds), Uncertainty in Artificial Intelligence: Proceedings of the Eleventh Conference Morgan Kaufmann, pp. 196-207.
32. Good, IJ, 1965. The Estimation of Probabilities MIT Press.
33. Hastings, W, 1970. "Monte Carlo sampling methods using Markov chains and their applications" Biometrika 57 97-109.
34. Heckerman, D, 1990. "Probabilistic similarity networks" Networks 20 607-636.
35. Heckerman, D, Mamdani, A and Wellman, M, 1995. "Real-world applications of Bayesian networks" Comm. ACM 38.
36. Heckerman, D, 1996a. "Bayesian networks for knowledge discovery" in Fayyad, UM, Piatetsky-Shapiro, G, Smyth, P and Uthurusamy, R (eds), Advances in Knowledge Discovery and Data Mining MIT Press, pp. 273-305.
37. Heckerman, D, 1996b. A Tutorial on Learning with Bayesian Networks Technical Report MSR-TR-95-06, Microsoft Corporation, Redmond, USA.
38. Heckerman, D and Breese, JS, 1994. "A new look at causal independence" in Lopez de Mantaras, R and Poole, D (eds), Uncertainty in Artificial Intelligence: Proceedings of the Tenth Conference Morgan Kaufmann, pp. 286-292.
39. Heckerman, D and Shachter, R, 1995. "Decision-theoretic foundations for causal reasoning" J. Artificial Intelligence Research 3 405-430.
40. Heckerman, D, Geiger, D and Chickering, D, 1995. "Learning Bayesian networks: The combination of knowledge and statistical data" Machine Learning 20 197-243.
41. Henrion, M, Shachter, RD, Kanal, L and Lemmer, JF (eds) 1990. Uncertainty in Artificial Intelligence 5 Elsevier Science.
42. Herskovits, E, 1991. "Computer-Based Probabilistic-Network Construction" PhD thesis, Stanford University.
43. Højsgaard, S, Skjøth, F and Thiesson, B, 1994. "User's guide to BIOFROST" Technical report, Department of Mathematics and Computer Science, Aalborg, Denmark.
44. Horvitz, E and Jensen, F (eds), 1996. Uncertainly in Artificial Intelligence: Proceedings of the Twelfth Conference Morgan Kaufmann.
45. Jensen, FV, 1996. An introduction to Bayesian Networks UCL Press.
46. Jensen, FV, Lauritzen, SL and Olesen, KG, 1989. "Bayesian Updating in Recursive Graphical Models by Local Computations" Technical Report R 89-15, Department of Mathematics and Computer Science, University of Aalborg, Denmark.
47. Jensen, FV, Olesen, KG and Andersen, SK, 1990. "An algebra of Bayesian belief universes for knowledge-based systems" Networks 20 637-659.
48. Holland, PW, 1986. "Statistics and causal inference" J. American Statistical Association 81 945-960.
49. Kass, R and Raftery, A, 1993. "Bayes Factors and Model Uncertainty" Technical Report 571, Department of Statistics, Carnegie Mellon University.
50. Kass, R and Raftery, A, 1995. "Bayes factors" J. American Statistical Association 90 773-795.
51. Lauritzen, SL, 1995. "The EM algorithm for graphical association models with missing data" Computational Statistics & Data Analysis 19 192-210.
52. Lauritzen, SL, 1996. Graphical Models Clarendon Press.
53. Lauritzen, SL and Spiegelhalter, DJ, 1988. "Local computations with probabilities on graphical structures and their application to expert systems (with discussion)" J. Roy. Stat. Soc. Ser. B 50 157-224.
54. Lauritzen, SL, Dawid, AP, Larsen, BN and Leimer, H-G, 1990. "Independence properties of directed Markov fields" Networks 20 491-505.
55. Lauritzen, SL, Thiesson, S and Spiegelhalter, D, 1994. "Diagnostic systems created by model selection methods: a case study" in Cheeseman, P and Oldford, R (eds), AI and Statistics IV Springer-Verlag Lecture Notes in Statistics vol 89, pp. 143-152.
56. Lopez de Mantaras, R and Poole, D (eds), 1994. Uncertainty in Artificial Intelligence: Proceedings of the Tenth Conference Morgan Kaufmann.
57. Madigan, D and Raftery, A, 1994. "Model selection and accounting for model uncertainty in graphical models using Occam's window" J. Am. Statist. Association 89 1535-1546.
58. Madigan, D and York, J, 1995. "Bayesian graphical models for discrete data" International Statistical Review 63 215-232.
59. Madigan, D, Raftery, A, Volinsky, C and Hoeting, J, 1996. "Bayesian model averaging" Proceedings of the AAAI Workshop on Integrating Multiple Learned Models Portland, OR.
60. Meek, C, 1995. "Causal inference and causal explanation with background knowledge" in Besnard, P and Hanks, S (eds), Uncertainty in Artificial Intelligence: Proceedings of the Eleventh Conference Morgan Kaufmann, pp. 403-410.
61. Meilijson, I, 1989. "A fast improvement to the EM algorithm on its own terms" J. Roy Statist. Soc. B 51(1) 127-138.
62. Neal, R, 1993. "Probabilistic inference using Markov chain Monte Carlo methods" Technical Report CRG-TR-93-1, Department of Computer Science, University of Toronto.
63. Neal, R, 1996. Bayesian Learning for Neural Networks Springer-Verlag.
64. Nilsson, N, 1986. "Probabilistic logic" Artificial Intelligence 28 71-87.
65. Oleson, KG, Lauritzen, SL and Jensen, FV, 1992. "aHugin: A system creating adaptive causal probabilistic networks" in Dubois et al. (eds), Uncertainty in Artificial Intelligence: Proceedings of the Eighth Conference Morgan Kaufmann, pp. 223-229.
66. Pearl, J, 1986. "A constraint-propagation approach to probabilistic reasoning" in Kanal, LN and Lemmer, JF (eds), Uncertainty in Artificial Intelligence North-Holland, pp. 371-382
67. Pearl, J, 1988. Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference Morgan Kauffman.
68. Pearl, J, 1995. "On the testability of causal models with latent and instrumental variables" in Besnard, P and Hanks, D (eds), Uncertainty in Artificial Intelligence: Proceedings of the Eleventh Conference Morgan Kaufmann, pp. 435-443.
69. Pearl, J, 1995. "Causal diagrams for empirical research" Biometrika 82 669-710.
70. Pearl, J, Geiger, D and Verma, T, 1990. "The logic of influence diagrams" in Oliver, RM and Smith, JQ (eds), Influence Diagrams, Belief Nets and Decision Analysis John Wiley.
71. Pearl, J and Verma, TS, 1991. "A theory of inferred causation" in Allen, J, Fikes, R and Sandewall, E (eds), KR-91: Principles of Knowledge Representation and Reasoning: Proceedings of the Second International Conference Morgan Kaufmann, pp. 441-452.
72. Richardson, T, 1997. "Extensions of undirected and acyclic, directed graphical models" Proc. 6th Conference on Artificial Intelligence in Statistics Ft Lauderdale, pp. 407-419.
73. Ripley, B, 1987. Stochastic Simulation John Wiley.
74. Rissanen, J, 1987. "Stochastic complexity (with discussion)" J. Roy. Statist. Soc. B 49 223-239.
75. Robins, J, 1986. "A new approach to causal inference in mortality studies with sustained exposure results" Mathematical Modelling 7 1393-1512.
76. Robinson, RW, 1977. "Counting unlabelled acyclic digraphs" in Dold, A and Eckmann, B (eds), Lecture Notes in Mathematics 622: Combinatorial Mathematics V Springer-Verlag.
77. Rubin, DB, 1974. "Estimating causal effects of treatments in randomized and nonrandomized studies" J. Educational Psychology 66 688-701.
78. Rubin, DB, 1978. "Bayesian inference for causal effects: The role of randomisation" Annals of Statistics 6 34-58.
79. Rubin, DB, 1991. "Practical implications of modes of statistical inference on causal effects and the critical role of the assignment mechanism" Biometrics 47 1213-1234.
80. Russell, S and Norvig, P, 1995. Artificial Intelligence: A Modern Approach Prentice-Hall.
81. Russell, S, Binder, J, Koller, D and Kanazawa, K, 1995. "Local learning in probabilistic networks with hidden variables" Proceedings of the Fourteenth International Joint Conference on Artificial Intelligence Morgan Kaufmann, pp. 1146-1152.
82. Schwarz, G, 1978. "Estimating the dimensions of a model" Annals of Statistics 6 461-464.
83. Shachter, RD, 1986. "Evaluating influence diagrams" Operations Research 34 871-882.
84. Shachter, RD, 1990. "Evidence absoprtion and propagation through evidence reversals" in Henrion et al. (eds), Uncertainty and Artificial Intelligence 5 173-190.
85. Singh, M and Provan, G, 1995. "Efficient learning of selective Bayesian network classifiers" Technical report MS-CS-95-36, Computer and Information Science Department, University of Pennyslvania, Philadelphia, PA.
86. Smith, AFM and Makov, UE, 1978 "A quasi-Bayes sequential procedure for mixtures" J. Roy. Statist. Soc. Ser. B 40 106-111.
87. Smyth, P, Heckerman, D and Jordan, MJ, 1996. "Probabilistic Independence Networks for Hidden Markov Probability Models" Microsoft Research Technical Report MSR-TR-96-03.
88. Spiegelhalter, DJ and Lauritzen, SL, 1990. "Sequential updating of conditional probabilities on directed graphical structures" Networks 20 579-605.
89. Spiegelhalter, DJ and Cowell, R, 1992. "Learning in probabilistic expert systems" in Bernardo, JM, Berger, JO, Dawid, AP and Smith, AF (eds), Bayesian Statistics 4 Oxford University Press, pp. 447-465.
90. Spiegelhalter, DJ, Harris, N, Bull, K and Franklin, R, 1991. "Empirical evaluation of prior beliefs about frequencies: methodology and a case study in congenital heart disease" BAIES Report BR-24, MRC Biostatistics unit, Cambridge, England.
91. Spiegelhalter, DJ, Dawid, AP, Lauritzen, SL and Cowell, RG, 1993. "Bayesian analysis in expert systems (with discussion)" Statistical Science 8 219-283.
92. Spirtes, P and Meek, C, 1995. "Learning Bayesian networks with discrete variables from data" Proc. First International Conference on Knowledge Discovery and Data Mining Morgan Kaufmann.
93. Spirtes, P, Glymour, C and Scheines, R, 1993. Causation, Prediction and Search Springer-Verlag.
94. Srinivas, S, 1993. "A generalisation of the noisy-or model" in Uncertainty in Artificial Intelligence: Proceedings of the Ninth Conference Morgan Kaufmann, pp. 208-215.
95. Taylor, SJ, 1966. Introduction to Measure and Integration Cambridge University Press.
96. Thomas, A, Spiegelhalter, DJ and Gilks, WR, 1992. "BUGS: A program to perform Bayesian inference using gibbs sampling" in Bernardo, JM, Berger, JO, Dawid, AP and Smith, AF (eds), Bayesian Statistics 4 Oxford University Press, pp. 837-842.
97. Titterington, DM, 1976. "Updating a diagnostic system using unconfirmed cases" Applied Statistics 25 238-247.
98. Titterington, DM, Smith, AFM and Makov, UE, 1985. Statistical Analysis of Finite Mixture Distributions John Wiley.
99. Verma, T and Pearl, J, 1990. "Equivalence and synthesis of causal models" Proc. Sixth Conference on Uncertainty in Artificial Intelligence Morgan Kaufmann, pp. 220-227.
100. Wallace, CS and Korb, K, 1996. "Learning a linear causal model by MML" Proc. UNICOM Seminar on Intelligent Data Management Chelsea Village, London, UK.
101. Wermuth, N and Lauritzen, SL, 1990. "On substantive research hypotheses, conditional independence graphs and graphical chain models" J. Roy. Stat. Soc. B 52 21-50.
102. Wilks, SS, 1963. Mathematical Statistics John Wiley.
103. Winkler, R, 1967. "The assessment of prior distributions in Bayesian analysis" American Statistical Association 62 776-800.
104. Wittaker, J, 1990. Graphical Models in Applied Multivariate Statistics John Wiley.