A simple graphical approach for understanding probabilistic inference in Bayesian networks

Information Sciences

Volumn 179, Issue 6, 2009, Pages 699-716

  Butz, C J ^a   Hua, S ^a   Chen, J ^a   Yao, H ^a  

^a UNIVERSITY OF REGINA   (Canada)

Author keywords

Bayesian networks; Conditional independence; Join tree propagation; Probabilistic inference

Indexed keywords

BAYESIAN NETWORKS; DISTRIBUTED PARAMETER NETWORKS; GRAPHIC METHODS; INFERENCE ENGINES; INTELLIGENT NETWORKS; POLYNOMIAL APPROXIMATION; PROBABILITY; RANDOM PROCESSES; SPEECH ANALYSIS; TREES (MATHEMATICS);

CONDITIONAL INDEPENDENCE; CONDITIONAL PROBABILITY TABLES; DIRECTED ACYCLIC GRAPHS; GRAPHICAL APPROACHES; GRAPHICAL METHODS; INFERENCE TECHNIQUES; MATHEMATICAL EQUATIONS; PEDAGOGICAL TOOLS; POLYNOMIAL TIMES; PRECISE DESCRIPTIONS; PROBABILISTIC INFERENCE; PROBABILITY INFORMATIONS; VARIABLE ELIMINATIONS;

PROBABILITY DISTRIBUTIONS;

EID: 58049119197     PISSN: 00200255     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ins.2008.10.036     Document Type: Article

References (46)

1. An X., Xiang Y., and Cercone N. Dynamic multiagent probabilistic inference. International Journal of Approximate Reasoning 48 1 (2008) 185-213
2. R. Barco, R. Guerrero, G. Hylander, L. Nielsen, M. Partanen, S. Patel, Automated Troubleshooting of Mobile Networks using Bayesian Networks, September 4, 2007. .
3. A. Bronstein, J. Das, M. Duro, R. Friedrich, G. Kleyner, M. Mueller, S. Singhal, April 25, 2005. .
4. Burns K. Bayesian inference in disputed authorship: a case study of cognitive errors and a new system for decision support. Information Sciences 176 11 (2006) 1570-1589
5. Butz C.J., Yao H., and Hua S. A join tree probability propagation architecture for semantic modelling. Journal of Intelligent Information Systems (2008) 10.1007/s10844-008-0073-4
6. Castillo E., Gutiérrez J., and Hadi A. Expert Systems and Probabilistic Network Models (1997), Springer, New York
7. Charniak E. Bayesian networks without tears. The AI Magazine 12 4 (1991) 50-63
8. Cobb B.R., and Shenoy P.P. Inference in hybrid Bayesian networks with mixtures of truncated exponentials. International Journal of Approximate Reasoning 41 3 (2006) 257-286
9. Cooper G.F. The computational complexity of probabilistic inference using Bayesian belief networks. Artificial Intelligence 42 2-3 (1990) 393-405
10. Cormen T.H., Leiserson C.E., Rivest R.L., and Stein C. Introduction to Algorithms (2001), MIT Press, Toronto
11. R. Dechter, Bucket elimination: a unifying framework for probabilistic inference, in: Proceedings of the 12th Conference on Uncertainty in Artificial Intelligence, 1996, pp. 211-219.
12. Hájek P., Havránek T., and Jiroušek R. Uncertain Information Processing in Expert Systems (1992), CRC Press, Ann Arbor
13. Heckerman D., Horvitz E., and Nathwani B. Towards normative expert systems: Part I. The Pathfinder project. Methods of Information in Medicine 31 2 (1992) 90-105
14. E. Horvitz, Agents with beliefs: reflections on Bayesian methods for user modelling, in: Proceedings of the 6th International Conference on User Modelling, 1997, pp. 441-442.
15. E. Horvitz, E.M. Barry, Display of information for time critical decision making, in: Proceedings of the 11th Conference on Uncertainty in Artificial Intelligence, 1995, pp. 296-305.
16. E. Horvitz, J. Breese, D. Heckerman, D. Hovel, K. Rommelse, The Lumiere project: Bayesian user modeling for inferring the goals and needs of software users, in: Proceedings of the 14th Conference on Uncertainty in Artificial Intelligence, 1998, pp. 256-265.
17. E. Horvitz, S. Srinivas, C. Rouokangas, M. Barry, A decision-theoretic approach to the display of information or time-critical decisions: the Vista project, in: Proceedings of the SOAR-92 Conference on Space Operations Automation and Research, 1992.
18. Huang C., and Darwiche A. Inference in belief networks: a procedural guide. International Journal of Approximate Reasoning 15 (1996) 225-263
19. Jensen F.V. An Introduction to Bayesian Networks (1996), UCL Press, London
20. Jensen F.V., Lauritzen S.L., and Olesen K.G. Bayesian updating in causal probabilistic networks by local computations. Computational Statistics Quarterly 4 (1990) 269-282
21. J.H. Kim, J. Pearl, A computational model for causal and diagnostic reasoning in inference engines, in: Proceedings of the 8th International Joint Conference on Artificial Intelligence, 1983, pp. 190-193.
22. U. Kjaerulff, Triangulation of graphs-algorithms giving small total state space, Technical Report R90-09, Department of Mathematics and Computer Science, Aalborg University, Denmark, 1990.
23. Kjaeulff U., and Madsen A.L. Bayesian Networks and Influence Diagrams - A Guide to Construction and Analysis (2007), Springer
24. Lauritzen S.L., and Spiegelhalter D.J. Local computations with probabilities on graphical structures and their application to expert systems. Journal Royal Statistical Society, B 50 2 (1988) 157-224
25. Lauritzen S.L., Dawid A.P., Larsen B.N., and Leimer H.G. Independence properties of directed Markov fields. Networks 20 5 (1990) 491-505
26. Lee S., Son Y., and Jin J. Decision field theory extensions for behavior modeling in dynamic environment using Bayesian belief network. Information Sciences 178 10 (2008) 2297-2314
27. Li Z., and D'Ambrosio B. Efficient inference in Bayes networks as a combinatorial optimization problem. International Journal of Approximate Reasoning 11 1 (1994) 55-81
28. Lockheed, Lockheed Martin Autonomous Control Logic to Guide Unmanned Underwater Vehicle, April 17, 1996. .
29. Long W. Medical diagnosis using a probabilistic causal network. Applied Artificial Intelligence 3 (1989) 367-383
30. Lumière Project: Bayesian Reasoning for Automated Assistance, September 4, 2007. .
31. Madsen A.L., and Jensen F.V. LAZY propagation: a junction tree inference algorithm based on lazy evaluation. Artificial Intelligence 113 1-2 (1999) 203-245
32. A.L. Madsen, An empirical evaluation of possible variations of lazy propagation, in: Proceedings of the 20th Conference on Uncertainty in Artificial Intelligence, 2004, pp. 366-373.
33. Madsen A.L. Variations over the message computation algorithm of lazy propagation. IEEE Transactions of Systems, Man, and Cybernetics B 36 3 (2006) 636-648
34. Munetomo M., Murao N., and Akama K. Introducing assignment functions to Bayesian optimization algorithms. Information Sciences 178 1 (2008) 152-163
35. Neapolitan R.E. Learning Bayesian Networks (2003), Prentice Hall
36. S. Olmsted, On Representing and Solving Decision Problems, Ph.D. Thesis, Department of Engineering Economic Systems, Stanford University, Stanford, CA, 1983.
37. Pearl J. Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference (1988), Morgan Kaufman
38. Russell S.J., and Norvig P. Artificial Intelligence: A Modern Approach (2003), Prentice Hall, Upper Saddle River, New Jersey
39. Shachter R. Evaluating influence diagrams. Operational Research 34 6 (1986) 871-882
40. Shafer G. Probabilistic Expert Systems (1996), Society for Industrial and Applied Mathematics
41. Shafer G., and Shenoy P.P. Probability propagating. Annals of Mathematics and Artificial Intelligence 2 (1990) 327-352
42. C. Skaanning, F.V. Jensen, U. Kjrulff, L. Parker, P. Pelletier, L. Rostrup-Jensen, Automated diagnosis of printer systems using bayesian networks, September 4, 2005. .
43. Wong S.K.M., Butz C.J., and Wu D. On the implication problem for probabilistic conditional independency. IEEE Transactions of Systems, Man, and Cybernetics A 30 6 (2000) 785-805
44. Xiang Y. Probabilistic Reasoning in Multiagent Systems: A Graphical Models Approach (2002), Cambridge University Press, New York
45. Xiang Y., Jensen F.V., and Chen X. Inference in Multiply Sectioned Bayesian Networks: Methods and Performance Comparison. IEEE Transactions of Systems, Man, and Cybernetics B 36 3 (2006) 546-558
46. Zhang N.L., and Poole D. Exploiting causal independence in Bayesian network inference. Journal of Artificial Intelligence Research 5 (1996) 301-328