Deterministic approximation of marginal probabilities in Bayes nets

IEEE Transactions on Systems, Man, and Cybernetics Part A:Systems and Humans.

Volumn 28, Issue 4, 1998, Pages 377-393

  Santos Jr , Eugene ^a,b   Shimony, Solomon Eyal ^c  

^a IEEE   (United States)

^b UNIVERSITY OF CONNECTICUT   (United States)

^c BEN GURION UNIVERSITY OF THE NEGEV   (Israel)

Author keywords

Anytime algorithms; Approximate belief updating; Approximating marginal probabilities; Bayesian belief networks; Decision making systems; Probabilistic reasoning

Indexed keywords

ALGORITHMS; APPROXIMATION THEORY; COMPUTATIONAL COMPLEXITY; DECISION MAKING; HEURISTIC METHODS; INTEGER PROGRAMMING; LEARNING SYSTEMS; LINEAR PROGRAMMING; PROBABILITY;

APPROXIMATING MARGINAL PROBABILITY; BAYESIAN BELIEF NETWORKS; INDEPENDENCE BASED (IB) ASSIGNMENTS; INTEGER LINEAR PROGRAMMING (ILP);

NEURAL NETWORKS;

EID: 0032122651     PISSN: 10834427     EISSN: None     Source Type: Journal    
DOI: 10.1109/3468.686701     Document Type: Article

References (45)

1. P. D. Bailor and W. D. Seward, "A distributed computer algorithm for solving integer linear programming problems," in Proc. 4th Conf. Hypercubes, Concurrent Computers Applications, 1989, pp. 1083-1088.
2. T. O. Binford, T. S. Levitt, and W. B. Mann, "Bayesian inference in model-based machine vision," in Proc. AAAI, Uncertainty AI Workshop, July 1987.
3. R. L. Boehning, R. M. Butler, and B. E. Gillett, "A parallel integer linear programming algorithm," Eur. J. Oper. Res., vol. 34, pp. 393-398, 1988.
4. R. R. Bouckaert, "A stratified simulation scheme for inference in Bayesian belief networks," in Uncertainty Artificial Intelligence, Proc. 10th Conf., July 1994, pp. 110-117.
5. C. Boutilier, N. Friedman, M. Goldszmidt, and D. Koller, "Context-specific independence in Bayesian networks," in Uncertainty Artificial Intelligence, Proc. 12th Conf., Aug. 1996, pp. 115-123.
6. E. Charniak and R. P. Goldman, "A Bayesian model of plan recognition," Artif. Intell. J., 1994.
7. E. Charniak and S. Husain, "A new admissible heuristic for minimal-cost proofs," in Proc. AAAI Conf., 1991, pp. 446-451.
8. E. Charniak and S. E. Shimony, "Cost-based abduction and MAP explanation," Artif. Intell. J., vol. 66, no. 2, pp. 345-374, 1994.
9. G. F. Cooper, "The computational complexity of probabilistic inference using Bayesian belief networks," Artif. Intell. J, vol. 42, nos. 2/3, pp. 393-405, 1990.
10. _, "NESTOR: A computer-based medical diagnosis aid that integrates causal and probabilistic knowledge," Ph.D. dissertation, Stanford Univ., Stanford, CA, 1984.
11. S. B. Cousins, W. Chen, and M. E. Frisse, "CABeN: A collection of algorithms for belief networks," Tech. Rep. WUCS-91-25, Dept. Comput. Sci., Washington Univ., St. Louis, MO, 1991.
12. P. Dagum and M. Luby, "Approximating probabilistic inference in Bayesian belief networks is NP-hard," Artif. Intell., vol. 60, no. 1, pp. 141-153, 1993.
13. B. D'Ambrosio, "Incremental probabilistic inference," in Uncertainty Artificial Intelligence, Proc. 9th Conf., July 1993.
14. T. Dean and K. Kanazawa, "A model for reasoning about persistence and causation," Comput. Intell., vol. 5, no. 3, pp. 142-150, 1991.
15. F. J. Diez, "Local conditioning in Bayesian networks," Tech. Rep. R-181, Cognitive Syst. Lab., Dept. Comput. Sci., Univ. Calif., Los Angeles, July 1992.
16. M. Druzdzel, "Some properties of joint probability distributions," in Uncertainty Artif. Intell., Proc. 10th Conf., July 1994, pp. 187-194.
17. R. Fung and B. Del Favero, "Backward simulation in Bayesian networks," in Uncertainty Artificial Intelligence, Proc. 10th Conf., July 1994, pp. 227-234.
18. S. Geeman and D. Geeman, "Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images," IEEE Trans. Pattern Anal. Machine Intell., vol. 6, pp. 721-741, 1984.
19. D. Geiger and D. Heckerman, "Advances in probabilistic reasoning," in Proc. 7th Conf. Uncertainty Artificial Intelligence, 1991.
20. B. E. Gillett, Introduction to Operations Research: A Computer-Oriented Algorithmic Approach. New York: McGraw Hill, 1976.
21. M. Henrion, "Propagating uncertainty in Bayesian networks by probabilistic logic sampling," in Proc. Uncertainty Artificial Intelligence, 1988, pp. 149-163.
22. E. J. Horvitz, H. J. Suermondt, and G. F. Cooper, "Bounded conditioning: Flexible inference for decisions under scarce resources," in 5th Workshop Uncertainty Artificial Intelligence, Aug. 1989.
23. F. V. Jensen, K. G. Olsen, and S. K. Andersen, "An algebra of Bayesian belief universes for knowledge-based systems," Networks, vol. 20, pp. 637-660, 1990.
24. J. H. Kim and J. Pearl, "A computation model for causal and diagnostic reasoning in inference systems," in Proc. 6th Int. Joint Conf. Artificial Intelligence, 1983.
25. U. Kjaerulff, "Reduction of computational complexity in Bayesian networks through removal of weak dependencies," in Uncertainty Artificial Intelligence, Proc. 10th Conf., July 1994, pp. 374-382.
26. S. L. Lauritzen and D. J. Speigelhalter, "Local computations with probabilities on graphical structures and their applications to expert systems," J. R. Stat. Soc., vol. 50, pp. 157-224, 1988.
27. Z. Li and B. D'Ambrosio, "An efficient approach to probabilistic inference in belief nets," in Proc. Annu. Can. AI Conf., May 1992.
28. N. Linial and N. Nisan, "Approximate inclusion-exclusion," Combinatorica, vol. 10, pp. 349-365, 1990.
29. A. A. Melkman and S. E. Shimony, "Algorithms for parsimonious complete sets in directed graphs," Inf. Process. Lett., vol. 59, pp. 335-339, 1996.
30. R. E. Neapolitan, Probabilistic Reasoning in Expert Systems. New York: Wiley, 1990, ch. 8.
31. J. Pearl, Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference. San Mateo, CA: Morgan Kaufmann, 1988.
32. D. Poole, "The use of conflicts in searching Bayesian networks," in Uncertainty Artificial Intelligence, Proc. 9th Conf., July 1993.
33. H. Pople, "The formation of composite hypotheses in diagnostic problem solving: An exercise in synthetic reasoning," in Proc. IJCAI 5, 1977, pp. 1030-1037.
34. C. Rojas-Guzman and M. A. Kramer, "GALGO: A genetic algorithm decision support tool for complex uncertain systems modeled with Bayesian belief networks," in Uncertainty Artificial Intelligence, Proc. 9th Conf., 1993.
35. E. Santos, Jr., "Cost-based abduction, linear constraint satisfaction, and alternative explanations," in Proc. AAAI Workshop on Abduction, 1991.
36. _, "On the generation of alternative explanations with implications for belief revision," in Proc. 7th Conf. Uncertainty Artificial Intelligence, 1991, pp. 339-347.
37. _, "A linear constraint satisfaction approach to cost-based abduction," Artif. Intell. J., vol. 65, no. 1, pp. 1-27, 1994.
38. E. Santos, Jr., S. E. Shimony, and E. Williams, "Sample-and-accumulate algorithms for belief updating in Bayes networks," in Uncertainty Artificial Intelligence, Proc. 12th Conf., Aug. 1996, pp. 477-484.
39. R. D. Shachter, "Evaluating influence diagrams," Oper. Res., vol. 34, no. 6, pp. 871-882, 1986.
40. S. E. Shimony, "A probabilistic framework for explanation," Tech. Rep. CS-91-57, Brown Univ., Providence, RI, 1991.
41. _, "The role of relevance in explanation I: Irrelevance as statistical independence," Int. J. Approx. Reas., vol. 8, pp. 281-324, June 1993.
42. _, "Finding MAP's for belief networks is NP-hard," Artif. Intell. J., vol. 68, pp. 399-410, Aug. 1994.
43. _, "The role of relevance in explanation II: Disjunctive assignments and approximate independence," Int. J. Approx. Reas., vol. 13, no. 1, pp. 27-60, July 1995.
44. S. E. Shimony and E. Santos, Jr., "Exploiting case-based independence for approximating marginal probabilities," Int. J. Approx. Reas., vol. 14, no. 1, pp. 25-54, Jan. 1996.
45. M. P. Wellman and C.-L. Liu, "State-space abstraction for anytime evaluation of probabilistic networks," in Uncertainty Artificial Intelligence, Proc. 10th Conf., July 1994, pp. 567-574.