Arc refractor methods for adaptive importance sampling on large Bayesian networks under evidential reasoning

International Journal of Approximate Reasoning

Volumn 51, Issue 7, 2010, Pages 800-819

  Yu, Haohai ^a   Van Engelen, Robert ^a  

^a Florida State University   (United States)

Author keywords

Approximate Bayesian inference; Bayesian networks; Probabilistic reasoning; Uncertainty

Indexed keywords

ADAPTIVE IMPORTANCE SAMPLING; ADAPTIVE METHODS; APPROXIMATE BAYESIAN INFERENCE; BAYESIAN METHODS; CONDITIONAL PROBABILITY TABLES; CRITICAL PROBLEMS; ERROR VARIANCE; EVIDENTIAL REASONING; IMPORTANCE FUNCTIONS; IMPORTANCE SAMPLING; OPTIMAL FUNCTION; OPTIMAL IMPORTANCE FUNCTION; POSTERIOR DISTRIBUTIONS; POSTERIOR PROBABILITY; PROBABILISTIC REASONING;

ADAPTIVE ALGORITHMS; DISTRIBUTED PARAMETER NETWORKS; DISTRIBUTION FUNCTIONS; INFERENCE ENGINES; INTELLIGENT NETWORKS; INTERLOCKING SIGNALS; OPTIMIZATION; SPEECH RECOGNITION;

BAYESIAN NETWORKS;

EID: 77955470929     PISSN: 0888613X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ijar.2010.04.006     Document Type: Article

References (48)

1. J. Pearl Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference 1988 Morgan Kaufmann Publishers, Inc. San Mateo, CA
2. R.E. Neapolitan Probabilistic Reasoning in Expert Systems 1990 John Wiley and Sons NY
3. S. Russell, and P. Norvig Artificial intelligence: a modern approach Prentice Hall Series in Artificial Intelligence 1995 Prentice Hall
4. G.F. Cooper The computational complexity of probabilistic inference using Bayesian belief networks Artificial Intelligence 42 2-3 1990 393 405
5. H. Guo, W. Hsu, A survey on algorithms for real-time Bayesian network inference, in: In the Joint AAAI-02/KDD-02/UAI-02 Workshop on Real-Time Decision Support and Diagnosis Systems, Edmonton, Alberta, Canada, 2002.
6. P. Dagum, and M. Luby Approximating probabilistic inference in Bayesian belief networks is NP-hard Artificial Intelligence 60 1993 141 153
7. A.J. Garvey, and V.R. Lesser A survey of research in deliberative real-time artificial intelligence Real-Time Systems 6 3 1994 317 347
8. E.J. Santos, S.E. Shimony, E. Solomon, E. Williams, On a Distributed Anytime Architecture for Probabilistic Reasoning, AFIT/EN/TR95-02, Department of Electrical and Computer Engineering, Air Force Institute of Technology, Tech. Rep., 1995.
9. M. Henrion Propagating uncertainty in Bayesian networks by probabilistic logic sampling Proceedings of the 2nd Conference on Uncertainty in Artificial Intelligence 1988 Elsevier Science New York 149 163
10. R. Fung, and K.C. Chang Weighting and integrating evidence for stochastic simulation in Bayesian networks Proceedings of the 5th Conference on Uncertainty in Artificial Intelligence 1989 Elsevier Science Publishing Company, Inc. New York, NY 209 219
11. W.R. Gilks, S. Richardson, and D.J. Spiegelhalter Markov Chain Monte Carlo in Practice 1996 Chapman and Hall London
12. D. MacKay Introduction to Monte Carlo methods M. Jordan, Learning in Graphical Models 1998 MIT Press
13. S. Geman, and D. Geman Stochastic relaxation, Gibbs distribution and the Bayesian restoration of images IEEE Transactions on Pattern Analysis and Machine Intelligence 6 6 1984 721 741
14. J. Pearl Evidential reasoning using stochastic simulation of causal models Artificial Intelligence 32 2 1987 245 257
15. R.M. Chavez, and G.F. Cooper A randomized approximation algorithm for probabilistic inference on Bayesian belief networks Networks 20 1990 661 685
16. R.R. Bouckaert, A stratified simulation scheme for inference in Bayesian belief networks, in: Proceedings of the 10th Conference on Uncertainty in Artificial Intelligence, July 1994, pp. 110-117.
17. J. Cheng, and M.J. Druzdzel Latin hypercube sampling in Bayesian networks Proceedings of the 13th International Florida Artificial Intelligence Research Symposium Conference (FLAIRS-00) 2000 AAAI Publishers Orlando, Florida 287 292
18. J. Cheng, and M.J. Druzdzel Computational investigations of low-discrepancy sequences in simulation algorithms for Bayesian networks Proceedings of the 16th Conference on Uncertainty in Artificial Intelligence 2000 Morgan Kaufmann Publishers 72 81
19. R.Y. Rubinstein Simulation and Monte Carlo Method 1981 John Wiley and Sons Hoboken, NJ
20. R.D. Shachter, M.A. Peot, Simulation approaches to general probabilistic inference on belief networks, in: Proceedings of the 5th Conference on Uncertainty in Artificial Intelligence, vol. 5, 1990.
21. C. Yuan, and M.J. Druzdzel Theoretical analysis and practical insights on importance sampling in Bayesian networks International Journal of Approximate Reasoning 46 2 2007 320 333 (Pubitemid 47464880)
22. R. Dechter, I. Rish, A scheme for approximating probabilistic inference, in: Proceedings of Uncertainty in Artificial Intelligence, UAI97, 1997, pp. 132-141.
23. L. Hernández, S. Moral, A. Salmerón, Importance sampling algorithms for belief networks based on approximate computation, in: Proceedings of the Sixth International Conference IPMU'96, 1996, pp. 859-864.
24. L. Hernández, S. Moral, and A. Salmerón A Monte Carlo algorithm for probabilistic propagation in belief networks based on importance sampling and stratified simulation techniques International Journal of Approximate Reasoning 18 1998 53 91
25. A. Salmerón, A. Cano, and S. Moral Importance sampling in Bayesian networks using probability trees Computational Statistics & Data Analysis 34 4 2000 387 413
26. S. Moral, and A. Salmerón Dynamic importance sampling in Bayesian networks based on probability trees International Journal of Approximate Reasoning 38 2005 245 261
27. C. Boutilier, N. Friedman, M. Goldszmidt, D. Koller, Context-specific independence in bayesian networks, in: Proceedings of the Twelfth Conference on Uncertainty in Artificial Intelligence (UAI 96), 1996, pp. 115-123.
28. L. Ortiz, and L. Kaelbling Adaptive importance sampling for estimation in structured domains Proceedings of the 16th Annual Conference on Uncertainty in Artificail Intelligence 2000 Morgan Kaufmann Publishers 446 454
29. J. Cheng, and M.J. Druzdzel AIS-BN: an adaptive importance sampling algorithm for evidential reasoning in large Bayesian networks Journal of Artificial Intelligence Research 13 2000 155 188
30. C. Yuan, M.J. Druzdzel, An importance sampling algorithm based on evidence pre-propagation, in: Proceedings of the 19th Conference on Uncertainty in Artificial Intelligence, July 2003, pp. 624-631.
31. C. Yuan, M.J. Druzdzel, Importance sampling in bayesian networks an influence-based approximation strategy for importance functions, in: Proceedings of the 21th Conference on Uncertainty in Artificial Intelligence, July 2005, pp. 650-657.
32. H. Yu, R. van Engelen, Refractor importance sampling, in: Proceedings of the 24th Conference on Uncertainty in Artificial Intelligence, July 2008, pp. 603-611.
33. C. Yuan, and M.J. Druzdzel Importance sampling algorithms for Bayesian networks: principles and performance Mathematical and Computer Modelling 43 2006 1189 1207
34. K.P. Murphy, Y. Weiss, M.I. Jordan, Loopy belief propagation for approximate inference: an empirical study, in: Proceedings of Uncertainty in Artificial Intelligence, 1999, pp. 467-475, .
35. Y. Weiss, and W.T. Freeman Correctness of belief propagation in gaussian graphical models of arbitrary topology Neural Computation 13 10 2001 2173 2200
36. J. Yedidia, W. Freeman, Y. Weiss, Bethe Free Energy, Kikuchi Approximations, and Belief Propagation Algorithms, 2001, .
37. J.S. Yedidia, An idiosyncratic journey beyond mean field theory, 2000, pp. 21-36.
38. P. Pakzad, V. Anantharam, Belief propagation and statistical physics, in: Proceedings of the 00 Conf. Inform. Sciences and Systems, Princeton U., March 2002, .
39. S. Kullback Information Theory and Statistics 1959 John Wiley and Sons New York
40. L. van der Gaag On evidence absorption for belief networks International Journal of Approximate Reasoning 15 3 1996 265 286
41. M. Henrion Some practical issues in constructing belief networks L. Kanal, T. Levitt, J. Lemmer, Proceedings of the 3rd Conference on Uncertainty in Artificial Intelligence 1989 Elsevier Science North Holland 161 173
42. I. Beinlich, G. Suermondt, R. Chavez, and G. Cooper The ALARM monitoring system: a case study with two probabilistic inference techniques for belief networks Proceedings of the 2nd European Conference on AI and Medicine 1989 Springer-Verlag Berlin
43. A. Onisko, Probabilistic Causal Models in Medicine: Application to Diagnosis of Liver Disorders, Ph.D. Dissertation, Institute of Biocybernetics and Biomedical Engineering, Polish Academy of Science, Warsaw, March 2003.
44. D.E. Heckerman, E.J. Horvitz, and B.N. Nathwani Toward normative expert systems: part I the pathfinder project Methods of Information in Medicine 31 1992 90 105
45. C. Conati, A.S. Gertner, K. VanLehn, and M.J. Druzdzel On-line student modeling for coached problem solving using Bayesian networks Proceedings of the Sixth International Conference on User Modeling (UM-96) 1997 Springer-Verlag Vienna, New York 231 242
46. S. Andreassen, F. Jensen, S. Andersen, B. Falck, U. Kjærulff, M. Woldbye, A. Sørensen, A. Rosenfalck, and F. Jensen MUNIN-an expert EMG assistant J.E. Desmedt, Computer-Aided Electromyography and Expert Systems 1989 Elsevier Science Publishers Amsterdam (Chapter 21)
47. E. Consortium, Elvira: an environment for probabilistic graphical models, in: First European Workshop on Probabilistic Graphical Models, 2002, pp. 222-230.
48. C.E. Shannon The bandwagon IRE Transactions on Information Theory IT-2 1956 3