Quantifying the uncertainty of a belief net response: Bayesian error-bars for belief net inference

Artificial Intelligence

Volumn 172, Issue 4-5, 2008, Pages 483-513

  Van Allen, Tim ^a   Singh, Ajit ^b   Greiner, Russell ^c   Hooper, Peter ^c  

^a Apollo Technologies Inc   (United States)

^b Carnegie Mellon University   (United States)

^c UNIVERSITY OF ALBERTA   (Canada)

Author keywords

Bayesian belief network; Bucket elimination; Credible interval; Error bars; Variance

Indexed keywords

ALGORITHMS; GAUSSIAN DISTRIBUTION; LEARNING SYSTEMS; PARAMETER ESTIMATION; QUERY PROCESSING; UNCERTAINTY ANALYSIS;

BUCKET ELIMINATION; ERROR BARS;

BAYESIAN NETWORKS;

EID: 38149069576     PISSN: 00043702     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.artint.2007.09.004     Document Type: Article

References (43)

1. Abramson B., Brown J., Edwards W., Murphy A., and Winkler R.L. Hailfinder: A Bayesian system for forecasting severe weather. Intl. J. Forecasting 12 1 (March 1996) 57-71
2. Anderson T.W., and Darling D.A. A test of goodness of fit. J. Amer. Statist. Assoc. 49 268 (December 1954) 765-769
3. Akimoto Y. A note on uniform asymptotic normality of Dirichlet distribution. Math. Japon. 44 1 (December 1996) 25-30
4. Atkinson A.C. Plots, Transformations, and Regression (1985), Oxford
5. C. Boutilier, N. Friedman, M. Goldszmidt, D. Koller, Context-specific independence in Bayesian networks, in: Twelfth Annual Conference on Uncertainty in Artificial Intelligence (UAI-96), 1996
6. Binder J., Koller D., Russell S.J., and Kanazawa K. Adaptive probabilistic networks with hidden variables. Machine Learning 29 2-3 (1997) 213-244
7. Cheng J., and Druzdzel M.J. Confidence inference in Bayesian networks. Seventeenth Conference on Uncertainty in Artificial Intelligence (UAI-2001) (2001), Morgan Kaufmann Publishers 75-82
8. Castillo E.F., Gutiérrez J.M., and Hadi A.S. Sensitivity analysis in discrete Bayesian networks. IEEE Trans. Man Cybernet. Syst. 27 (1997) 412-424
9. Cooper G., and Herskovits E. A Bayesian method for the induction of probabilistic networks from data. Machine Learning 9 (1992) 309-347
10. Che P., Neapolitan R.E., Kenevan J., and Evens M. An implementation of a method for computing the uncertainty in inferred probabilities in belief networks. 9th Annual Conference on Uncertainty in Artificial Intelligence (UAI-93) (1993), Morgan Kaufmann Publishers 292-300
11. Darling D.A. The Kolmogorov-Smirnov, Cramer-von Mises tests. Ann. Math. Stat. 28 (1957) 823-838
12. A. Darwiche, A differential approach to inference in Bayesian networks, in: 16th Annual Conference on Uncertainty in Artificial Intelligence (UAI-93), 2000
13. March 1995, Special issue of "Communications of the ACM", on Bayesian Networks
14. R. Dechter, Bucket elimination: A unifying framework for probabilistic inference, in: Learning and Inference in Graphical Models, 1998
15. A. Darwiche, G.M. Provan, Query DAGs: A practical paradigm for implementing belief network inference, in: Twelfth Conference on Uncertainty in Artificial Intelligence (UAI'96), 1996
16. D'Agostino R.B., and Stephens M.A. Goodness-of-Fit Techniques. Statistics, Textbooks and Monographs vol. 68 (1986), Marcel Dekker Inc.
17. R. Greiner, C. Darken, I. Santoso, Efficient reasoning, Computing Surveys, 2001
18. Y. Guo, R. Greiner, Discriminative model selection for belief net structures, in: Twentieth National Conference on Artificial Intelligence (AAAI-05), Pittsburgh, July 2005, pp. 770-776
19. R. Greiner, A. Grove, D. Schuurmans, Learning Bayesian nets that perform well, in: 13th Annual Conference on Uncertainty in Artificial Intelligence (UAI-97), 1997
20. http://www.cs.ualberta.ca/~greiner/RESEARCH/BNvar
21. E.H. Herskovits, C.F. Cooper, Algorithms for Bayesian belief-network precomputation, in: Methods of Information in Medicine, 1991, pp. 362-370
22. D.E. Heckerman, A tutorial on learning with Bayesian networks, in: M.I. Jordan (Ed.), Learning in Graphical Models, 1998
23. Heckerman D., Geiger D., and Chickering D.M. Learning Bayesian networks: The combination of knowledge and statistical data. Machine Learning 20 (1995)
24. Hooper P. Exact distribution theory for belief net responses, Technical report, University of Alberta, 2007. http://www.stat.ualberta.ca/~hooper/research/papers+talks/exactbeta.pdf
25. Jensen F., and Jensen F. Optimal junction trees. Tenth Annual Conference on Uncertainty in Artificial Intelligence (UAI-94) (1994), Morgan Kaufmann, San Francisco, CA
26. Kleiter G. Propagating imprecise probabilities in Bayesian networks. Artificial Intelligence 88 (1996)
27. Keeney R.L., and Raiffa H. Decision with Multiple Objectives: Preferences and Value Tradeoffs (1976), John Wiley & Sons, New York
28. Korth H., Silberschatz A., and Sudarshan S. Database System Concepts (1998), McGraw Hill
29. U. Kjaerulff, L.C. Van der Gaag, Making sensitivity analysis computationally efficient, in: 16th Conference on Uncertainty in Artificial Intelligence (UAI-00), 2000
30. Laskey K.B. Sensitivity analysis for probability assessments in Bayesian networks. IEEE Trans. Man Cybernet. Syst. 25 6 (1995) 901-909
31. Y. Lin, M.J. Druzdzel, Computational advantages of relevance reasoning in Bayesian beliefs networks, in: Uncertainty in Artificial Intelligence (UAI-97), 1997, pp. 342-350
32. C. Lee, R. Greiner, S. Wang, Using variance estimates to combine Bayesian classifiers, in: International Conference on Machine Learning (ICML'06), Pittsburgh, June 2006
33. A.W. Moore, Private communication, May 2003
34. Pearl J. Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference (1988), Morgan Kaufmann
35. Peixoto J.L. Hierarchical variable selection in polynomial regression models. American Statistician 41 (1987)
36. Ripley B. Pattern Recognition and Neural Networks (1996), Cambridge University Press, Cambridge UK
37. In: Rumelhart D.E., McClelland J.L., and the PDP Research Group (Eds). Parallel Distributed Processing: Explorations in the Microstructure of Cognition, vol. 1: Foundations (1986), The MIT Press, Cambridge
38. A.P. Singh, What to do when you don't have much data: Issues in small sample parameter learning in Bayesian networks, Master's thesis, University of Alberta, 2004
39. Spiegelhalter D.J., and Lauritzen S.L. Sequential updating of conditional probabilities on directed graphical structures. Networks (1990) 579-605
40. T. Van Allen, R. Greiner, P. Hooper, Bayesian error-bars for belief net inference, in: 17th Conference on Uncertainty in Artificial Intelligence (UAI-01), Aug 2001
41. T. Van Allen, Handling uncertainty when you're handling uncertainty: Model selection and error bars for belief networks, Master's thesis, Department of Computing Science, University of Alberta, 2000
42. G.I. Webb, P. Conilione, Estimating bias and variance from data, Technical report, 2005
43. Wilks S. Mathematical Statistics (1962), John Wiley & Sons