Verification and validation of Bayesian knowledge-bases

Data and Knowledge Engineering

Volumn 37, Issue 3, 2001, Pages 307-329

  Santos Jr , Eugene ^a,b,c  

^a University of Connecticut   (United States)

^b UNIVERSITY OF CONNECTICUT   (United States)

^c IEEE   (United States)

Author keywords

Bayesian knowledge bases; Knowledge engineering; Uncertainty; Validation; Verification

Indexed keywords

BAYESIAN KNOWLEDGE-BASES;

INFORMATION MANAGEMENT; MATHEMATICAL MODELS;

KNOWLEDGE BASED SYSTEMS;

EID: 0035370813     PISSN: 0169023X     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0169-023X(01)00011-8     Document Type: Article

References (59)

1. L. Adelman, Evaluating Decision Support and Expert Systems, 1992.
2. F. Bacchus, Representing and Reasoning with Probabilistic Knowledge: A Logical Approach to Probabilities, The MIT Press, Cambridge, MA, 1990.
3. S.B. Banks, R.A. Harrington, E. Santos Jr., S.M. Brown, Usability testing of an intelligent interface agent, in: Proceedings of Interfaces '97 - Sixth International Conference, 1997, pp. 121-123.
4. S.B. Banks, E. Santos Jr., R.A. Harrington, An intelligent agent for modeling user intent using Bayesian techniques, in: Proceedings of the Seventh International Conference on Human-Computer Interaction: Poster Sessions 60, 1997.
5. D. Banks, Acquiring consistent knowledge for Bayesian forests, Master's Thesis, Graduate School of Engineering, Air Force Institute of Technology, 1995.
6. V. Barr, Applying reliability engineering to expert systems, in: Proceedings of the 12th International FLAIRS Conference, 1999, pp. 494-498.
7. E.J. Bass, S.T. Ernst-Fortin, R.L. Small, Knowledge base development tool requirements for an intelligent monitoring aid, in: Proceedings of the Tenth International Florida Artificial Intelligence Research Symposium, 1997, pp. 412-416.
8. T.W. Bickmorse, Personal communication, NASA Aerojet Propulsion Division, Sacramento, CA, 1994.
9. B.J. Borghetti, E.M. Williams, E. Santos Jr., Inferencing over incomplete solution spaces with genetic algorithms for probabilistic reasoning, in: Proceedings of the Seventh Midwest AI and Cognitive Science Conference, 1996.
10. S.T. Branch, CLIPS Reference Manual, NASA, Lyndon B. Johnson Space Center, Information Systems Directorate, Software Technology Branch, Houston, TX, 1991.
11. S.M. Brown, E. Santos Jr., Active user interfaces, Technical Report IDIS Technical Report 101, Intelligent Distributed Information Systems Lab, University of Connecticut, 1999.
12. S.M. Brown, R.A. Harrington, E. Santos Jr., S.B. Banks, User models, intelligent interface agents and expert systems, in: Proceedings of the Sixth International Conference on User Modeling Workshop on Embedding User Models in Intelligent Applications, 1997, pp. 12-16.
13. S.M. Brown, E. Santos Jr., S.B. Banks, A dynamic Bayesian intelligent interface agent, in: Proceedings of Interfaces '97 - Sixth International Conference, 1997, pp. 118-120.
14. S.M. Brown, E. Santos Jr., S.B. Banks, Active user interfaces for building decision-theoretic systems, in: Proceedings of the First Asia-Pacific Conference on Intelligent Agent Technology, 1999.
15. L.J. Burnell, Intelligent software maintenance, PC AI (1996) 16-21.
16. E. Charniak, Bayesian networks without tears, AI Magazine 12 (4) (1991) 50-63.
17. D. Dubois, H. Prade, L. Godo, R.L. de Mantaras, A symbolic approach to reasoning with linguistic quantifiers, in: Proceedings of the Conference on Uncertainty in Artificial Intelligence, 1992, pp. 74-82.
18. C. Elsaesser, M. Henrion, Verbal expressions for probability updates: How much more probable is 'much more probable'?, in: M. Henrion, , R.D. Shachter, , L. Kanal, J. Lemmer (Eds.), Uncertainty in Artificial Intelligence 5, Elsevier, Amsterdam, 1990.
19. U.M. Fayyad, R. Uthurusamy (Eds.), in: Proceedings of the First International Conference on Knowledge Discovery and Data Mining, AAAI Press, Menlo Park, CA, 1995.
20. U.M. Fayyad, R. Uthurusamy (Eds.), in: Proceedings of the Second International Conference on Knowledge Discovery and Data Mining, AAAI Press, Menlo Park, CA, 1996.
21. A. Gilio, Conditional events and subjective probability in management of uncertainty, in: B.B.-M., et al. (Ed.), Uncertainty in Intelligent Systems, Elsevier, Amsterdam, 1993.
22. M. Goldszmidt, J. Pearl, Reasoning with qualitative probabilities can be stractable, in: Proceedings of the Conference on Uncertainty in Artificial Intelligence, 1992, pp. 112-120.
23. A.J. Gonzalez, D.D. Dankel, The Engineering of Knowledge-Based Systems: Theory and Practice, Prentice-Hall, Englewood Cliffs, NJ, 1993.
24. R.A. Harrington, S.B. Banks, E. Santos Jr., Development of an intelligent user interface for a generic expert system, in: Proceedings of the Seventh Midwest AI and Cognitive Science Conference, 1996.
25. R.A. Harrington, S.B. Banks, E. Santos Jr., Gesia: Uncertainty-based reasoning for a generic expert system intelligent user interface, in: Proceedings of the Eighth IEEE International Conference on Tools with Artificial Intelligence, 1996, pp. 52-55.
26. P.M. Healey, E.J. Jacobson, Common Medical Diagnoses: An Algorithmic Approach, W.B. Saunders, London, 1990.
27. D. Heckerman, M. Shwe, Diagnosis of multiple faults: A sensitivity analysis, in: Proceedings of the Conference on Uncertainty in Artificial Intelligence, 1993, pp. 80-87.
28. K.B. Laskey, Conflict and surprise: Heuristics for model revision, in: Proceedings of the Conference on Uncertainty in Artificial Intelligence, Morgan Kaufmann, Los Altos, CA, 1991.
29. K.B. Laskey, Sensitivity analysis for probability assessments in Bayesian networks, IEEE Transactions on Systems, Man, and Cybernetics 25 (6) (1995) 901-909.
30. R. Lippmann, An introduction to computing with neural nets, IEEE ASSP Magazine (1987) 4-22.
31. P. Meseguer, A. Verdaguer, Verification of multi-level rule-based expert systems: Theory and practice, International Journal of Expert Systems 6 (1993) 163-192.
32. T. Nguyen, W. Perkins, T. Laffey, D. Pecora, Checking an expert system's knowledge base for consistency and completeness, in: Proceedings of the Ninth International Joint Conference on Artificial Intelligence, 1985, pp. 375-378.
33. T. Nguyen, Verifying consistency of production systems, in: Proceedings of the Third IEEE Conference on Artificial Intelligence Applications, 1987, pp. 4-8.
34. R.M. O'Keefe, O. Bald, E.P. Smith, Validating expert system performance, IEEE Expert 2 (4) (1987) 81-90.
35. D. O'Leary, Validation of blackboard systems: On the order of knowledge sources, in: Proceedings of the AAAI Workshop on Verification & Validation of Knowledge-Based Systems, 1997, pp. 47-52.
36. J. Pearl, Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Morgan Kaufmann, Morgan Kaufmann, San Mateo, CA, 1988.
37. M. Pradhan, M. Henrion, G.M. Provan, B.D. Favero, K. Huang, The sensitivity of belief networks to imprecise probabilities: An experimental investigation, Aritificial Intelligence 85 (1-2) (1996) 363-397.
38. G.R. Prakash, H. Mahabala, Svepoa: A tool to aid verification and validation of ops5-based AI applications, International Journal of Expert Systems 6 (1993) 193-236.
39. A. Preece, Towards a methodology for evaluating expert systems, Expert Systems 7 (1990) 215-223.
40. A.D. Preece, Validation of knowledge-based systems: Current trends and issues, The Knowledge Engineering Review 10 (1) (1995) 69-71.
41. J.R. Quinlan, Induction of decision trees, Machine Learning 1 (1) (1986) 81-106.
42. S. Ram, S. Ram, Design and validation of a knowledge-based system for screening product innovations, IEEE Transactions on Systems, Man, and Cybernetics (Part A) 26 (2) (1996) 213-221.
43. Space transportation system training data, SSME orientation (part a - engine). Rocketdyne Division, Rockwell International Corporation, 1988.
44. R.A. Riemenschneider, T.A. Linden, K. Morgan, W. Vrotney, Verification and validation of AI software, Technical Report RL-TR-92-118, Rome Laboratory, Air Force Systems Command, USAF, 1992.
45. D.E. Rumelhart, J.L. McClelland, Parallel Distributed Processing: Explorations in the Microstrctures of Cognition, Vol. 1, MIT Press, Cambridge, MA, 1986.
46. Reusable rocket engine turbopump health management system, Technical Report Final Report, Contract NAS3-25882, Science Applications International Corporation, 1994.
47. E. Santos Jr., E.S. Santos, A framework for building knowledge-bases under uncertainty, Journal of Experimental and Theoretical Artificial Intelligence 11 (1999) 265-286.
48. E. Santos Jr., S.E. Shimony, Belief updating by enumerating high-probability independence-based assignments, in: Proceedings of the Conference on Uncertainty in Artificial Intelligence, 1994, pp. 506-513.
49. E. Santos Jr., D.O. Banks, S.B. Banks, Mack: A tool for acquiring consistent knowledge under uncertainty, in: Proceedings of the AAAI Workshop on Verification and Validation of Knowledge-Based Systems, 1997, pp. 23-32.
50. E. Santos Jr., S.B. Banks, S.M. Brown, D.J. Bawcom, Identifying and handling structural incompleteness for validation of probabilistic knowledge-bases, in: Proceedings of the 12th International FLAIRS Conference, 1999, pp. 506-510.
51. E. Santos Jr., H.T. Gleason, S.B. Banks, Bval: Probabilistic knowledge-base validation, in: Proceedings of the AAAI Workshop on Verification and Validation of Knowledge-Based Systems, 1997, pp. 13-22.
52. S.E. Shimony, E. Santos Jr., Exploiting case-based independence for approximating marginal probabilities, International Journal of Approximate Reasoning 14 (1) (1996) 25-54.
53. S.E. Shimony, C. Domshlak, E. Santos Jr., Cost-sharing heuristic for bayesian knowledge-bases, in: Proceedings of the Conference on Uncertainty in Artificial Intelligence, 1997, pp. 421-428.
54. S.E. Shimony, Explanation, irrelevance and statistical independence, in: Proceedings of the AAAI Conference, 1991.
55. S.E. Shimony, The role of relevance in explanation I: Irrelevance as statistical independence, International Journal of Approximate Reasoning 8 (4) (1993) 281-324.
56. D.J. Spiegelhalter, R.C.G. Franklin, K. Bull, Assessment, criticism and improvement of imprecise subjective probabilities for a medical expert system, in: M. Henrion, , R.D. Shachter, , L. Kanal, J. Lemmer (Eds.), Uncertainty in Artificial Intelligence 5, Elsevier, Amsterdam, 1990.
57. D.J. Stein, S.B. Banks, E. Santos Jr., M. Talbert, Utilizing goal-directed data mining for incompleteness repair in knowledge bases, in: Proceedings of the Eighth Midwest AI and Cognitive Science Conference, 1997, pp. 82-85.
58. E. Williams, E. Santos Jr., S.E. Shimony, Experiments with distributed anytime inferencing: Working with cooperative algorithms, in: Proceedings of the AAAI Workshop on Building Resource-Bounded Reasoning Systems, 1997, pp. 86-91.
59. X.-J.M. Zhou, T.S. Dillon, Theoretical and practical considerations of uncertainty and complexity in automated knowledge acquisition, IEEE Transactions on Knowledge and Data Engineering 7 (5) (1995) 699-712.