Measures of uncertainty in expert systems

Artificial Intelligence

Volumn 83, Issue 1, 1996, Pages 1-58

  Walley, Peter ^a  

^a UNIVERSITY OF WESTERN AUSTRALIA   (Australia)

Author keywords

Bayesian theory; Belief functions; Conditional probability; Decision; Dempster Shafer theory; Imprecise probabilities; Independence; Inference; Lower probability; Possibility theory; Prevision; Upper probability

Indexed keywords

BAYESIAN THEORY; BELIEF FUNCTIONS; COHERENT LOWER PREVISIONS; CONDITIONAL PROBABILITY; DEMPSTER-SHAFER THEORY; IMPRECISE PROBABILITIES; LOWER PROBABILITY; POSSIBILITY THEORY;

DECISION THEORY; FUZZY SETS; PROBABILITY;

EXPERT SYSTEMS;

EID: 0030146168     PISSN: 00043702     EISSN: None     Source Type: Journal    
DOI: 10.1016/0004-3702(95)00009-7     Document Type: Article

References (122)

1. K.-P. Adlassnig and G. Kolarz, CADIAG-2: computer-assisted medical diagnosis using fuzzy subsets, in: M.M. Gupta and E. Sanchez, eds., Approximate Reasoning in Decision Analysis (North-Holland, Amsterdam, 1982) 219-247.
2. S.K. Andersen, K.G. Olesen, F.V. Jensen and F. Jensen, HUGIN - a shell for building Bayesian belief universes for expert systems, in: Proceedings IJCAI-89, Detroit, MI (Morgan Kaufmann, San Mateo, CA, 1989) 1080-1085.
3. R. Beyth-Marom, How probable is probable? Numerical translations of verbal probability expressions, J. Forecasting 1 (1982) 257-269.
4. G. Biswas and T.S. Anand, Using the Dempster-Shafer scheme in a mixed-initiative expert system shell, in: L.N. Kanal, T.S. Levitt and J.F. Lemmer, eds., Uncertainty in Artificial Intelligence 3 (North-Holland, Amsterdam, 1989) 223-239.
5. G. Biswas, M. Oliff and R. Abramczyk, OASES (Operations Analysis Expert System): an application in fiberglass manufacturing. Int. J. Expert Syst. Res. Appl. 1 (1988) 193-216.
6. B.G. Buchanan and E.H. Shortliffe, eds., Rule-Based Expert Systems (Addison-Wesley, Reading, MA, 1984).
7. J.-C. Buisson, H. Farreny and H. Prade, The development of a medical expert system and the treatment of imprecision in the framework of possibility theory. Inf. Sci. 37 (1985) 211-226.
8. R. Buxton, Modelling uncertainty in expert systems. Int. J. Man-Mach. Stud. 31 (1989) 415-476.
9. L.M. De Campos, M.T. Lamata and S. Moral, The concept of conditional fuzzy measure, Int. J. Intell. Syst. 5 (1990) 237-246.
10. J.E. Cano, S. Moral and J.F. Verdegay, Propagation of convex sets of probabilities in directed acyclic networks, in: Proceedings Fourth IPMU Conference (1992) 289-292.
11. P. Cheeseman, Probabilistic versus fuzzy reasoning, in: L.N. Kanal and J.F. Lemmer, eds., Uncertainty in Artificial Intelligence (North-Holland, Amsterdam, 1986) 85-102.
12. L.J. Cohen, The Probable and the Provable (Clarendon Press, Oxford. 1977).
13. P.R. Cohen, Heuristic Reasoning about Uncertainty: An Artificial Intelligence Approach (Pitman, London, 1985).
14. R.G. Cowell, BAIES - a probabilistic expert system shell with qualitative and quantitative learning, in: J.M. Bernardo, J.O. Berger, A.P. Dawid and A.F.M. Smith, eds., Bayesian Statistics 4 (Clarendon Press, Oxford, 1992) 595-600.
15. A.P. Dempster, Upper and lower probabilities induced by a multivalued mapping, Ann. Math. Stat. 38 (1967) 325-339.
16. D. Dubois and H. Prade, An introduction to possibilistic and fuzzy logics, in: P. Smets, A. Mamdani, D. Dubois and H. Prade, eds., Non-Standard Logics for Automated Reasoning (Academic Press, London, 1988) 287-326.
17. D. Dubois and H. Prade, Possibility Theory (Plenum Press, New York, 1988).
18. D. Dubois and H. Prade, Modelling uncertain and vague knowledge in possibility and evidence theories, in: R.D. Shachter, T.S. Levitt, L.N. Kanal and J.F. Lemmer, eds., Uncertainty in Artificial Intelligence 4 (North-Holland, Amsterdam, 1990) 303-318.
19. D. Dubois and H. Prade, Evidence, knowledge, and belief functions, Int. J. Approx. Reasoning 6 (1992) 295-319.
20. R.O. Duda, P.E. Hart and N.J. Nilsson, Subjective Bayesian methods for rule-based inference systems, in: Proceedings 1976 National Computer Conference, AFIPS 45 (1976) 1075-1082; also in: B.W. Webber and N.J. Nilsson. eds., Readings in Artificial Intelligence (Morgan Kaufmann, Los Altos, CA, 1981) 192-199.
21. R.O. Duda, P.E. Hart and N.J. Nilsson, Subjective Bayesian methods for rule-based inference systems, in: Proceedings 1976 National Computer Conference, AFIPS 45 (1976) 1075-1082; also in: B.W. Webber and N.J. Nilsson. eds., Readings in Artificial Intelligence (Morgan Kaufmann, Los Altos, CA, 1981) 192-199.
22. R.O. Duda and R. Reboh, AI and decision making: the PROSPECTOR experience, in: W. Reitman, ed., Artificial Intelligence Applications for Business (Ablex, Norwood, NJ, 1984) 111-147.
23. A. Dutta, Reasoning with imprecise knowledge in expert systems, Inf. Sci. 37 (1985) 3-24.
24. R. Fagin and J.Y. Halpern, A new approach to updating beliefs, in: P.P. Bonissone, M. Henrion, L.N. Kanal and J.F. Lemmer, eds., Uncertainty in Artificial Intelligence 6 (North-Holland, Amsterdam, 1991) 347-374.
25. H. Farreny, H. Prade and E. Wyss. Approximate reasoning in a rule-based expert system using possibility theory: a case study, in: H.J. Kugler, ed., Information Processing '86 (North-Holland, Amsterdam, 1986) 407-413.
26. K.W. Fertig and J.S. Breese, Interval influence diagrams, in: M. Henrion, R.D. Shachter, L.N. Kanal and J.F. Lemmer, eds., Uncertainty in Artificial Intelligence 5 (North-Holland, Amsterdam, 1990) 149-161.
27. M. Fieschi, M. Joubert, D. Fieschi, G. Botti and M. Roux, A program for expert diagnosis and therapeutic decision, Wed. Inf. 8 (1983) 127-135.
28. T.L. Fine, Theories of Probability (Academic Press, New York, 1973).
29. B. de Finetti, Theory of Probability Vol. 1 (Wiley, London, 1974).
30. B. de Finetti, Theory of Probability Vol. 2 (Wiley, London, 1975).
31. L.C. van der Gaag, Computing probability intervals under independency constraints, in: P.P. Bonissone, M. Henrion, L.N. Kanal and J.F. Lemmer, eds., Uncertainty in Artificial Intelligence 6 (North-Holland, Amsterdam, 1991) 457-466.
32. W.A. Gale, ed., Artificial Intelligence and Statistics (Addison-Wesley, Reading, MA, 1986).
33. R. Giles, Foundations for a theory of possibility, in: M.M. Gupta and E. Sanchez, eds., Fuzzy Information and Decision Processes (North-Holland, Amsterdam, 1982) 183-195.
34. R. Giles, Semantics for fuzzy reasoning. Int. J. Man-Mach. Stud. 17 (1982) 401-415.
35. J. Gordon and E.H. Shortliffe, A method for managing evidential reasoning in a hierarchical hypothesis space, Artif. Intell. 26 (1985) 323-357.
36. B.N. Grosof, An inequality paradigm for probabilistic knowledge, in: L.N. Kanal and J.F. Lemmer, eds., Uncertainty in Artificial Intelligence (North-Holland, Amsterdam, 1986) 259-275.
37. J.Y. Halpern and R. Fagin, Two views of belief: belief as generalized probability and belief as evidence, Artif. Intell. 54 (1992) 275-317.
38. D. Heckerman, E. Horvitz and B. Nathwani, Toward normative expert systems I: the PATHFINDER project, Methods Inf. Med. 31 (1992) 90-105.
39. M. Henrion, J.S. Breese and E.J. Horvitz, Decision analysis and expert systems, AI Magazine 12 (1991) 64-91.
40. Y.-T. Hsia and P.P. Shenoy, An evidential language for expert systems, in: Z. Ras, ed., Methodologies for Intelligent Systems 4 (North-Holland, New York, 1989) 9-16.
41. P.J. Huber, Robust Statistics (Wiley, New York, 1981).
42. J.-Y Jaffray, Bayesian updating and belief functions, IEEE Trans. Syst. Man Cybern. 22 (1992) 1144-1152.
43. E.T. Jaynes, Papers on Probability, Statistics and Statistical Physics (Reidel, Dordrecht, 1983).
44. F.V. Jensen, S.K. Andersen, U. Kjaerulff and S. Andreassen, MUNIN - on the case for probabilities in medical expert systems. Lecture Notes in Medical Informatics 33 (Springer, Berlin, 1987).
45. A.C. Kak, K.M. Andress, C. Lopez-Abadia, M.S. Caroll and J.R. Lewis, Hierarchical evidence accumulation in the PSEIKI system, in: M. Henrion, R.D. Shachter, L.N. Kanal and J.F. Lemmer, eds., Uncertainty in Artificial Intelligence 5 (North-Holland, Amsterdam, 1990).
46. S. Kent, Words of estimated probability, Stud. Intell. 8 (1964) 49-65.
47. G.J. Klir and T.A. Folger, Fuzzy Sets, Uncertainty, and Information (Prentice-Hall, Englewood Cliffs, NJ, 1988).
48. P. Krause and D. Clark, Representing Uncertain Knowledge (Kluwer, Dordrecht, 1993).
49. H.E. Kyburg Jr, Bayesian and non-Bayesian evidential updating, Artif. Intell. 31 (1987)271-293.
50. K.B. Laskey, M.S. Cohen and A.W. Martin, Representing and eliciting knowledge about uncertain evidence and its implications, IEEE Trans. Syst. Man Cybern. 19 (1989) 536-557.
51. S.L. Lauritzen and D.J. Spiegelhalter, Local computations with probabilities on graphical structures and their application to expert systems (with discussion), J. Roy. Stat. Soc. Ser. B 50 (1988) 157-224.
52. J. Lebailly, R. Martin-Clouaire and H. Prade, Use of fuzzy logic in rule-based systems in petroleum geology, in: E. Sanchez and L.A. Zadeh, eds., Approximate Reasoning in Intelligent Systems, Decision and Control (Pergamon Press, Oxford, 1987) 125-144.
53. J.F. Lemmer, Generalised Bayesian updating of incompletely specified distributions. Large Scale Syst. 5 (1983) 51-68.
54. K.S. Leung, W.S.F. Wong and W. Lam, Applications of a novel fuzzy expert system shell, Expert Syst. 6 (1989) 2-10.
55. I. Levi, Potential surprise: its role in inference and decision making, in: L.J. Cohen and M. Hesse, eds., Applications of Inductive Logic (Oxford University Press, Oxford, 1980) 1-27.
56. I. Levi, Consonance, dissonance and evidentiary mechanisms, in: P. Gärdenfors, B. Hansson and N.E. Sahlin, eds., Evidentiary Value, Library of Theoria 15 (Gleerups, Lund, 1983) 27-43.
57. D.V. Lindley, Making Decisions (Wiley, London, 1971).
58. R.P. Loui, Interval-based decisions for reasoning systems, in: L.N. Kanal and J.F. Lemmer, eds., Uncertainty in Artificial Intelligence (North-Holland, Amsterdam, 1986) 459-472.
59. J.D. Lowrance, Automated argument construction, J. Stat. Planning Inference 20 (1988) 369-387.
60. R.C. Moore, Semantical considerations on nonmonotonic logic, Artif. Intell. 25 (1985) 75-94.
61. N.J. Nilsson, Probabilistic logic, Artif. Intell. 28 (1986) 71-87.
62. P. Orponen, Dempster's rule is #P-complete, Artif. Intell. 44 (1990) 245-253.
63. G. Paass, Probabilistic logic, in: P. Smets, A. Mamdani, D. Dubois and H. Prade, eds., Non-Standard Logics for Automated Reasoning (Academic Press, London, 1988) 213-251.
64. J. Pearl, Probabilistic Reasoning in Intelligent Systems (Morgan Kaufmann, San Mateo, CA, 1988).
65. J. Pearl, Reasoning with belief functions: an analysis of compatibility, Int. J. Approx. Reasoning 4 (1990) 363-389.
66. J. Pearl, Rejoinder to comments on "Reasoning with belief functions: an analysis of compatibility", Int. J. Approx. Reasoning 6 (1992) 425-443.
67. J.R. Quinlan, Inferno: a cautious approach to uncertain inference, Comput. J. 26 (1983) 255-269.
68. R. Reiter, A logic for default reasoning, Artif. Intell. 13 (1980) 81-132.
69. R. Reiter, Nonmonotonic reasoning, Ann. Rev. Comput. Sci. 2 (1987) 147-186.
70. A. Saffiotti and E. Umkehrer, PULCINELLA: a general tool for propagating uncertainty in valuation networks, in: B.D. D'Ambrosio, P. Smets and P.P. Bonissone, eds., Proceedings Seventh International Conference on Uncertainty in AI, Los Angeles, CA (Morgan Kaufmann, San Mateo, CA, 1991) 323-331.
71. G.L.S. Shackle, Decision, Order, and Time in Human Affairs (Cambridge University Press, Cambridge, 1969).
72. G. Shafer, A Mathematical Theory of Evidence (Princeton Universtiy Press, Princeton, NJ, 1976).
73. G. Shafer, Constructive probability, Synthese 48 (1981) 1-60.
74. G. Shafer, Belief functions and parametric models (with discussion), J. Roy. Stat. Soc. Ser. B 44 (1982) 322-352.
75. G. Shafer, Probability judgement in artificial intelligence and expert systems, Stat. Sci. 2 (1987) 3-16.
76. G. Shafer, Perspectives on the theory and practice of belief functions, Int. J. Approx. Reasoning 4 (1990) 323-362.
77. G. Shafer, Rejoinders to comments on "Perspectives on the theory and practice of belief functions", Int. J. Approx. Reasoning 6 (1992) 445-480.
78. G. Shafer and R. Logan, Implementing Dempster's rule for hierarchical evidence, Artif. Intell. 33 (1987) 271-298.
79. P. Shenoy and G. Shafer, Propagating belief functions with local computations, IEEE Expert 1 (3) (1986) 43-52.
80. F.K.J. Sheridan, A survey of techniques for inference under uncertainty, Artif. Intell. Rev. 5 (1991) 89-119.
81. E.H. Shortliffe, Computer-Based Medical Consultations: MYCIN (Elsevier, New York, 1976).
82. E.H. Shortliffe and B.G. Buchanan, A model of inexact reasoning in medicine, Math. Biosci. 23 (1975) 351-379.
83. P. Smets, Belief functions, in: P. Smets, A. Mamdani, D. Dubois and H. Prade, eds., Non-Standard Logics for Automated Reasoning (Academic Press, London, 1988) 253-286.
84. P. Smets, The transferable belief model and other interpretations of Dempster-Shafer's model, in: P.P. Bonissone, M. Henrion, L.N. Kanal and J.F. Lemmer, eds., Uncertainty in Artificial Intelligence 6 (North-Holland, Amsterdam, 1991) 375-383.
85. P. Smets, Resolving misunderstandings about belief functions, Int. J. Approx. Reasoning 6 (1992) 321-344.
86. P. Smets and R. Kennes, The transferable belief model, Artif. Intell. 66 (1994) 191-234.
87. P. Smets, A. Mamdani, D. Dubois and H. Prade, eds., Non-Standard Logics for Automated Reasoning (Academic Press, London, 1988).
88. C.A.B. Smith, Consistency in statistical inference and decision (with discussion), J. Roy. Stat. Soc. Ser. B 23 (1961) 1-37.
89. M. Smithson, Ignorance and Uncertainty (Springer, Berlin, 1989).
90. D.J. Spiegelhalter, A statistical view of uncertainty in expert systems, in: W.A. Gale, ed., Artificial Intelligence and Statistics (Addison-Wesley, Reading, MA, 1986).
91. D.J. Spiegelhalter, A.P. Dawid, S.L. Lauritzen and R.G. Cowell, Bayesian analysis in expert systems (with discussion), Stat. Sci. 8 (1993) 219-283.
92. D.J. Spiegelhalter and R.P. Knill-Jones, Statistical and knowledge-based approaches to clinical decision-support systems, with an application in gastroenterology (with discussion), J. Roy. Stat. Soc. Ser. A 147 (1984) 35-76.
93. T.M. Strat, Decision analysis using belief functions, Int. J. Approx. Reasoning 4 (1990) 391-417.
94. C. Sundberg and C. Wagner, Generalized finite differences and Bayesian conditioning of Choquet capacities. Unpublished manuscript (1991).
95. B. Tessem, Interval probability propagation, Int. J. Approx. Reasoning 7 (1992) 95-120.
96. F. Voorbraak, On the justification of Dempster's rule of combination, Artif. Intell. 48 (1991) 171-197.
97. P. Walley, Coherent lower (and upper) probabilities, Statistics Research Report, University of Warwick, Coventry (1981).
98. P. Walley, The elicitation and aggregation of beliefs, Statistics Research Report, University of Warwick, Coventry (1982).
99. P. Walley, Belief function representations of statistical evidence, Ann. Stat. 15 (1987) 1439-1465.
100. P. Walley, Statistical Reasoning with Imprecise Probabilities (Chapman and Hall, London, 1991).
101. P. Walley, Measures of uncertainty in expert systems, Statistics Research Report, Department of Mathematics, University of Western Australia, Perth (1991).
102. P. Walley, Inferences from multinomial data: learning about a bag of marbles (with discussion), J. Roy. Stat. Soc. Ser. B 58 (1996) 3-57.
103. P. Walley, Statistical inferences based on a second-order possibility distribution (with discussion), J. Am. Star. Assoc. 91 (1996).
104. P. Walley and F.M. Campello de Souza, Uncertainty and indeterminacy in assessing the economic viability of energy options: a case study of solar heating systems in Brazil, Energy Syst. Policy 14 (1990) 281-304.
105. P. Walley and T.L. Fine, Varieties of modal (classificatory) and comparative probability, Synthese 41 (1979) 321-374.
106. P. Walley and T.L. Fine, Towards a frequentist theory of upper and lower probability, Ann. Stat. 10 (1982) 741-761.
107. T.S. Wallsten, D.V. Budescu, A. Rapoport, R. Zwick and B. Forsyth, Measuring the vague meanings of probability terms, J. Exper. Psych. General 115 (1986) 348-365.
108. L.A. Wasserman, Comments on Shafer's "Perspectives on the theory and practice of belief functions", Int. J. Approx. Reasoning 6 (1992) 367-375.
109. L.A. Wasserman and J. Kadane, Bayes' theorem for Choquet capacities, Ann. Stat. 18 (1990) 1328-1339.
110. S.R. Watson, J.J. Weiss and M.L. Donnell, Fuzzy decision analysis, IEEE Trans. Syst. Man Cybern. 9 (1979) 1-9.
111. P.M. Williams, Indeterminate probabilities, in: M. Przelecki, K. Szaniawski and R. Wojcicki, eds., Formal Methods in the Methodology of Empirical Sciences (Reidel, Dordrecht, 1976) 229-246.
112. N. Wilson, A Monte-Carlo algorithm for Dempster-Shafer belief, in: B.D. D'Ambrosio, P. Smets and P.P. Bonissone, eds., Proceedings Seventh International Conference on Uncertainty in AI, Los Angeles, CA (Morgan Kaufmann, San Mateo, CA, 1991) 414-417.
113. N. Wilson, The combination of belief: when and how fast?, Int. J. Approx. Reasoning 6 (1992) 377-388.
114. N. Wilson and S. Moral, A logical view of probability, in: A. Cohn, ed., Proceedings Eleventh European Conference on Artificial Intelligence (Wiley, London, 1994) 386-390.
115. H. Xu, An efficient implementation of belief function propagation, in: B.D. D'Ambrosio, P. Smets and P.P. Bonissone, eds., Proceedings Seventh International Conference on Uncertainty in AI, Los Angeles, CA (Morgan Kaufmann, San Mateo, CA, 1991) 425-432.
116. R.R. Yager, An introduction to applications of possibility theory (with discussion), Human Syst. Manage. 3 (1983) 246-269.
117. L.A. Zadeh, Fuzzy sets. Inf. Control 8 (1965) 338-353.
118. L.A. Zadeh, The concept of a linguistic variable and its application to approximate reasoning (Part 3), Inf. Sci. 9 (1976) 43-80.
119. L.A. Zadeh, Fuzzy sets as a basis for a theory of possibility, Fuzzy Sets Syst. 1 (1978) 3-28.
120. L.A. Zadeh, A theory of approximate reasoning, in: J. Hayes, D. Michie and L.I. Mikulich, eds., Machine Intelligence 9 (Halstead Press, New York, 1979) 149-194.
121. L.A. Zadeh, The role of fuzzy logic in the management of uncertainty in expert systems, Fuzzy Sets Syst. 11 (1983) 199-227.
122. L.A. Zadeh, Is probability theory sufficient for dealing with uncertainty in AI: a negative view, in: L.N. Kanal and J.F. Lemmer, eds., Uncertainty in Artificial Intelligence (North-Holland, Amsterdam, 1986) 103-116.