Characterizing the principle of minimum cross-entropy within a conditional-logical framework

Artificial Intelligence

Volumn 98, Issue 1-2, 1998, Pages 169-208

  Kern Isberner, Gabriele ^a  

^a UNIVERSITY OF HAGEN   (Germany)

Author keywords

Conditionals; Expert systems; Knowledge representation; Minimum cross entropy; Nonmonotonic reasoning; Probabilistic reasoning

Indexed keywords

EXPERT SYSTEMS; KNOWLEDGE REPRESENTATION; PROBABILISTIC LOGICS; PROBABILITY;

CONDITIONAL LOGICAL FRAMEWORK; MINIMUM CROSS ENTROPY (ME) PRINCIPLE; NONMONOTONIC REASONING;

INFORMATION THEORY;

EID: 0031652218     PISSN: 00043702     EISSN: None     Source Type: Journal    
DOI: 10.1016/s0004-3702(97)00068-4     Document Type: Article

References (36)

1. J. Aczél, Vorlesungen über Funktionalgleichungen und ihre Anwendungen (Birkhäuser, Basel, 1961).
2. E.W. Adams, The Logic of Conditionals (Reidel, Dordrecht, 1975).
3. F. Bacchus, Representing and Reasoning with Probabilistic Knowledge: A Logical Approach to Probabilities (MIT Press, Cambridge, MA, 1990).
4. G. Brewka, Preferred subtheories: an extended logical framework for default reasoning, in: Proceedings IJCAI-89, Vol. 2 (Morgan Kaufmann, San Mateo, CA, 1989) 1043-1048.
5. P.G. Calabrese, Deduction and inference using conditional logic and probability, in: I.R. Goodman, M.M. Gupta, H.T. Nguyen and G.S. Rogers, eds., Conditional Logic in Expert Systems (North-Holland, Amsterdam, 1991) 71-100.
6. I. Csiszár, I-divergence geometry of probability distributions and minimization problems, Ann. Probab. 3 (1975) 146-158.
7. B. De Finetti, Theory of Probability, Vols. 1 and 2 (John Wiley and Sons, New York, 1974).
8. D. Dubois and H. Prade, Conditional objects and non-monotonic reasoning, in: Proceedings 2nd International Conference on Principles of Knowledge Representation and Reasoning (KR-91) (Morgan Kaufmann, Los Altos, CA, 1991) 175-185.
9. P. Gaerdenfors, Knowledge in Flux: Modeling the Dynamics of Epistemic States (MIT Press, Cambridge, MA, 1988).
10. H. Geffner, Default Reasoning: Causal and Conditional Theories (MIT Press, Cambridge, MA, 1992).
11. M. Goldszmidt, Research issues in qualitative and abstract probability, AI Mag. (Winter 1994) 63-66.
12. M. Goldszmidt and J. Pearl, Rank-based systems: a simple approach to belief revision, belief update and reasoning about evidence and actions, in: Proceedings 3rd International Conference on Principles of Knowledge Representation and Reasoning (KR-92), Cambridge, MA (1992) 661-672.
13. I.J. Good, Maximum entropy for hypothesis formulation, especially for multidimensional contingency tables, Ann. Math. Statist. 34 (1963) 911-934.
14. A.J. Grove, J.Y. Halpern and D. Koller, Random worlds and maximum entropy, J. Artif. Intell. Res. 2 (1994) 33-88.
15. P. Hajek, T. Havranek and R. Jirousek, Uncertain Information Processing in Expert Systems (CRC Press, Boca Raton, FL, 1992).
16. E.T. Jaynes, Papers on Probability, Statistics and Statistical Physics (Reidel, Dordrecht, 1983).
17. R.W. Johnson and J.E. Shore, Comments on and correction to "Axiomatic derivation of the principle of maximum entropy and the principle of minimum cross-entropy", IEEE Trans. Inform. Theory 29 (6) (1983) 942-943.
18. G. Kern-Isberner, Conditional logics and entropy, Informatik Fachbericht 203, FernUniversität Hagen (1996).
19. G. Kern-Isberner, A logically sound method for uncertain reasoning with quantified conditionals, in: Proceedings 1st International Conference on Qualitative and Quantitative Practical Reasoning, ECSQARU-FAPR'97 (Springer, Berlin, 1997) 365-379.
20. S. Kraus, D. Lehmann and M. Magidor, Nonmonotonic reasoning, preferential models and cumulative logics, Artificial Intelligence 44 (1990) 167-207.
21. S. Kullback, Information Theory and Statistics (Dover, New York, 1968).
22. S.L. Lauritzen and D.J. Spiegelhalter, Local computations with probabilities in graphical structures and their applications to expert systems, J. Roy. Statist. Soc. Ser. B 50 (2) (1988) 415-448.
23. R.C. Lyndon and P.E. Schu, Combinatorial Group Theory (Springer, Berlin, 1977).
24. D. Makinson, General patterns in nonmonotonic reasoning, in: D.M. Gabbay, C.H. Hogger and J.A. Robinson, eds., Handbook of Logic in Artificial Intelligence and Logic Programming, Vol. 3 (Oxford University Press, Oxford, 1994) 35-110.
25. D. Nute, Topics in Conditional Logic (Reidel, Dordrecht, 1980).
26. J.B. Paris and A. Vencovská, A note on the inevitability of maximum entropy, Internat. J. Approximate Reasoning 14 (1990) 183-223.
27. J.B. Paris and A. Vencovská, In defence of the maximum entropy inference process. Internat. J. Approximate Reasoning, to appear.
28. J. Pearl, Probabilistic Reasoning in Intelligent Systems (Morgan Kaufmann, San Mateo, CA, 1988).
29. J. Pearl, Bayesian and belief-functions formalisms for evidential reasoning: A conceptual analysis, in: Z.W. Ras and M. Zemankova, eds., Intelligent Systems - State of the Art and Future Directions (Ellis Horwood, Chichester, 1990) 73-117.
30. W. Rödder and G. Kern-Isberner, Representation and extraction of information by probabilistic logic, Inform. Systems 21 (8) (1997) 637-652.
31. W. Rödder and C.-H. Meyer, Coherent knowledge processing at maximum entropy by spirit, in: E. Horvitz and F. Jensen, eds., Proceedings 12th Conference on Uncertainty in Artificial Intelligence, Portland, OR (Morgan Kaufmann, San Francisco, CA, 1996) 470-476.
32. J.E. Shore, Relative entropy, probabilistic inference and AI, in: L.N. Kanal and J.F. Lemmer, eds., Uncertainty in Artificial Intelligence (North-Holland, Amsterdam, 1986) 211-215.
33. J.E. Shore and R.W. Johnson, Axiomatic derivation of the principle of maximum entropy and the principle of minimum cross-entropy, IEEE Trans. Inform. Theory 26 (1980) 26-37.
34. J.E. Shore and R.W. Johnson, Properties of cross-entropy minimization, IEEE Trans. Inform. Theory 27 (1981) 472-482.
35. M. Spies, Combination of evidence with conditional objects and its application to cognitive modeling, in: I.R. Goodman, M.M. Gupta, H.T. Nguyen and C.S. Rogers, eds., Conditional Logic in Expert Systems (North-Holland, Amsterdam, 1991) 181-209.
36. J. Whittaker, Graphical Models in Applied Multivariate Statistics (John Wiley & Sons, New York, 1990).