Measures of uncertainty and information based on possibility distributions

International Journal of General Systems

Volumn 9, Issue 1, 1982, Pages 43-58

  Higashi, Masahiko ^a   Klir, George J ^b  

^a KYOTO UNIVERSITY   (Japan)

^b BINGHAMTON UNIVERSITY   (United States)

Author keywords

conditional uncertainly; Information; possibility distribution; possibility measure; possibility theory; probability theory; Shannon entropy. Hartley information; U uncertainty; uncertainty

Indexed keywords

THEORY OF INFORMATION; U INFORMATION; U UNCERTAINTY;

SYSTEMS SCIENCE AND CYBERNETICS - THEORY;

INFORMATION UNCERTAINTY; POSSIBILITY THEORY;

INFORMATION THEORY;

EID: 0020330109     PISSN: 03081079     EISSN: 15635104     Source Type: Journal    
DOI: 10.1080/03081078208960799     Document Type: Article

References (49)

1. J. Aczel, and Z. Daroczy, On Measures of Information and Their Characterizations. Academic Press, New York, 1973
2. J. Aczel. B, Forte and C. T. Ng, “Why the Shannon and Hartley entropies are ‘natural'”. Advances in Applied Probability, 6, 1974, pp. 131-146
3. W. R. Ashby. “Measuring the internal information exchange in a system”. Cybernerica, 1, No. 1, 1965, pp. 5-22.
4. W. R. Ashby, Two tables of identities governing information flows within large systems”. ASC Communications, 1, No. 2. 1969, pp. 3-8.
5. W. R. Ashby, “Information flows within co-ordinated systems”. In: Progress of Cybernetics, edited by J. Rose, Gordon and Breach, London, 1970, pp. 37-64.
6. W. R. Ashby, “Systems and their informational measures”. In: Trends in General Systems Theory, edited by G. 1. Klir, John Wiley, New York, 1972, pp. 78-97.
7. D. E. Boelcee and J. C. A. Van Der Lubbe, The R-norm information measure”. Information, and Control, 45, No. 2, 1980, pp. 136-155.
8. L. Brillouin, Science and Information Theory. Academic Press. New York. 1956.
9. L. Brillouin, Scientific Uncertainty and Infortnniion. Academic Press, New York, 1964.
10. G. Broetnra, “On the representation and identification of structure systems”. International Journal of Systems Science. 9, No. 11. 1978, pp, 1271-1293
11. R. E. Cavillo and G. J. Klir. “A conceptual foundation for systems problem solving. International Journal of Systems Science, 9, No. 2, 1978. pp. 219-236.
12. R. E. Cavallo and C. J. Klir. “Systems of overall possibilities: reconstruction aspects”. In: Applied Systems and Cybernetics, edited by G. E Lasker, Pergamon Press, New York, 1981, pp. 939-946.
13. E. Cavallo and G. J. Klir. “Reconstruction of possibilistic behavior systems”. Fuzzy Sets and Systems, 8. No. 2, August 1982, pp. 175-197.
14. C. Cherry. On Human Communication, The M.I.T. Press, Cambridge, Mass., 1957.
15. R. Christenseo, Foundations of Inductive Reasoning Entropy. Lincoln. Mass, 1980.
16. R. Christensen, Entropy Minimax Source Sourcebooks, Vols. 1-4. Entropy, Lincoln. Mass, 1981.
17. R. C. Conant, “Detecting subsystems of a complex system”. IEEE Trans, on Systems, Man, and Cybernetics, SMC-2, No. 4, 1972, pp 550-553.
18. R. C. Conant. “Measuring the strength of intervariable relations”. Kybernetes. 2, No. 1, 1973. pp. 47-51
19. R. C. Conant, “Laws of information which govern systems”, IEEE Trans, on Systems, Man, and Cybernetics, SMC-6, No. 4, 1976, pp. 240-253.
20. R. C. Conant, “Structural modelling using a simple information measure”. international Journal of Systems Science, 11, No, 6, June 1980, pp 721-730.
21. Z. Daroczy, “Generalized information functions”. information and Control, 16, No. 1, 1970, pp. 36-51.
22. D. Dubois and H. Prade. Fuzzy Sets and Systems: Theory and Applications. Academic Press, New York, 1980.
23. B. Forte, “On the amount of information given by an experiment”, In; Proc. of the Colloquium on information Theory, edited by A. Renyi, Janus Bolyai Mathematical Society, Budapest. 1968, pp. 149-166 (Vol. 1).
24. B. Forte, “Why Shannon entropy”. Symposia Mathematica, XV, Academic Press, New York, 1975. pp. 137-151
25. R. V. L. Hartley, Transmission of information”. The Bell Systems Technical Journal, 7, 1928. pp. 535-563.
26. E. Hisdale, “Conditional possibilities, independence and noninteraction”. Fuzzy Sets and Systems, 1, No. 4, 1978, pp. 283-297.
27. E. T. Jaynes, “Where do we stand on maximum entropy?” In: The Maximum Entropy Formalism, edited by R. L Levine and M. Trio us, MIT Press, Cambridge, Mass, 1979. pp. 15-118.
28. G. J. Klir. On the representation of activity arrays. International Journal of General Systems, 2, No. 3, 1975, pp. 149-168.
29. G. J. Klir, “General systems problem solving methodology”. In: Modelling and Simulation Methodology. edited by B. Zeigler et al, North-Holland, Amsterdam, 1979.
30. A. N. Kotmogorov, Foundations of the Theory of Probability, Chelsea, New York, 1950.
31. A. N. Kolmogorov, Three approaches to the quantitative definition of information” Problems of Information Transmission, 1, No. 1, 1965, pp. 1-7.
32. H. T. Nguyen, “On conditional possibility distributions”. Fuzzy Sets and Systems, I. No. 4. October 1978. pp. 299-309.
33. H. T. Nguyen, Toward a calculus of the mathemariea J notion of possibility”. In: Advances in Fusty Set Theory and Applications, edited by M. M. Gupta, R. K. Ragade, and R. R. Yager, North-Holland, New York. 1979, pp. 235-246.
34. M. L. Puri and D. Ralescu, “A possibility measure is not a fuzzy measure”. Furry Sets and Systems, 7, No. 3, 1981 pp. 311-313.
35. A. Renyi, “On measures of entropy and information”. Proc. 4th Berkeley Symp. on Math. Stat, and Prob, Univ. of California Press. Berkeley, 1960, pp. 547-561.
36. A. Renyi, Probability Theory. North-Holland. Amsterdam, 1970 (Appendix: “Introduction to information theory”, pp. 540-616.
37. C. E. Shannon, “A mathematical theory of communication”. The Belt System Technical Journal, 27, July and October, 1948. pp. 379-423, 623-656.
38. J. E. Shore and ft. W. Johnson, “Axiomatic derivation of tbh principle of maximum entropy and the principle of minimum cross-entropy”. IEEE Trans, on Information Theory. IT-26, No. 1, 1980, pp. 26-37.
39. Special Issue of the International Journal of General Systems on Reconstruaabitity Analysis, VoL 7. No. 1. 1981 (Brockstra, Cavallo, Conant, Klir, Krippendorff).
40. M. Sugcno. “Fuzzy measures and fuzzy integrals: a survey”. In: Fuzzy Automata and Decision Processes. edited by M. M. Gupta, North-Holland. New York. I977, pp. 89-102
41. S. Watanabc, “Information theoretical analysis of multivariate correlations”. IBM Journal of Research and Development, 4, No. 1. 1960, pp. 66-81
42. S. Watanabe, Knowing and Guessing. John Wiley, New York, 1969.
43. S. Watanabe, “Pattern recognition as a guest for minimum entropy”. Pattern Recognition, 13, No. 5, 1981, pp. 381-387.
44. R. R. Yager, “Measuring tranquility and anxiety in decision making: an application of fuzzy sets”. Technical Report No. RRY 79-03. Iona College, School of Business Adminstralion, New Rochelle, New York, 1979.
45. R. R. Yager, “Measuring tranquility and anxiety in decision making” International Journal of General Systems, 8, No. 3. 1981 PP. 139-146.
46. R.R. Yager, “Aspects of posnbtlistic uncertainty”. intern. J. of Man-Machine Studies, 11 No. 3, April 1980, pp. 283-298.
47. R. R. Yager, “A foundation for a theory of possibility”, Journal of Cybernetics, 10, Nos. 1-3, 1980, pp. 177-204.
48. L. A. Zadeh, “Fuzxy sets as a basis for a theory of possibility”. Fussy Sets and Systems, 1, No. 1. 1978, pp. 3-28.
49. L. A. Zadeh, “PRUF-a meaning representation language for natural languages”. International Journal of Man-Machine Studies, 10, No. 4, 1978, pp, 395-460.