Three information-theoretical methods to estimate a random variable

Journal of Environmental Management

Volumn 49, Issue 1, 1997, Pages 43-51

  Lind, Niels C ^a,b  

^a UNIVERSITY OF WATERLOO   (Canada)

^b NONE   (Canada)

Author keywords

Distribution; Entropy; Estimation; Information; Sample

Indexed keywords

INFORMATION THEORY;

CONTINUOUS UNIVARIATE DISTRIBUTIONS; CROSS ENTROPY; DISTRIBUTION; INFORMATION; INFORMATION MEASURES; RELATIVE ENTROPY; SAMPLE; SHANNON INFORMATION; SIMPLE++; THEORETICAL METHODS;

ENTROPY;

ALGORITHM; ARTICLE; INFORMATION; INTERMETHOD COMPARISON; MATHEMATICS; MODEL; STATISTICAL ANALYSIS;

DISTRIBUTION; ENTROPY; ESTIMATION; RANDOM VARIABLE;

EID: 0030617066     PISSN: 03014797     EISSN: None     Source Type: Journal    
DOI: 10.1006/jema.1996.0115     Document Type: Article

References (12)

1. Cheng, R. C. H. and Amin, N. A. K. (1983). Estimating parameters in continuous univariate distributions with a shifted origin. Journal of the Royal Statistical Society, Series B 45, 394-403.
2. Cheng, R. C. H. and Stephens, M. A. (1989). A goodness-of-fit-test using Moran's statistic with estimated parameters. Biometrika 76, 385-392.
3. Feller, W. (1968). An Introduction to Probability Theory and its Applications, Third edition. New York, NY: John Wiley and Sons, Inc.
4. Jaynes, E. T. (1983). Papers on Probability, Statistics, and Statistical Physics. Netherlands: D. Reidel, Dordrecht.
5. Kapur, J. N. and Kesavan, H. K. (1992). Entropy Optimization Principles with Applications. London: Academic Press, Inc.
6. Kullback, S. and Leibler, R. A. (1951). On Information and Sufficiency. Annals of Mathematical Statistics, 22, 79-86.
7. Lind, N. C. (1994). Information theory and maximum product of spacings estimation. Journal of the Royal Statistical Society, Series B 56, 341-343.
8. Lind, N. C. and Solana, V. (1988). Estimation of random variables with fractile constraints. IRR paper No. 11. Waterloo, ON: Institute for Risk Research, University of Waterloo.
9. Ranneby, B. (1984). The maximum spacing method. An estimating method related to the maximum likelihood method. Scandinavian Journal of Statistics 11, 93-112.
10. Shore, J. and Johnson, R. W. (1980). Axiomatic derivation of the principle of maximum entropy and the principle of minimum cross-entropy. IEEE Transactions on Information Theory IT-26, No. 1, 26-37.
11. Silverman, B. W. (1986). Density Estimation for Statistics and Data Analysis. London: Chapman and Hall.
12. Titterington, D. M. (1985). Comment on "Estimating parameters in continuous univariate distributions". Journal of the Royal Statistical Society, Series B 47, 115-116.