Principal Information Theoretic Approaches

Journal of the American Statistical Association

Volumn 95, Issue 452, 2000, Pages 1349-1353

  Soofi, Ehsan S ^a  

^a UNIVERSITY OF WISCONSIN MILWAUKEE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0442277936     PISSN: 01621459     EISSN: 1537274X     Source Type: Journal    
DOI: 10.1080/01621459.2000.10474346     Document Type: Article

References (43)

1. Akaike, H. (1973), “Information Theory and an Extension of the Maximum Likelihood Principle,” 2nd International Symposium on Information Theory, 267-281.
2. Akaike, H. (1974), “A New Look at the Statistical Model Identification,” IEEE Transactions of Automated Control, AC-19, 716-723.
3. Alwan, L. C., Ebrahimi, N., and Soofi, E. S. (1998), “Information-Theoretic Framework for Statistical Process Control,” European Journal of Operational Research, 111, 526-541.
4. Berger, J. O. (2000), “Bayesian Analysis: A Look at Today and Thoughts for Tomorrow,” Journal of the American Statistical Association, 95, 1269-1276.
5. Bernardo, J. M. (1979a), “Expected Information as Expected Utility,” The Annals of Statistics, 1, 686-690.
6. Bernardo, J. M. (1979b), “Reference Posterior Distributions for Bayesian Inference” (with discussion), Journal of the Royal Statistical Society, Ser. (14) B, 41, 113-147.
7. Bozdogan, H. (1994), Proceedings of the First U.S./Japan Conference of the Frontiers of Statistical Modeling, Vols. 1-3, Amsterdam: Kluwer.
8. Brockett, P. L. (1991), “Information Theoretic Approach to Actuarial Sci-ence: A Unification and Extension of Relevant Theory and Applications,” Transactions of Society of Actuaries, 43, 73-135.
9. Brockett, P. L., Charnes, A., Cooper, W. W., Learner, D., and Phillips, F. Y. (1995), “Information Theory as a Unifying Statistical Approach for Use in Marketing Research,” European Journal of Operational Research, 84, 310-329.
10. Burnham, K. P., and Anderson, D. R. (1998), Model Selection and Infer-ence: A Practical Information-Theoretic Approach, New York: Springer-Verlag.
11. Cover, T. M., and Thomas, J. A. (1991), Elements of Information Theory, New York: Wiley.
12. Csiszar, I. (1991), “Why Least Squares and Maximum Entropy? An Ax-iomatic Approach to Inference in Linear Inverse Problems,” The Annals of Statistics, 19, 2032-66.
13. Fisher, R. A. (1921), “On Mathematical Foundations of Theoretical Statistics,” Philosophical Transactions of the Royal Society of London, Ser. A, 222, 309-368.
14. Fomby, T. B., and Hill, R. C. (1997), Advances in Econometrics: Applying Maximum Entropy to Econometric Problems, Vol. 12, Greenwich, CT: JAI Press.
15. Gokhale, D. V., and Kullback, S. (1978), The Information in Contingency Tables, New York: Marcel Dekker.
16. Golan, A., Judge, G. G., and Miller, D. (1996), Maximum Entropy Econo-metrics: Robust Estimation with Limited Data, New York: Wiley.
17. Good, I. J. (1950), Probability and Weighting of Evidence, London: Griffin.
18. Gull, S. F. (1989), “Developments in Maximum Entropy Data Analysis,” in Maximum Entropy and Bayesian Methods, ed. J. Skilling, Boston: Kluwer.
19. Jaynes, E. T. (1957), “Information Theory and Statistical Mechanics,” Physical Review, 106, 620-630.
20. Jaynes, E. T. (1968), “Prior Probabilities,” IEEE Transactions Systems in Science and Cybernetics, SSC-4, 227-241.
21. Jeffreys, H. (1946), “An Invariant Form for the Prior Probability in Estimation Problems,” Proceedings of the Royal Statistical Society (London), Ser. A, 186, 453-461.
22. Kapur, J. N. (1989), Maximum Entropy Models in Science and Engineering, New York: Wiley.
23. Kullback, S. (1954), “Certain Inequalities in Information Theory and the Cramer-Rao Inequality,” The Annals of Mathematical Statistics, 25, 745-751.
24. Kullback, S. (1959), Information Theory and Statistics, New York: Wiley.
25. Kullback, S., and Leibler, R. A. (1951), “On Information and Sufficiency,” Annals of Mathematical Statistics, 22, 79-86.
26. Lehmann, E. L. (1983), Theory of Point Estimation, New York: Wiley.
27. Lindley, D. V. (1956), “On a Measure of Information Provided by an Ex-periment,” Annals of Mathematical Statistics, 27, 986-1005.
28. Lindley, D. V. (1961), “The Use of Prior Probability Distributions in Statistical Inference and Decision,” in Proceedings of the Fourth Berkeley Symposium, 1, Berkeley, CA: University of California Press, pp. 436-468.
29. Maasoumi, E. (1993), “A Compendium to Information Theory in Eco-nomics and Econometrics,” Econometric Reviews, 12(2), 137-181.
30. Pourahmadi, M., and Soofi, E. S. (2000), “Predictive Variance and Infor-mation Worth of Observations in Time Series,” Journal of Time Series Analysis, 21, 413-434.
31. Rao, C. R. (1973), Linear Statistical Inference and Its Applications (2nd ed.), New York: Wiley.
32. Shannon, C. E. (1948), “A Mathematical Theory of Communication,” Bell System Technical Journal, 27, 379-423.
33. Shore, J. E., and Johnson, R. W. (1980), “Axiomatic Derivation of the Principle of Maximum Entropy and the Principle of Minimum Cross-Entropy,” IEEE Transactions on Informational Theory, IT-26, 26-37.
34. Soofi, E. S. (1994), “Capturing the Intangible Concept of Information,” Journal of the American Statistical Association, 89, 1243-1254.
35. Soofi, E. S. (1997), “Information Theoretic Regression Methods,” in Advances in Econometrics: Applying Maximum Entropy to Econometric Problems, 12, eds. T. B. Fomby and R. C. Hill, Greenwich, CT: JAI Press, pp. 25-83.
36. Soofi, E. S., Ebrahimi, N., and Habibullah, M. (1995), “Information Dis-tinguishability With Application to Analysis of Failure Data,” Journal of the American Statistical Association, 90, 657-668.
37. Soofi, E. S., and Gokhale, D. V. (1997), “Information Theoretic Methods for Categorical Data,” in Advances in Econometrics: Applying Maximum Entropy to Econometrics Problems, 12, eds. T. B. Fomby and R. C. Hill, Greenwich, CT: JAI Press, pp. 107-134.
38. Theil, H., and Fiebig, D. Z. (1984), Exploiting Continuity: Maximum Entropy Estimation of Continuous Distributions, Cambridge, MA: Ballinger.
39. Wyner, A. D., and Ziv, J. (1969), “On Communication of Analog Data From Bounded Source Space,” Bell System Technical Journal, 48, 3139-3172.
40. Yang, R., and Berger, J. (1997), “A Catalog of Noninformative Priors,” ISDS Discussion Paper 97-42, Duke University.
41. Zellner, A. (1971), An Introduction to Bayesian Inference in Econometrics, New York: Wiley.
42. Zellner, A. (1988), “Optimal Information Processing and Bayes’s Theorem” (with discussion), The American Statistician, 42, 278-284.
43. Zellner, A. (1997), Bayesian Analysis in Econometrics and Statistics: The Zellner View and Papers, Cheltenham, U.K.: Edward Elgar.