An information criterion for likelihood selection

IEEE Transactions on Information Theory

Volumn 45, Issue 2, 1999, Pages 562-571

  Yuan, A ^a   Clarke, B ^a  

^a MASSACHUSETTS GENERAL HOSPITAL   (United States)

Author keywords

Likelihood selection; Mutual information; Rate distortion

Indexed keywords

DATA COMPRESSION; DATA REDUCTION; SIGNAL DISTORTION;

LIKELIHOOD SELECTION; RATE DISTORTION FUNCTIONS;

INFORMATION THEORY;

EID: 0033098617     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/18.749003     Document Type: Article

References (23)

1. J. Aitchison, "Goodness of prediction fit," Biometrika, vol. 62, pp. 547-554, 1975.
2. S. Arimoto, "An algorithm for computing the capacity of arbitrary discrete memoryless channels," IEEE Trans. Inform. Theory, vol. IT-18, pp. 14-20, Jan. 1972.
3. T. Berger, Rate Distortion Theory. Englewood Cliffs, NJ: Prentice-Hall, 1971.
4. J.M. Bernardo, "Reference posterior distribution for Bayesian inference," J. Roy. Statist. Soc., Ser. B, no. 2, pp. 113-147, 1979.
5. P.J. Bickel and J. R. Collins, "Minimizing Fisher information over mixtures of distributions" Sankhya, Ser. A, vol. 45, pp. 1-19, 1983.
6. R.E. Blahut, "Computation of channel capacity and rate-distortion functions," IEEE Trans. Inform. Theory, vol. IT-18, pp. 460173, July 1972.
7. "A hypothesis testing approach to information theory," Ph.D. dissertation, Cornell Univ., Ithaca, NY, 1972.
8. Principles and Practice of Information Theory. Reading, MA: Addison-Wesley, 1987.
9. B. Clarice and A. R. Barron, "Jeffreys' prior is asymptotically least favorable under entropy risk," J. Statist. Planning Infer., vol. 41, pp. 37-60, 1994.
10. T.M. Cover and J. A. Thomas, Elements of Information Theory. New York: Wiley, 1991.
11. I. Csiszâr, "On topological properties of /-divergences," Studio Sei. Math. Hungar., vol. 2, pp. 329-339, 1967.
12. "On the computation of rate distortion functions," IEEE Trans. Inform. Theory, vol. IT-20, pp. 122-124, 1974.
13. "I-divergence geometry of probability distributions and minimization problems," A. Prob., vol. 3, no. 1, pp. 146-158, 1975.
14. I. Csiszâr and G. Tusnady, "Information geometry and alternating minimization procedures," Statist. Decisions, Supplement Issue, vol. 1, pp. 205-237, 1984.
15. I. Efroimovich, "Information contained in a sequence of distributions," Probl. Inform. Transm., vol. 15, pp. 24-39, 1980.
16. P.J. Huber, "Robust estimation of a location parameter," Ann. Math. Statist., vol. 35, pp. 73-101, 1964.
17. Robust Statistics. New York: Wiley, 1981.
18. I.A. Ibragimov and R. Z. Hasmimsky, "On the information in a sample about a parameter," in Proc. 2nd Int. Symp. Information Theory. Budapest, Hungary: Akademiai Kaido, 1973, pp. 295-309.
19. F. Kanaya and K. Nakagawa, "On the practical implication of mutual information for statistical decision making," IEEE Trans. Inform. Theory, vol. 37, pp. 1151-1156, July 1991.
20. B.Y. Levit, "On asymptotic minimax estimates of the second order," Theory Probab. Appl., vol. 25, no. 3, pp. 552-568, 1980.
21. R.J. McEliece, The Theory of Information and Coding. Reading, MA: Addison-Wesley, 1977.
22. A. Yuan, "A minimally informative likelihood approach to Bayesian inference and decision analysis," Ph.D. dissertation, Dept. Statistics, Univ. British Columbia, Vancouver, BC, Canada, 1997.
23. A. Yuan and B. Clarke, "A minimally informative likelihood approach to Bayesian decision analysis and robustness agaisnt modeling strategy," submitted to Can. J. Statist., 1998.