Fisher's information matrix and φ-divergence for finite and optimal partitions of the sample space

Communications in Statistics - Theory and Methods

Volumn 26, Issue 9, 1997, Pages 2271-2289

  Tsairidis, Ch ^a   Zografos, K ^a   Ferentinos, K ^a  

^a UNIVERSITY OF IOANNINA   (Greece)

Author keywords

Convergence of information measures; Discretization; Equidistant intervals; Fisher information matrix; Loss of information; Optimal partition; Divergence

Indexed keywords

OPTIMIZATION; PROBLEM SOLVING; SAMPLING; THEOREM PROVING;

CONVERGENCE OF INFORMATION MEASURES; DIVERGENCE; EQUIDISTANT INTERVALS; FISHER INFORMATION MATRIX; LOSS OF INFORMATION; OPTIMAL PARTITIONS; SAMPLE SPACE;

MATRIX ALGEBRA;

EID: 0031224332     PISSN: 03610926     EISSN: None     Source Type: Journal    
DOI: 10.1080/03610929708832046     Document Type: Article

References (24)

1. Billingsley, P. (1979). Probability and Measure. Wiley, New York.
2. Csiszar, I. (1963). Eine Informationstheoretische Ungleichung und ihre Anwendung auf den Beweis der Ergodizitat von Markoffschen Ketten. A Mayar Tudomanyos Academia Matematikai Kutato Intezetenek Kozlemenyei 8, 85-108.
3. Csiszar, I. (1973). Generalized entropy and quantization problems. Transactions of the sixth Prague Conference on Information Theory, Statistical Decision Functions and Random Processes, Prague, 159-174.
4. Ferentinos, K. and Papaioannou, T. (1979). Loss of information due to groupings. Transactions of the eighth Prague Conferrence on Information Theory. Statistical Decision Functions and Random Processes, Prague, 87-94.
5. Ferentinos, K. and Papaioannou, T. (1983). Convexity of measures of information and loss of information due to grouping of observations. Journal of Combinatorics. Information and System Sciences 8, 286-294.
6. Ghurye, S. G. (1968). Information and sufficient sub-fields. The Annals of Mathematical Statistics 39, 2056-2066.
7. Ghurye, S. G. and Johnson, B. R. (1981). Discrete approximations to the information integral. The Canadian Journal of Statistics 9, 27-37.
8. Guiasu, S. (1986). Grouping data by using the weighted entropy. Journal of Statistical Planning and Inference 15, 63-69.
9. Kale, B. K. (1964). A note on the loss of information due to grouping of observations. Biometrika 51, 495-497.
10. Kallianpur, G. (1960). On the amount of information contained in a σ-field. Contributions to Probability and Statistics. Essays in Honor of Harold Hotelling (Ingram Olkin et al., Eds.), 265-273. Stanford University Press.
11. Nagahata, H. (1985). Optimal spacing for grouped observations from the information view-point. Mathematica Japonica 30, 277-282.
12. Papaioannou, T. (1985). Measures of information. Encyclopedia of Statistical Sciences, Kotz and Johnson, Eds. 5, 391-397. Wiley, New York.
13. Papaioannou, T., Ferentinos, K., Menendez, M. L. and Salicru M. (1994). Discretization of (h, φ)-divergences. Information Sciences 77, 351-358.
14. Pardo, L., Morales, D., Ferentinos, K. and Zografos K. (1994). Discretization problems on generalized entropies and R-divergences. Kybernetika 30, 445-460.
15. Perez, A. (1967). Information-theoretic risk estimates in statistical decision. Kybernetika 3, 1-21.
16. Pinsker, M. S. (1964). Information and Information Stability of Random Variables and Processes. Holden-Day, USA.
17. Potzelberger, K. and Felsenstein, K. (1993). On the Fisher information of discretized data. Journal of Statistical Computation and Simulation 46, 125-144.
18. Renyi, A. (1970). Probability Theory. North-Holland. Amsterdam.
19. Ryu, K. (1993). Monotonicity of the Fisher information and the Kullback-Leibler divergence measure. Economics Letters 42, 121-128.
20. Vajda, I. (1972). On the f-divergence and singularity of probability measures. Periodica Mathematica Hungarica 2, 223-234.
21. a-Divergence and generalized Fisher's information. Transactions of the sixth Prague Conference on Information Theory, Statistical Decision Functions and Random Processes, Prague, 873-886.
22. Zografos, K. (1987). Contributions to Statistical Information Theory. Ph.D. Thesis, Probability, Statistics and Operational Research Section, Department of Mathematics, University of Ioannina, Greece (in Greek).
23. Zografos, K., Ferentinos, K. and Papaioannou, T. (1986). Discrete approximations to the Csiszar, Renyi, and Fisher measures of information. The Canadian Journal of Statistics 14, 355-366.
24. Zografos, K., Ferentinos, K. and Papaioannou, T. (1989). Limiting properties of some measures of information. Annals of the Institute of Statistical Mathematics 41, 451-460.