Divergence measures for statistical data processing - An annotated bibliography

Signal Processing

Volumn 93, Issue 4, 2013, Pages 621-633

  Basseville, Michèle ^a  

^a CAMPUS DE BEAULIEU   (France)

Author keywords

Bregman divergence; Classification; Compression; Detection; Distance; Divergence; Estimation; f Divergence; Indexing; Information; Learning; Recognition

Indexed keywords

BREGMAN DIVERGENCES; DISTANCE; DIVERGENCE; F-DIVERGENCE; INFORMATION; LEARNING; RECOGNITION;

BIBLIOGRAPHIES; CLASSIFICATION (OF INFORMATION); COMPACTION; ERROR DETECTION; ESTIMATION; INDEXING (OF INFORMATION); STATISTICS;

DATA PROCESSING;

EID: 84871363146     PISSN: 01651684     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.sigpro.2012.09.003     Document Type: Review

References (284)

1. J. Aczél, Lectures on Functional Equations and Their Applications, Mathematics in Science and Engineering, vol. 19, Academic Press, 1966.
2. J. Aczél Measuring information beyond communication theory - Why some generalized information measures may be useful, others not Aequationes Mathematicae 27 1984 1 19
3. J. Aczél, Z. Daròczy, On Measures of Information and Their Characterizations, Mathematics in Science and Engineering, vol. 115, Academic Press, 1975.
4. A. Agarwal, and H. Daume III A geometric view of conjugate priors Machine Learning 81 October (1) 2010 99 113
5. H. Akaike A new look at the statistical model identification IEEE Transactions on Automatic Control 19 December (6) 1974 716 723
6. S.M. Ali, and S.D. Silvey A general class of coefficients of divergence of one distribution from another Journal of the Royal Statistical Society - Series B Methodological 28 1 1966 131 142
7. Y. Altun, and A. Smola Unifying divergence minimization and statistical inference via convex duality G. Lugosi, H.U. Simon, Proceedings of the 19th Annual Conference on Learning Theory (COLT'06), Pittsburgh, PA, USA, June 22-25, 2006 Lecture Notes in Computer Science vol. 4005 2006 Springer-Verlag Berlin, Heidelberg 139 153
8. S.-I. Amari, Differential-Geometrical Methods in Statistics, Lecture Notes In Statistics, vol. 28, Springer-Verlag, New York, NY, USA, 1985.
9. S.-I. Amari Information geometry on hierarchy of probability distributions IEEE Transactions on Information Theory 47 July (5) 2001 1701 1711
10. S.-I. Amari Integration of stochastic models by minimizing α-divergence Neural Computation 19 October (10) 2007 2780 2796
11. S.-I. Amari α-divergence is unique belonging to both f-divergence and Bregman divergence classes IEEE Transactions on Information Theory 55 November (11) 2009 4925 4931
12. S.-I. Amari, Information geometry and its applications: convex function and dually flat manifold, in: Emerging Trends in Visual Computing - LIX Colloquium, November 2008, Lecture Notes in Computer Science, vol. 5416, Springer-Verlag, 2009, pp. 75-102.
13. S.-I. Amari, Information geometry derived from divergence functions, in: 3rd International Symposium on Information Geometry and its Applications, Leipzig, FRG, August 2-6, 2010.
14. S.-I. Amari, and H. Nagaoka Methods of Information Geometry, Translations of Mathematical Monographs vol. 191 2000 American Mathematical Society, Oxford University Press Oxford, UK
15. V. Anantharam A large deviations approach to error exponents in source coding and hypothesis testing IEEE Transactions on Information Theory 36 July (4) 1990 938 943
16. E. Arikan An inequality on guessing and its application to sequential decoding IEEE Transactions on Information Theory 42 January (1) 1996 99 105
17. S. Arimoto Information-theoretical considerations on estimation problems Information and Control 19 October (3) 1971 181 194
18. S. Arimoto, Information measures and capacity of order α for discrete memoryless channels, in: Topics in Information Theory - 2nd Colloquium, Keszthely, HU, 1975, Colloquia Mathematica Societatis János Bolyai, vol. 16, North Holland, Amsterdam, NL, 1977, pp. 41-52.
19. V. Arsigny, P. Fillard, X. Pennec, and N. Ayache Geometric means in a novel vector space structure on symmetric positive-definite matrices SIAM Journal on Matrix Analysis and Applications 29 1 2007 328 347
20. K.A. Arwini, C.T.J. Dodson, Information Geometry - Near Randomness and Near Independence, Lecture Notes in Mathematics, vol. 1953, Springer, 2008.
21. J.A. Aslam, V. Pavlu, Query hardness estimation using Jensen-Shannon divergence among multiple scoring functions, in: G. Amati, C. Carpineto, G. Romano (Eds.), Advances in Information Retrieval - 29th European Conference on IR Research, ECIR'07, Rome, Italy, Lecture Notes in Computer Science, vol. 4425, Springer-Verlag, Berlin Heidelberg, FRG, April 2-5, 2007, pp. 198-209.
22. S. Aviyente, L. Brakel, R. Kushwaha, M. Snodgrass, H. Shevrin, and W. Williams Characterization of event related potentials using information theoretic distance measures IEEE Transactions on Biomedical Engineering 51 May (5) 2004 737 743
23. R.K. Bahr Asymptotic analysis of error probabilities for the nonzero-mean Gaussian hypothesis testing problem IEEE Transactions on Information Theory 36 May (3) 1990 597 607
24. A. Banerjee, I. Dhillon, J. Ghosh, S. Merugu, An information theoretic analysis of maximum likelihood mixture estimation for exponential families, in: C.E. Brodley (Ed.), Proceedings of the 21st International Conference on Machine Learning (ICML'04), Banff, Alberta, Canada, ACM International Conference Proceeding Series, vol. 69, New York, NY, USA, July 4-8, 2004.
25. A. Banerjee, I. Dhillon, J. Ghosh, S. Merugu, and D.S. Modha A generalized maximum entropy approach to Bregman co-clustering and matrix approximation Journal of Machine Learning Research 8 August 2007 1919 1986
26. A. Banerjee, S. Merugu, I.S. Dhillon, and J. Ghosh Clustering with Bregman divergences Journal of Machine Learning Research 6 October 2005 1705 1749
27. O.E. Barndorff-Nielsen, D.R. Cox, and N. Reid The role of differential geometry in statistical theory International Statistical Review 54 April (1) 1986 83 96
28. M. Basseville Distance measures for signal processing and pattern recognition Signal Processing 18 December (4) 1989 349 369
29. M. Basseville, Information: entropies, divergences et moyennes. Research Report 1020, IRISA, 〈 hal.archives-ouvertes.fr/inria-00490399/ 〉, May 1996 (in French).
30. M. Basseville Information criteria for residual generation and fault detection and isolation Automatica 33 May (5) 1997 783 803
31. M. Basseville, J.-F. Cardoso, On entropies, divergences, and mean values, in: Proceedings of the IEEE International Symposium on Information Theory (ISIT'95), Whistler, British Columbia, Canada, September 1995, p. 330.
32. A. Basu, I.R. Harris, N. Hjort, and M.C. Jones Robust and efficient estimation by minimising a density power divergence Biometrika 85 September (3) 1998 549 559
33. A. Basu, and B.G. Lindsay Minimum disparity estimation for continuous models efficiency, distributions and robustness Annals of the Institute of Statistical Mathematics 46 December (4) 1994 683 705
34. A. Basu, and B.G. Lindsay The iteratively reweighted estimating equation in minimum distance problems Computational Statistics and Data Analysis 45 March (2) 2004 105 124
35. A. Basu, H. Shioya, and C. Park Statistical Inference The Minimum Distance Approach, Chapman & Hall/CRC Monographs on Statistics & Applied Probability 2011 CRC Press Boca Raton, FL
36. H.H. Bauschke Duality for Bregman projections onto translated cones and affine subspaces Journal of Approximation Theory 121 March (1) 1983 1 12
37. M. Bekara, L. Knockaert, A.-K. Seghouane, and G. Fleury A model selection approach to signal denoising using Kullback's symmetric divergence Signal Processing 86 July (7) 2006 1400 1409
38. A. Ben-Tal, A. Charnes, and M. Teboulle Entropic means Journal of Mathematical Analysis and Applications 139 May (2) 1989 537 551
39. J.-F. Bercher On some entropy functionals derived from Rényi information divergence Information Sciences 178 June (12) 2008 2489 2506
40. A. Bhattacharyya On a measure of divergence between two statistical populations defined by their probability distributions Bulletin of the Calcutta Mathematical Society 35 1943 99 109
41. L. Birgé A new lower bound for multiple hypothesis testing IEEE Transactions on Information Theory 51 April (4) 2005 1611 1615
42. R.E. Blahut Hypothesis testing and information theory IEEE Transactions on Information Theory 20 July (4) 1974 405 417
43. R.E. Blahut Principles and Practice of Information Theory, Series in Electrical and Computer Engineering 1987 Addison Wesley Publishing Co
44. J. Boets, K. De Cock, B. De Moor, A mutual information based distance for multivariate Gaussian processes, in: A. Chiuso, A. Ferrante, S. Pinzoni (Eds.), Modeling, Estimation and Control, Festschrift in Honor of Giorgio Picci on the Occasion of his Sixty-Fifth Birthday, Lecture Notes in Control and Information Sciences, vol. 364, Springer-Verlag, Berlin, FRG, October 2007, pp. 15-33.
45. P. Bougerol Kalman filtering with random coefficients and contraction SIAM Journal on Control and Optimization 31 July (4) 1993 942 959
46. L.M. Bregman The relaxation method of finding the common point of convex sets and its application to the solution of problems in convex programming USSR Computational Mathematics and Mathematical Physics 7 3 1967 200 217
47. M. Broniatowski, and A. Keziou Minimization of φ-divergences on sets of signed measures Studia Scientiarum Mathematicarum Hungarica 43 December (4) 2006 403 442
48. M. Broniatowski, and A. Keziou Parametric estimation and tests through divergences and the duality technique Journal of Multivariate Analysis 100 January (1) 2009 16 36
49. M. Broniatowski, and A. Keziou Divergences and duality for estimation and test under moment condition models Journal of Statistical Planning and Inference 142 September (9) 2012 2554 2573
50. M. Broniatowski, I. Vajda, Several applications of divergence criteria in continuous families. Kybernetika 48, arXiv:0911.0937, in press.
51. J. Burbea, and C.R. Rao Entropy differential metric, distance and divergence measures in probability spaces a unified approach Journal of Multivariate Analysis 12 December (4) 1982 575 596
52. J. Burbea, and C.R. Rao On the convexity of higher order Jensen differences based on entropy functions IEEE Transactions on Information Theory 28 November (6) 1982 961 963
53. J. Burbea, and C.R. Rao On the convexity of some divergence measures based on entropy functions IEEE Transactions on Information Theory 28 May (3) 1982 489 495
54. J. Burg, D. Luenberger, and D. Wenger Estimation of structured covariance matrices Proceedings of the IEEE 70 September (9) 1982 963 974
55. C.I. Byrnes, T.T. Georgiou, and A. Lindquist A generalized entropy criterion for Nevanlinna-Pick interpolation with degree constraint IEEE Transactions on Automatic Control 46 June (6) 2001 822 839
56. M.A. Carreira-Perpiñán, G.E. Hinton, On contrastive divergence learning, in: R. Cowell, Z. Ghahramani (Eds.), Proceedings of the 10th International Workshop on Artificial Intelligence and Statistics (AISTATS'05), Barbados, UK, January 6-8, 2005, pp. 59-66.
57. L. Cayton, Fast nearest neighbor retrieval for Bregman divergences, in: W.W. Cohen, A. McCallum, S.T. Roweis (Eds.), Proceedings of the 25th International Conference on Machine Learning (ICML'08), Helsinki, Finland, June 2008, pp. 112-119.
58. L. Cayton, Efficient Bregman range search, in: Y. Bengio, D. Schuurmans, J. Lafferty, C.K.I. Williams, A. Culotta (Eds.), Advances in Neural Information Processing Systems 22, Vancouver, British Columbia, Canada, NIPS Foundation, December 7-10, 2009, pp. 243-251.
59. H. Chernoff A measure of asymptotic efficiency for tests of a hypothesis based on the sum of observations Annals of Mathematical Statistics 23 December (4) 1952 493 507
60. A. Cichocki, and S.-I. Amari Families of alpha- beta- and gamma-divergences flexible and robust measures of similarities Entropy 12 June (6) 2010 1532 1568
61. A. Cichocki, R. Zdunek, S.-I. Amari, Csiszár's divergences for non-negative matrix factorization: family of new multiplicative algorithm, in: J.P. Rosca, D. Erdogmus, J.C. Príncipe, S. Haykin (Eds.), Proceedings of the 6th International Conference on Independent Component Analysis and Blind Source Separation (ICA'06), Charleston, South Carolina, USA, Lecture Notes in Computer Science, vol. 3889, Springer-Verlag, Berlin Heidelberg, FRG, March 5-8, 2006, pp. 32-39.
62. A. Cichocki, R. Zdunek, and S.-I. Amari Nonnegative matrix and tensor factorization IEEE Signal Processing Magazine 25 January (1) 2008 142 145
63. A. Cichocki, R. Zdunek, A. Phan, and S.-I. Amari Nonnegative Matrix and Tensor Factorizations Applications to Exploratory Multi-way Data Analysis and Blind Source Separation 2009 John Wiley & Sons Ltd
64. M. Collins, R.E. Schapire, and Y. Singer Logistic regression, AdaBoost and Bregman distances Machine Learning 48 July (1-3) 2002 253 285
65. J. Coursol, and D. Dacunha-Castelle Sur la formule de Chernoff pour deux processus Gaussiens stationnaires Comptes Rendus Hebdomadaires des Séances de l'Académie des Sciences 288 May (Section A) 1979 769 770 (in French)
66. T.M. Cover, and J.A. Thomas Elements of Information Theory, Wiley Series in Telecommunications 1991 John Wiley & Sons Ltd
67. T.M. Cover, and J.A. Thomas Elements of Information Theory second edition 2006 John Wiley & Sons Ltd aa
68. I. Csiszár Eine informationstheoretische ungleichung und ihre anwendung auf den beweis der ergodizitat von markoffschen ketten Magyar Tudományos Akadémia Matematikai Kutató Intezetenek Kozlemenyei 8 1963 85 108
69. I. Csiszár Information-type measures of difference of probability distributions and indirect observation Studia Scientiarum Mathematicarum Hungarica 2 1967 299 318
70. I. Csiszár On topological properties of f-divergence Studia Scientiarum Mathematicarum Hungarica 2 1967 329 339
71. I. Csiszár I-divergence geometry of probability distributions and minimization problems Annals of Probability 3 Feb. (1) 1975 146 158
72. I. Csiszár, Information measures: a critical survey, in: J. Kozesnik (Ed.), Transactions of the 7th Conference on Information Theory, Statistical Decision Functions, Random Processes, Prague, vol. B, Academia, Prague, August 18-23, 1974, pp. 73-86.
73. I. Csiszár Why least squares and maximum entropy? An axiomatic approach to inference for linear inverse problems Annals of Statistics 19 December (4) 1991 2032 2066
74. I. Csiszár Generalized cutoff rates and Renyi's information measures IEEE Transactions on Information Theory 41 January (1) 1995 26 34
75. I. Csiszár Generalized projections for non-negative functions Acta Mathematica Hungarica 68 March (1-2) 1995 161 186
76. I. Csiszár Axiomatic characterizations of information measures Entropy 10 September (3) 2008 261 273
77. I. Csiszár, and F. Matus Information projections revisited IEEE Transactions on Information Theory 49 June (6) 2003 1474 1490
78. I. Csiszár, F. Matus, On minimization of multivariate entropy functionals, in: V. Anantharam, I. Kontoyiannis (Eds.), Proceedings of the IEEE Information Theory Workshop on Networking and Information Theory (ITW'09), Volos, Greece, June 10-12, 2009, pp. 96-100.
79. I. Csiszár, F. Matus, Generalized minimizers of convex integral functionals, Bregman distance, Pythagorean identities. ArXiv:1202.0666, February 2012.
80. 1 regularized logistic regression. ArXiv:1004.3814, April 2010.
81. S. Della Pietra, V. Della Pietra, J. Lafferty, Duality and Auxiliary Functions for Bregman Distances, Technical Report Collection CMU-CS-01-109R, School of Computer Science, Carnegie Mellon University, February 2002.
82. A. Dembo Information inequalities and concentration of measure Annals of Probability 25 April (2) 1997 927 939
83. A. Dembo, T.M. Cover, and J.A. Thomas Information theoretic inequalities IEEE Transactions on Information Theory 37 November (6) 1991 1501 1518
84. A. Dembo, and O. Zeitouni second edition Large Deviations Techniques and Applications, Applications of Mathematics vol. 38 1998 Springer-Verlag Berlin, Heidelberg, DE
85. L. Devroye, L. Györfi, and G. Lugosi A Probabilistic Theory of Pattern Recognition, Stochastic Modelling and Applied Probability vol. 31 1996 Springer-Verlag New York, USA
86. I.S. Dhillon, S. Mallela, and R. Kumar A divisive information-theoretic feature clustering algorithm for text classification Journal of Machine Learning Research 3 March 2003 1265 1287
87. I.S. Dhillon, and S. Sra Generalized nonnegative matrix approximations with Bregman divergences Y. Weiss, B. Schölkopf, J. Platt, Advances in Neural Information Processing Systems 18, Vancouver, British Columbia, Canada, December 5-8, 2005 2006 MIT Press Cambridge, MA 283 290
88. I.S. Dhillon, and J.A. Tropp Matrix nearness problems with Bregman divergences SIAM Journal on Matrix Analysis and Applications 29 4 2008 1120 1146
89. D. Donoho, and V. Stodden When does non-negative matrix factorization give a correct decomposition into parts? S. Thrun, L. Saul, B. Schölkopf, Advances in Neural Information Processing Systems 16, Vancouver, British Columbia, Canada, December 8-13, 2003 2004 MIT Press Cambridge, MA
90. M.D. Donsker, and S. Varadhan Asymptotic evaluation of certain Markov process expectations for large time, II Communications on Pure and Applied Mathematics 28 March (2) 1975 279 301
91. I.L. Dryden, A. Kolydenko, and D. Zhou Non-Euclidean statistics for covariance matrices, with applications to diffusion tensor imaging Annals of Applied Statistics 3 September (3) 2009 1102 1123
92. S. Eguchi, and S. Kato Entropy and divergence associated with power function and the statistical application Entropy 12 February (2) 2010 262 274
93. D.M. Endres, and J.E. Schindelin A new metric for probability distributions IEEE Transactions on Information Theory 49 July (7) 2003 1858 1860
94. M.D. Esteban A general class of entropy statistics Applications of Mathematics 42 June (3) 1997 161 169
95. A.A. Fedotov, P. Harremoes, and F. Topsoe Refinements of Pinsker's inequality IEEE Transactions on Information Theory 49 June (6) 2003 1491 1498
96. A. Ferrante, M. Pavon, and F. Ramponi Hellinger versus Kullback-Leibler multivariable spectrum approximation IEEE Transactions on Automatic Control 53 May (4) 2008 954 967
97. q-likelihood estimation Annals of Statistics 38 April (2) 2010 753 783
98. L. Finesso, and P. Spreij Nonnegative matrix factorization and I-divergence alternating minimization Linear Algebra and its Applications 416 July (2-3) 2006 270 287
99. A. Fischer Quantization and clustering with Bregman divergences Journal of Multivariate Analysis 101 October (9) 2010 2207 2221
100. B.A. Frigyik, S. Srivastava, and M.R. Gupta Functional Bregman divergence and Bayesian estimation of distributions IEEE Transactions on Information Theory 54 November (11) 2008 5130 5139
101. Y. Fujimoto, and N. Murata A modified EM algorithm for mixture models based on Bregman divergence Annals of the Institute of Statistical Mathematics 59 March (1) 2007 3 25
102. C. Fé, N. Bertin, and J.-L. Durrieu Nonnegative matrix factorization with the Itakura-Saito divergence. With application to music analysis Neural Computation 21 March (3) 2009 793 830
103. C. Févotte, and J. Idier Algorithms for nonnegative matrix factorization with the β-divergence Neural Computation 23 September (9) 2011 2421 2456
104. T.T. Georgiou Relative entropy and the multivariable multidimensional moment problem IEEE Transactions on Information Theory 52 March (3) 2006 1052 1066
105. T.T. Georgiou Distances and Riemannian metrics for spectral density functions IEEE Transactions on Signal Processing 55 August (8) 2007 3995 4003
106. T.T. Georgiou, J. Karlsson, and M.S. Takyar Metrics for power spectra an axiomatic approach IEEE Transactions on Signal Processing 57 March (3) 2009 859 867
107. T.T. Georgiou, and A. Lindquist Kullback-Leibler approximation of spectral density functions IEEE Transactions on Information Theory 49 November (11) 2003 2910 2917
108. T.T. Georgiou, and A. Lindquist A convex optimization approach to ARMA modeling IEEE Transactions on Automatic Control 53 June (5) 2008 1108 1119
109. P. Gibilisco, E. Riccomagno, M.P. Rogantin, and H.P. Wynn Algebraic and Geometric Methods in Statistics 2010 Cambridge University Press Cambridge, UK
110. G.L. Gilardoni On Pinsker's and Vajda's type inequalities for Csiszár's f-divergences IEEE Transactions on Information Theory 56 November (11) 2010 5377 5386
111. A.H.J. Gray, and J.D. Markel Distance measures for speech processing IEEE Transactions on Acoustics, Speech, and Signal Processing 24 October (5) 1976 380 391
112. R.M. Gray, Entropy and Information Theory, Springer-Verlag, New York, NY, USA, 1990, online corrected version, 2009, 〈 http://ee.stanford.edu/gray/ it.html 〉.
113. R.M. Gray Entropy and Information Theory second edition 2010 Springer-Verlag New York, NY, USA
114. R.M. Gray, A. Buzo, A.H.J. Gray, and Y. Matsuyama Distortion measures for speech processing IEEE Transactions on Acoustics, Speech, and Signal Processing 28 August (4) 1980 367 376
115. P.D. Grünwald, and A.P. Dawid Game theory, maximum entropy, minimum discrepancy and robust Bayesian decision theory Annals of Statistics 32 August (4) 2004 1367 1433
116. A. Guntuboyina Lower bounds for the minimax risk using f-divergences and applications IEEE Transactions on Information Theory 57 April (4) 2011 2386 2399
117. L. Györfi, and T. Nemetz f-Dissimilarity a generalization of the affinity of several distributions Annals of the Institute of Statistical Mathematics 30 December (1) 1978 105 113
118. P. Harremoës, I. Vajda, On Bahadur efficiency of power divergence statistics. ArXiv:1002.1493, February 2010.
119. P. Harremoës, and I. Vajda On pairs of f-divergences and their joint range IEEE Transactions on Information Theory 57 June (6) 2011 3230 3235
120. P. Harremoës, C. Vignat, Rényi entropies of projections, in: A. Barg, R.W. Yeung (Eds.), Proceedings of the IEEE International Symposium on Information Theory (ISIT'06), Seattle, WA, USA, July 9-14, 2006, pp. 1827-1830.
121. M.E. Havrda, and F. Charvát Quantification method of classification processes concept of structural α-entropy Kybernetika 3 1967 30 35
122. Y. He, A.B. Hamza, and H. Krim A generalized divergence measure for robust image registration IEEE Transactions on Signal Processing 51 May (5) 2003 1211 1220
123. A.O. Hero, B. Ma, O. Michel, J. Gorman, Alpha-divergence for Classification, Indexing and Retrieval, Research Report CSPL-328, University of Michigan, Communications and Signal Processing Laboratory, May 2001.
124. G.E. Hinton Training products of experts by minimizing contrastive divergence Neural Computation 14 August (8) 2002 1771 1800
125. G.E. Hinton, S. Osindero, and Y.-W. Teh A fast learning algorithm for deep belief nets Neural Computation 18 July (7) 2006 1527 1554
126. W. Hoeffding Asymptotically optimal tests for multinomial distributions Annals of Mathematical Statistics 36 April (2) 1965 369 401
127. A. Hyvárinen Estimation of non-normalized statistical models by score matching Journal of Machine Learning Research 6 April 2005 695 709
128. A. Hyvárinen Some extensions of score matching Computational Statistics and Data Analysis 51 February (5) 2007 2499 2512
129. W. James, and C. Stein Estimation with quadratic loss J. Neyman, Proceedings of the 4th Berkeley Symposium on Mathematical Statistics and Probability vol. 1 1961 University of California Press Berkeley, CA, USA 361 379
130. X. Jiang, Z.-Q. Luo, and T.T. Georgiou Geometric methods for spectral analysis IEEE Transactions on Signal Processing 60 March (3) 2012 1064 1074
131. X. Jiang, L. Ning, and T.T. Georgiou Distances and Riemannian metrics for multivariate spectral densities IEEE Transactions on Automatic Control 57 July (7) 2012 1723 1735
132. O. Johnson, and A. Barron Fisher information inequalities and the central limit theorem Probability Theory and Related Fields 129 July (3) 2004 391 409
133. R. Johnson Axiomatic characterization of the directed divergences and their linear combinations IEEE Transactions on Information Theory 25 November (6) 1979 709 716
134. L.K. Jones, and C.L. Byrne General entropy criteria for inverse problems, with applications to data compression, pattern classification, and cluster analysis IEEE Transactions on Information Theory 36 January (1) 1990 23 30
135. M.C. Jones, N. Hjort, I.R. Harris, and A. Basu A comparison of related density-based minimum divergence estimators Biometrika 88 October (3) 2001 865 873
136. A. Kagan, and T. Yu Some inequalities related to the Stam inequality Applications of Mathematics 53 3 2008 195 205
137. T. Kanamori, A. Ohara, A Bregman extension of quasi-Newton updates II: convergence and robustness properties. ArXiv:1010.2846, October 2010.
138. T. Kanamori, A. Ohara, A Bregman extension of quasi-Newton updates I: an information geometrical framework, Optimization Methods and Software 27, doi:10.1080/10556788.2011.613073, in press.
139. T. Kanamori, T. Suzuki, and M. Sugiyama f-divergence estimation and two-sample homogeneity test under semiparametric density-ratio models IEEE Transactions on Information Theory 58 February (2) 2012 708 720
140. A. Karagrigoriou, and K. Mattheou Measures of divergence in model selection C.H. Skiadas, Advances in Data Analysis. Statistics for Industry and Technology 2010 Birkhäuser Boston, MA 51 65
141. A. Karagrigoriou, and T. Papaioannou On measures of information and divergence and model selection criteria F. Vonta, M. Nikulin, N. Limnios, C. Huber-Carol, Statistical Models and Methods for Biomedical and Technical Systems. Statistics for Industry and Technology 2008 Birkhäuser Boston, MA, USA 503 518
142. J. Karlsson, T.T. Georgiou, and A.G. Lindquist The inverse problem of analytic interpolation with degree constraint and weight selection for control synthesis IEEE Transactions on Automatic Control 55 February (2) 2010 405 418
143. R.E. Kass, and P.W. Vos Geometrical Foundations of Asymptotic Inference, Series in Probability and Statistics 1997 Wiley
144. D. Kazakos On resolution and exponential discrimination between Gaussian stationary vector processes and dynamic models IEEE Transactions on Automatic Control 25 April (2) 1980 294 296
145. D. Kazakos Spectral distance measures between continuous-time vector Gaussian processes IEEE Transactions on Information Theory 28 July (4) 1982 679 684
146. D. Kazakos, and P. Papantoni-Kazakos Spectral distance measures between Gaussian processes IEEE Transactions on Automatic Control 25 October (5) 1980 950 959
147. D. Kazakos, and P. Papantoni-Kazakos Detection and Estimation 1990 Computer Science Press
148. M. Kim, and S. Lee Estimation of a tail index based on minimum density power divergence Journal of Multivariate Analysis 99 November (10) 2008 2453 2471
149. J. Kivinen, M.K. Warmuth, Boosting as entropy projection, in: Proceedings of the 12th Annual Conference on Computational Learning Theory (COLT'99), Santa Cruz, CA, USA, ACM, July 7-9, 1999, pp. 134-144.
150. J. Kivinen, M.K. Warmuth, and B. Hassibi The p-norm generalization of the LMS algorithm for adaptive filtering IEEE Transactions on Signal Processing 54 May (5) 2006 1782 1793
151. L. Knockaert A class of statistical and spectral distance measures based on Bose-Einstein statistics IEEE Transactions on Signal Processing 41 November (11) 1993 3171 3174
152. L. Knockaert, Statistical thermodynamics and natural f-divergences. unpublished paper 〈 users.ugent.be/lknockae/ 〉, 1994.
153. L. Knockaert On scale and concentration invariance in entropies Information Sciences 152 June 2003 139 144
154. R. Kompass A generalized divergence measure for nonnegative matrix factorization Neural Computation 19 March (3) 2007 780 791
155. B. Kulis, M.A. Sustik, and I.S. Dhillon Low-rank kernel learning with Bregman matrix divergences Journal of Machine Learning Research 10 February 2009 341 376
156. S. Kullback, J.C. Keegel, J.H. Kullback, Topics in Statistical Information Theory, Lecture Notes in Statistics, vol. 42, Springer-Verlag, New York, NY, USA, 1987.
157. J.D. Lafferty, Statistical learning algorithms based on Bregman distances, in: Proceedings of the Canadian Workshop on Information Theory, Toronto, Canada, June 3-6, 1997, pp. 77-80.
158. J.D. Lafferty, Additive models, boosting, and inference for generalized divergences, in: Proceedings of the 12th Annual Conference on Computational Learning Theory (COLT'99), Santa Cruz, CA, USA, ACM, July 7-9, 1999, pp. 125-133.
159. J. Lawson, and Y. Lim A Birkhoff contraction formula with application to Riccati equations SIAM Journal on Control and Optimization 46 June (3) 2007 930 951
160. G. Le Besnerais, J.-F. Bercher, and G. Demoment A new look at entropy for solving linear inverse problems IEEE Transactions on Information Theory 45 July (5) 1999 1565 1578
161. G. Lebanon, J. Lafferty, Boosting and maximum likelihood for exponential models, in: T.G. Dietterich, S. Becker, Z. Ghahramani (Eds.), Advances in Neural Information Processing Systems 14, Vancouver, British Columbia, Canada, MIT Press, Cambridge, MA, December 3-8, 2001.
162. H. Lee, and H. Lim Invariant metrics, contractions and nonlinear matrix equations Nonlinearity 21 April (4) 2008 857 878
163. A. Lefevre, F. Bach, C. Fevotte, Online algorithms for nonnegative matrix factorization with the Itakura-Saito divergence, in: Proceedings of the IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA'11), New Paltz, NY, USA, October 16-19, 2011, pp. 313-316.
164. N. Leonenko, and O. Seleznjev Statistical inference for the ε-entropy and the quadratic Rényi entropy Journal of Multivariate Analysis 101 October (9) 2010 1981 1994
165. B. Levy, and R. Nikoukhah Robust least-squares estimation with a relative entropy constraint IEEE Transactions on Information Theory 50 January (1) 2004 89 104
166. K. Li, W. Zhou, and S. Yu Effective metric for detecting distributed denial-of-service attacks based on information divergence IET Communications 3 December (12) 2009 1851 1860
167. F. Liese, I. Vajda, Convex Statistical Distances, Texte zur Mathematick, vol. 95, Teubner, Leipzig, 1987.
168. F. Liese, and I. Vajda On divergences and informations in statistics and information theory IEEE Transactions on Information Theory 52 October (10) 2006 4394 4412
169. J. Lin Divergence measures based on the Shannon entropy IEEE Transactions on Information Theory 37 January (1) 1991 145 151
170. B.G. Lindsay Efficiency versus robustness the case for minimum Hellinger distance and related methods Annals of Statistics 22 June (2) 1994 1081 1114
171. E. Lutwak, D. Yang, and G. Zhang Cramér-Rao and moment-entropy inequalities for Rényi entropy and generalized Fisher information IEEE Transactions on Information Theory 51 February (2) 2005 473 478
172. S. Ma, D. Goldfarb, and L. Chen Fixed point and Bregman iterative methods for matrix rank minimization Mathematical Programming, Series A 128 June (1-2) 2011 321 353
173. D. MacKay Information Theory, Inference & Learning Algorithms 2003 Cambridge University Press Cambridge, UK
174. P. Maji f-Information measures for efficient selection of discriminative genes from microarray data IEEE Transactions on Biomedical Engineering 56 April (4) 2009 1063 1069
175. P. Maji, and S.K. Pal Feature selection using f-information measures in fuzzy approximation spaces IEEE Transactions on Knowledge and Data Engineering 22 June (6) 2010 854 867
176. P. Mantalos, K. Mattheou, and A. Karagrigoriou An improved divergence information criterion for the determination of the order of an AR process Communications in Statistics - Simulation and Computation 39 5 2010 865 879
177. M. Markatou, A. Basu, and B.G. Lindsay Weighted likelihood equations with bootstrap root search Journal of the American Statistical Association 93 June (442) 1998 740 750
178. N. Martín, and Y. Li A new class of minimum power divergence estimators with applications to cancer surveillance Journal of Multivariate Analysis 102 September (8) 2011 1175 1194
179. A. Mathai, and P. Rathie Basic Concepts in Information Theory and Statistics 1975 Wiley Eastern Ltd New Delhi, India
180. Y. Matsuyama, Non-logarithmic information measures, α-weighted EM algorithms and speedup of learning, in: Proceedings of the IEEE International Symposium on Information Theory (ISIT'98), Cambridge, MA, USA, August 16-21, 1998, p. 385.
181. Y. Matsuyama, The α-EM algorithm and its applications, in: Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP'00), vol. 1, Istanbul, Turkey, June 5-9, 2000, pp. 592-595.
182. Y. Matsuyama The α-EM algorithm surrogate likelihood maximization using alpha-logarithmic information measures IEEE Transactions on Information Theory 49 March (3) 2003 692 706
183. Y. Matsuyama, N. Katsumata, S. Imahara, Convex divergence as a surrogate function for independence: the f-divergence, in: T.-W, Lee, T.-P. Jung, S. Makeig, T.J. Sejnowski, (Eds.), Proceedings of the 3rd International Conference on Independent Component Analysis and Blind Signal Separation, San Diego, CA, USA, December 2001, pp. 31-36.
184. K. Mattheou, S. Lee, and A. Karagrigoriou A model selection criterion based on the BHHJ measure of divergence Journal of Statistical Planning and Inference 139 February (2) 2009 228 235
185. F. Matus Divergence from factorizable distributions and matroid representations by partitions IEEE Transactions on Information Theory 55 December (12) 2009 5375 5381
186. K. Matusita Discrimination and the affinity of distributions T. Cacoullos, Discriminant Analysis and Applications 1973 Academic Press New York, USA 213 223
187. N. Merhav Data processing theorems and the second law of thermodynamics IEEE Transactions on Information Theory 57 August (8) 2011 4926 4939
188. M. Minami, and S. Eguchi Robust blind source separation by beta divergence Neural Computation 14 August (8) 2002 1859 1886
189. T. Minka, Divergence Measures and Message Passing, Technical Report MSR-TR-2005-173, Microsoft Research Ltd, 2005.
190. A. Mnih, G. Hinton, Learning nonlinear constraints with contrastive backpropagation, in: D.V. Prokhorov (Ed.), Proceedings of the IEEE International Joint Conference on Neural Networks (IJCNN'05), vol. 2, Montréal, Québec, Canada, July 31-August 4, 2005, pp. 1302-1307.
191. M. Moakher, and P.G. Batchelor Symmetric positive-definite matrices from geometry to applications and visualization J. Weickert, H. Hagen, Visualization and Processing of Tensor Fields Mathematics - Visualization vol. 17 2006 Springer-Verlag 285 298
192. M.N.H. Mollah, M. Minami, and S. Eguchi Exploring latent structure of mixture ICA models by the minimum β-divergence method Neural Computation 18 January (1) 2006 166 190
193. T. Morimoto Markov processes and the H-theorem Journal of the Physical Society of Japan 18 March (3) 1963 328 331
194. N. Murata, T. Takenouchi, T. Kanamori, and S. Eguchi Information geometry of U-Boost and Bregman divergence Neural Computation 16 July (7) 2004 1437 1481
195. A. Nascimento, R. Cintra, and A. Frery Hypothesis testing in speckled data with stochastic distances IEEE Transactions on Geoscience and Remote Sensing 48 January (1) 2010 373 385
196. G. Nason Robust projection indices Journal of the Royal Statistical Society - Series B Methodological 63 3 2001 551 567
197. S. Natarajan Large deviations, hypotheses testing, and source coding for finite Markov chains IEEE Transactions on Information Theory 31 May (3) 1985 360 365
198. P. Nath On a coding theorem connected with Rényi's entropy Information and Control 29 November (3) 1975 234 242
199. X. Nguyen, M.J. Wainwright, and M.I. Jordan On surrogate loss functions and f-divergences Annals of Statistics 37 April (2) 2009 876 904
200. X. Nguyen, M.J. Wainwright, and M.I. Jordan Estimating divergence functionals and the likelihood ratio by convex risk minimization IEEE Transactions on Information Theory 56 November (11) 2010 5847 5861
201. F. Nielsen, and S. Boltz The Burbea-Rao and Bhattacharyya centroids IEEE Transactions on Information Theory 57 August (8) 2011 5455 5466
202. F. Nielsen, and R. Nock Sided and symmetrized Bregman centroids IEEE Transactions on Information Theory 55 June (6) 2009 2882 2904
203. F. Nielsen, P. Piro, M. Barlaud, Bregman vantage point trees for efficient nearest neighbor queries, in: Q. Sun, Y. Rui (Eds.), Proceedings of the IEEE International Conference on Multimedia and Expo (ICME'09), New York, NY, USA, June 28-July 3, 2009, pp. 878-881.
204. T. Nishimura, and F. Komaki The information geometric structure of generalized empirical likelihood estimators Communications in Statistics - Theory and Methods 37 January (12) 2008 1867 1879
205. R. Nock, and F. Nielsen Bregman divergences and surrogates for learning IEEE Transactions on Pattern Analysis and Machine Intelligence 31 November (11) 2009 2048 2059
206. L. Pardo Statistical Inference Based on Divergence Measures, Chapman & Hall/CRC Monographs on Statistics & Applied Probability 2006 CRC Press, Taylor & Francis Group Boca Raton, FL
207. L. Pardo, M. Salicrú, M.L. Menéndez, and D. Morales Divergence measures based on entropy functions and statistical inference Sankhyā The Indian Journal of Statistics - Series B 57 December (3) 1995 315 337
208. M. Pardo, and I. Vajda On asymptotic properties of information-theoretic divergences IEEE Transactions on Information Theory 49 July (7) 2003 1860 1867
209. R.K. Patra, A. Mandal, and A. Basu Minimum Hellinger distance estimation with inlier modification Sankhyā The Indian Journal of Statistics - Series B 70 November (2) 2008 310 323
210. M. Pavon, and A. Ferrante On the Georgiou-Lindquist approach to constrained Kullback-Leibler approximation of spectral densities IEEE Transactions on Automatic Control 51 April (4) 2006 639 644
211. M. Pavon, A. Ferrante, On the geometry of maximum entropy problems. ArXiv:1112.5529, December 2011.
212. B. Pelletier Informative barycentres in statistics Annals of the Institute of Statistical Mathematics 57 December (4) 2005 767 780
213. B. Pelletier Inference in φ-families of distributions Statistics - A Journal of Theoretical and Applied Statistics 45 3 2011 223 237
214. A. Perez Barycenter of a set of probability measures and its application in statistical decision T. Havranek, Z. Sidak, M. Novak, Proceedings of the 6th Prague Symposium on Computational Statistics, COMPSTAT'84 1984 Physica-Verlag Wien, AUS 154 159
215. D. Petz Monotone metrics on matrix spaces Linear Algebra and its Applications 244 September 1996 81 96
216. D. Petz, and R. Temesi Means of positive numbers and matrices SIAM Journal on Matrix Analysis and Applications 27 3 2005 712 720
217. D.-T. Pham, F. Vrins, and M. Verleysen On the risk of using Rényi's entropy for blind source separation IEEE Transactions on Signal Processing 56 October (10) 2008 4611 4620
218. J.P.W. Pluim, J.B.A. Maintz, and M.A. Viergever f-Information measures in medical image registration IEEE Transactions on Medical Imaging 23 December (12) 2004 1508 1516
219. B. Poczos, L. Xiong, J. Schneider, Nonparametric divergence estimation with applications to machine learning on distributions. ArXiv:1202.3758, February 2012.
220. J.C. Principe Information Theoretic Learning Renyi's Entropy and Kernel Perspectives, Information Science and Statistics 2008 Springer-Verlag
221. Y. Qiao, and N. Minematsu A study on invariance of f-divergence and its application to speech recognition IEEE Transactions on Signal Processing 58 July (7) 2010 3884 3890
222. F. Ramponi, A. Ferrante, and M. Pavon A globally convergent matricial algorithm for multivariate spectral estimation IEEE Transactions on Automatic Control 54 October (10) 2009 2376 2388
223. C.R. Rao Information and accuracy attainable in the estimation of statistical parameters Bulletin of the Calcutta Mathematical Society 37 1945 81 91
224. C.R. Rao Diversity and dissimilarity coefficients a unified approach Theoretical Population Biology 21 February (1) 1982 24 43
225. C.R. Rao Diversity its measurement, decomposition, apportionment and analysis Sankhyā The Indian Journal of Statistics - Series A 44 1 1982 1 22
226. C.R. Rao Rao's axiomatization of diversity measures S. Kotz, N.L. Johnson, Encyclopedia of Statistical Sciences vol. 7 1986 John Wiley & Sons Ltd 614 617
227. C.R. Rao Differential metrics in probability spaces S.-I. Amari, O.E. Barndorff-Nielsen, R.E. Kass, S.L. Lauritzen, C.R. Rao, Differential Geometry in Statistical Inference, Lecture Notes - Monograph Series vol. 10 1987 Institute of Mathematical Statistics Hayward, CA, USA 217 240
228. C.R. Rao, and T. Nayak Cross entropy, dissimilarity measures, and characterizations of quadratic entropy IEEE Transactions on Information Theory 31 September (5) 1985 589 593
229. J. Rauh Finding the maximizers of the information divergence from an exponential family IEEE Transactions on Information Theory 57 June (6) 2011 3236 3247
230. P. Ravikumar, A. Agarwal, and M.J. Wainwright Message-passing for graph-structured linear programs proximal methods and rounding schemes Journal of Machine Learning Research 11 March 2010 1043 1080
231. T. Read, and N. Cressie Goodness-of-Fit Statistics for Discrete Multivariate Data. Statistics 1988 Springer NY
232. M.D. Reid, and R.C. Williamson Composite binary losses Journal of Machine Learning Research 11 September 2010 2387 2422
233. M.D. Reid, and R.C. Williamson Information, divergence and risk for binary experiments Journal of Machine Learning Research 12 March 2011 731 817
234. A. Rényi On measures of information and entropy J. Neyman, Proceedings of the 4th Berkeley Symposium on Mathematical Statistics and Probability vol. 1 1961 University of California Press Berkeley, CA, USA 547 561
235. A. Rényi On some basic problems of statistics from the point of view of information theory L.M. Le Cam, J. Neyman, Proceedings of the 5th Berkeley Symposium on Mathematical Statistics and Probability vol. 1 1967 University of California Press Berkeley, CA, USA 531 543
236. A. Roman, S. Jolad, M.C. Shastry, Bounded divergence measures based on Bhattacharyya coefficient. ArXiv:1201.0418, January 2012.
237. W. Sander Measures of information E. Pap, Handbook of Measure Theory vol. 2 2002 North-Holland Amsterdam, NL 1523 1565
238. R. Santos-Rodriguez, D. Garcia-Garcia, J. Cid-Sueiro, Cost-sensitive classification based on Bregman divergences for medical diagnosis, in: M.A. Wani (Ed.), Proceedings of the 8th International Conference on Machine Learning and Applications (ICMLA'09), Miami Beach, FL, USA, December 13-15, 2009, pp. 551-556.
239. M.P. Schützenberger, Contribution aux applications statistiques de la théorie de l'information. Thèse d'État, Inst. Stat. Univ. Paris, 1953 (in French).
240. F.C. Schweppe On the Bhattacharyya distance and the divergence between Gaussian processes Information and Control 11 October (4) 1967 373 395
241. F.C. Schweppe State space evaluation of the Bhattacharyya distance between two Gaussian processes Information and Control 11 September (3) 1967 352 372
242. J. Shore, and R. Johnson Properties of cross-entropy minimization IEEE Transactions on Information Theory 27 July (4) 1981 472 482
243. J.E. Shore, and R.M. Gray Minimum cross-entropy pattern classification and cluster analysis IEEE Transactions on Pattern Analysis and Machine Intelligence 4 January (1) 1982 11 17
244. S. Si, D. Tao, and B. Geng Bregman divergence-based regularization for transfer subspace learning IEEE Transactions on Knowledge and Data Engineering 22 July (7) 2010 929 942
245. R. Sibson Information radius Probability Theory and Related Fields 14 June (2) 1969 149 160
246. B.K. Sriperumbudur, A. Gretton, K. Fukumizu, G.R.G. Lanckriet, B. Schölkopf, On integral probability metrics, φ-divergences and binary classification. ArXiv:0901.2698, January 2009.
247. S. Srivastava, M.R. Gupta, and B.A. Frigyik Bayesian quadratic discriminant analysis Journal of Machine Learning Research 8 June 2007 1277 1305
248. F. Österreicher, and I. Vajda A new class of metric divergences on probability spaces and its applicability in statistics Annals of the Institute of Statistical Mathematics 55 September (3) 2003 639 653
249. A.A. Stoorvogel, and J.H. van Schuppen Approximation problems with the divergence criterion for Gaussian variables and Gaussian processes Systems and Control Letters 35 November (4) 1998 207 218
250. W. Stummer, and I. Vajda On divergences of finite measures and their applicability in statistics and information theory Statistics - A Journal of Theoretical and Applied Statistics 44 April (2) 2010 169 187
251. W. Stummer, and I. Vajda On Bregman distances and divergences of probability measures IEEE Transactions on Information Theory 58 March (3) 2012 1277 1288
252. M. Sugiyama, T. Suzuki, T. Kanamori, Density-ratio matching under the Bregman divergence: a unified framework of density-ratio estimation. Annals of the Institute of Statistical Mathematics 64 (2) (2012), 1009-1044
253. Y. Sung, L. Tong, and H.V. Poor Neyman-Pearson detection of Gauss-Markov signals in noise closed-form error exponent and properties IEEE Transactions on Information Theory 52 April (4) 2006 1354 1365
254. I. Sutskever, T. Tieleman, On the convergence properties of contrastive divergence, in: Y.W. Teh, M. Titterington (Eds.), Proceedings of the 13th International Workshop on Artificial Intelligence and Statistics (AISTATS'10), Chia Laguna, Sardinia, Italy, May 13-15, 2010, pp. 78-795.
255. I.J. Taneja On generalized information measures and their applications Advances in Electronics and Electron Physics 76 1989 327 413
256. I.J. Taneja, Generalized Information Measures and Their Applications. 〈 www.mtm.ufsc.br/taneja/book/book.html 〉, 2001.
257. B. Taskar, S. Lacoste-Julien, and M.I. Jordan Structured prediction, dual extragradient and Bregman projections Journal of Machine Learning Research 7 July 2006 1627 1653
258. M. Teboulle A unified continuous optimization framework for center-based clustering methods Journal of Machine Learning Research 8 January 2007 65 102
259. M. Teboulle, P. Berkhin, I.S. Dhillon, Y. Guan, and J. Kogan Clustering with entropy-like k-means algorithms J. Kogan, C. Nicholas, M. Teboulle, Grouping Multidimensional Data - Recent Advances in Clustering 2006 Springer-Verlag Berlin, Heidelberg 127 160
260. A. Toma, and M. Broniatowski Dual divergence estimators and tests robustness results Journal of Multivariate Analysis 102 January (1) 2011 20 36
261. F. Topsoe Some inequalities for information divergence and related measures of discrimination IEEE Transactions on Information Theory 46 July (4) 2000 1602 1609
262. E. Torgersen Comparison of Statistical Experiments, Encyclopedia of Mathematics and its Applications vol. 36 1991 Cambridge University Press Cambridge, UK
263. J. Touboul Projection pursuit through minimisation φ-divergence Entropy 12 June (6) 2010 1581 1611
264. K. Tsuda, G. Rätsch, and M.K. Warmuth Matrix exponentiated gradient updates for on-line learning and Bregman projection Journal of Machine Learning Research 6 June 2005 995 1018
265. M. Tsukada, H. Suyari, Tsallis differential entropy and divergences derived from the generalized Shannon-Khinchin axioms, in: Proceedings of the IEEE International Symposium on Information Theory (ISIT'09), Seoul, Korea, June 28-July 3, 2009, pp. 149-153.
266. J. Vachery, A. Dukkipati, On Shore and Johnson properties for a special case of Csiszár f-divergences. ArXiv:1201.4285, January 2012.
267. α-divergence and generalized Fisher's information J. Kozesnik, Transactions of the 6th Prague Conference on Information Theory, Statistical Decision Functions, Random Processes, Prague, September 19-25, 1971 1973 Academia Prague 873 886
268. I. Vajda Theory of Statistical Inference and Information, Series B Mathematical and Statistical Methods vol. 11 1989 Kluwer Academic Publishers Dordrecht
269. I. Vajda, Modifications of Divergence Criteria for Applications in Continuous Families, Research Report 2230, Academy of Sciences of the Czech Republic, Institute of Information Theory and Automation, November 2008.
270. I. Vajda On metric divergences of probability measures Kybernetika 45 6 2009 885 900
271. B. Vemuri, M. Liu, S. Amari, and F. Nielsen Total Bregman divergence and its applications to DTI analysis IEEE Transactions on Medical Imaging 30 February (2) 2011 475 483
272. C. Vignat, A.O. Hero, J.A. Costa, A geometric characterization of maximum Rényi entropy distributions, in: Proceedings of the IEEE International Symposium on Information Theory (ISIT'06), Seattle, Washington, USA, July 2006, pp. 1822-1826.
273. F. Vrins, D.-T. Pham, M. Verleysen, Is the general form of Renyi's entropy a contrast for source separation?, in: M.E. Davies, C.J. James, S.A. Abdallah, M.D. Plumbley (Eds.), Proceedings of the 7th International Conference on Independent Component Analysis and Blind Source Separation (ICA'07), London, UK, Lecture Notes in Computer Science, Lecture Notes in Computer Science, vol. 4666, September 9-12, 2007, Springer-Verlag, Berlin, Heidelberg, FRG, 2007, pp. 129-136.
274. Q. Wang, S.R. Kulkarni, and S. Verdu Divergence estimation for multidimensional densities via k-nearest-neighbor distances IEEE Transactions on Information Theory 55 May (5) 2009 2392 2405
275. S. Wang, D. Schuurmans, Learning continuous latent variable models with Bregman divergences, in: R. Gavaldà, K.P. Jantke, E. Takimoto (Eds.), Proceedings of the 14th International Conference on Algorithmic Learning Theory (ALT'03), Sapporo, Japan, Lecture Notes in Artificial Intelligence, vol. 2842, Springer-Verlag, Berlin Heidelberg, October 17-19, 2003, pp. 190-204.
276. L. Wu, R. Jin, S.C.-H. Hoi, J. Zhu, N. Yu, Learning Bregman distance functions and its application for semi-supervised clustering, in: Y. Bengio, D. Schuurmans, J. Lafferty, C.K.I. Williams, A. Culotta (Eds.), Advances in Neural Information Processing Systems 22, Vancouver, British Columbia, Canada, NIPS Foundation, December 7-10, 2009, pp. 2089-2097.
277. Y. Wu, Y. Jin, and M. Chen Model selection in loglinear models using φ-divergence measures and MφE s Sankhyā The Indian Journal of Statistics - Series A 71 2 2009 260 283
278. R.W. Yeung A First Course in Information Theory. Information Technology Transmission, Processing and Storage 2002 Springer-Verlag
279. R.W. Yeung Information Theory and Network Coding. Information Technology Transmission, Processing and Storage 2008 Springer-Verlag
280. 1-minimization with applications to compressed sensing SIAM Journal on Imaging Sciences 1 1 2008 143 168
281. S. Yu, and P.G. Mehta The Kullback-Leibler rate pseudo-metric for comparing dynamical systems IEEE Transactions on Automatic Control 55 July (7) 2010 1585 1598
282. R.G. Zaripov, New Measures and Methods in Information Theory. A. N. Tupolev State Technical University Press, Kazan, Tatarstan, 〈 www.imm.knc.ru/zaripov-measures.html 〉, 2005 (in Russian).
283. J. Zhang Divergence function, duality, and convex analysis Neural Computation 16 January (1) 2004 159 195
284. J. Ziv, and M. Zakaï On functionals satisfying a data-processing theorem IEEE Transactions on Information Theory 19 May (3) 1973 275 283