A note on metric properties for some divergence measures: The Gaussian case

Journal of Machine Learning Research

Volumn 25, Issue , 2012, Pages 1-15

  Abou Moustafa, Karim T ^a   Ferrie, Frank P ^b  

^a UNIVERSITY OF ALBERTA   (Canada)

^b MCGILL UNIVERSITY   (Canada)

Author keywords

Divergence measures; Gaussian densities; Manifold learning; Riemannian metric for covariance matrices

Indexed keywords

BHATTACHARYYA DISTANCE; COVARIANCE MATRICES; DIVERGENCE MEASURES; GAUSSIAN DENSITY; MANIFOLD LEARNING; MANIFOLD LEARNING ALGORITHM; METRIC PROPERTIES; UNFOLDING PROCESS;

COVARIANCE MATRIX; GAUSSIAN DISTRIBUTION; LEARNING SYSTEMS; PATTERN RECOGNITION;

LEARNING ALGORITHMS;

EID: 84876882135     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Conference Paper

References (31)

1. K. Abou-Moustafa and F. Ferrie. A framework for hypothesis learning over sets of vectors. In Proc. of 9th SIGKDD Workshop on Mining and Learning with Graphs, pages 335-344. ACM, 2011.
2. K. Abou-Moustafa, F. De La Torre, and F. Ferrie. Designing a metric for the diffierence between two Gaussian densities. In Advances in Intelligent and Soft Computing, volume 83, pages 57 - 70. Springer, 2010.
3. K. Abou-Moustafa, M. Shah, F. De La Torre, and F. Ferrie. Relaxed exponenrial kernels for unsupervised learning. In LNCS 6835, Pattern Recognition, Proc. of the 33rd DAGM Symp., pages 335-344. Springer, 2011.
4. S. M. Ali and S. D. Silvey. A general class of coefficients of divergence of one distribution from another. J. of the Royal Statistical Society. Series B, 28(1):131-142, 1966.
5. C. Atkinson and A. F. S. Mitchell. Rao's distance measure. The Indian J. of Statistics, Series A, 43(3):345-365, 1945.
6. M. Belkin and P. Niyogi. Laplacian eigenmaps and spectral techniques for data representation. Neural Computation, 15:1373-1396, 2003.
7. J. Briët and P. Harremoës. Properties of classical and quantum jensen-shannon divergence. Phys. Rev. A, 79, May 2009.
8. G. Cao, L. Bachega, and C. Bouman. The sparse matrix transform for covariance estimation and analysis of high dimensional signals. IEEE. Trans. on Image Processing, 20(3):625 - 640, Mar. 2011.
9. I. Csiszár. Information-type measures of difference of probability distributions and indirect observations. Studia Scientiarium Mathematicarum Hungarica, 2:299-318, 1967.
10. W. Förstner and B. Moonen. A metric for covariance matrices. Technical report, Dept. of Geodesy and Geo-Informatics, Stuttgart University, 1999.
11. B. Fuglede and F. Topsøe. Jensen-Shannon divergence and Hilbert space embedding. In Proc. of the Int. Symp. on Information Theory, 2004.
12. J. Gower and P. Legendre. Metric and Euclidean properties of dissimilarity coefficients. J. of Classification, 3:5-48, 1986.
13. T. Kailath. The divergence and Bhattacharyya distance measures in signal selection. IEEE Trans. on Communication Technology, 15(1):52-60, 1967.
14. R. Kondor and T. Jebara. A kernel between sets of vectors. In ACM Proc. of ICML, 2003.
15. E. Kreyszig, editor. Introductory functional Analysis with Applications. Wiley Classics Library, 1989.
16. S. Kullback. Information Theory and Statistics - Dover Edition. Dover, New York, 1997.
17. I. Laptev, M. Marsza lek, C. Schmid, and B. Rozenfeld. Learning realistic human actions from movies. In IEEE Proc. of CVPR, 2008.
18. B. Lucas and T. Kanade. An iterative image registration technique with an application to stereo vision. In Proc. of IJCAI, pages 674-679, 1981.
19. U. von Luxburg. A tutorial on spectral clustering. Statistics and Computing, 17(4):395-416, 2007.
20. J. Mercer. Functions of positive and negative type, and their connection with the theory of integral equations. Philosophical Trans. of the Royal Society of London. Series A, 209: 415-446, 1909.
21. P. Moreno, P. Ho, and N. Vasconcelos. A Kullback-Leibler divergence based kernel for svm classification in multimedia applications. In NIPS 16, 2003.
22. P. Natarajan and Others. BBN VISER TRECVID 2011 multimedia event detection system. Technical report, Raytheon BBN Technologies, Columbia University, University of Central Florida, and University of Maryland at College Park, Dec. 2011.
23. X. Pennec, P. Fillard, and N. Ayache. A Riemannian Framework for Tensor Computing. Technical Report RR-5255, INRIA, 7 2004.
24. C. R. Rao. Information and the accuracy attainable in the estimation of statistical parameters. Bull. Calcutta Math. Soc., (58):326-337, 1945.
25. I. Saleemi, L. Hartung, and M. Shah. Scene understanding by statistical modelling of motion patterns. In IEEE Proc. of CVPR, pages 2069 - 2076, 2010.
26. I. Schoenberg. Metric spaces and positive definite functions. Trans. of the American Mathematical Society, 44(3):522-536, 1938.
27. C. Schüldt, I. Laptev, and B. Caputo. Recognizing human actions: A local SVM approach. In In Proc. of ICPR, pages 32-36, 2004.
28. J. Tenenbaum, V. de Silva, and J. Langford. A global geometric framework for nonlinear dimensionality reduction. Science, 290(5500):2319-2323, November 2000.
29. G. Young and A. Householder. Discussion of a set of points in terms of their mutual distances. Psychometrika, 3(1):19-22, 1938.
30. L. Zelnik-Manor and M. Irani. Event-based analysis of video. In IEEE Proc. of CVPR, pages 1063-6919, 2001.
31. H. Zha, C. Ding, M Gu, X. He, and H. Simon. Spectral relaxation for k-means clustering. In NIPS 13. MIT Press, 2001.