Direct approximation of quadratic mutual information and its application to dependence-maximization clustering

IEICE Transactions on Information and Systems

Volumn E96-D, Issue 10, 2013, Pages 2282-2285

  Sainui, Janya ^a   Sugiyama, Masashi ^a  

^a Tokyo Institute of Technology ^*  (Japan)

Author keywords

Information theoretic clustering; Least square density difference estimation; Quadratic mutual information

Indexed keywords

STATISTICS;

DENSITY DIFFERENCE; INFORMATION THEORETIC CLUSTERING; LEAST SQUARES; MUTUAL INFORMATIONS; PROBABILITY DENSITIES; QUADRATIC MUTUAL INFORMATION; STATISTICAL DEPENDENCE; SYSTEM OF LINEAR EQUATIONS;

ESTIMATION;

EID: 84885047407     PISSN: 09168532     EISSN: 17451361     Source Type: Journal    
DOI: 10.1587/transinf.E96.D.2282     Document Type: Article

References (11)

1. M. Kimura and M. Sugiyama, "Dependence-maximization clustering with least-squares mutual information," J. Advanced Computational Intelligence and Intelligent Informatics, vol.15, no.7, pp.800-805, 2011.
2. S. Kullback and R.A. Leibler, "On information and sufficiency," Annals of Mathematical Statistics, vol.22, pp.79-86, 1951.
3. K. Pearson, "On the criterion that a given system of deviations from the probable in the case of a correlated system of variables is such that it can be reasonably supposed to have arisen from random sampling," Philosophical Magazine Series 5, vol.50, no.302, pp.157-175, 1900.
4. C. Shannon, "A mathematical theory of communication," Bell Syst. Tech. J., vol.27, pp.379-423, 1948.
5. L. Song, A. Smola, A. Gretton, and K. Borgwardt, "A dependence maximization view of clustering," Proc. 24th Annual International Conference on Machine Learning, pp.815-822, 2007.
6. M. Sugiyama, T. Suzuki, and T. Kanamori, Density Ratio Estimation in Machine Learning, Cambridge University Press, Cambridge, UK, 2012.
7. M. Sugiyama, T. Suzuki, and T. Kanamori, "Density ratio matching under the Bregman divergence: A unified framework of density ratio estimation," Annals of the Institute of Statistical Mathematics, vol.64, no.5, pp.1009-1044, 2012.
8. M. Sugiyama, T. Suzuki, T. Kanamori, M.C. du Plessis, S. Liu, and I. Takeuchi, "Density-difference estimation," Neural Computation, to appaer.
9. T. Suzuki, M. Sugiyama, T. Kanamori, and J. Sese, "Mutual information estimation reveals global associations between stimuli and biological processes," BMC Bioinformatics, vol.10, no.1, p.S52 (12 pages), 2009.
10. T. Suzuki, M. Sugiyama, J. Sese, and T. Kanamori, "Approximating mutual information by maximum likelihood density ratio estimation," JMLR Workshop and Conference Proceedings, vol.4, pp.5-20, 2008.
11. K. Torkkola, "Feature extraction by non-parametric mutual information maximization," J. Machine Learning Research, vol.3, pp.1415-1438, 2003. Technology