A hierarchical clustering based on mutual information maximization

Proceedings - International Conference on Image Processing, ICIP

Volumn 1, Issue , 2006, Pages 277-280

  Aghagolzadeh, M ^a   Soltanian Zadeh, H ^a,c   Araabi, B ^a   Aghagolzadeh, A ^b  

^a UNIVERSITY OF TEHRAN   (Iran)

^b UNIVERSITY OF TABRIZ   (Iran)

^c HENRY FORD HEALTH SYSTEM   (United States)

Author keywords

Agglomerative hierarchical clustering; Information potential; Mutual information (MI); Renyi's entropy

Indexed keywords

HIERARCHICAL CLUSTERING; IMAGE PROCESSING;

AGGLOMERATIVE HIERARCHICAL CLUSTERING; INFORMATION POTENTIAL; INFORMATION-BASED CLUSTERING; LOW COMPUTATIONAL COMPLEXITY; MUTUAL INFORMATION MAXIMIZATION; MUTUAL INFORMATIONS; ORDINARY CLUSTERING ALGORITHMS; RENYI'S ENTROPY;

CLUSTERING ALGORITHMS;

EID: 48149100444     PISSN: 15224880     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICIP.2007.4378945     Document Type: Conference Paper

References (17)

1. E. Anderson, "The Irises of the Gaspe peninsula," Bulletin of the American Iris Society, vol. 59, pp. 2-5, 1935.
2. J. C. Bezdek, Pattern Recognition with Fuzzy Objective Function Algorithms, Plenum Press, New York, 1981.
3. R. O. Duda, P. E. Hart, and D. G. Stork, Pattern Classification and Scene Analysis, John Wiley & sons, 2001.
4. R. A. Fisher, "The use of multiple measurements in taxonomic problems," Annuals of Eugenics, vol. 7, pp. 179-188, 1936.
5. E. Gokcay, and J. C. Principe, "Information Theoretic Clustering," IEEE Transaction on PAMI, Vol. 24, No. 2, February pp. 158-171, 2002.
6. R. Jenssen, D. Erdogmus, K. E. Hild, J. C. Principe and T. Eltoft, "Infonnation force clustering using directed trees," EMMCVPR, pp. 68-82, 2003.
7. J. N. Kapur, Measures of information, and their applications, Wiley, New Delhi, India, 1994.
8. A. Kraskov, H. Stogbauer, R. G. Andrzejak, and P. Grassberger, "Hierarchical Clustering Based on Mutual Information," http://arxiv.org/abs/q-bio/0311039, 2003.
9. E. Parzen, "On the estimation of probability density function, and the mode, the Annals of Mathematical Statistics, vol. 33, pp. 1065, 1962.
10. J. C. Principe, D. Xu, and J. W. Fisher III, "Information theoretic learning," in: S. Haykin (Ed.), Unsupervised Adaptive Filtering: Blind Source Separation, John Wiley & Sons Inc., pp. 265-319, 2000.
11. A. Renyi, "On Measures of Entropy and Information," in Proceedings of the Fourth Berkeley Sympodium on Mathematics of Statistics and Probability, vol. 1, pp. 547-561, 1961.
12. C. E. Shannon, "A Mathematical Theory of Communication," Bell System Technical Journal, Vol. 27, July pp 379-423, October pp. 623-656, 1948.
13. B. W. Silverman, Density estimation for statistics and data analysis, Chapman and Hall, 1986.
14. S. Theodoridis and K. Koutroumbas, Pattern Recognition, Academic Press, 1999.
15. K. Torkkola, "Feature Extraction by Non-Parametric Mutual Infonnation Maximization," Journal of Machine Learning Research, vol. 3, pp 1415-1438, 2003.
16. P. Vincent and Y. Bengio, "Manifold Parzen windows," Advances in Neural Information Processing Systems, vol. 12, MIT Press, pp 825-832, 2003.
17. X. Zhou, X. Wang, E. R. Dougherty, D. Russ, and E. Suh, "Gene Clustering Based on Clusterwide Mutual Infonnation," Computational Biology, vol. 11, no. 1, pp. 147-161, 2004.