Information cut and information forces for clustering

Neural Networks for Signal Processing - Proceedings of the IEEE Workshop

Volumn 2003-January, Issue , 2003, Pages 459-468

  Jenssen, Robert ^a,b   Principe, Jose C ^a   Eltoft, Torbjørn ^b  

^a UNIVERSITY OF FLORIDA   (United States)

^b UNIVERSITY OF TROMSØ   (Norway)

Author keywords

[No Author keywords available]

Indexed keywords

DECISION TREES; DENSITY FUNCTIONAL THEORY; FUNCTION EVALUATION; GRAPH THEORY; INFORMATION THEORY; SIGNAL PROCESSING; TREES (MATHEMATICS);

CLUSTER EVALUATIONS; CLUSTERING METHODS; DATA SET; DIRECTED TREES; DIVERGENCE MEASURES; GAUSSIAN KERNELS; NOVEL INFORMATION; NUMBER OF CLUSTERS;

PROBABILITY DENSITY FUNCTION;

EID: 84921517406     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/NNSP.2003.1318045     Document Type: Conference Paper

References (21)

1. A. Ben-Hur, D. Horn, H. T. Siegelmann and V. Vapnik, "Support Vector Clustering," Journal of Machine Learning Research, vol. 2; pp. 125-137, 2001.
2. N. Cristianini, J. Shawe-Taylor and J. Kandola, "Spectral Kernel Methods for Clustering," in Advances in Neural Information Processing Systems, 2002, vol. 1, pp. 649455.
3. C. H. Q. Ding, X. He, H. Zha, h4. Gu and H. D. Simon, "A Min-max Cut Algorithm for Graph Partitioning and Data Clustering," in IEEE Int. Conf. on Data Mining, 2001, pp. 107-114.
4. T. Eltoft and R. J. P. deFigueiredo, "A New Neural Network for Cluster-Detection-and-Labeling," IEEE Transactions on Neural Networks, vol. 9, no. 5, pp. 1021-1035, 1998.
5. K. Fukunaga, Introduction to Statistical Pattern Recognition, New York: Academic Press, 1990.
6. Y. Gdalyahu, D. Weinshall and M. \Verman, "Self-Organization in Vision: Stochastic Clusterine for Imaee Sewentation. Percentud Grounine. and Im-I I I. I I age Database Organization," IEEE 'Pransactions on Pattern Analysis and Machine Intelligence, vol. 23, no. 10, pp. 1053-1074, 2001.
7. M. Girolami, "Mercer Kernel-Based Clustering in Feature Space," IEEE Transactions on Neural Networks, vol. 13, no. 3, pp. 780-784, 2002.
8. E. Gokcay and J. Principe, "Information Theoretic Clustering," IEEE Transactions on, Pattern Analysis and Machine Intelligence, vol. 24, no. 2, pp. 158-170, 2002.
9. A. K. Jain and R. C. Duhes, Algorithms for Clustering Data, Prentice Hall, Englewood C l i, NJ, 1988.
10. R. Jenssen, D. Erdogmus, K. E. Hild, J. C. Principe and T. Eltoft, "Information Force Clustering using Directed Trees," in Accepted to International Workshop, on Energy Minimization Methods in Computer Vision and Pattern Recognition, Lisbon, Portugal, 2003.
11. R. Jenssen, K. E. Hild, D. Erdogmus, J. C. Principe and T. Eltoft, "Clustering using Flenyi's Entropy," in Accepted to International Joint Conference on Neural.Networks, Portland, Oregon, USA, 2003.
12. J. McQueen, "Some Methods for Classification and Analysis of Multivariate Observations," in FiRh Berkeley Symposium on Mathematical Statistics and Probability, 1967, pp. 281-297.
13. E. Parzen, "On the Estimation of a Probability Density Function and the Mode," Ann. Math. Stat., vol. 32, pp. 1065-1076, 1962.
14. J. Principe, D. Xu and J. Fisher, "Information Theoretic Learning," in Unsupervised Adaptive Filtering, S. Haykin (Ed.), John Wiley & Sons, 2000, vol. I, Chapter 7.
15. A. Renyi, "On Measures of Entropy and Information," in Fourth Berkeley Symposium on Mathematical Statistics and Probability, 1960, pp. 547-561.
16. S. J. Robe&, R. Evemon and 1. Rezek, "Minimum Entropy Data Partitioning," in Ninth International Conference on Artificial Neural Networks, 1999, vol. 2, pp. 844-849.
17. J. Scanlon and N. Deo, "Graph-Theoretic Algorithms for Image Segmentation," in IEEE International Symposium on Circuits and Systems, Orlando, Florida, 1999, pp. VI141-144.
18. J. Shi andbJ. Malik, "Normalized Cuts and Image Segmentation," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 22, no. 8: pp. 888-905, 2000.
19. N. Tishhy and N. Slonim, "Data Clustering by Markovian Relaxation and the Information Bottleneck Method," in Advances in Neural Information Processing Systems, Denver, USA, 2000, vol. 13, pp. 64Cb646.
20. S. Watanabe, Pattern Recognition: Human and Mechanical, John Wiley & sons, 1985.
21. Z. Wu and R. Leahy, "An Optimal Graph Theoretic Approach to Data Clus tering: Theory and Its Applications to Image Segmentation," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 15, no. 11, pp. 1101-1113, 1993.