Factor analysis latent subspace modeling and robust fuzzy clustering using t-distributions

IEEE Transactions on Fuzzy Systems

Volumn 17, Issue 3, 2009, Pages 505-517

  Chatzis, Sotirios ^a,b   Varvarigou, Theodora ^a  

^a NATIONAL TECHNICAL UNIVERSITY OF ATHENS   (Greece)

^b UNIVERSITY OF MIAMI   (United States)

Author keywords

Factor analysis; Fuzzy clustering; Kullback Leibler divergence; Local subspace modeling; Student's t distribution

Indexed keywords

CLUSTERING APPROACH; CLUSTERING PROCEDURE; CLUSTERING SCHEME; DIMENSIONALITY REDUCTION; DISTRIBUTED DATA; EXPECTATION MAXIMIZATION; FACTOR ANALYSIS; FUZZY C-MEANS; GAUSSIAN MIXTURE MODELS; KULLBACK-LEIBLER DIVERGENCE; LOCAL SUBSPACE MODELING; MODEL YIELDS; OBJECTIVE FUNCTIONS; OBSERVATION SPACE; ROBUST FUZZY CLUSTERING; SUBSPACE MODELS; T DISTRIBUTION; T-MIXTURE MODELS;

BLIND SOURCE SEPARATION; CLUSTER ANALYSIS; CLUSTERING ALGORITHMS; FUZZY RULES; FUZZY SYSTEMS; STUDENTS;

FUZZY CLUSTERING;

EID: 67149143365     PISSN: 10636706     EISSN: None     Source Type: Journal    
DOI: 10.1109/TFUZZ.2008.924317     Document Type: Article

References (34)

1. L. Zadeh, "Fuzzy sets," Inf. Control, vol. 8, pp. 338-353, 1965.
2. R. Bellman, R. Kalaba, and L. Zadeh, "Abstraction and pattern classification," J. Math. Anal. Appl., vol. 2, pp. 581-586, 1966.
3. E. Ruspini, "A new approach to clustering," Inf. Control, vol. 15, pp. 22-32, 1969.
4. J. Dunn, "A fuzzy relative of the ISODATA process and its use in detecting compact well-separated cluster," J. Cybern., vol. 3, pp. 32-57, 1974.
5. J. Bezdek, Pattern Recognition With Fuzzy Objective Function Algorithms. New York/London: Plenum, 1981.
6. D. E. Gustafson and W. C. Kessel, "Fuzzy clustering with a fuzzy covariance matrix," in Proc. IEEE Conf. Decision Control, 1979, vol. 2, pp. 761-766.
7. I. Gath and A. B. Geva, "Unsupervised optimal fuzzy clustering," IEEE Trans. Pattern Anal. Mach. Intell., vol. 11, no. 7, pp. 773-781, Jul. 1989.
8. D. Tran and M. Wagner, "A robust clustering approach to fuzzy Gaussian mixture models for speaker identification," in Proc. 3rd Int. Conf. Knowl. -Based Intell. Inf. Eng. Syst., 1999, pp. 337-340.
9. R. Li and M. Mukaidono, "A maximum entropy approach to fuzzy clustering estimation," in Proc. Conf. Fuzzy Syst. (Fuzz'IEEE , Mar. 1995, pp. 2227-2232.
10. S. Miyamoto and M. Mukaidono, "Fuzzy c-means as a regularization and maximum entropy approach," in Proc. 7th Int. Fuzzy Syst. Assoc. World Congr., 1997, vol. 2, pp. 86-92.
11. H. Ichihashi, K. Honda, and N. Tani, "Gaussian mixture pdf approximation and fuzzy c-means clustering with entropy regularization," in Proc. 4th Asian Fuzzy Syst. Symp., 2000, pp. 217-221.
12. R. J. Hathaway, "Another interpretation of the EM algorithm for mixture distributions," Statist. Probab. Lett., vol. 4, pp. 53-56, 1986.
13. M.-T. Gan, M. Hanmandlu, and A. H. Tan, "From a Gaussian mixture model to additive fuzzy systems," IEEE Trans. Fuzzy Syst., vol. 13, no. 3, pp. 303-316, Jun. 2005.
14. G. McLachlan and D. Peel, Finite Mixture Models. New York: Wiley, 2000. (Wiley Series on Probability and Statistics).
15. J. C. Bezdek, N. R. Pal, J. Keller, and R. Krishnapuram, Fuzzy Models and Algorithms for Pattern Recognition and Image Processing. Norwell, MA: Kluwer, 1999.
16. A. Kosinski, "A procedure for the detection of multivariate outliers," Comput. Statist. Data Anal., vol. 29, pp. 145-161, 1999.
17. R. N. Dave and R. Krishnapuram, "Robust clustering methods: A unified view," IEEE Trans. Fuzzy Syst., vol. 5, no. 2, pp. 270-293, May 1997.
18. K. Honda and H. Ichihashi, "Component-wise robust linear fuzzy clustering for collaborative filtering," Int. J. Approx. Reason., vol. 37, no. 2, pp. 127-144, 2004.
19. S. Miyamoto and A. C. Alanzado, "Fuzzy c-means and mixture distribution models in the presence of noise cluster," Int. J. Image Graph., vol. 2, no. 4, pp. 573-586, 2002.
20. A. Alanzado and S. Miyamoto, "Fuzzy c-means and a mixture distribution for clustering of noisy data," presented at the Joint SCIS & ISIS Conf., Tsukuba, Japan, 2002.
21. D. Peel and G. J. McLachlan, "Robust mixture modelling using the t distribution," Statist. Comput., vol. 10, no. 4, pp. 339-348, 2000.
22. M. Tipping and C. Bishop, "Mixtures of probabilistic principal component analyzers," Neural Comput., vol. 11, no. 2, pp. 443-482, 1999.
23. A. Hyvärinen, "Survey on independent component analysis," Neural Comput. Surveys, vol. 2, pp. 94-128, 1999.
24. Z. Ghahramani and G. Hinton, "The EM algorithm for mixtures of factor analyzers," Dept. Comput. Sci., Univ. Toronto, Toronto, ON, Canada, Tech. Rep. CRGTR-96-1, 1997.
25. J. C. Bezdek, C. Coray, R.Gunderson, and J.Watson, "Detection and characterization of cluster substructure: Fuzzy c-varieties and convex combinations thereof," SIAM J. Appl. Math., vol. 40, no. 2, pp. 358-372, 1981.
26. K. Honda and H. Ichihashi, "Regularized linear fuzzy clustering and probabilistic PCA mixture models," IEEE Trans. Fuzzy Syst., vol. 13, no. 4, pp. 508-516, Aug. 2005.
27. G. McLachlan, R. Bean, and L. B.-T. Jones, "Extension of the mixture of factor analyzers model to incorporate the multivariate t distribution," Comp. Stat. Data Anal., vol. 51, no. 11, pp. 5327-5338, 2007.
28. Z. Khan and F. Dellaert, "Robust generative subspace modeling: The subspace t distribution," Georgia Inst. Technol., Atlanta, GA, Tech. Rep. GIT-GVU-04-11, 2004.
29. C. Liu and D. Rubin, "ML estimation of the t distribution using EM and its extensions, ECM and ECME," Statist. Sinica, vol. 5, no. 1, pp. 19-39, 1995.
30. S. Shoham, "Robust clustering by deterministic agglomeration EM of mixtures of multivariate t distributions," Pattern Recog., vol. 35, no. 55, pp. 1127-1142, 2002.
31. X. Meng and D. van Dyk, "The EM algorithm - An old folk song sung to a fast new tune (with discussion)," J. Royal Statist. Soc. B, vol. 59, no. 3, pp. 511-567, 1997.
32. S. Weiss and C. Kulikowski, Computer Systems That Learn. San Francisco, CA: Morgan Kaufmann, 1991.
33. E. Backer and A. Jain, "A clustering performance measure based on fuzzy set decomposition," IEEE Trans. Pattern Anal. Mach. Intell., vol. PAMI-3, no. 1, pp. 66-75, Jan. 1981.
34. P. Murphy and D. Aha. (1994). UCI repository of machine learning databases [Online]. Available: http://mlearn.ics.uci.edu/databases