Mean vector component analysis for visualization and clustering of nonnegative data

IEEE Transactions on Neural Networks and Learning Systems

Volumn 24, Issue 10, 2013, Pages 1553-1564

  Jenssen, Robert ^a  

^a UNIVERSITY OF TROMSØ   (Norway)

Author keywords

Clustering; eigenvalues (spectrum); eigenvectors; inner product matrix; mean vector; nonnegative data; principal component analysis; visualization

Indexed keywords

CLUSTERING ALGORITHMS; DATA VISUALIZATION; EIGENVALUES AND EIGENFUNCTIONS; FLOW VISUALIZATION; MATRIX ALGEBRA; VECTORS; VISUALIZATION;

CLUSTERING; EIGENVALUES; INNER PRODUCT; MEAN VECTOR; NON NEGATIVES;

PRINCIPAL COMPONENT ANALYSIS;

EID: 84885179073     PISSN: 2162237X     EISSN: 21622388     Source Type: Journal    
DOI: 10.1109/TNNLS.2013.2262774     Document Type: Article

References (42)

1. S. Theodoridis and K. Koutroumbas, Pattern Recognition, 4th ed. San Diego, CA, USA: Academic, 2009.
2. R. O. Duda, P. E. Hart, and D. G. Stork, Pattern Classification, 2nd ed. New York, NY, USA: Wiley, 2001.
3. C. M. Bishop, Pattern Recognition and Machine Learning. New York, NY, USA: Springer-Verlag, 2006.
4. K. Pearson, On lines and planes of closest fit to systems of points in space Phil. Mag., vol. 2, no. 6, pp. 559-572, 1901.
5. H. Hotelling, Analysis of a complex of statistical variables into principal components J. Educ. Psychol., vol. 24, no. 1, pp. 417-441, 1933.
6. I. T. Jolliffe, Principal Component Analysis, 2nd ed. New York, NY, USA: Springer-Verlag, 2002.
7. E. Oja, Simplified neuron model as a principal component analyzer J. Math. Biol., vol. 15, no. 3, pp. 267-273, 1982.
8. K. I. Diamantaras and S. Y. Kung, Principal Component Neural Networks. New York, NY, USA: Wiley, 1996.
9. A. K. Jain, R. P. W. Duin, and J. Mao, Statistical pattern recognition: A review IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 1, pp. 4-37, Jan. 2000.
10. J. MacQueen, Some methods for classification and analysis of multivariate observations in Proc. Berkeley Symp. Math. Stat. Probab., 1967, pp. 281-297.
11. B. Schölkopf, A. J. Smola, and K.-r. Müller, Nonlinear component analysis as a kernel eigenvalue problem Neural Comput., vol. 10, no. 5, pp. 1299-1319, Jul. 1998.
12. S. Moon and H. Qi, Hybrid dimensionality reduction method based on support vector machine and independent component analysis IEEE Trans. Neural Netw. Learn. Syst., vol. 23, no. 5, pp. 749-761, May 2012.
13. X. Kong, C. Hu, H. Ma, and C. Han, A unified self-stabilizing neural network algorithm for principal and minor components extraction IEEE Trans. Neural Netw. Learn. Syst., vol. 23, no. 2, pp. 185-198, Feb. 2012.
14. S. Liwicki, S. Zafeiriou, G. Tzimiropoulos, and M. Pantic, Efficient online subspace learning with an indefinite kernel for visual tracking and recognition IEEE Trans. Neural Netw. Learn. Syst., vol. 23, no. 10, pp. 1624-1636, Oct. 2012.
15. A. Y. Ng, M. Jordan, and Y. Weiss, On spectral clustering: Analysis and an algorithm in Advances in Neural Information Processing Systems. Cambridge, MA, USA: MIT Press, 2002, pp. 849-856.
16. M. Belkin and P. Niyogi, Laplacian eigenmaps for dimensionality reduction and data representation Neural Comput., vol. 15, no. 6, pp. 1373-1396, Jun. 2003.
17. J. Shi and J. Malik, Normalized cuts and image segmentation IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 8, pp. 888-905, Aug. 2000.
18. S. Roweis and L. Saul, Nonlinear dimensionality reduction by locally linear embedding Science, vol. 290, no. 5500, pp. 2323-2326, Dec. 2000.
19. J. Tenenbaum, V. De Silva, and J. C. Langford, A global geometric framework for nonlinear dimensionality reduction Science, vol. 290, no. 5500, pp. 2319-2323, Dec. 2000.
20. K. Q. Weinberger and L. K. Saul, Unsupervised learning of image manifolds by semidefinite programming Int. J. Comput. Vis., vol. 70, no. 1, pp. 77-90, 2006.
21. L. K. Saul, K. Q. Weinberger, J. H. Ham, F. Sha, and D. D. Lee, Spectral methods for dimensionality reduction in Semisupervised Learning, O. Chapelle, B. Schölkopf, and A. Zien, Eds. Cambridge, MA, USA: MIT Press, 2005, ch. 1.
22. C. J. C. Burges, Geometric methods for feature extraction and dimensional reduction in Data Mining and Knowledge Discovery Handbook: A Complete Guide for Researchers and Practitioners, O. Maimon and L. Rokach, Eds. Norwell, MA, USA: Kluwer, 2005, ch. 4.
23. K. Balci and V. Atalay, PCA for gender estimation: Which eigenvectors contribute? in Proc. Int. Conf. Pattern Recognit., 2002, pp. 363-366.
24. J. Shawe-taylor and N. Cristianini, Kernel Methods for Pattern Analysis. Cambridge, U.K.: Cambridge Univ. Press, 2004.
25. A. A. Miranda, Y.-a. Borgne, and G. Bontempi, New routes from minimal approximation error to principal components Neural Process. Lett., vol. 27, no. 3, pp. 197-207, 2008.
26. J. Cadima and I. Jolliffe, On relationships between uncentred and column-centred principal component analysis Pakistan J. Stat., vol. 25, no. 4, pp. 473-503, 2009.
27. H. Van Den Dool, Empirical Methods in Short-term Climate Prediction. London, U.K.: Oxford Univ. Press, 2007.
28. S. Clements, Principal component analysis applied to the spectral energy distribution of blazars in Proc. Blazar Continuum Variability, Astronomical Soc. Pacific Conf. Series, 1996, pp. 455-461.
29. O. Alter and G. H. Golub, Singular value decomposition of genomescale mRNA lengths distribution reveals asymmetry in RNA gel electrophoresis brand broadening in Proc. Nat. Acad. Sci., vol. 103, no. 32, pp. 11828-11833, Jul. 2006.
30. F. Gwadry, C. Berenstein, J. van Horn, and A. Braun, Implementation and application of principal component analysis on functional neuroimaging data Univ. Inst. Syst. Res., School of Eng., Tech. Rep. TR 2001-47, 2001.
31. C. ter Braak, Principal components biplots and alpha and beta diversity Ecology, vol. 64, no. 3, pp. 454-462, 1983.
32. J. E. Jackson, A User?s Guide to Principal Components. New York, NY, USA: Wiley, 1991.
33. R. A. Reyment and K. G. Jöreskog, Applied Factor Analysis in the Natural Sciences. Cambridge, U.K.: Cambridge Univ. Press, 1993.
34. C. D. Meyer, Matrix Analysis and Applied Linear Algebra. Philadelphia, PA, USA: SIAM, 2000.
35. A. N. Langville and C. D. Meyer, Google?s PageRank and Beyond: The Science of Search Engine Rankings. Princeton, NJ, USA: Princeton Univ. Press, 2006.
36. R. Jenssen, Kernel entropy component analysis IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 5, pp. 847-860, May 2010.
37. T. Shi, M. Belkin, and B. Yu, Data spectroscopy: Eigenspaces of convolution operators and clustering Ann. Stat., vol. 37, no. 6, pp. 3960-3984, 2009.
38. S. Sarkar and K. L. Boyer, Quantitative measures of change based on feature organization: Eigenvalues and eigenvectors Comput. Vis. Image Understand., vol. 71, no. 1, pp. 110-136, 1998.
39. M. Lee, Determining the dimensionality of multidimensional scaling representations for cognitive modeling J. Math. Psychol., vol. 45, no. 1, pp. 149-166, Feb. 2001.
40. D. G. Lowe, Distinctive image features from scale-invariant keypoints Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-110, 2004.
41. J. Deng, W. Dong, R. Socher, L.-J. Li, K. Li, and L. Fei-fei, Imagenet: A large-scale hierarchical image database in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2009, pp. 248-255.
42. A. Frank and A. Asuncion, UCI machine learning repository Univ. of California, School Inf. Comput. Sci., Irvine, CA, USA, Tech. Rep., 2013.