PCA and SVD with nonnegative loadings

Pattern Recognition

Volumn 42, Issue 1, 2009, Pages 68-76

  Lipovetsky, Stan ^a  

^a GfK Custom Research North America   (United States)

Author keywords

Exponential; Logit; Multinomial parameterization; Perron Frobenius theory; Positive and sparse loadings; Principal component analysis; Singular value decomposition

Indexed keywords

AGGLOMERATION; CURVE FITTING; EIGENVALUES AND EIGENFUNCTIONS; FINANCIAL DATA PROCESSING; LEAST SQUARES APPROXIMATIONS; LOADING; MATRIX ALGEBRA; SINGULAR VALUE DECOMPOSITION; VECTORS;

EXPONENTIAL; LOGIT; MULTINOMIAL PARAMETERIZATION; PERRON-FROBENIUS THEORY; POSITIVE AND SPARSE LOADINGS;

PRINCIPAL COMPONENT ANALYSIS;

EID: 51649097829     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2008.06.025     Document Type: Article

References (48)

1. Pearson K. On lines and planes of closest fit to systems of points in space. Philos. Mag. 2 (1901) 559-572
2. Hotelling H. Analysis of a complex of statistical variables into principal components. J. Educ. Psychol. 24 (1933) 417-441
3. Hotelling H. Simplified calculation of principal components. Psychometrika 1 (1936) 27-35
4. Eckart C., and Young G. The approximation of one matrix by another of lower rank. Psychometrika 1 (1936) 211-218
5. Lynn H.S., and McCulloch C.E. Using principal component analysis and correspondence analysis for estimation in latent variable models. J. Am. Stat. Assoc. 95 (2000) 561-572
6. Lipovetsky S., Tishler A., and Conklin M. Multivariate least squares and its relation to other multivariate techniques. Appl. Stochastic Models Bus. Ind. 18 (2002) 347-356
7. Weingessel A., and Hornik K. A robust subspace algorithm for principal component analysis. Int. J. Neural Syst. 13 (2003) 307-313
8. Pavoine S., Dufour A.B., and Chessel D. From dissimilarities among species to dissimilarities among communities: a double principal coordinate analysis. J. Theoret. Biol. 228 (2004) 523-537
9. Levi Y., Last I., and Jortner J. Dynamics of fission and Coulomb explosion of multicharged large finite systems. Mol. Phys. 104 (2006) 1227-1237
10. Rousson V., and Gasser T. Simple component analysis. Appl. Statist. 53 (2004) 539-555
11. Lipovetsky S. Multimode data analysis for decision making. In: Tzeng G.H., Wang H.F., Wen U.P., and Yu P.L. (Eds). Multiple Criteria Decision Making (1994), Springer, New York 275-282
12. deLathauwer L., deMoor B., and Vandewalle J. A multilinear singular value decomposition. SIAM J. Matrix Anal. Appl. 21 (2000) 1253-1278
13. Drineas P., Frieze A., Kannan R., Vempala S., and Vinay V. Clustering large graphs via the singular value decomposition. Mach. Learn. 56 (2004) 9-33
14. Kazantsev S.G., and Bukhgeim A.A. Singular value decomposition for the 2D fan-beam Radon transform of tensor fields. J. Inverse Ill-Posed Probl. 12 (2004) 245-278
15. Hochstenbach M.E. Harmonic and refined extraction methods for the singular value problem, with application in least squares problems. BIT Numer. Math. 44 (2004) 721-754
16. Carroll J.D., Green P.E., and Schaffer C.M. Interpoint distance comparisons in correspondence analysis. J. Mark. Res. 23 (1986) 271-280
17. Shugan S.M. Estimating brand positioning maps using supermarket scanning data. J. Mark. Res. 24 (1987) 1-18
18. Kaciak E., and Louviere J. Multiple correspondence analysis of multiple choice experiment data. J. Mark. Res. 27 (1990) 455-465
19. Steenkamp J.B., Trijp H.V., and Berge J.T. Perceptual mapping based on idiosyncratic sets. J. Mark. Res. 31 (1994) 15-27
20. Sinha I., and DeSarbo W.S. An integrated approach toward the spatial modeling of perceived customer value. J. Mark. Res. 35 (1998) 236-249
21. Hastie T., Tibshirani R., and Friedman J. The Elements of Statistical Learning: Data Mining, Inference, and Prediction (2001), Springer, New York
22. Bishop C.M. Pattern Recognition and Machine Learning (2006), Springer, New York
23. Elden L. Matrix Methods in Data Mining and Pattern Recognition (2007), SIAM, Philadelphia
24. Hoerl A.E., and Kennard R.W. Ridge regression: biased estimation for nonorthogonal problems. Technometrics 12 (1970) 55-67 (Reprinted in: Technometrics 42 (2000) 80-86)
25. Lipovetsky S. Two-parameter ridge regression and its convergence to the eventual pairwise model. Math. Comput. Modelling 44 (2006) 304-318
26. Tibshirani R. Regression shrinkage and selection via the lasso. J. R. Stat. Soc. B 58 (1996) 267-288
27. Frank I., and Friedman J. A statistical view of some chemometrics regression tools. Technometrics 35 (1993) 109-148
28. Efron B., Hastie T., Johnstone I., and Tibshirani R. Least angle regression. Ann. Stat. 32 (2004) 407-489
29. p-metric for minimizing powered deviations in regression. J. Mod. Appl. Stat. Methods 6 (2007) 219-227
30. Jolliffe I.T., Trendafilov N., and Uddin M. A modified principal component technique based on the lasso. J. Comput. Graphical Stat. 12 (2003) 531-547
31. Zou H., Hastie T., and Tibshirani R. Sparse principal component analysis. J. Comput. Graphical Stat. 15 (2006) 265-286
32. Hoyer P.O. Non-negative matrix factorization with sparseness constraints. J. Mach. Learn. Res. 5 (2004) 1457-1469
33. Berry M.W., and Browne M. Email surveillance using non-negative matrix factorization. Comput. Math. Organ. Theory 11 (2005) 249-264
34. Pauca V.P., Piper J., and Plemmons R.J. Nonnegative matrix factorization for spectral data analysis. Linear Algebra Appl. 416 (2006) 29-47
35. Fogel P., Young S.S., Hawkins D.M., Ledirac N., and Inferential. robust non-negative matrix factorization analysis of microarray data. Bioinformatics 23 (2007) 44-49
36. Lipovetsky S., and Conklin M. Singular value decomposition in additive, multiplicative, and logistic forms. Pattern Recognition 38 (2005) 1099-1110
37. Bellman R. Introduction to Matrix Analysis (1960), McGraw-Hill, New York
38. Marcus M., and Minc H. A Survey of Matrix Theory and Matrix Inequalities (1964), Allyn & Bacon, Boston
39. In: Arminger G., Clogg C.C., and Sobel M.E. (Eds). Handbook of Statistical Modeling for the Social and Behavioral Sciences (1995), Plenum Press, New York, London
40. McCullagh P., and Nelder J.A. Generalized Linear Models (1997), Chapman & Hall, London, New York
41. Lipovetsky S. Equidistant regression modeling. Model Assisted Stat. Appl. 2 (2007) 71-80
42. Golub G.H., and van Loan C.F. Matrix Computations. third ed. (1996), Johns Hopkins University Press, Baltimore, MD
43. Chambers J.M., and Hastie T.J. Statistical Models in S (1992), Wadsworth & Brooks, Pacific Grove, CA
44. S-PLUS'2000, MathSoft Inc., Seattle, WA, 1999.
45. Gantmacher F.R. Applications of the Theory of Matrices (1959), Interscience, New York
46. Salton G. Automatic Text Processing: The Transformation, Analysis, and Retrieval of Information by Computer (1988), Addison-Wesley, Reading, MA
47. Harville D.A. Matrix Algebra from a Statistician' Perspective (1997), Springer, New York
48. Lipovetsky S., and Conklin M. Regression by data segments via discriminant analysis. J. Mod. Appl. Stat. Methods 4 (2005) 63-74