Tensor-CUR decompositions for tensor-based data

SIAM Journal on Matrix Analysis and Applications

Volumn 30, Issue 3, 2008, Pages 957-987

  Mahoney, Michael W ^a,b   Maggioni, Mauro ^b,c   Drineas, Petros ^d  

^a YAHOO RESEARCH   (United States)

^b YALE UNIVERSITY   (United States)

^c DUKE UNIVERSITY   (United States)

^d Rensselaer Polytechnic Institute   (United States)

Author keywords

CUR decomposition; Hyperspectral imagery; Recommendation system; Tensor decomposition

Indexed keywords

CLASSIFICATION QUALITY; CUR DECOMPOSITION; DATA ANALYSIS; DATA ANALYSIS TOOL; DATA ELEMENTS; DIVERSE DOMAINS; ENCODING MATRIX; ERROR PARAMETERS; FAILURE PROBABILITY; FROBENIUS NORM; HIGH QUALITY; HYPERSPECTRAL; HYPERSPECTRAL DATA; HYPERSPECTRAL IMAGERY; MATRIX; MEDICAL IMAGE ANALYSIS; P-MATRICES; RECOMMENDATION SYSTEM; RECOMMENDATION SYSTEMS; TENSOR DECOMPOSITION;

APPROXIMATION ALGORITHMS; DATA COMPRESSION; DECOMPOSITION; IMAGE ANALYSIS; MEDICAL PROBLEMS; PROBABILITY DISTRIBUTIONS; REMOTE SENSING; TENSORS;

MATRIX ALGEBRA;

EID: 67651094047     PISSN: 08954798     EISSN: 10957162     Source Type: Journal    
DOI: 10.1137/060665336     Document Type: Article

References (67)

1. G. ADOMAVICIUS AND A. TUZHILIN, Toward the next generation of recommender systems: A survey of the state-of-the-art and possible extensions, IEEE Trans. Knowl. Data Eng., 17 (2005), pp. 734-749.
2. C. ANGELETTI, N. R. HARVEY, V. KHOMITCH, R. LEVENSON, AND D. L. RIMM, Detection of malignant cells in cytology specimen using genie hybrid genetic algorithm, Mod. Pathol., 17 (2004), Suppl l:350A.
3. C. ANGELETTI, R. JAGANTH, R. M. LEVENSON, AND D. L. RIMM, Spectral analysis: A novel method for classification of urine cytology. Mod. Pathol., 16 (2003), 57A.
4. Y. AZAR, A. FIAT, A. R. KARLIN, F. MCSHERRY, AND J. SAIAZ, Spectral analysis of data, in Proceedings of the 33rd Annual ACM Symposium on Theory of Computing, 2001, pp. 619-626.
5. T. S. BARRY, A. M. GOWN, H. E. YAZIJI, AND R. W. LEVENSON, Use of spectral imaging analysis for evaluation of multi-color immuno-histochemistry, Mod. Pathol., 17 (2004), Suppl l:350A.
6. M. BEBENDORF, Approximation of boundary element matrices, Numer. Math., 86 (2000), pp. 565-589.
7. M. W. BERRY, S. A. PULATOVA, AND G. W. STEWART, Computing Sparse Reduced-Rank Approximations to Sparse Matrices, Technical report UMIACS TR-2004-32 CMSC TR-4589, University of Maryland, College Park, MD, 2004.
8. G. BEYLKIN AND M. J. MOHLENKAMP, Numerical operator calculus in higher dimensions, Proc. Natl. Acad. Sci. USA, 99 (2002), pp. 10246-10251.
9. D. BILLSUS AND M. J. PAZZANI, Learning collaborative information filters, in Proceedings of the 15th International Conference on Machine Learning, Morgan Kaufman, San Francisco, 1998, pp. 46-54.
10. J. BREESE, D. HECKERMAN, AND C. KADIE, Empirical analysis of predictive algorithms for collaborative filtering, in Proceedings of the 14th Annual Conference on Uncertainty in Artificial Intelligence, Morgan Kaufman, San Francisco, 1998, pp. 43-52.
11. J. D. CARROLL AND J. J. CHANG, Analysis of individual differences in multidimensional scaling via an N-way generalization of "Eckart-Young" decomposition, Psychometrika, 35 (1970), pp. 283-319.
12. W. W. COHEN, R. E. SCHAPIRE, AND Y. SINGER, Learning to order things, in Annual Advances in Neural Information Processing Systems 10: Proceedings of the 1997 Conference, 1998, pp. 451-457.
13. R. R. COIFMAN, Multiresolution analysis in non-homogeneous media, in Wavelets. Time-Frequency Methods and Phase Space, J.-M. Combes, A. Grossmann, and P. Tchamitchian, eds., Springer-Verlag, Berlin, 1989, p. 259.
14. G. L. DAVIS, M. MAGGIONI, R. R. COIFMAN, D. L. RIMM, AND R. M. LEVENSON, Spectral/spatial analysis of colon carcinoma, Mod. Pathol., 16 (2003), 3320:3321A.
15. G. L. DAVIS, M. MAGGIONI, F. J. WARNER, F. B. GESHWIND, A. C. COPPI, R. A. DEVERSE, AND R. R. COIFMAN, Spectral analysis of normal and malignant microarray tissue sections using a novel micro-optoelectricalmechanical system, Mod. Pathol., 17 (2004), 1:358A.
16. R. A. DEVERSE, R. R. COIFMAN, A. C. COPPI, W. G. FATELEY, F. GESHWIND, R. M. HAM-MAKER, S. VALENTI, F. J. WARNER, AND G. L. DAVIS, Application of spatial light modulators for new modalities in spectrometry and imaging, in Proceedings of the SPIE 4959, 2003, pp. 12-22.
17. P. DRINEAS, R. KANNAN, AND M. W. MAHONEY, Fast Monte Carlo algorithms for matrices I: Approximating matrix multiplication, SIAM J. Comput., 36 (2006), pp. 132-157.
18. P. DRINEAS, R. KANNAN, AND M. W. MAHONEY, Fast Monte Carlo algorithms for matrices II: Computing a low-rank approximation to a matrix, SIAM J. Comput., 36 (2006), pp. 158-183.
19. P. DRINEAS, R. KANNAN, AND M. W. MAHONEY, Fast Monte Carlo algorithms for matrices III: Computing a compressed approximate matrix decomposition, SIAM J. Comput., 36 (2006), pp. 184-206.
20. P. DRINEAS, I. KERENIDIS, AND P. RAGHAVAN, Competitive recommendation systems, in Proceedings of the 34th Annual ACM Symposium on Theory of Computing, 2002, pp. 82-90.
21. P. DRINEAS AND M. W. MAHONEY, Approximating a Gram matrix for improved kernel-based learning, in Proceedings of the 18th Annual Conference on Learning Theory, Springer-Verlag, Berlin, 2005, pp. 323-337.
22. P. DRINEAS AND M. W. MAHONEY, On the Nyström method for approximating a Gram matrix for improved kernel-based learning, J. Mach. Learn. Res., 6 (2005), pp. 2153-2175.
23. P. DRINEAS AND M. W. MAHONEY, A randomized algorithm for a tensor-based generalization of the singular value decomposition, Linear Algebra Appl., 420 (2007), pp. 553-571.
24. Y. FREUND, R. IYER, R. E. SCHAPIRE, AND Y. SINGER, An efficient boosting algorithm for combining preferences, J. Mach. Learn. Res., 4 (2003), pp. 933-969.
25. Y. GARINI, N. KATZIR, D. CABIB, R. A. BUCKWALD, D.G. SOENKSEN, AND Z. MALIK, Spectral bio-imaging, in Fluorescence Imaging Spectroscopy and Microscopy, John Wiley and Sons, New York, 1996, pp. 87-124.
26. K. GOLDBERG, T. ROEDER, D. GUPTA, AND C. PERKINS, Eigentaste: A constant time collaborative filtering algorithm, Inform. Retrieval, 4 (2001), pp. 133-151.
27. T. GONZALEZ AND J. JA'JA', On the complexity of computing bilinear forms with {0,1} constants, J. Comput. System Sci., 20 (1980), pp. 77-95.
28. S. A. GOREINOV AND E. E. TYRTYSHNIKOV, The maximum-volume concept in approximation by low-rank matrices, in Structured Matrices in Mathematics, Computer Science, and Engineering, I., Contemp. Math. 280, AMS, Providence, RI, 2001, pp. 47-51.
29. S. A. GOREINOV, E. E. TYRTYSHNIKOV, AND N. L. ZAMARASHKIN, A theory of pseudoskeleton approximations, Linear Algebra Appl., 261 (1997), pp. 1-21.
30. W. H. GREUB, Multilinear Algebra, Springer-Verlag, Berlin, 1967.
31. R. A. HARSHMAN AND M. E. LUNDY, The PARAFAC model for three-way factor analysis and multidimensional scaling, in Research Methods for Multimode Data Analysis, H. G. Law, C. W. Snyder, Jr., J. Hattie, and R. P. McDonald, eds., Praeger, New York, 1984, pp. 122-215.
32. J. HÅSTAD, Tensor rank is NP-complete, J. Algorithms, 11 (1990), pp. 644-654.
33. T. D. HOWELL, Global properties of tensor rank, Linear Algebra Appl., 22 (1978), pp. 9-23.
34. R. JIN, L. SI, AND C. X. ZHAI, Preference-based graphic models for collaborative filtering, in Proceedings of the 19th Conference in Uncertainty in Artificial Intelligence, Morgan Kaufman, San Francisco, 2003, pp. 329-336.
35. R. JIN, L. SI, C. X. ZHAI, AND J. CALLAN, Collaborative filtering with decoupled models for preferences and ratings, in Proceedings of the 12th ACM International Conference on Information and Knowledge Management, 2003, pp. 309-316.
36. H. A. L. KIERS, Towards a standardized notation and terminology in multiway analysis, J. Chemometrics, 14 (2000), pp. 105-122.
37. J. KLEINBERG AND M. SANDLER, Using mixture models for collaborative filtering, in Proceedings of the 36th Annual ACM Symposium on Theory of Computing, 2004, pp. 569-578.
38. T. G. KOLDA, A counterexample to the possibility of an extension of the Eckart-Young low-rank approximation theorem for the orthogonal rank tensor decomposition, SIAM J. Matrix Anal. Appl., 24 (2003), pp. 762-767.
39. P. M. KROONENBERG AND J. DE LEEUW, Principal component analysis of three-mode data by means of alternating least squares algorithms, Psychometrika, 45 (1980), pp. 69-97.
40. J. B. KRUSKAL, Three-way arrays: Rank and uniqueness of trilinear decompositions, with application to arithmetic complexity and statistics, Linear Algebra Appl., 18 (1977), pp. 95-138.
41. J. B. KRUSKAL, Rank, decomposition, and uniqueness for 3-way and N-way arrays, in Multi-way Data Analysis, R. Coppi and S. Bolasco, eds., North-Holland, Amsterdam, 1989, pp. 7-18.
42. R. KUMAR, P. RAGHAVAN, S. RAJAGOPALAN, AND A. TOMKINS, Recommendation systems: A probabilistic analysis, in Proceedings of the 39th Annual IEEE Symposium on Foundations of Computer Science, 1998, pp. 664-673.
43. L. DE LATHAUWER, B. DE MOOR, AND J. VANDEWALLE, An introduction to independent component analysis, J. Chemometrics, 14 (2000), pp. 123-149.
44. L. DE LATHAUWER, B. DE MOOR, AND J. VANDEWALLE, A multilinear singular value decomposition, SIAM J. Matrix Anal. Appl., 21 (2000), pp. 1253-1278.
45. N) approximation of higher-order tensors, SIAM J. Matrix Anal. Appl., 21 (2000), pp. 1324-1342.
46. D. LEIBOVICI AND R. SABATIER, A singular value decomposition of a k-way array for a principal component analysis of multiway data, PTA-k, Linear Algebra Appl., 269 (1998), pp. 307-329.
47. R. M. LEVENSON AND D. FARKAS, Digital spectral imaging for histopathology and cytopathology, in Proceedings of the SPIE 2983, 1997, pp. 123-135.
48. L.-H. LIM AND G. H. GOLUB, Tensors for Numerical Multilinear Algebra: Ranks and Basic Decompositions, Technical report 05-02, Stanford University SCCM, Stanford, CA, 2005.
49. G. LINDEN, B. SMITH, AND J. YORK, Amazon.com recommendations: Item-to-item collaborative filtering, IEEE Internet Comput., 7 (2003), pp. 76-80.
50. C. F. VAN LOAN, The ubiquitous Kronecker product, J. Comput. Appl. Math., 123 (2000), pp. 85-100.
51. M. MAGGIONI, G. L. DAVIS, F. J. WARNER, F. B. GESHWIND, A. C. COPPI, R. A. DEVERSE, AND R. R. COIFMAN, Algorithms from Signal and Data Processing Applied to Hyperspectral Analysis: Discriminating Normal and Malignant Microarray Colon Tissue Sections Using a Novel Digital Mirror Device System, Technical report YALEU/DCS/TR-1311, Yale University Department of Computer Science, New Haven, CT, 2004.
52. M. W. MAHONEY, M. MAGGIONI, AND P. DRINEAS, Tensor-CUR decompositions for tensor-based data, in Proceedings of the 12th Annual ACM SIGKDD Conference, 2006, pp. 327-336.
53. A. PAPADAKIS, E. STATHOPOULOS, G. DELIDES, K. BERBERIDES, G. NIKIFORIDES, AND C. BALAS, A novel spectral microscope system: Application in quantitative pathology, IEEE Trans. Biomed. Eng., 50 (2003), pp. 207-217.
54. P. RESNICK AND H. R. VARIAN, Recommender systems, Comm. ACM, 40 (1997), pp. 56-58.
55. C. ROTHMAN, I. BAR-AM, AND Z. MALIK, Spectral imaging for quantitative histology and cy-togenetics, Histology and Histopathology, 13 (1998), pp. 921-926.
56. N. SAITO AND R. R. COIFMAN, Local discriminant bases and their applications, J. Math. Imaging Vision, 5 (1995), pp. 337-358.
57. N. SAITO, R. R. COIFMAN, F. B. GESHWIND, AND F. WARNER, Discriminant feature extraction using empirical probability density estimation and a local basis library, Pattern Recognition, 35 (2002), pp. 2841-2852, 2002.
58. B. SARWAR, G. KARYPIS, J. KONSTAN, AND J. RIEDL, Application of dimensionality reduction in recommender system-a case study, in Proceedings of the WebKDD 2000 Workshop, 2000.
59. G. W. STEWART, Four algorithms for the efficient computation of truncated QR approximations to a sparse matrix, Numer. Math., 83 (1999), pp. 313-323.
60. G. W. STEWART, Error analysis of the quasi-Gram-Schmidt algorithm, SIAM J. Matrix Anal. Appl., 27 (2005), 493-506.
61. L. R. TUCKER, Some mathematical notes on three-mode factor analysis, Psychometrika, 31 (1966), pp. 279-311.
62. M. TURK AND A. PENTLAND, Eigenfaces for recognition, J. Cogn. Neurosci., 3 (1991), pp. 71-96.
63. E. TYRTYSHNIKOV, Incomplete cross approximation in the mosaic-skeleton method, Computing, 64 (2000), pp. 367-380.
64. S. G. VARI, G. MULLER, J. M. LERNER, AND R. D. NABER, Telepathology and imaging spec-troscopy as a new modality in histopathology, Stud. Health Technol. Inform., 68 (l999), pp. 211-216.
65. M. A. O. VASILESCU AND D. TERZOPOULOS, Multilinear analysis of image ensembles: Tensor-Faces, in Proceedings of the 7th European Conference on Computer Vision, Springer-Verlag, Berlin, 2002, pp. 447-460.
66. C. K. I. WILLIAMS AND M. SEEGER, Using the Nyström method to speed up kernel machines, in Annual Advances in Neural Information Processing Systems 13: Proceedings of the 2000 Conference, MIT Press, Cambridge, MA, 2001, pp. 682-688.
67. T. ZHANG AND G. H. GOLUB, Rank-one approximation to high order tensors, SIAM J. Matrix Anal. Appl., 23 (2001), pp. 534-550.