Out-of-core SVD performance for document indexing

Applied Numerical Mathematics

Volumn 57, Issue 11-12, 2007, Pages 1230-1239

  Martin, Dian I ^a   Martin, John C ^a   Berry, Michael W ^b   Browne, Murray ^b  

^a Small Bear Technical Consulting   (United States)

^b University of Tennessee Knoxville   (United States)

Author keywords

Lanczos algorithm; Latent semantic analysis; Out of core; Singular value decomposition

Indexed keywords

COMPUTATION THEORY; OPTIMIZATION; PROGRAM PROCESSORS; SOFTWARE PACKAGES; STORAGE ALLOCATION (COMPUTER);

LANCZOS ALGORITHMS; LATENT SEMANTIC ANALYSIS; MEMORY USAGE;

SINGULAR VALUE DECOMPOSITION;

EID: 34548357215     PISSN: 01689274     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.apnum.2007.01.002     Document Type: Article

References (21)

1. Berry M. Large scale sparse singular value computations. International Journal of Supercomputer Applications 6 1 (1992) 13-49
2. Berry M., and Browne M. Understanding Search Engines: Mathematical Modeling and Text Retrieval. second ed. (2005), SIAM, Philadelphia, PA
3. Berry M., Drmač Z., and Jessup E. Matrices, vector spaces, and information retrieval. SIAM Review 41 (1999) 335-362
4. Berry M., Dumais S., and O'Brien G. Using linear algebra for intelligent information retrieval. SIAM Review 37 (1995) 573-595
5. Berry M., and Martin D. Principal component analysis for information retrieval. In: Kontoghiorghes E. (Ed). Handbook of Parallel Computing and Statistics. CRC Series: Statistics: A Series of Textbooks and Monographs (2005), Chapman & Hall, Boca Raton, FL 399-413
6. Berry M., Mezher D., Philippe B., and Sameh A. Parallel algorithms for the singular value decomposition. In: Kontoghiorghes E. (Ed). Handbook of Parallel Computing and Statistics. CRC Series: Statistics: A Series of Textbooks and Monographs (2005), Chapman & Hall, Boca Raton, FL 117-164
7. Björck A. Numerical Methods for Least Squares Problems (1996), Linköping University, Linköping, Sweden
8. Deerwester S., Dumais S., Furnas G., Landauer T., and Harshman R. Indexing by latent semantic analysis. Journal of the American Society for Information Sciences 41 (1990) 391-407
9. Duff I., Grimes R., and Lewis J. Sparse matrix test problems. ACM Transactions on Mathematical Software 15 (1989) 1-14
10. Dumais S. Improving the retrieval of information from external sources. Behavior Research Methods, Instruments, & Computers 23 (1991) 229-236
11. Eckart C., and Young G. The approximation of one matrix by another of lower rank. Psychometrika 1 (1936) 211-218
12. Furnas G., Landauer T., Gomez L., and Dumais S. The vocabulary problem in human-system communication. Communications of the ACM 30 (1987) 964-971
13. Golub G., and Loan C.V. Matrix Computations. third ed. (1996), Johns Hopkins University Press, Baltimore, MD
14. Landauer T., and Dumais S. A solution to Plato's problem: The latent semantic analysis theory of acquisition, induction, and representation of knowledge. Psychological Review 104 (1997) 211-240
15. Landauer T., Foltz P., and Laham D. An introduction to latent semantic analysis. Discourse Processes 25 (1998) 259-284
16. Letsche T., and Berry M. Large-scale information retrieval with latent semantic indexing. Information Sciences 10 (1999) 105-137
17. Lewis D., Yang Y., Rose T., and Li F. RCV1: A new benchmark collection for text categorization research. Journal of Machine Learning Research 5 (2004) 361-397
18. Mirsky L. Symmetric Gauge functions and unitarily invariant norms. The Quarterly Journal of Mathematics 11 (1960) 50-59
19. Parlett B. The Symmetric Eigenvalue Problem (1980), Prentice-Hall, Englewood Cliffs, NJ
20. Parlett B., and Scott D. The Lanczos algorithm with selective reorthogonalization. Mathematics of Computation 33 (1979) 217-238
21. G. Salton, C. Buckley, Automatic text structuring and retrieval-experiments in automatic encyclopedia searching, in: Proceedings of the Fourteenth Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 1991, pp. 21-30