Improved parallel QR method for large least squares problems involving Kronecker products

Journal of Computational and Applied Mathematics

Volumn 78, Issue 1, 1997, Pages 63-78

  Fausett, Donald W ^a   Fulton, Charles T ^a   Hashish, Hany ^a  

^a FLORIDA INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

Kronecker product; Matrix algorithms; Overdetermined least squares; Parallel processing; QR factorization

Indexed keywords

COMPUTATIONAL METHODS; LEAST SQUARES APPROXIMATIONS; MATHEMATICAL MODELS; MATRIX ALGEBRA; PARALLEL PROCESSING SYSTEMS; PROBLEM SOLVING;

BINARY EXCHANGE ALGORITHM; KRONECKER PRODUCTS; QR FACTORIZATION;

PARALLEL ALGORITHMS;

EID: 0031550488     PISSN: 03770427     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0377-0427(96)00109-4     Document Type: Article

References (32)

1. R. Bellman, Introduction to Matrix Analysis (McGraw-Hill, New York, 2nd ed., 1970).
2. D.P. Bertsekas and J.N. Tsitsiklis, Parallel and Distributed Computation: Numerical Methods (Prentice-Hall, Englewood cliffs, NJ, 1989).
3. G. Birkhoff and R.E. Lynch, Numerical Solution of Elliptic Problems (SIAM, Philadelphia, 1984).
4. C.H. Bischof, A parallel factorization algorithm with controlled local pivoting, SIAM J. Sci. Statist. Comput. 12 (1991) 36-57.
5. A. Björck, Numerical Methods for Least Squares Problems (SIAM, Philadelphia, 1996).
6. J.-Y. Choi, J.J. Dongarra and D.W. Walker, Parallel matrix transpose algorithms on distributed memory concurrent computers, ORNL/TM-12309 1993.
7. E. Chu and A. George, QR factorization of a dense matrix on a hypercube multiprocessor, SIAM J. Sci. Statist. Comput. 11 (1990) 990-1028.
8. T.F. Coleman and P.E. Plassman, A parallel nonlinear least-squares solver: Theoretical analysis and numerical results, SIAM J. Sci. Statist. Comput. 13 (1991) 771-793.
9. J.J. Dongarra, S.A. Moulton, L.S. Ostrouchov, A. Petitet and R. C. Whaley, Installation Guide for ScaLapack, LAPACK Working Note, 1993.
10. J. Douglas and T. Dupont, Alternating direction Galerkin methods on rectangles, in: B. Hubbard, Ed., Numerical Solution of Partial Differential Equations, II, SYNSPADE, 1970 (Academic Press, New York, 1971) 133-244.
11. V. Faber, Global communication algorithms for hypercubes and other Cayley coset graphs, LA-UR-87-3136, 1987.
12. D.W. Fausett and C.T. Fulton, Large least squares problems involving Kronecker products, SIAM J. Matrix Anal. Appl. 15 (1994) 219-227.
13. G.H. Golub and C.F. Van Loan, Matrix Computations (Johns Hopkins, Baltimore, MD, 2nd ed., 1989).
14. A. Graham, Kronecker Products and Matrix Calculus: with Applications (Halsted Press, New York, 1981).
15. J. Granata, M. Conner and R. Tolimieri, The Tensor Product: A mathematical programming language for FFTs and other fast DSP operations, IEEE Signal Process. Mag. 9 (1992) 40-48.
16. W.W. Hager, Applied Numerical Linear Algebra (Prentice-Hall, Englewood cliffs, NJ, 1988).
17. H. Hashish, Parallel algorithms based on QR factorization for large least squares problems involving Kronecker products, Ph.D. Dissertation, Dept. of Engineering Mathematics, El-Mansoura University, Egypt, 1994.
18. H. Hashish and D.W. Fausett, Matrix transposition algorithm on a distributed memory parallel computer, in: Proc. 8th Internat. Conf. on Parallel and Distributed Computing Systems, Orlando, FL (1995) 433-438.
19. H.V. Henderson and S.R. Searle, The vec-permutation matrix, the vec operator and Kronecker products: A review, Linear and Multilinear Algebra 9 (1981) 271-288.
20. R.A. Horn and C.R. Johnson, Topics in Matrix Analysis (Cambridge University Press, Cambridge, 1991).
21. S.L. Johnsson and C.-T. Ho, Algorithms for matrix transposition on boolean N-cube configured ensemble architectures, SIAM. J. Matrix Anal. Appl. 9 (1988) 419-454.
22. E.V. Krishnamurthy and S.K. Sen, Numerical Algorithms, Computations in Science and Engineering (Affiliated East-West Press, Pvt. Ltd., New Delhi, 1986).
23. P. Lancaster and M. Tismenetsky, The Theory of Matrices, With Applications, (Academic Press, Orlando, 2nd ed., 1985).
24. C.B. Moler, Matrix computation on distributed memory multiprocessors, in: M. Heath, ed., Hypercube Multiprocessors, 1986 (SIAM, Philadelphia, 1986) 181-195.
25. J.M. Ortega, Introduction to Parallel and Vector Solution of Linear Systems (Plenum Press, New York 1988).
26. A. Pothen and P. Raghavan, Distributed orthogonal factorization: Givens and Householder algorithms, SIAM J. Sci. Statist. Comput. 10 (1989) 1113-1134.
27. C.R. Rao and S.K. Mitra, Generalized Inverse of Matrices and its Applications (Wiley, New York, 1971).
28. U.A. Rauhala, Introduction to array algebra, Photogrammetric Engineering and Remote Sensing 46 (1980) 177-192.
29. P.A. Regalia and S.K. Mitra, Kronecker products, unitary matrices and signal processing applications, SIAM Rev. 31 (1989) 586-613.
30. S.S. Takkella and S.R. Seidel, Broadcast and complete exchange algorithms for mesh topologies, Tech. Report 93-04, Dept of Computer Science, Michigan Technological University, 1993.
31. C.F. Van Loan and N. Pitsianis, Approximation with Kronecker products, CTC92, TR109, 1992.
32. C.F. Van Loan, Computational Frameworks for the Fast Fourier Transform (SIAM, Philadelphia, 1992).