Tracking a Few Extreme Singular Values and Vectors in Signal Processing

Proceedings of the IEEE

Volumn 78, Issue 8, 1990, Pages 1327-1343

  Comon, Pierre ^a   Golub, Gene H ^b  

^a DTAS Team of Thomson Sintra   (France)

^b STANFORD UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER SIMULATION; MATHEMATICAL TECHNIQUES--EIGENVALUES AND EIGENFUNCTIONS;

BIDIAGONALIZATION; CHOLESKY FACTORIZATION; COVARIANCE MATRIX UPDATES; EIGENVALUE DECOMPOSITION; LANCZOS METHOD; SINGULAR VALUE DECOMPOSITION;

SIGNAL PROCESSING;

EID: 0025474239     PISSN: 00189219     EISSN: 15582256     Source Type: Journal    
DOI: 10.1109/5.58320     Document Type: Article

References (70)

1. K. V. Mardia et al., Multivariate Analysis. New York, NY: Academic Press, 1979.
2. W. K. Pratt, Digital Image Processing. New York, NY: Wiley, 1975.
3. B.C. Moore,"Principle component analysis in linear systems, controllability, observability, and Model Reduction," IEEE Trans on Automatic Control, vol TAC-26, no. 1, pp. 17-32, Feb. 1981.
4. H. L. Van Trees, Detection, Estimation and Modulation theory, vol. 1. New York, NY: Wiley, 1968.
5. Y.T. Chien and K. S. Fu, "On the generalized Karhunen-Loève expansion," IEEE Trans. Inform. Theory, vol. TI-13, no. 3, pp. 518-520, 1967.
6. S. Y. Kung and K. S. Arun, "SVD algorithms for linear system approximation and spectrum estimation," in Advances in Statistical Signal Processing, vol. 1, JAI Press Inc., 1987, pp. 203-250.
7. T. Kailath, Linear Systems. Englewood Cliffs, NJ: Prentice Hall, 1980.
8. R. Courant and D. Hubert, Methods of Mathematical Physics. New York, NY: Wiley, 1953.
9. J. C. Samson, "Pure states, polarized waves and principal components in the spectra of multiple geophysical time series," Geophys. Jour. Roy. Astr. Soc, vol. 72, no. 3, pp. 647-664, 1983.
10. F. Glangeaud and C. Latombe, "Identification of electromagnetic sources," Annales Geophysicae, vol. 1, no. 3, pp. 245-252, 1983.
11. V. F. Pisarenko, "The retrieval of harmonics from a covariance function," Geophys. Jour. Roy. Astr. Soc, vol. 33, pp. 347-366, 1973.
12. T. N. Ulrych and R.W. Clayton, "Time series modeling and maximum entropy," Physics of the Earth and Planeary Interiors, vol. 12, pp. 188-199, 1976.
13. S. Haykin, Ed. Nonlinear Methods of Spectral Analysis. New York, NY: Springer-Verlag, 1983.
14. G. Bienvenu and L. Kopp, "Optimality of high-resolution array processing using the eigensystem approach," IEEE Trans. ASSP-31, no. 5, pp. 1235-1248, Oct. 1983.
15. R. O. Schmidt, "Multiple emitter location and signal parameter estimation," Proc. RADC Spectrum Estimation Workshop, NY 1979, reprinted in IEEE Trans, on Antenna and Propag., vol. AP-34, no. 3, pp. 276-280, Mar. 1986.
16. O. C. Zienkiewicz, The Finite Element Method. New York, NY: McGraw Hill, 1977.
17. R. Roy, A. Paulraj and T. Kailath, "Esprit, a subspace rotation approach to estimation of parameters of cisoids in noise," IEEE Trans, on ASSP, vol. ASSP-34, no. 5, pp. 1340-1342, Oct. 1986.
18. P. Comon, "An array processing technique using the first principal component," in SVD and Signal Processing, M. Deprettere, Ed. Amsterdam, The Netherlands: North Holland, 1988.
19. R. Roy, "ESPRIT–Estimation of Signal Paramaters via Rotational Invariance Techniques," Ph.D. Thesis, Stanford University, Aug. 1987.
20. R. Roy, and T. Kailath, "ESRIT–Estimation of Signal Parameters via Rotational Invariance Techniques," IEEE Trans. ASSP, vol. 37, no. 7, pp. 984-995, July 1989.
21. K. Aziz and A. Settari, Petroleum Reservoir Simulation. Applied Science Publishers, 1979.
22. J. K. Cullum and R. A. Willoughby, Lanczos Algorithms, vol. 1. Birkhauser, 1985.
23. J. Karhunen, "Adaptive algorithm for estimating eigenvectors of correlation-type matrices," in Proc. ICASSP, San Diego, 1984, pp. 14.6.1-14.6.4.
24. D. Pal, A. Ligtenberg and T. Kailath, "An 0(n2 log n) method for finding the eigenvalues of a symmetric Toepliz and Han-kel matrices," preprint, Jan 1987.
25. G. H. Golub and C. F. Van Loan, Matrix Computations. Hopkins, 1983.
26. V. U. Reddy, B. E. Gardt and T. Kailath, "Least squares type algorithm for adaptive implementation of Pisarenko’s harmonic retrieval method," IEEE ASSP, vol. 30, no. 3, pp. 399-405,1982.
27. D. R. Fuhrmann, "Adaptive MUSIC," in Proc. SPIEConf, San Diego, 1987.
28. I. Karasalo, "Estimating the covariance matrix by signal sub-space averaging," IEEE Trans, on ASSP, vol. 34, no. 1, pp. 8-12, Feb. 1986.
29. P. Comon, "Fast computation of a restricted subset of eigen-pairs of a varying hermitian matrix," in Proc. NATO ASI on Numerical Linear Algebra, Signal Processing and Parallel Processing, Aug. 1-12, 1988, Leuven, Belgium.
30. G. H. Golub, "Some modified matrix eigenvalue problems," SIAM Review, vol. 15, no. 2, pp. 318-334, Apr. 1973.
31. J. R. Bunch, C. P. Nielsen, "Updating the singular value decomposition," Numerische Math., vol. 31, pp. 111-129, 1978.
32. J. J. Dongarra et al., Unpack User’s Guide. SIAM, 1979.
33. B. S. Garbow et al., EISPACK, Lecture Notes in Computer Science, vol. 51. New York, NY: Springer-Verlag, 1977.
34. C. Moler, S. Herskovitzet, et al., Matlab User’s Guide. S. Natick, MA: The Mathworks Inc., 1989.
35. J. P. Lecadre, "Parametric methods for spatial signal processing in the presence of unknown colored noise fields," to appear in IEEE Trans. ASSP.
36. H. Hung and M. Kaveh, "Focusing matrices for coherent sig-nal-subspace processing," IEEE Trans. ASSP, pp. 1272-1281, Aug. 1988.
37. P. E. Gill, G. H. Golub,W. Murray, and M.A. Saunders,"Methods for modifying matrix factorizations," Math. Comp., vol. 28, no. 126, pp. 505-535, Apr. 1974.
38. G. J. Bierman and C. Thornton, "Numerical comparison of Kaiman filter algorithms: orbit determination case study," Automatica, vol. 13, pp. 23-35, 1977.
39. T. Kailath, "Alternatives in discrete-time recursive estimation," Int. Jour. Control, 1980, vol. 32, no. 2, pp. 311-328. Also reprinted in Lectures on Wiener and Kaiman Filtering, T. Kailath, Ed. New York, NY: Springer-Verlag, 1981.
40. M. Verhaegen and P. Van Dooren, "Numerical aspects of different Kaiman filter implementations," IEEE Trans. on AC, vol. 31, no. 10, pp. 907-917, Oct. 1986.
41. J. M. Cioffi, A Fast QR frequency-domain RLS adaptive filter," Proc. ICASSP, Dallas, Apr. 1987, vol. 1, pp. 407-410.
42. S. Haykin, Adaptive Filter Theory. Englewood Cliffs, NJ: Prentice-Hall, 1986.
43. C. H. Colub and C. Reinsch, "Singular value decomposition and least squares solutions," Numerische Math, vol. 14, pp. 403-420, 1970, or Handbook of Automatic Computation, Wilkinson and Reinsch, Ed. New York, NY: Springer-Verlag, 1971.
44. J. H. Wilkinson, The Algebraic Eigenvalue Problem. Oxford, UK: Clarendon Press, 1965.
45. R. J. Vaccaro et al., "Advances in principal component signal processing," First Workshop on SVD and Signal Processing, M. Deprettere Ed. Amsterdam, The Netherlands: North Holland.
46. G. Peters and J. H. Wilkinson, "The calculation of specified eigenvectors by inverse iteration," in Linear Algebra. Handbook for Automatic Computation, J. H. Wilkinson and C. Reinsch, Eds. New York, NY: Springer-Verlag, 1971.
47. R.Schreiber,"Implementation of adaptive array algorithms," IEEE Trans. ASSP, vol. 34, no. 5, pp. 1038-1045, Oct. 1986.
48. J. R. Bunch, C. P. Nielsen, and D. C. Sorensen, "Rank one modification of symmetric eigenproblem," Numerische Math., vol. 31, pp. 31-48, 1978.
49. C. Davis and W. Kahan, "The rotation of eigenvectors by a perturbation," SIAM Jour. Num. Anal., vol. 7, pp. 1-46, 1970.
50. R. C. Thompson, "The behavior of eigenvalues and singular values under perturbations of restricted rank," Linear Algebra and its Applications, vol. 13, pp. 69-78, vol. 13, 1976.
51. B. N. Parlett, "Remarks on matrix eigenvalue computations," in VLSI and Modern Signal Processing, S. Y. Kung, H.J. White-house, and T. Kailath Eds. Englewood Cliffs, NJ: Prentice-Hall, 1985.
52. C. C. Paige, "Accuracy and effectiveness of the Lanczos algorithm for the symmetric eigenproblem," Linear Algebra and its Applications, vol. 34, pp. 235-258, 1980.
53. B. N. Parlett, The Symmetric Eigenvalue Problem. Englewood Cliffs, NJ: Prentice-Hall, 1980.
54. B. N. Parlett, H. Simon, and L. M. Stringer, "On estimating the largest eigenvalue with Lanczos algorithm," Mathematics of Computation, vol. 36, no. 157, pp. 153-165, Jan. 1982.
55. P. Comon, "Adaptive computation of a few extreme eigen-pairs of a positive definite hermitian matrix," Proc. of EUSIPCO, Sept. 5-8,1988, Grenoble, France.
56. G. H. Golub and W. Kahan, "Calculating the singular values and pseudo inverse of a matrix," SIAM Journal Num. Anal., ser. B, vol. 2, no. 2, pp. 205-224, 1965.
57. C. C. Paige, "Bidiagonalization of matrices and solution of linear equations," SIAM Jour. Numer. Analysis, vol. 11, no. 1, Mar. 1974.
58. G. H. Golub, F. T. Luk, and M. L. Overton, "A block lanczos method for computing the singular values and corresponding singular vectors of a matrix," ACM Trans. Math. Soft, pp. 149-169, June 1981.
59. P. Comon and D. Trystram, "An incomplete factorization algorithm for adpative filtering," Signal Processing, vol. 13, no. 4, pp. 353-360, Dec. 1987.
60. M. G. Larimore, "Adaptation convergence of spectral estimation based on Pisarenko harmonic retrieval," IEEE Trans. ASSP, pp. 955-962, Aug. 1983.
61. Y. H. Hu, "Adaptive methods for real time Pisarenko spe trum estimate, in Proc. ICASSP 85, 1985, pp. 105-108.
62. H. Chen and T. K. Sarkar et al., "Adaptive spectral estimatic by the conjugate gradient method," IEEE Trans. ASSP, vol. 3 no. 2, pp. 272-284, 1986.
63. D. R. Fuhrmann and B. Liu, "An iterative algorithm for locating the minimal eigenvector of a symmetric matrix," in Pro ICASSP 84, 1984, pp. 45.8.1-45.8.4.
64. J. F.Yang and M. Kaveh, "Adaptive eigensubspace algorithms for direction or frequency estimation and tracking," IEEE, Trans. ASSP, vol. 36, no. 2, pp. 241-251, Feb. 1988.
65. N. L. Owsley, "Adaptive data orthogonalization," in Pro Conf. ICASSP, 1978, pp. 109-112.
66. B. Windrow and S. D. Stearns, Adaptive Signal Processin Englewood Cliffs, NJ: Prentice-Hall, 1985.
67. D. R. Fuhrmann, "An algorithm for subspace computatic with applications in signal processing," SIAM Jour. Mati Anal. Appl., vol. 9, no. 2, Apr. 1988.
68. E. Oja and J. Karhunen, "On stochastic approximation of tl eigenvectors and eigenvalues of the expectation of a rando matrix," Journal of Math Analysis Appl., vol. 106, no. 1, p 69-84, Feb. 1985.
69. J. M. Cioffi, "Limited precision effects in adaptive filtering IEEE Trans. CAS, pp. 821-833, July 1987.
70. T. F.Chan, "An improved algorithm for computing the SVD ACM Trans. Math. Soft, vol. 8, pp. 84-88.