Conjugate gradient methods for Toeplitz systems

SIAM Review

Volumn 38, Issue 3, 1996, Pages 427-482

  Chan, Raymond H ^a   Michael, K N G ^b  

^a CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

^b AUSTRALIAN NATIONAL UNIVERSITY   (Australia)

Author keywords

Differential equations; Integral equations; Preconditioned conjugate gradient methods; Preconditioners; Queueing problems; Signal and image processing; Time series; Toeplitz matrices

Indexed keywords

ALGORITHMS; COMPUTATIONAL COMPLEXITY; COMPUTER NETWORKS; IMAGE PROCESSING; INTEGRAL EQUATIONS; MATRIX ALGEBRA; PARTIAL DIFFERENTIAL EQUATIONS; PROBLEM SOLVING; QUEUEING THEORY; SIGNAL PROCESSING; TIME SERIES ANALYSIS;

CONJUGATE GRADIENT METHODS; PRECONDITIONERS; TOEPLITZ SYSTEMS;

NUMERICAL METHODS;

EID: 0030246195     PISSN: 00361445     EISSN: None     Source Type: Journal    
DOI: 10.1137/S0036144594276474     Document Type: Article

References (200)

1. J. ABBISS AND P. EARWICKER, Compact operator equations, regularization and super-resolution, in Mathematics in Signal Processing, T. Durrani, J. Abbiss, J. Hudson, R. Madan, J. Macwhirter, and T. Moore, eds., Clarendon Press, Oxford, UK, 1987, pp. 225-236.
2. S. AKL, The Design and Analysis of Parallel Algorithms, Prentice-Hall, Englewood Cliffs, NJ, 1989.
3. T. ALEXANDER, Adaptive Signal Processing, Theory and Applications, Springer-Verlag, New York, 1986.
4. G. AMMAR AND W. GRAGG, Superfast solution of real positive definite Toeplitz systems, SIAM J. Matrix Anal. Appl., 9 (1988), pp. 61-76.
5. H. ANDREWS AND B. HUNT, Digital Image Restoration, Prentice-Hall, Englewood Cliffs, NJ, 1977.
6. P. ANSELONE, Collectively Compact Operator Approximation Theory and Applications to Integral Equations, Prentice-Hall, Englewood Cliffs, NJ, 1971.
7. O. AXELSSON AND V. BARKER, Finite Element Solution of Boundary Value Problems, Theory and Computation, Academic Press, Orlando, FL, 1984.
8. G. BAXTER, Polynomials defined by a difference system, J. Math. Anal. Appl., 2 (1961), pp. 223-263.
9. F. DI BENEDETTO, Analysis of preconditioning techniques for ill-conditioned Toeplitz matrices, SIAM J. Sci. Comput., 16 (1995), pp. 682-697.
10. _, Preconditioning of block Toeplitz matrices by sine transforms, SIAM J. Sci. Comput., 16 (1995), pp. 682-697.
11. F. DI BENEDETTO, G. FIORENTINO, AND S. SERRA, C.G. preconditioning for Toeplitz matrices, Comput. Math. Appl., 25 (1993), pp. 35-45.
12. D. BERTSEKAS AND J. TSITSIKLIS, Parallel and Distributed Computation: Numerical Methods, Prentice-Hall, Englewood Cliffs, NJ, 1989.
13. J. BIEMOND, R. LAGENDIJK, AND R. MERSEREAU, Iterative methods for image deblurring, Proc. IEEE, 78 (1990), pp. 856-883.
14. D. BINI AND P. FAVATI, On a matrix algebra related to the discrete Hartley transform, SIAM J. Matrix Anal. Appl., 14 (1993), pp. 500-507.
15. D. BINI AND F. DI BENEDETTO, A new preconditioner for the parallel solution of positive definite Toeplitz systems, in Proc. 2nd ACM Symp. on Parallel Algorithms and Architectures, Crete, Greece, 1990, pp. 220-223.
16. R. BITMEAD AND B. ANDERSON, Asymptotically fast solution of Toeplitz and related systems of linear equations, Linear Algebra Appl., 34 (1980), pp. 103-116.
17. Å. BJÖRCK, Least squares methods, in Handbook of Numerical Analysis, Vol. 1, P. Ciarlet and J. Lions, eds., Elsevier, Amsterdam, 1989, p. 465.
18. A. BOJANCZYK, R. BRENT, AND F. DE HOOG, QR factorization of Toeplitz matrices, Numer. Math., 49 (1986), pp. 81-94.
19. E. BOMAN AND I. KOLTRACHT, Fast transform based preconditioners for Toeplitz equations, SIAM J. Matrix Anal. Appl., 16 (1995), pp. 628-645.
20. R. BRENT, F. GUSTAVSON, AND D. YUN, Fast solution of Toeplitz systems of equations and computation of Padé approximants, J. Algorithms, 1 (1980), pp. 259-295.
21. P. BROCKWELL AND R. DAVIS, Time Series: Theory and Methods, 2nd ed. Springer-Verlag, New York, 1991.
22. A. BUCKLEY, On the solution of certain skew symmetric linear systems, SIAM J. Numer. Anal., 14 (1977), pp. 566-570.
23. J. BUNCH, Stability of methods for solving Toeplitz systems of equations, SIAM J. Sci. Stat. Comput., 6 (1985), pp. 349-364.
24. G. CARAYANNIS, N. KALOUPTSIDIS, AND D. MANOLAKIS, Fast recursive algorithms for a class of linear equations, IEEE Trans. Acoust. Speech Signal Process., 30 (1982), pp. 227-239.
25. R. CARRERAS, personal correspondence, 1993.
26. R. CHAN, Iterative methods for overflow queueing models I, Numer. Math., 51 (1987), pp. 143-180.
27. R. CHAN, Circulant preconditioners for Hermitian Toeplitz systems, SIAM J. Matrix Anal. Appl., 10 (1989), pp. 542-550.
28. _, The spectrum of a family of circulant preconditioned Toeplitz systems, SIAM J. Numer. Anal., 26 (1989), pp. 503-506.
29. _, Toeplitz preconditioners for Toeplitz systems with nonnegative generating functions, IMA J. Numer. Anal., 11 (1991), pp. 333-345.
30. N, SEA Bull. Math., 16 (1992), pp. 97-105.
31. R. CHAN AND T. CHAN, Circulant preconditioners for elliptic problems, Numer. Linear Algebra Appl., 1 (1992), pp. 77-101.
32. R. CHAN AND W. CHING, Toeplitz-circulant preconditioners for Toeplitz systems and their applications to queueing networks with batch arrivals, SIAM J. Sci. Comput., 17 (1996), pp. 762-772.
33. R. CHAN, W. CHING, AND C. WONG, Optimal trigonometric preconditioners for elliptic problems and queueing problems, SEA Bull. Math., 20 (1996), to appear.
34. R. CHAN, T. DELILLO, AND M. HORN, The numerical solution of the biharmonic equation by conformai mapping, SIAM J. Sci. Comput., to appear.
35. R. CHAN AND X. JIN, Circulant and skew-circulant preconditioners for skew-Hermitian type Toeplitz systems, BIT, 31 (1991), pp. 632-646.
36. _, A family of block preconditioners for block systems, SIAM J. Sci. Stat. Comput., 13 (1992), pp. 1218-1235.
37. R. CHAN, X. JIN, AND M. NG, Circulant integral operators as preconditioners for Wiener-Hopf equations, Integral Equations Operator Theory, 21 (1995), pp. 12-23.
38. R. CHAN, X. JIN, AND M. YEUNG, The circulant operator in the Banach algebra of matrices, Linear Algebra Appl., 149 (1991), pp. 41-53.
39. _, The spectra of super-optimal circulant preconditioned Toeplitz systems, SIAM J. Numer. Anal., 28 (1991), pp. 871-879.
40. R. CHAN AND F. LIN, Preconditioned conjugate gradient methods for integral equations of the second kind defined on the half-line, J. Comput. Math., to appear.
41. _, Circulant integral operators and circulant preconditioners, in Proc. Cornelius Lanczos Intl. Centenary Conf., Raleigh, NC, 1993, pp. 407-409.
42. R. CHAN, J. NAGY, AND R. PLEMMONS, Circulant preconditioned Toeplitz least squares iterations, SIAM J. Matrix Anal. Appl., 15 (1994), pp. 80-97.
43. _, FFT-based preconditioners for Toeplitz-block least squares problems, SIAM J. Numer. Anal., 30 (1993), pp. 1740-1768.
44. _, Displacement preconditioner for Toeplitz least squares iterations, Elec. Trans. Numer. Anal., 2 (1994), pp. 44-56.
45. R. CHAN AND M. NG, Fast iterative solvers for Toeplitz-plus-band systems, SIAM J. Sci. Comput., 14 (1993), pp. 1013-1019.
46. _, Toeplitz preconditioners for Hermitian Toeplitz systems, Linear Algebra Appl., 190 (1993), pp. 181-208.
47. R. CHAN, M. NG, AND R. PLEMMONS, Generalization of Strang's preconditioner with applications to Toeplitz least squares problems, Numer. Linear Algebra Appl., 3 (1996), pp. 45-64.
48. R. CHAN, M. NG, and C. WONG, Sine transform based preconditioners for symmetric Toeplitz systems, Linear Algebra Appl., 232 (1996), pp. 237-259.
49. R. CHAN AND G. STRANG, Toeplitz equations by conjugate gradients with circulant preconditioner, SIAM J. Sci. Stat. Comput., 10 (1989), pp. 104-119.
50. R. CHAN and P. TANG, Fast band-Toeplitz preconditioners for hermitian Toeplitz systems, SIAM J. Sci. Comput., 15 (1994), pp. 164-171.
51. R. CHAN AND C. WONG, Best-conditioned circulant preconditioners, Linear Algebra Appl., 218 (1995), pp. 205-212.
52. _, Sine Transform Based Preconditioners for Elliptic Problems, Tech. report 93-12-4, Dept. of Mathematics, CUHK, 1993.
53. R. CHAN AND M. YEUNG, Circulant preconditioners for Toeplitz matrices with positive continuous generating functions, Math. Comp., 58 (1992), pp. 233-240.
54. _, Circulant preconditioners constructed from kernels, SIAM J. Numer. Anal., 29 (1992), pp. 1093-1103.
55. _, Jackson's theorem and circulant preconditioned Toeplitz systems, J. Approx. Theory, 70 (1992), pp. 191-205.
56. _, Circulant preconditioners for complex Toeplitz matrices, SIAM J. Numer. Anal., 30 (1993), pp. 1193-1207.
57. T. CHAN, An optimal circulant preconditioner for Toeplitz systems, SIAM J. Sci. Stat. Comput., 9 (1988), pp. 766-771.
58. T. CHAN AND P. HANSEN, A look-ahead Levinson algorithm for general Toeplitz systems, IEEE Trans. Signal Process., 40 (1992), pp. 1079-1090.
59. T. CHAN AND J. OLKIN, Circulant preconditioners for Toeplitz-block matrices, Numer. Algorithms, 6 (1994), pp. 89-101.
60. E. CHENEY, Introduction to Approximation Theory, McGraw-Hill, New York, 1966.
61. C. CHUI AND A. CHAN, Application of approximation theory methods to recursive digital filter design, IEEE Trans. Acoust. Speech Signal Process., 30 (1982), pp. 18-24.
62. C. CHUI AND G. CHEN, Signal Processing and Systems Theory, Selected Topics, Springer-Verlag, Berlin, 1992.
63. J. CHUN AND T. KAILATH, Divide-and-conquer solutions of least-squares problems for matrices with displacement structure, SIAM J. Matrix Anal. Appl., 12 (1991), pp. 128-145.
64. J. CHUN, T. KAILATH, AND H. LEV-ARI, Fast parallel algorithms for QR and triangular factorization, SIAM J. Sci. Stat. Comput., 8 (1987), pp. 899-913.
65. N. CLINTHORNE, T. PAN, P. CHIAO, L. ROGERS, AND J. STAMOS, Preconditioning methods for improved convergence rates in iterative reconstructions, IEEE Trans. Med. Imag., 12 (1993), pp. 78-83.
66. J. COOLEY AND J. TUKEY, An algorithm for the machine calculation of complex Fourier series, Math. Comp., 19 (1965), pp. 297-301.
67. P. CONCUS AND P. SAYLOR, A modified direct preconditioner for indefinite symmetric Toeplitz systems, Numer. Linear Algebra Appl., 2 (1995), pp. 415-429.
68. G. CYBENKO, Fast Toeplitz orthogonalization using inner products, SIAM J. Sci. Stat. Comput., 8 (1987), pp. 734-740.
69. P. DAVIS, Circulant Matrices, John Wiley, New York, 1979.
70. P. DELSARTE, Y. GENIN, AND Y. KAMP, A generalization of the Levinson algorithm for Hermitian Toeplitz matrices with any rank profile, IEEE Trans. Acoust. Speech Signal Process., 33 (1985), pp. 964-971.
71. L. DELVES AND J. MOHAMED, Computational Methods for Integral Equations, Cambridge University Press, Cambridge, UK, 1985.
72. M. DRYJA AND O. WIDLUND, Some domain decomposition algorithms for elliptic problems, in Proc. Conf. on Iterative Methods for Large Linear Systems, Austin, TX, 1989.
73. T. DUPONT, R. KENDALL, AND H. RACHFORD, An approximate factorization procedure for solving self-adjoint elliptic difference equations, SIAM J. Numer. Anal., 5 (1968), pp. 559-573.
74. G. FIORENTINO AND S. SERRA, Multigrid methods for Toeplitz matrices, Calcolo, 28 (1991), pp. 283-305.
75. _, Multigrid methods for symmetric positive definite block Toeplitz matrices with nonnegative generating functions, SIAM J. Sci. Comput., to appear.
76. R. FREUND, A transpose-free quasi-minimal residual algorithm for non-Hermitian linear systems, SIAM J. Sci. Comput., 14 (1993), pp. 470-482.
77. _, A look-ahead Bareiss algorithm for general Toeplitz matrices, Numer. Math., 68 (1994), pp. 35-69.
78. R. FREUND, G. GOLUB, AND N. NACHTIGAL, Iterative solution of linear systems, Acta Numerica, 1 (1992), pp. 57-100.
79. R. FREUND AND T. HUCKLE, Iterative solution of linear systems with low displacement rank by conjugate gradient-type algorithms, XII Householder Symp., Lake Arrowhead, CA, 1993, manuscript.
80. R. FREUND AND H. ZHA, Formally biorthogonal polynomials and a look-ahead Levinson algorithm for general Toeplitz systems. Linear Algebra Appl., 188,189 (1993), pp. 255-303.
81. B. FRIEDLANDER, M. MORF, T. KAILATH, AND L. LJUNG, New inversion formulas for matrices classified in terms of their distance from Toeplitz matrices, Linear Algebra Appl., 27 (1979), pp. 31-60.
82. W. FULLER, Introduction to Statistical Time Series, John Wiley, New York, 1976.
83. D. GILLIAM, C. MARTIN, AND J. LUND, Analytic and numerical aspects of the observation of the heat equation, in Proc. 26th IEEE Conf. on Decision and Control, 2 (1987), pp. 975-976.
84. A. GIORDANO AND F. HSU, Least Square Estimation with Applications to Digital Signal Processing, Wiley, New York, 1985.
85. I. GOHBERG AND I. FEL'DMAN, Convolution equations and projection methods for their solution, Transl. Math. Monographs, Vol. 41, Amer. Math. Soc., Providence, RI, 1974.
86. I. GOHBERG, M. HANKE, AND I. KOLTRACHT, Fast preconditioned conjugate gradient algorithms for Wiener-Hopf integral equations, SIAM J. Numer. Anal., 31 (1994), pp. 429-443.
87. I. GOHBERG AND A. SEMENCUL, On the inversion of finite Toeplitz matrices and their continuous analogs, Mat. Issled., 2 (1972), pp. 201-233.
88. G. GOLUB AND C. VAN LOAN, Matrix Computations, 2nd ed., The Johns Hopkins University Press, Baltimore, MD, 1989.
89. M. GOVER AND S. BARNETT, Inversion of Toeplitz matrices which are not strongly non-singular, IMA J. Numer. Anal., 5 (1985), pp. 101-110.
90. C. GREEN, Integral Equation Methods, Barnes & Noble, New York, 1969.
91. U. GRENANDER AND G. SZEGÖ, Toeplitz Forms and Their Applications, 2nd ed., Chelsea, New York, 1984.
92. C. GROETSCH, The Theory of Tikhonov Regularization for Fredholm Equations of the First Kind, Pitman, London, UK, 1984.
93. C. GUEGUEN, Linear prediction in the singular case and the stability of Eigen models, in Proc. IEEE Intl. Conf. on Acoust. Speech and Signal Process., 2 (1981), pp. 881-885.
94. I. GUSTAFSSON, A class of first order factorization methods, BIT, 18 (1978), pp. 142-156.
95. M. GUTKNECHT, Stable row recurrences for the Pade table and generically superfast look-ahead solvers for non-Hermitian Toeplitz systems. Linear Algebra Appl., 188,189 (1993), pp. 351-421.
96. R. HAMMING, Digital Filters, 3rd ed., Prentice-Hall, Englewood Cliffs, NJ, 1989.
97. M. HANKE, J. NAGY, AND R. PLEMMONS, Preconditioned iterative regularization for ill-posed problems, in Numerical Linear Algebra, L. Reichel, A. Ruttan, and R. Varga, eds., de Gruyter, Berlin, 1993.
98. M. HANKE AND J. NAGY, Toeplitz approximate inverse preconditioner for banded Toeplitz matrices, Numer. Algorithms, 7 (1994), pp. 183-199.
99. S. HAYKIN, Adaptive Filter Theory, 2nd ed., Prentice-Hall, Englewood Cliffs, NJ, 1991.
100. L. HEMMINGSSON, Toeplitz preconditioners with block structure for first-order PDEs, Numer. Linear Algebra Appl., 3 (1996), pp. 21-44.
101. L. HEMMINGSSON AND K. OTTO, Analysis of semi-Toeplitz preconditioners for first-order PDE, SIAM J. Sci. Comput., 17 (1996), pp. 47-64.
102. W. HENKEL, An extended Berlekamp-Massey algorithm for the inversion of Toeplitz matrices, IEEE Trans. Comm., 40 (1992), pp. 1557-1561.
103. S. HOLMGREN, CG-like Iterative Methods and Semicirculant Preconditioners on Vector and Parallel Computers, Report No. 148, Dept. of Scientific Computing, Uppsala University, Uppsala, Sweden, 1992.
104. S. HOLMGREN AND K. OTTO, A Comparison of Preconditioned Iterative Methods for Nonsymmetric Block-tridiagonal Systems of Equations, Report No. 123 (revised), Dept. of Scientific Computing, Uppsala University, Uppsala, Sweden, 1990.
105. _, Iterative solution methods and preconditioners for block- tridiagonal systems of equations, SIAM J. Matrix Anal. Appl., 13 (1992), pp. 863-886.
106. _, Semicirculant preconditioners for first-order partial differential equations, SIAM J. Sci. Comput., 15 (1994), pp. 385-407.
107. _, Semicirculant solvers and boundary corrections for first-order partial differential equations, SIAM J. Sci. Comput., 17 (1996), pp. 613-630.
108. F. DE HOOG, A new algorithm for solving Toeplitz systems of equations, Linear Algebra Appl., 88/89 (1987), pp. 123-138.
109. J. HSUE AND A. YAGLE, Fast algorithms for close-to-Toeplitz-plus-Hankel systems and two-sided linear prediction, IEEE Trans. Signal Process., 41 (1993), pp. 2349-2361.
110. T. HUCKLE, Circulant/skew circulant matrices as preconditioners for Hermitian Toeplitz systems, in Proc. IMACS Conf. on Iterative Methods in Linear Algebra, Brussels, Belgium, 1991.
111. _, Circulant and skew circulant matrices for solving Toeplitz matrix problems, SIAM J. Matrix Anal. Appl., 13 (1992), pp. 767-777.
112. _, Some aspects of circulant preconditioners, SIAM J. Sci. Comput., 14 (1993), pp. 531-541.
113. _, Iterative Methods for Toeplitz-like Matrices, Report SCCM-94-05, Computer Science Dept., Stanford University, Stanford, CA, 1994.
114. _, Fast transforms for tridiagonal linear equations, BIT, 34 (1994), pp. 99-112.
115. _, A note on skew circulant preconditioners for elliptic problems, Numer. Algorithms, 2 (1992), pp. 279-286.
116. A. JAIN, Fundamentals of Digital Image Processing, Prentice-Hall, Englewood Cliffs, NJ, 1989.
117. _, Fast inversion of banded Toeplitz matrices by circular decompositions, IEEE Trans. Acoust. Speech Signal Process., 26 (1978), pp. 121-126.
118. X. JIN, A note on circulant preconditioners for hyperbolic and parabolic equations, Chinese J. Math., 21 (1993), pp. 129-142.
119. X. JIN, Hartley preconditioners for Toeplitz systems generated by positive continuous functions, BIT, 34 (1994), pp. 367-371.
120. _, Band-Toeplitz Preconditioners for Block Toeplitz Systems, J. Comput. Appl. Math., submitted.
121. X. JIN AND R. CHAN, Circulant preconditioners for second order hyperbolic equations, BIT, 32 (1992), pp. 650-664.
122. M. KAC, W. MURDOCK, AND G. SZEGÖ, On the eigenvalues of certain Hermitian forms, J. Ration. Mech. Anal., 2 (1953), pp. 767-800.
123. A. KATSAGGELOS, Digital Image Restoration, Springer-Verlag, Berlin, 1991.
124. L. KAUFMAN, Matrix methods for queueing problems, SIAM J. Sci. Stat. Comput., 4 (1983), pp. 525-552.
125. R. KING, M. AHMADI, R. GOROUI-NAGUIB, A. KWABWE, and M. AZIMI-SADJADI, Digital Filtering in One and Two Dimensions: Design and Applications, Plenum, New York, 1989.
126. B. KISS AND G. MOLNÁRKA, A preconditioned domain decomposition algorithm for the solution of the elliptic Neumann problem, Period. Math. Hungar., 24 (1992), pp. 151-165.
127. -, A preconditioned domain decomposition algorithm for the solution of the elliptic Neumann problem, in Parallel Algorithms for Partial Differential Equations, W. Hackbusch, ed., Vieweg, Braunschweig, Germany, 1991, pp. 140-156.
128. T. KU AND C. KUO, Design and analysis of Toeplitz preconditioners, IEEE Trans. Signal Process., 40 (1992), pp. 129-141.
129. _, On the spectrum of a family of preconditioned block Toeplitz matrices, SIAM J. Sci. Stat. Comput., 13 (1992), pp. 948-966.
130. _, Spectral properties of preconditioned rational Toeplitz matrices, SIAM J. Matrix Anal. Appl., 14 (1993), pp. 146-165.
131. _, Spectral properties of preconditioned rational Toeplitz matrices: The nonsymmetric case, SIAM J. Matrix Anal. Appl., 14 (1993), pp. 521-544.
132. _, A minimum-phase LU factorization preconditioner for Toeplitz matrices, SIAM J. Sci. Stat. Comput., 13 (1992), pp. 1470-1487.
133. _, Preconditioned iterative methods for solving Toeplitz-plus-Hankel systems, SIAM J. Numer. Anal., 30 (1993), pp. 824-845.
134. N. LEVINSON, The Wiener RMS (root mean square) error criterion in filter design and prediction, J. Math. Phys., 25 (1946), pp. 261-278.
135. F. LIN, M. NG, AND R. CHAN, Preconditioners for Wiener-Hopf equations with higher order quadrature rules, SIAM J. Numer. Anal., to appear.
136. E. LINZER, Arithmetic Complexity of Iterative Toeplitz Solvers, manuscript.
137. _, Extended Circulant Conditioning of Toeplitz Systems, Tech. report R.C, IBM Research, Yorktown Heights, NY, 1992.
138. I. LIRKOV AND S. MARGENOV, On circulant preconditioning of elliptic problems in L-shaped domain, in Advances in Numerical Methods and Applications, I. Dimov, Bl. Sendov, and P. Vassilevski, eds., World Scientific, Singapore, 1994.
139. D. LUENBERGER, Linear and Nonlinear Programming, 2nd ed., Addison-Wesley, Reading, MA, 1984.
140. L. MARPLE, A new autoregressive spectrum analysis algorithm, IEEE Trans. Acoust. Speech Signal Process., 28 (1980), pp. 441-454.
141. _, Efficient least squares FIR system identification, IEEE Trans. Acoust. Speech Signal Process., 29 (1981), pp. 62-73.
142. _, Fast algorithms for linear prediction and system identification filters with linear phase, IEEE Trans. Acoust. Speech Signal Process., 30 (1982), pp. 942-953.
143. M. MORF, Doubling algorithms for Toeplitz and related equations, in Proc. IEEE Intl. Conf. on Acoust. Speech and Signal Process., 3 (1980), pp. 954-959.
144. J. NAGY AND R. PLEMMONS, Some fast Toeplitz least squares algorithms, in Proc. SPIE Conf. on Advanced Signal Processing Algorithms, Architectures, and Implementations II, 1566 (1991), pp. 35-46.
145. J. NAGY, R. PLEMMONS, AND T. TORGERSEN, Iterative image restoration using approximate inverse, IEEE Trans. Image Process., to appear.
146. _, Fast restoration of atmospherically blurred images, in Proc. SPIE Symp. on Advanced Signal Processing: Algorithms, Architectures, and Implementations, 2296, 1994, to appear.
147. M. NG, Fast iterative methods for solving Toeplitz-plus-Hankel least squares problems, Elec. Trans. Numer. Anal., 2 (1994), pp. 154-170.
148. _, Fast FFT-based conjugate gradient algorithm for applications in signal processing, in Proc. Cornelius Lanczos Intl. Centenary Conf., Raleigh, NC, 1993, pp. 404-406.
149. M. NG AND R. CHAN, Fast iterative methods for least squares estimations, Numer. Algorithms, 6 (1994), pp. 353-378.
150. M. NG AND F. LIN, Decomposition and construction of preconditioners for Wiener-Hopf equations, SEA Bull. Math., 20 (1996), to appear.
151. M. NG, F. LIN, AND R. CHAN, Construction of preconditioners for Wiener-Hopf equations by operator splitting, Appl. Math. Comp., 72 (1995), pp. 77-96.
152. M. NG AND R. PLEMMONS, Fast recursive least squares using the FFT, in Mathematics in Signal Processing III, J. McWhirter, ed., Clarendon Press, Oxford, UK, 1994.
153. _, Fast RLS adaptive filtering by FFT-based conjugate gradient iterations, SIAM J. Sci. Comput., (1996), to appear.
154. T. ODA, Moment analysis for traffic associated with Markovian queueing systems, IEEE Trans. Comm., 39 (1991), pp. 737-745.
155. J. OLKIN, Linear and Nonlinear Deconvolution Problems, Ph.D. thesis, Rice University, Houston, TX, 1986.
156. K. OTTO, Analysis of preconditioners for hyperbolic partial differential equations, SIAM J. Numer. Anal., to appear.
157. D. PAL, Fast Algorithms for Structured Matrices with Arbitrary Rank Profile, Ph.D. thesis, Stanford University, Stanford, CA, 1990.
158. J. PEARL, On coding and filtering stationary signals by discrete Fourier transforms, IEEE Trans. Inform. Theory, 19 (1973), pp. 229-232.
159. R. PLEMMONS, FFT-based RLS in signal processing, in Proc. IEEE Intl. Conf. on Acoust. Speech Signal Process., 3 (1993), pp. 571-574.
160. M. PRIESTLEY, Spectral Analysis and Time Series, Academic Press, London, UK, 1981.
161. L. PUSTYUNIKOV, On the algebraic structure of the spaces of Toeplitz and Hankel matrices, Soviet Math. Dokl., 21 (1980), pp. 141-144.
162. S. REEVES AND R. MERSEREAU, Optimal regularization parameter estimation for image restoration, in Proc. SPIE Conf. on Image Processing Algorithms and Techniques II, 1452 (1991), pp. 127-138.
163. L. RUDIN, S. OSHER, AND C. FU, Total Variation Based Restoration of Noisy, Blurred Images, manuscript.
164. Y. SAAD AND M. SCHULTZ, GMRES: A generalized minimal residual algorithm for solving nonsymmetric linear systems, SIAM J. Sci. Stat. Comput., 7 (1986), pp. 856-869.
165. A. SAYED AND T. KAILATH, Optimal Circulant Preconditioning for Arbitrary Matrices, manuscript.
166. A. SEILA, Multivariate estimation of conditional performance measure in regenerative simulation, Amer. J. Math. Manag. Sci., 10 (1990), pp. 17-50.
167. S. SERRA, Preconditioning strategies for asymptotically ill-conditioned block Toeplitz systems, BIT, 34 (1994), pp. 579-594.
168. _, Preconditioning Strategies for Hermitian Toeplitz Systems with Nondefinite Generating Functions, SIAM J. Matrix Anal. Appl., to appear.
169. P. SHERMAN, Circulant approximations of the inverses of Toeplitz matrices and related quantities with applications to stationary random processes, IEEE Trans. Acoust. Speech Signal Process., 33 (1985), pp. 1630-1632.
170. L. SIBUL, Adaptive Signal Processing, IEEE Press, New York, 1987.
171. U. STEIMEL, Fast computation of Toeplitz forms under narrow band conditions with applications to spectral estimation, in Digital Signal Processing, V. Cappellini and A. G. Constantinides, eds., Academic Press, London, UK, 1980.
172. G. STRANG, A proposal for Toeplitz matrix calculations, Stud. Appl. Math., 74 (1986), pp. 171-176.
173. G. STRANG AND A. EDELMAN, The Toeplitz-circulant eigenvalue problem Ax = λCx, in Oakland Conf. on PDE and Appl. Math., L. Bragg and J. Dettman, eds., Longman Sci. Tech., New York, 1987.
174. P. SWARZTRAUBER, Multiprocessor FFTs, Parallel Comput., 5 (1987), pp. 197-210.
175. D. SWEET, The use of pivoting to improve the numerical performance of algorithms for Toeplitz matrices, SIAM J. Matrix Anal. Appl., 14 (1993), pp. 468-493.
176. _, Fast Toeplitz orthogonalization, Numer. Math., 43 (1984), pp. 1-21.
177. P. TANG, A fast algorithm for linear complex Chebyshev approximations, Math. Comp., 51 (1988), pp. 721-739.
178. A. TEKALP AND G. PAVLOVIĆ, Restoration of scanned photographic images, in Digital Image Restoration, A. Katsaggelos, ed., Springer-Verlag, Berlin, 1991.
179. M. TISMENETSKY, A decomposition of Toeplitz matrices and optimal circulant preconditioning, Linear Algebra Appl., 154, 156 (1991), pp. 105-121.
180. O. TOEPLITZ, Zur Theorie der quadratischen und bilinearen Formen von unendlichvielen Veränderlichen. I. Teil: Theorie der L-Formen., Math. Annal., 70 (1911), pp. 351-376.
181. N. TREFETHEN, Approximation theory and numerical linear algebra, in Algorithms for Approximation II, J. Mason and M. Cox, eds., Chapman and Hall, London, 1990, pp. 336-360.
182. W. TRENCH, An algorithm for the inversion of finite Toeplitz matrices, SIAM J. Appl. Math., 12 (1964), pp. 515-522.
183. E. TYRTYSHNIKOV, Optimal and superoptimal circulant preconditioners, SIAM J. Matrix Anal. Appl., 13 (1992), pp. 459-473.
184. _, A unifying approach to some old and new theorems on distribution and clustering, Linear Algebra Appl., 232 (1996), pp. 1-43.
185. _, Circulant preconditioners with unbounded inverses, Linear Algebra Appl., 216 (1995), pp. 1-24.
186. _, Influence of matrix operations on the distribution of eigenvalues and singular values of Toeplitz matrices, Linear Algebra Appl., 207 (1994), pp. 225-249.
187. E. TYRTYSHNIKOV AND V. STRELA, Which circulant preconditionerd are better?, Math. Comp., 65 (1996), pp. 137-150.
188. C. VAN LOAN, Computational Frameworks for the Fast Fourier Transform, SIAM, Philadelphia, PA, 1992.
189. C. VOGEL AND M. OMAN, Iterative methods for total variation denoising, SIAM J. Sci. Comput., 17 (1996), pp. 227-238.
190. J. WALKER, Fourier Analysis, Oxford University Press, New York, 1988.
191. O. WIDLUND, Iterative substructuring methods: Algorithms and theory for elliptic problems in the plane, in First Intl. Symp. on Domain Decomposition Methods for Partial Differential Equations, R. Glowinski, G. Golub, G. Meurant, and J. Périaux, eds., SIAM, Philadelphia, PA, 1988.
192. H. WIDOM, Hankel matrices, Trans. Amer. Math. Soc., 121 (1966), pp. 1-35.
193. S. WRIGHT, Parallel algorithms for banded linear systems, SIAM J. Sci. Stat. Comput., 12 (1991), pp. 824-842.
194. A. YAGLE, New analogs of split algorithms for arbitrary Toeplitz-plus-Hankel matrices, IEEE Trans. Signal Process., 39 (1991), pp. 2457-2463.
195. M. YEUNG AND R. CHAN, Circulant preconditioners for Toeplitz matrices with piecewise continuous generating functions, Math. Comp., 61 (1993), pp. 701-718.
196. P. YIP AND K. RAO, Fast decimation-in-time algorithms for a family of discrete sine and cosine transforms, Circuits, Systems, Signal Process., 3 (1984), pp. 387-408.
197. U. YULE, On a method of investigating periodicities in disturbed series, with special reference to Wolfer's sunspot numbers, Phil. Trans. Roy. Soc. London, A 226 (1927), pp. 267-298.
198. C. ZAROWSKI, Schur algorithms for Hermitian Toeplitz, and Hankel matrices with singular leading principal submatrices, IEEE Trans. Signal Process., 39 (1991), pp. 2464-2480.
199. S. ZOHAR, The solution of a Toeplitz set of linear equations, J. Assoc. Comput. Mach., 21 (1974), pp. 272-276.
200. A. ZYGMUND, Trigonometric Series, Cambridge University Press, London, UK, 1968.