Novel algorithms based on the conjugate gradient method for inverting ill-conditioned matrices, and a new regularization method to solve ill-posed linear systems

CMES - Computer Modeling in Engineering and Sciences

Volumn 60, Issue 3, 2010, Pages 279-308

  Liu, Chein Shan ^a   Hong, Hong Ki ^a   Atluri, Satya N ^b  

^a NATIONAL TAIWAN UNIVERSITY   (Taiwan)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Hilbert matrix; Ill posed linear system; Inversion of ill conditioned matrix; Left inversion; Regularization vector; Right inversion; Tikhonov regularization; Vandermonde matrix

Indexed keywords

ILL POSED; ILL-CONDITIONED MATRIX; LEFT-INVERSION; MATRIX; REGULARIZATION VECTOR; RIGHT-INVERSION; TIKHONOV REGULARIZATION; VANDERMONDE MATRIX;

ALGORITHMS; CONJUGATE GRADIENT METHOD; DYNAMIC LOADS; LINEAR SYSTEMS; PROBLEM SOLVING; QUADRATIC PROGRAMMING; VECTORS;

MATRIX ALGEBRA;

EID: 77956115510     PISSN: 15261492     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (39)

1. Atluri, S. N. (2004): The Meshless Method (MLPG) for Domain& BIE Discretizations. Tech Science Press.
2. Atluri, S. N. (2005): Methods of Computer Modeling in Engineering & the Sciences. Tech Science Press.
3. Atluri, S. N.; Kim, H. G.; Cho, J. Y. (1999): A critical assessment of the truly meshless local Petrov-Galerkin (MLPG), and local boundary integral equation (LBIE) methods. Comp. Mech., vol. 24, pp. 348-372.
4. Atluri, S. N.; Shen, S. (2002): The meshless local Petrov-Galerkin (MLPG) method: a simple & less-costly alternative to the finite element and boundary element methods. CMES: Computer Modeling in Engineering & Sciences, vol. 3, pp. 11-51.
5. Atluri, S. N.; Zhu, T. L. (1998): A new meshless local Petrov-Galerkin (MLPG) approach in computational mechanics. Comp. Mech., vol. 22, pp. 117-127.
6. Bj̈orck, A.; Pereyra, V. (1970): Solution of Vandermonde systems of equations. Math. Comput., vol. 24, pp. 893-903.
7. Calvetti, D.; Reichel, L. (1993): Fast inversion of Vanderomnde-like matrices involving orthogonal polynomials. BIT, vol. 33, pp. 473-484.
8. Choi, M. D. (1983): Tricks or treats with the Hilbert matrix. Amer. Math. Monthly, vol. 90, pp. 301-312.
9. Eisinberg, A.; Fedele, G. (2006): On the inversion of the Vandermonde matrix. Appl. Math. Comp., vol. 174, pp. 1384-1397.
10. El-Mikkawy, M. E. A. (2003): Explicit inverse of a generalized Vandermonde matrix. Appl. Math. Comp., vol. 146, pp. 643-651.
11. Fairweather, G.; Karageorghis, A. (1998): The method of fundamental solutions for elliptic boundary value problems. Adv. Comp. Math., vol. 9, pp. 69-95. (Pubitemid 128403959)
12. Gautschi, W. (1975): Norm estimates for inverses of Vandermonde matrices. Num. Math., vol. 23, pp. 337-347.
13. Gohberg, I.; Olshevsky, V. (1997): The fast generalized Parker-Traub algorithm for inversion of Vandermonde and related matrices. J. Complexity, vol. 13, pp. 208-234.
14. Han, P. S.; Olson, M. D. (1987): An adaptive boundary element method. Int. J. Num. Meth. Eng., vol. 24, pp. 1187-1202.
15. Hansen, P. C. (1992): Analysis of discrete ill-posed problems by means of the L-curve. SIAM Rev., vol. 34, pp. 561-580.
16. Hansen, P. C.; O'Leary, D. P. (1993): The use of the L-curve in the regularization of discrete ill-posed problems. SIAM J. Sci. Comput., vol. 14, pp. 1487-1503.
17. Higham, N. J. (1987): Error analysis of the Bj̈orck-Pereyra algorithms for solving Vandermonde systems. Num. Math., vol. 50, pp. 613-632.
18. Higham, N. J. (1988): Fast solution of Vandermonde-like systems involving orthogonal polynomials. IMA J. Num. Anal., vol. 8, pp. 473-486.
19. Jog, C. S. (2004): The accurate inversion of Vandermonde matrices. Comp. Math. Appl., vol. 47, pp. 921-929.
20. Karlis, G. F.; Tsinopoulos, S. V.; Polyzos, D.; Beskos, D. E. (2008): 2D and 3D boundary element analysis of mode-I cracks in gradient elasticity. CMES: Computer Modeling in Engineering & Sciences, vol. 26, pp. 189-207.
21. Kunisch, K.; Zou, J. (1998): Iterative choices of regularization parameters in linear inverse problems. Inverse Problems, vol. 14, pp. 1247-1264.
22. Liu, C.-S. (2008): Improving the ill-conditioning of the method of fundamental solutions for 2D Laplace equation. CMES: Computer Modeling in Engineering & Sciences, vol. 28, pp. 77-93.
23. Liu, C.-S.; Atluri, S. N. (2009a): A highly accurate technique for interpolations using very high-order polynomials, and its applications to some ill-posed linear problems. CMES: Computer Modeling in Engineering & Sciences, vol. 43, pp. 253-276.
24. Liu, C.-S.; Atluri, S. N. (2009b): A Fictitious time integration method for the numerical solution of the Fredholm integral equation and for numerical differentiation of noisy data, and its relation to the filter theory. CMES: Computer Modeling in Engineering & Sciences, vol. 41, pp. 243-261.
25. Liu, C.-S.; Chang, C. W. (2009): Novel methods for solving severely ill-posed linear equations system. J. Marine Sci. Tech., vol. 17, pp. 216-227.
26. Liu, C.-S.; Yeih, W.; Atluri, S. N. (2009): On solving the ill-conditioned system Ax = b: general-purpose conditioners obtained from the boundary-collocation solution of the Laplace equation, using Trefftz expansions with multiple length scales. CMES: Computer Modeling in Engineering & Sciences, vol. 44, pp. 281-311.
27. Neagoe, V. E. (1996): Inversion of the Van der Monde matrix. IEEE Sign. Proce. Lett., vol. 3, pp. 119-120.
28. Quarteroni, A.; Sacco, R.; Saleri, F. (2000): Numerical Mathematics. Springer-Verlag, Berlin.
29. Resmerita, E. (2005): Regularization of ill-posed problems in Banach spaces: convergence rates. Inverse Problems, vol. 21, pp. 1303-1314.
30. Skrzipek, M. R. (2003): Inversion of Vandermonde-like matrices. BIT, vol. 44, pp. 291-306.
31. Tang, Z.; Shen, S.; Atluri, S. N. (2003): Analysis of materials with strain-gradient effects: a meshless local Petrov-Galerkin (MLPG) approach, with nodal displacements only. CMES: Computer Modeling in Engineering & Sciences, vol. 4, pp. 177-196.
32. Tikhonov, A. N.; Arsenin, V. Y. (1977): Solutions of Ill-Posed Problems. John-Wiley & Sons, New York.
33. Tsai, C. C.; Lin, Y. C.; Young, D. L.; Atluri, S. N. (2006): Investigations on the accuracy and condition number for the method of fundamental solutions. CMES: Computer Modeling in Engineering and Sciences, vol. 16, pp. 103-114.
34. Wang, Y.; Xiao, T. (2001): Fast realization algorithms for determining regularization parameters in linear inverse problems. Inverse Problems, vol. 17, pp. 281-291.
35. Wen, P. H.; Aliabadi, M. H.; Young, A. (2002): Boundary element analysis of curved cracked panels with mechanically fastened repair patches. CMES: Computer Modeling in Engineering & Sciences, vol. 3, pp. 1-10. (Pubitemid 135695144)
36. Wertz, H. J. (1965): On the numerical inversion of a recurrent problem: the Vandermonde matrix. IEEE Trans. Auto. Control, vol. AC-10, p. 492.
37. Xie, J.; Zou, J. (2002): An improved model function method for choosing regularizationparameters in linear inverse problems. Inverse Problems, vol. 18, pp. 631-643.
38. Young D.L., Ruan J.W.(2005)Method of fundamental solutions for scattering problems of electromagnetic waves. CMES: Computer Modeling in Engineering & Sciences, vol. 7, pp. 223-232.
39. Young, D. L.; Tsai, C. C.; Lin, Y. C.; Chen, C. S. (2006): The method of fundamental solutions for eigenfrequencies of plate vibrations. CMC: Computers, Materials & Continua, vol. 4, pp. 1-10.