A control-theoretic approach to the design of zero finding numerical methods

IEEE Transactions on Automatic Control

Volumn 52, Issue 6, 2007, Pages 1014-1026

  Bhaya, Amit ^a   Kaszkurewicz, Eugenius ^a  

^a FEDERAL UNIVERSITY OF RIO DE JANEIRO   (Brazil)

Author keywords

Conjugate gradient (CG) algorithm; Control Lyapunov functions (CLFs); Iterative methods; Proportional integral derivative control; Zero finding methods

Indexed keywords

CONJUGATE GRADIENT METHOD; DISCRETE TIME CONTROL SYSTEMS; LINEAR EQUATIONS; LYAPUNOV FUNCTIONS; NEWTON-RAPHSON METHOD; NONLINEAR EQUATIONS; THREE TERM CONTROL SYSTEMS;

CONTROL LYAPUNOV FUNCTIONS; ZERO FINDING METHOD;

CONTROL THEORY;

EID: 34447134100     PISSN: 00189286     EISSN: None     Source Type: Journal    
DOI: 10.1109/TAC.2007.899109     Document Type: Article

References (56)

1. E. D. Sontag, "A Lyapunov-like characterization of asymptotic controllability," SIAM J. Control Optim., vol. 21, pp. 462-471, 1983.
2. Z. Artstein, "Stabilization with relaxed controls," Nonlinear Anal. Theory Math. Appl., vol. 7, pp. 1163-1173, 1983.
3. E. D. Sontag, "A universal construction of Artstein's theorem on nonlinear stabilization," Syst. Control Lett., vol. 13, pp. 117-123, 1989.
4. O. Diene and A. Bhaya, "Adaptive filtering algorithms designed using control Liapunov functions," IEEE Signal Process. Lett., vol. 13, no. 4, pp. 224-227, Apr. 2006.
5. A. Bhaya and E. Kaszkurewicz, "Steepest descent with momentum for quadratic functions is a version of the conjugate gradient method," Neural Netw., vol. 17, no. 1, pp. 65-71, 2004.
6. Y.Z. Tsypkin, Adaptation and Learning in Automatic Systems. New York: Academic, 1971, vol. 73, Mathematics in Science and Engineering.
7. Y.Z. Tsypkin, Foundations of the Theory of Learning Systems. New York: Academic, 1973, vol. 80, Mathematics in Science and Engineering.
8. M.A. Krasnosel'skii, J. A. Lifshits, and A. V. Sobolev, Positive Linear Systems: The Method of Positive Operators. Berlin, Germany: Heldermann Verlag, 1989.
9. A.M. Stuart and A. R. Humphries, Dynamical Systems and Numerical Analysis. Cambridge, U.K.: Cambridge Univ. Press, 1998, vol. 2.
10. L. Grüne, "Asymptotic behavior of dynamical and control systems under perturbation and discretization," in Lecture Notes in Mathematics. Berlin, Germany: Springer-Verlag, 2002, vol. 1783.
11. M.T. Chu, "On the continuous realization of iterative processes," SIAM Rev., vol. 30, no. 3, pp. 375-387, Sep. 1988.
12. R. W. Brockett, "Least squares matching problems," Lin. Algebra Appl., vol. 122/123/124, pp. 710-777, 1989.
13. R. W. Brockett, "Dynamical systems that sort lists, diagonalize matrices and solve linear programming problems," Lin. Algebra Appl. vol. 146, pp. 76-91, 1991.
14. U. Helmke and J. B. Moore, Optimization and Dynamical Systems. London, U.K.: Springer-Verlag, 1994.
15. S. L. Campbell, "Numerical analysis and systems theory," Int. J. Appl. Math. Comput. Sci., vol. 11, no. 5, pp. 1025-1033, 2001.
16. K. Gustafsson, M. Lundh, and G. Söderlind, "A PI stepsize control for the numerical solution of ordinary differential equations," BIT vol. 28, pp. 270-287, 1988.
17. J. T. Betts, Practical Methods for Optimal Control Using Nonlinear Programming. Philadelphia, PA: SIAM, 2001, vol. DC3, Advances in Design and Control.
18. U. Helmke and P. A. Fuhrmann, "Controllability of matrix eigenvalue algorithms: The inverse power method," Syst. Control Lett., vol. 41, pp. 57-66, 2000.
19. U. Helmke and F. Wirth, "On controllability of the real shifted inverse power iteration," Syst. Control Lett., vol. 43, pp. 9-23, 2001.
20. V. I. Utkin, Sliding Modes in Control And Optimization. Berlin, Germany: Springer-Verlag, 1992.
21. L. Z. Liao, H. D. Qi, and L. Q. Qi, "Neurodynamical optimization," J. Global Optim., vol. 28, no. 2, pp. 175-195, Feb. 2004.
22. S.K. Korovin and V. I. Utkin, "Using sliding modes in static optimization," Automatica, vol. 10, pp. 525-532, Sep. 1974.
23. K. B. Ariyur and M. Krstić, Real-Time Optimization by Extremum Seeking Control. Hoboken, NJ: Wiley, 2003.
24. Y. G. Evtushenko and V. G. Zhadan, "Application of the method of Lyapunov functions to the study of the convergence of numerical methods," USSR Comput. Math. Math. Phys., vol. 15, no. 1, pp. 96-108, 1975.
25. V. I. Venets and M. V. Rybashov, "The method of Lyapunov functions in the study of continuous algorithms of mathematical programming," USSR Comput. Math. Math. Phys., vol. 17, no. 3, pp. 64-73, 1977.
26. J. Hurt, "Some stability theorems for ordinary difference equations," SIAM J. Numer. Anal., vol. 4, no. 4, pp. 582-596, Dec. 1967.
27. J. M. Ortega, "Stability of difference equations and convergence of iterative processes," SIAM J. Numer. Anal., vol. 10, no. 2, pp. 268-282, Apr. 1973.
28. E. Polak, Computational Methods in Optimization: A Unified Approach New York: Academic, 1971.
29. B. T. Polyak, "Convergence and convergence rate of iterative stochastic algorithms. 1. general case," Autom. Remote Control, vol. 37, no. 12, pp. 1858-1868, 1976.
30. D. P. Bertsekas, "Distributed asynchronous computation of fixed points," Math. Programm., vol. 27, pp. 107-120, 1983.
31. D. G. Luenberger, Linear and Nonlinear Programming. Reading, MA: Addison-Wesley, 1984.
32. K. Kashima, S. Ashida, and Y. Yamamoto, "System theory for numerical analysis," in Preprints 16th IFAC World Congress, Prague, Czech Republic, Jul. 2005, pp. 1-6, 01980.pdf.
33. E. D. Sontag, "Mathematical control theory: Deterministic finite dimensional systems," in Texts in Applied Mathematics, 2nd ed. New York: Springer-Verlag, 1998, vol. 6.
34. T. L. Vincent and W. J. Grantham, Nonlinear and Optimal Control Systems. New York: Wiley, 1997.
35. Y. I. Alber, "Continuous processes of the Newton type," Differential Equations, vol. 7, no. 11, pp. 1461-1471, Nov. 1971.
36. J.W. Neuberger, "Continuous Newton's method for polynomials," The Mathematical Intelligencer, vol. 21, no. 3, pp. 18-23, 1999.
37. A. F. Filippov, Differential Equations with Discontinuous Righthand Sides Transl.:TRanslation of Differentsial'nye uravneniia razryvnoi pravoi chast'iu. Dordrecht: Kluwer, 1988, Mathematics and its Applications (Soviet Series).
38. K. S. Chao and R. J. P. de Figueiredo, "Optimally controlled iterative schemes for obtaining the solution of a non-linear equation," Int. J. Control, vol. 18, no. 2, pp. 377-384, 1973.
39. A. Bhaya and E. Kaszkurewicz, "Control perspectives on numerical algorithms and matrix problems," in Advances in Design and Control Philadelphia, PA: SIAM, 2006, vol. DC10.
40. H. H. Rosenbrock, "An automatic method for finding the greatest or least value of a function," Comput. J., vol. 3, pp. 175-184, 1960.
41. F. H. Branin, "Widely convergent method for finding multiple solutions of simultaneous nonlinear equations," IBM J. Res. Develop., vol. 16, no. 5, pp. 504-522, Sep. 1972.
42. R. Riaza and P. J. Zufiria, "Weak singularities and the continuous Newton method," J. Math. Anal. Appl., vol. 236, no. 2-3, pp. 438-462, Aug. 1999.
43. P. J. Zufiria and R. S. Guttalu, "On the role of singularities in Branin's method from dynamic and continuation perspectives," Appl. Math. Comput., vol. 130, no. 2-3, pp. 593-618, Aug. 2002.
44. C. Brezinski, "Dynamical systems and sequence transformations," J. Phys. A, vol. 34, no. 48, pp. 10659-10669, Dec. 2001.
45. P.T. Boggs, "The convergence of the Ben-Israel iteration for nonlinear least squares problems," Math. Comput., vol. 30, no. 135, pp. 512-522, Jul. 1976.
46. A. Greenbaum, Iterative Methods for Solving Linear Systems. Philadelphia, PA: SIAM, 1997.
47. C. Schaerer and E. Kaszkurewicz, "The shooting method for the solution of ordinary differential equations: A control-theoretical perspective," Int. J. Syst. Sci., vol. 32, no. 8, pp. 1047-1053, 2001.
48. E. K. P. Chong and S. H.Zak, An Introduction to Optimization, 2nd ed. New York: Wiley, 2001.
49. H. A. van der Vorst, "Krylov subspace iteration," Comput. Sci. Eng. vol. 2, no. 1, pp. 32-37, Jan.-Feb. 2000.
50. L. N. Trefethen, "The definition of numerical analysis," SIAM News Nov. 1992.
51. Y. Saad, Iterative Methods for Sparse Linear Systems. Boston, MA: PWS, 1996.
52. Y. Saad and H. A. van der Vorst, "Iterative solution of linear systems in the 20th century," J. Comput. Appl. Math., vol. 123, no. 1-2, pp. 1-33, Nov. 2000.
53. G. H. Golub and C. F. V. Loan, Matrix Computations. Baltimore, MD: The John Hopkins Univ. Press, 1989.
54. J. R. Bunch, R. C. L. Borne, and I. K. Proudler, "A conceptual framework for consistency, conditioning, and stability issues in signal processing," IEEE Trans. Signal Process., vol. 49, no. 9, pp. 1971-1981, Sep. 2001.
55. J. R. Bunch, R. C. L. Borne, and I. K. Proudler, "Applying numerical linear algebra techniques to analyzing algorithms in signal processing," Lin. Algebra Appl., vol. 361, pp. 133-146, 2003.
56. M. Rupp and A. H. Sayed, "Robustness of Gauss-Newton recursive methods: A deterministic feedback analysis," Signal Process., vol. 50, no. 3, pp. 165-187, May 1996.