Discrete optimal control: Second order optimality conditions

Journal of Difference Equations and Applications

Volumn 8, Issue 10, 2002, Pages 875-896

  Hilscher, Roman ^a   Zeidan, Vera ^a  

^a MICHIGAN STATE UNIVERSITY   (United States)

Author keywords

Accessory problem; Conjugate interval; Discrete maximum principle; Discrete quadratic functional; Linear Hamiltonian difference system; Optimality conditions; Riccati difference equation

Indexed keywords

EID: 0036791541     PISSN: 10236198     EISSN: None     Source Type: Journal    
DOI: 10.1080/1023619021000000951     Document Type: Review

References (53)

1. R.P. Agarwal, C.D. Ahlbrandt, M. Bohner and A. Peterson, Discrete linear Hamiltonian systems: A survey. In: Discrete and Continuous Hamiltonian Systems, R.P. Agarwal, M. Bohner, editors, Dynam. Systems Appl., 8(3-4) (1999), 307-333.
2. R.P. Agarwal and M. Bohner, Quadratic functionals for second order matrix equations on time scales, Nonlinear Anal., 33(7) (1998), 675-692.
3. C.D. Ahlbrandt, Discrete variational inequalities, In: W. Walter, eds, General Inequalities 6, Proceedings of the 6th International Conference on General Inequalities, Oberwolfach, 1990, International Series of Numerical Mathematics, Vol. 123, Birkhäuser Verlag, Basel, (1992), pp 93-107.
4. C.D. Ahlbrandt, Equivalence of discrete Euler equations and discrete Hamiltonian systems, J. Math. Anal. Appl., 180 (1993), 498-517.
5. C.D. Ahlbrandt, C. Chicone, S.L. Clark, W.T. Patula and D. Steiger, Approximate first integrals for discrete Hamiltonian systems, Dynam. Contin. Discrete Impuls. Systems (1996), 237-264.
6. C.D. Ahlbrandt and M. Heifetz, Discrete Riccati equations of filtering and control, In: S. Elaydi, G. Graef, G. Ladas and A. Peterson, eds, Proceedings of the First International Conference on Difference Equations, San Antonio, TX, 1994, Gordon and Breach, Newark, NJ, (1996), pp 1-16.
7. C.D. Ahlbrandt, M. Heifetz, J.W. Hooker and W.T. Patula, Asymptotics of discrete time Riccati equations, robust control, and discrete linear Hamiltonian systems, PanAmer. Math. J., 5 (1996), 1-39.
8. C.D. Ahlbrandt and J.W. Hooker, A variational view of nonoscillation theory for linear difference equations, In: J.L. Henderson, eds, Differential and Integral Equations, Proceedings of the Twelfth and Thirteenth Midwest Conferences (Iowa City, IO, 1983, Argonne, IL, 1984), Institute of Applied Mathematics, University of Missouri-Rolla, Rolla, MO, (1985), pp 1-21.
9. C.D. Ahlbrandt and J.W. Hooker, Riccati matrix difference equations and disconjugacy of discrete linear systems, SIAM J. Math. Anal., 19(5) (1988), 1183-1197.
10. C.D. Ahlbrandt and A. Peterson, The (n,n)-disconjugacy of a 2nth order linear difference equation, Comput. Math. Appl., 28(1-3) (1994), 1-9.
11. C.D. Ahlbrandt and A.C. Peterson, Discrete Hamiltonian Systems: Difference Equations, Continued Fractions, and Riccati Equations, Kluwer Academic Publishers, Boston, 1996.
12. M. Bohner, Linear Hamiltonian difference systems: disconjugacy and Jacobi-type conditions, J. Math. Anal. Appl., 199 (1996), 804-826.
13. M. Bohner, Riccati matrix difference equations and linear Hamiltonian difference systems, Dynam. Contin. Discrete Impuls. Systems, 2(2) (1996), 147-159.
14. M. Bohner, On disconjugacy for Sturm-Liouville difference equations. In: Difference Equations: Theory and Applications, San Francisco, CA, 1995, J. Differ. Equations Appl., 2(2) (1996), 227-237.
15. M. Bohner, Controllability and disconjugacy for linear Hamiltonian difference systems, In: S. Elaydi, J. Graef, G. Ladas and A. Peterson, eds, Proceedings of the First International Conference on Difference Equations, San Antonio, TX, 1994, Gordon and Breach, Newark, NJ, (1996), pp 65-77.
16. M. Bohner, Inhomogeneous discrete variational problems, In: S. Elaydi, I. Györi and G. Ladas, eds, Advances in Difference Equations, Proceedings of the Second International Conference on Difference Equations, Veszprem, 1995, Gordon and Breach, Amsterdam, (1997), pp 89-97.
17. M. Bohner, Positive definiteness of discrete quadratic functionals, In: C. Bandle, W.N. Everitt, L. Losonczi and W. Walter, eds, General Inequalities 7, 7th International Conference on General Inequalities, Oberwolfach, 1995, International Series of Numerical Mathematics, Vol. 123, Birkhäuser Verlag, Basel, (1997), pp 55-60.
18. M. Bohner and O. Došlý, Disconjugacy and transformations for symplectic systems, Rocky Mountain J. Math., 27(3) (1997), 707-743.
19. M. Bohner, O. Došlý, Positivity of block tridiagonal matrices, SIAM J. Matrix Anal., 20(1) (1998), 182-195.
20. M. Bohner, O. Došlý and W. Kratz, Discrete Reid roundabout theorems. In: Discrete and Continuous Hamiltonian Systems, R.P. Agarwal and M. Bohner, editors, Dynam. Systems Appl., 8(3-4) (1999), 345-352.
21. M. Bohner and A. Peterson, Peterson, Dynamic Equations on Time Scales: An Introduction with Applications, Birkhäuser, Boston, 2001.
22. V.G. Boltyanskii, Optimal Control of Discrete Systems, John Wiley & Sons, New York-Toronto, 1978.
23. J. Doležal, Necessary optimality conditions for discrete systems with state-dependent control region, Kybernetika, 11(6) (1975), 423-450.
24. O. Došlý and R. Hilscher, Linear Hamiltonian difference systems: transformations, recessive solutions, generalized reciprocity. In: Discrete and Continuous Hamiltonian Systems, R.P. Agarwal and M. Bohner, editors, Dynam. Systems Appl., 8(3-4) (1999), 401-420.
25. O. Došlý and R. Hilscher, Disconjugacy, transformations and quadratic functionals for symplectic dynamic systems on time scales, J. Differ. Equations Appl., 7 (2001), 265-295.
26. L. Erbe and P. Yan, Disconjugacy for linear Hamiltonian difference systems, J. Math. Anal. Appl., 167 (1992), 355-367.
27. L. Erbe and P. Yan, Qualitative properties of Hamiltonian difference systems, J. Math. Anal. Appl., 171 (1992), 334-345.
28. J.A.S. Ferreira and R.V.V. Vidal, On the connections between mathematical programming and dicrete optimal control, Lecture Notes in Control and Information Sciences, Vol. 84, Springer-Verlag, New York, (1986), pp 234-243.
29. J. Gregory and C. Lin, Constrained Optimization in the Calculus of Variations and Optimal Control Theory, Van Nostrand Reinhold, New York, 1992.
30. S. Hilger, Analysis on measure chains - a unified approach to continuous and discrete calculus, Results Math., 18 (1990), 18-56.
31. R. Hilscher, Disconjugacy of symplectic systems and positivity of block tridiagonal matrices, Rocky Mountain J. Math., 29(4) (1999), 1301-1319.
32. R. Hilscher, Linear Hamiltonian systems on time scales: transformations. In: Discrete and Continuous Hamiltonian Systems, R.P. Agarwal and M. Bohner, editors, Dynam. Systems Appl., 8(3-4) (1999), 489-501.
33. R. Hilscher, On disconjugacy for vector linear Hamiltonian systems on time scales, In: S. Elaydi, G. Ladas, J. Popenda and J. Rakowski, eds, Communications in Difference Equations: Proceedings of the Fourth International Conference on Difference Equations, Poznan, Poland, 1998, Gordon and Breach, Amsterdam, 2000, pp 181-188.
34. R. Hilscher, Linear Hamiltonian systems on time scales: positivity of quadratic functionals. In: Boundary value problems and related topics, A.C. Peterson, editor, Math. Comput. Modelling, 32(5-6) (2000), 507-527.
35. R. Hilscher, Inhomogeneous quadratic functionals on time scales, J. Math. Anal. Appl., 253(2) (2001), 473-481.
36. R. Hilscher, Reid roundabout theorem for symplectic dynamic systems on time scales, Appl. Math. Optim., 43(2) (2001), 129-146.
37. R. Hilscher, Positivity of quadratic functionals on time scales: necessity, Math. Nachr., 226 (2001), 85-98.
38. R. Hilscher and V. Zeidan, Discrete optimal control: the accessory problem and necessary optimality conditions, J. Math. Anal. Appl., 243(2) (2000), 429-452.
39. R. Hilscher and V. Zeidan, Second order sufficiency criteria for a discrete optimal control problem, J. Differ. Equations Appl. (2002), to appear.
40. R. Hilscher and V. Zeidan, Nonnegativity of a discrete quadratic functional in terms of the (strengthened) Legendre and Jacobi conditions. In: Advances in Difference Equations IV, R.P. Agarwal, ed., Comput. Math. Appl. (2002), to appear.
41. R. Hilscher and V. Zeidan, Coupled intervals in the discrete calculus of variations: necessity and sufficiency, submitted.
42. R.E. Kalman and J.E. Bertram, Control system analysis and design via the second method of Lyapunov II. Discrete-time systems, Trans. ASME Ser. D J. Basic Engrg., 82 (1960), 394-400.
43. H. Kawasaki, A conjugate points theory for a nonlinear programming problem, SIAM J. Control Optim., 40(1) (2001), 54-63.
44. W. Kratz, Quadratic Functionals in Variational Analysis and Control Theory, Akademie Verlag, Berlin, 1995.
45. D.G. Luenberger, Linear and Nonlinear Programming, 2nd Ed., Addison-Wesley, Reading, MA, 1984.
46. T.L. Magnanti, Non-linear programming and the maximum principle for discrete time optimal control problems, Rev. Française Automat. Informat. Recherche Öpérationnelle Sér. Verte, 9(V-3) (1975), 75-91.
47. Z. Nahorski, H.F. Ravn and R.V.V. Vidal, The discrete-time maximum principle: a survey and some new results, Int. J. Control., 40(3) (1984), 533-554.
48. R.V.V. Vidal, On the sufficiency of the linear maximum principle for discrete-time control problems, J. Optim. Theory Appl., 54(3) (1987), 583-589.
49. V. Zeidan, Sufficiency criteria via focal points and via coupled points, SIAM J. Control Optim., 30(1) (1992), 82-98.
50. V. Zeidan, Sufficient conditions for variational problems with variable endpoints: coupled points, Appl. Math. Optim., 27(2) (1993), 191-209.
51. V. Zeidan, Nonnegativity and positivity of a quadratic functional. In: Discrete and Continuous Hamiltonian Systems, R.P. Agarwal, M. Bohner, editors, Dynam. Systems Appl., 8(3-4) (1999), 571-588.
52. P. Zezza, The Jacobi condition in optimal control, In: S. Chen and J. Yong, eds, Control Theory, Stochastic Analysis and Applications, World Scientific Publishing, River Edge, NJ, 1991, pp 137-149.
53. P. Zezza, Jacobi condition for elliptic forms in Hilbert spaces, J. Optim. Theory Appl., 76(2) (1993), 357-380.