Using dynamic programming with adaptive grid scheme for optimal control problems in economics

Journal of Economic Dynamics and Control

Volumn 28, Issue 12, 2004, Pages 2427-2456

  Grüne, Lars ^a   Semmler, Willi ^b  

^a UNIVERSITY OF BAYREUTH   (Germany)

^b NEW SCHOOL FOR SOCIAL RESEARCH   (United States)

Author keywords

Adaptive grid scheme; Dynamic optimization; Dynamic programming

Indexed keywords

EID: 7244245623     PISSN: 01651889     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jedc.2003.11.002     Document Type: Article

References (51)

1. Azariadis C. Drazen A. Thresholds externalities in economic development Quarterly Journal of Economics 105 2 1990 501-526
2. Bardi M. Capuzzo Dolcetta I. Optimal Control and Viscosity Solutions of Hamilton-Jacobi-Bellman equations 1997 Birkhäuser Boston, MA
3. Benhabib J. Farmer R. 1999. Indeterminacy in macroeconomics. In: Taylor, J., Woodford, M. (Eds.), Handbook of Macroeconomics. Elsevier, Amsterdam
4. Benhabib J. Perli R. Uniqueness and indeterminacy: On the dynamics of endogenous growth Journal of Economic Theory 63 1 1994 113-142
5. Benhabib J. Perli R. Xie D. Monopolistic competition, indeterminacy and growth Ricerche Economiche 48 1994 279-298
6. Blanchard O.J. Debt and current account deficit in Brazil In: Armella P.A. Dornbush R. Obstfield M. (Eds.) Financial Policies and the World Capital Market: The Problem of Latin American Countries 1983 187-197 University of Chicago Press Chicago, IL
7. Brock W. Mirman L. Optimal economic growth and uncertainty: The discounted case Journal of Economic Theory 4 1972 479-513
8. Brock W.A. Starrett D. 1999. Nonconvexities in ecological management problems. SSRI Working Paper 2026, Department of Economics, University of Wisconsin, Madison, WI
9. Burnside C. Discrete state-space methods for the study of dynamic economies In: Marimon R. Scott A. (Eds.) Computational Methods for the Study of Dynamic Economies 2001 95-113 Oxford University Press Oxford
10. Camilli F. Falcone M. An approximation scheme for the optimal control of diffusion processes RAIRO. Modélisation Math. Anal. Numér. 29 1995 97-122
11. Candler G.V. Finite-difference methods for continuous-time dynamic programming In: Marimon R. Scott A. (Eds.) Computational Methods for the Study of Dynamic Economies 2001 172-194 Oxford University Press Oxford
12. Capuzzo Dolcetta I. On a discrete approximation of the Hamilton-Jacobi equation of dynamic programming Appl. Math. Optim. 10 1983 367-377
13. Capuzzo Dolcetta I. Falcone M. Discrete dynamic programming and viscosity solutions of the Bellman equation Ann. Inst. Henri Poincaré, Anal. Non Linéaire 6 supplement 1989 161-184
14. Carlini E. Falcone M. Ferretti R. 2002. An efficient algorithm for Hamilton-Jacobi equations in high dimensions. Report 2002/7, Università di Roma 'La Sapienza', Dipartimento di Matematica 'Guido Castelnuovo', submitted for publication
15. Chow C.-S. Tsitsiklis J.N. An optimal one-way multigrid algorithm for discrete-time stochastic control IEEE Transactions on Automatic Control 36 1991 898-914
16. Daniel J.W. Splines and efficiency in dynamic programming Journal of Mathematical Analysis and Applications 54 1976 402-407
17. Deissenberg D. Feichtinger G. Semmler W. Wirl F. 2001. History dependence and global dynamics in models with multiple equilibria. Working paper No. 12, Center for Empirical Macroeconomics, University of Bielefeld, www.wiwi.uni-bielefeld.de
18. Falcone M. 1987. A numerical approach to the infinite horizon problem of deterministic control theory, Applied Mathematical and Optimization 15, 1-13
19. Falcone M. Ferretti R. Convergence analysis for a class of high-order semi-Lagrangian advection schemes SIAM Journal of Numerical Analysis 35 1998 909-940 Corrigenda, ibid, 1991. 23, 213-214
20. Falcone M. Giorgi T. An approximation scheme for evolutive Hamilton-Jacobi equations In: McEneaney W.M. Yin G.G. Zhang Q. (Eds.) Stochastic Analysis, Control, Optimization and Applications 1999 288-303 Birkhäuser Boston, MA
21. Feichtinger G. Haunschmied J.L. Kort P.M. Hartl R.F. 2000. A DNS-curve in a two state capital accumulation model: A numerical analysis. Forschungsbericht 242 des Instituts für Ökonometrie, OR und Systemtheorie. University of Technology, Vienna, submitted for publication
22. Feichtinger G. Kort P. Hartl R.F. Wirl F. The dynamics of a simple relative adjustment-cost framework German Economic Review 2 3 2001 255-268
23. González R.L.V. Sagastizábal C.A. Un algorithme pour la résolution rapide d'équations discrètes de Hamilton-Jacobi-Bellman C. R. Acad. Sci., Paris, Sér. I 311 1990 45-50
24. Grüne L. An adaptive grid scheme for the discrete Hamilton-Jacobi-Bellman equation Numerical Mathematics 75 3 1997 319-337
25. Grüne L. 2003. Error estimation and adaptive discretization for the discrete stochastic Hamilton-Jacobi-Bellman equation. Preprint, Universität Bayreuth, submitted
26. Grüne L. Metscher M. Ohlberger M. On numerical algorithm and interactive visualization for optimal control problems Computing and Visualization in Science 1 4 1999 221-229
27. Grüne L. Semmler W. Sieveking M. 2001. Thresholds in a credit market model with multiple equilibria. Discussion Paper No. 482, Department of Economics, University of Bielefeld, submitted for publication
28. Grüne L. Kato M. Semmler W. 2002. Numerical study of an ecological management problem. CEM Bielefeld, Working paper
29. Hartl R.F. Kort P. Feichtinger G. Wirl F. 2000. Multiple equilibria and thresholds due to relative investment costs: Non-concave-concave, focus-node, continuous-discontinuous. Working paper, University of Technology, Vienna
30. Jermann U.J. Asset pricing in production economies Journal of Monetary Economics 41 1998 257-275
31. Johnson S.A. Stedinger J.R. Shoemaker C.A. Li Y. Tejada-Guibert J.A. Numerical solution of continuous-state dynamic programs using linear and spline interpolation Operations Research 41 1993 484-500
32. Judd K.L. 1996 Approximation, perturbation, and projection methods in economic analysis. In: Amman, H.M., Kendrick, D.A., Rust, J. (Eds.), Handbook of Computational Economics. Elsevier, Amsterdam, pp. 511-585 (Chapter 12)
33. Judd K.L. Numerical Methods in Economics 1998 MIT Press Cambridge, MA
34. Judd K.L. Guu S.-M. Asymptotic methods for aggregate growth models Journal of Economic Dynamics & Control 21 1997 1025-1042
35. Keane M.P. Wolpin K.I. The solution and estimation of discrete choice dynamic programming models by simulation and interpolation: Monte Carlo evidence The Review of Economics & Statistics 76 1994 648-672
36. Ljungqvist L. Sargent T.J. Recursive Macroeconomic Theory 2001 MIT Press Cambridge, MA
37. Marcet A. Simulation analysis of stochastic dynamic models: Applications to theory and estimation In: Sims C.A. (Ed.) Advances in Econometrics, Sixth World Congress of the Econometric Society 1994 81-118 Cambridge University Press Cambridge
38. Munos R. Moore A. Variable resolution discretization in optimal control Machine Learning 49 2002 291-323
39. Reiter M. Solving higher-dimensional continuous-time stochastic control problems by value function regression Journal of Economic Dynamics and Control 23 1999 1329-1353
40. Rust J. Numerical Dynamic Programming in economics In: Amman H.M. Kendrick D.A. Rust J. (Eds.) Handbook of Computational Economics 1996 620-729 Elsevier Amsterdam
41. Rust J. Using randomization to break the curse of dimensionality Econometrica 65 1997 478-516
42. Santos M.S. Vigo-Aguiar J. 1995. Accuracy estimates for a numerical approach to stochastic growth models. Discussion Paper 107, Institute for Empirical Macroeconomics, Federal Reserve Bank of Minneapolis
43. Santos M.S. Vigo-Aguiar J. Analysis of a numerical dynamic programming algorithm applied to economic models Econometrica 66 2 1998 409-426
44. Seeck A. Iterative Lösungen der Hamilton-Jacobi-Bellman-Gleichung bei unendlichem Zeithorizont 1997 Diplomarbeit Universität Kiel
45. Semmler W. Sieveking M. On optimal exploitation of interacting resources Journal of Economics 59 1 1994 23-49
46. Sieveking M. Semmler W. The Present value of resources with large discount rates Applied Mathematics and Optimization 35 1997 283-309
47. Skiba A.K. Optimal growth with a convex-concave a production function Econometrica 46 3 1978 527-539
48. Tauchen G. Hussey R. Quadrature-based methods for obtaining approximate solutions to nonlinear asset-price models Econometrica 59 1991 371-396
49. Taylor J.B. Uhlig H. Solving non-linear stochastic growth models: a comparison of alternative solution methods Journal of Business and Economic Studies 8 1990 1-18
50. Trick M.A. Zin S.E. 1993. A linear programming approach to solving stochastic dynamic programs, Working paper, Carnegie-Mellon University
51. Trick M.A. Zin S.E. Spline approximations to value functions: a linear programming approach Macroeconomic Dynamics 1 1997 255-277