Stochastic control for economic models: Past, present and the paths ahead

Journal of Economic Dynamics and Control

Volumn 29, Issue 1-2, 2005, Pages 3-30

  Kendrick, David A ^a  

^a UNIVERSITY OF TEXAS AT AUSTIN   (United States)

Author keywords

Adaptive control; Economic models; Feedback; Feedback rules; Lucas critique; Min max control; Parameter uncertainty; Quadratic linear systems; Robust control; Stochastic control

Indexed keywords

EID: 11344271212     PISSN: 01651889     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jedc.2003.02.002     Document Type: Article

References (136)

1. Abel A.B. A comparison of three control algorithms to the monetarist-fiscalist debate Annals of Economic and Social Measurement 4 1975 239-252
2. Aghion P. Bolton P. Harris C. Jullien B. Optimal learning by experimentation Review of Economic Studies 58 1991 621-654
3. Amman H.M. Kendrick D.A. Active learning: Monte Carlo results Journal of Economic Dynamics and Control 18 1994 119-124
4. Amman H.M. Kendrick D.A. Nonconvexities in stochastic control models International Economic Review 36 1995 455-475
5. Amman H.M. Kendrick D.A. Erratum to active learning: Monte Carlo results Journal of Economic Dynamics and Control 21 1997 1613-1614
6. Amman H.M. Kendrick D.A. 1999a. Linear quadratic optimization for models with rational expectations, with Hans M. Amman. Macroeconomic Dynamics 3, 534-543
7. Amman H.M. Kendrick D.A. Should macroeconomic policy makers consider parameter covariances Computational Economics 14 1999 263-267
8. Amman H.M. Kendrick D.A. 1999c. The Duali/Dualpc Software for Optimal Control Models: User's Guide. Center for Applied Research in Economics, The University of Texas, Austin, TX
9. Amman H.M. Kendrick D.A. Programming languages in economics Computational Economics 14 1999 151-181
10. Amman H.M. Kendrick D.A. Stochastic policy design in a learning environment with rational expectations Journal of Optimization Theory and Applications 105 2000 509-520
11. Amman H.M. Kendrick D.A. 2003. Mitigation of the Lucas critique with stochastic control methods. Journal of Economic Dynamics and Control 27, 2035-2057
12. Anderson G. Moore G. A linear algebraic procedure for solving linear perfect foresight models Economics Letters 17 1985 247-252
13. Aoki M. Optimization of Stochastic Systems 1967 Academic Press New York
14. Athans M. Chow G.C. Introduction to stochastic control and economic systems Annals of Economic and Social Measurement 1 1972 375-384
15. Atkinson A.B. Sandmo A. Welfare implications of the taxation of savings Economic Journal 90 1980 529-549
16. Basar T. Olsder T.G. 1999. Dynamic Noncooperative Game Theory. SIAM Series in Classics in Applied Mathematics. SIAM, Philadelphia, PA (revised version of the 1995 Academic Press book with the same title).
17. Beck G.W. Wieland V. Learning and control in a changing economic environment Journal of Economic Dynamics and Control 26 2002 1359-1378
18. Binder M. Pesaran M.H. Solution of finite horizon multivariate linear rational expectations models with sparse linear systems Journal of Economic Dynamics and Control 24 2000 325-346
19. Blanchard O.J. Kahn C.M. The solution of linear difference models under rational expectations Econometrica 48 1980 1305-1311
20. Brainard W. Uncertainty and the effectiveness of policy American Economic Review 57 1967 411-425
21. Breslaw J. 1994. GAUSSX, Econotron Software, Ver. 3.3. Econotron Software, 4164 Henri Juilen, Montreal, Canada
22. Brock W.A. Dechert D. Nonlinear dynamical systems: Instability and chaos in economics In: Hildenbrand W. Sonnenschein H. (Eds.) Handbook of Mathematical Economics IV 1991 2210-2235 North-Holland Amsterdam
23. Brock W.A. Turnovsky S.J. The analysis of macroeconomic policies in perfect foresight equilibrium International Economic Review 22 1981 179-209
24. Brooke A. Kendrick D.A. Meeraus A. 1982. GAMS: A User's Guide. The Scientific Press, South San Francisco, currently available at the GAMS web cite http://www.gams.com
25. Bryson A. Yu-Chi Ho 1969. Applied Optimal Control. Ginn and Company, Waltham, MA
26. Chiarella C. The cobweb model: Its instability and the onset of chaos Economic Modeling 5 1988 377-384
27. Chow G.C. Effects of uncertainty on optimal control policies International Economic Review 14 1973 632-645
28. Chow G.C. Analysis and Control of Dynamic Systems 1975 Wiley New York
29. Coenen G. Levin A. Wieland V. 2001. Data uncertainty and the role of money as an information variable for monetary policy. European Central Bank Working Paper No. 84, Frankfurt, Germany
30. Craine R. Optimal monetary policy with uncertainty Journal of Economic Dynamics and Control 1 1979 59-83
31. Craine R. Havenner A. Tinsley P. Optimal macroeconomic control policies Annals of Economic and Social Measurement 5 1976 191-204
32. Currie D. Levine P. 1993a. The design of feedback rules in linear stochastic rational expectations models. In: Currie, D., Levine, P. (Eds.), Rules, Reputation and Macroeconomics Policy Coordination. Cambridge University Press, Cambridge, United Kingdom, pp. 95-121 (Chapter 4)
33. Currie D. Levine P. Rules, Reputation and Macroeconomic Policy Coordination 1993 Cambridge University Press Cambridge, United Kingdom
34. Dechert W.D. Hommes C.H. Complex nonlinear dynamics and computational methods Journal of Economic Dynamics and Control 24 2000 651-662
35. Deissenberg C. On the minmax lyapunov stabilization of uncertain economies Journal of Economic Dynamics and Control 11 1987 229-234
36. Easley D. Kiefer N.M. Controlling a stochastic process with unknown parameters Econometrica 56 1988 1045-1064
37. Fair R.C. The use of optimal control techniques to measure economic performance International Economic Review 19 1978 289-309
38. Fair R.C. 2002. FAIRMODEL http://fairmodel.econ.yale.edu
39. Fair R.C. 2003. Optimal control and stochastic simulation of large nonlinear models with rational expectations. Computational Economics 21, 245-256
40. Fair R.C. Taylor J.B. Solution and maximum likelihood estimation of dynamic nonlinear rational expectations models Econometrica 51 1983 1169-1185
41. Farison J.B. Graham R.E. Shelton R.C. Identification and control of linear discrete systems IEEE Transactions on Automatic Control AC-12 4 1967 438-442
42. Fisher P.G. Holly S. Hallett A.J.H. Efficient solution techniques for dynamic nonlinear rational expectations models Journal of Economic Dynamics and Control 10 1986 139-145
43. Giannoni M. Does model uncertainty justify caution?: Robust optimal monetary policy in a forward looking model Macroeconomics Dynamics 6 2002 111-144
44. Hall R.E. Taylor J.B. Macroeconomics 4th Ed 1993 W.W. Norton - Company New York
45. Hansen L.P. Sargent T.J. 2001. Elements of Robust Control and Filtering for Macroeconomics, draft downloaded from Sargents web site at www.stanford.edu/~sargent , version of 23 March
46. Hansen L.P. Sargent T.J. Tallarini T.D. Jr. Robust permanent income and pricing Review of Economic Studies 66 1999 873-907
47. Healey A.J. Summers S. A suboptimal method for feedback control of the St. Louis econometric model Trans. ASME, Journal of Dynamic Systems and Measurement Control 96 1974 446-454
48. Henderson D.W. McKibbin W.J. 1993. A comparison of some basic monetary policy regimes for open economies. International Finance Discussion Papers 458, Board of Governors of the Federal Reserve System, Washington, DC
49. Henderson D. Turnovsky S.J. Optimal macroeconomic policy adjustment under conditions of risk Journal of Economic Theory 4 1972 58-72
50. Herbert R.D. Observers and Macroeconomic Systems 1998 Kluwer Academic Boston, MA
51. Herbert R.D. Bell R.D. Visualisation in the simulation and control of economic models Computational Economics 10 1997 107-118
52. Holt C.C. Linear decision rules for economic stabilization and growth Quarterly Journal of Economics 76 1962 20-45
53. Holt C. Modigliani F. Muth J.F. Simon H.A. Planning Production, Inventories, and Work Force 1960 Prentice-Hall Englewood Cliffs, NJ
54. Judd K.L. Numerical Methods in Economics 1998 MIT Press Cambridge, MA
55. Juillard M. 1996. DYNARE: A program for the resolution and simulation of dynamic models with forward variables through the use of a relaxation algorithm. CEPREMAP Working Paper No. 9602, Paris
56. Kalchbrenner J. Tinsley P. On the use of feedback control in the design of aggregate monetary policy American Economic Review 66 1976 349-355
57. Kalchbrenner J. Tinsley P. 1977. On filtering auxiliary information in short-run monetary policy. In: Brunner, K., Meltzer, A. (Eds.), Journal of Monetary Economics, Carnegie-Rochester Supplement, pp. 39-84
58. Karakitsos E. Rustem B. Optimally derived fixed rules and indicators Journal of Economic Dynamics and Control 8 1984 33-64
59. Karakitsos E. Rustem B. Optimal fixed rules and simple feedback laws for nonlinear econometric models Automatica 21 1985 169-180
60. Kendrick D.A. Non-convexities from probing an adaptive control problem Economics Letters 1 1978 347-351
61. Kendrick D.A. Stochastic Control for Economic Models 1981 McGraw-Hill New York
62. Kendrick D.A. Caution and probing in a macroeconomic model Journal of Economic Dynamics and Control 4 1982 149-170
63. Kendrick D.A. 2002. A classification system for economic stochastic control models. Working Paper, Department of Economics, The University of Texas, Austin, TX
64. Kendrick D.A. Majors J. Stochastic control with uncertain macroeconomic parameters Automatica 10 1974 587-594
65. Kendrick D.A. Taylor L. Numerical methods and nonlinear planning models Econometrica 38 1970 453-467
66. Kiefer N. Nyarko Y. Optimal control of an unknown linear process with learning International Economic Review 30 1989 571-586
67. Kozicki S. Tinsley P.A. Dynamic specification in optimizing trend-deviation macro models Journal of Economic Dynamics and Control 26 2002 1585-1612
68. Lee M.H. 1998. Analysis of optimal macroeconomic policy design. Ph.D. Dissertation, Department of Economics, The University of Texas, Austin, TX
69. Leeson R. 2000. A.W.H. Phillips: Collected Works in Contemporary Perspective. Cambridge University Press, Cambridge, UK
70. Leitmann G. Wan H. Jr. A stabilization policy for an economy with some unknown characteristics Journal of the Franklin Institute 14 1978 23-33
71. Levin A. Wieland V. Williams J.C. 1999. The performance of forward-looking monetary policy rules under model uncertainty. In: Taylor, J.B. (Ed.), Monetary Policy Rules. University of Chicago Press, Chicago, IL
72. Lin Kuan-Pin 2001. Computational Econometrics: GAUSS Programming for Econometricians and Financial Analysts. ETEXT Publishing
73. Livesey D.A. Optimizing short-term economic policy Economic Journal 81 1971 525-546
74. Lucas R. 1976. Econometric policy evaluation: A critique. In: Brunner, K., Meltzer, A.H. (Eds.), The Phillips Curve and the Labor Markets. pp. 19-46 (Supplemental series to the Journal of Monetary Economics)
75. MacRae E.C. Linear decision with experimentation Annals of Economic and Social Measurement 1 1972 437-447
76. MacRae E.C. An adaptive learning role for multiperiod decision problems Econometrica 43 1975 893-906
77. Math Works 1999. Using MATLAB Version 5. The Math Works Inc., 24 Prime Park Way, Natick, MA
78. Mercado P.R. 2001. The timing of uncertainty and the intensity of policy. Paper Presented at the Seventh International Conference of the Society of Computational Economics, June 28-29, Yale University, New Haven
79. Mercado P.R. Kendrick D.A. 1999. Computational Methods for Macro Policy Analysis: Hall and Taylor's Model in Duali. In: Hughes-Hallett, A., McAdam, P., (Eds.), Analyses in Macroeconomic Modeling. Kluwer Academic, Boston, MA, pp. 179-206 (Chapter 8)
80. Mercado P.R. Kendrick D.A. Caution in macroeconomic policy: Uncertainty and the relative intensity of policy Economics Letters 68 2000 37-41
81. Mercado P.R. Kendrick D.A. Amman H.M. Teaching macroeconomics with GAMS Computational Economics 12 1998 125-149
82. Mizrach B. Non-convexities in a stochastic control problem with learning Journal of Economic Dynamics and Control 15 1991 515-538
83. Norman A.L. First order dual control Annals of Economic and Social Measurement 5 1976 311-321
84. Norman A. On the control of structural models, and a reply Journal of Econometrics 15 1981 13-24,29
85. Norman A. On the complexity of linear quadratic control European Journal of Operations Research 73 1994 319-330
86. Norman A.L. Jung W. Linear quadratic theory for models with long lags Econometrica 45 1977 905-917
87. Norman A. Norman M. Palash C. Multiple relative maxima in optimal macroeconomic policy: An illustration Southern Economic Journal 46 1979 274-279
88. Oudiz G. Sachs J. 1985. International policy coordination in dynamic macroeconomic models. In: Buiter, W.H., Marston, R.C. (Eds.), International Economic Policy Coordination. Cambridge University Press, Cambridge, UK
89. Phillips A.W. Stabilization policy in a closed economy Economic Journal 64 1954 290-323
90. Pindyck R.S. An application of the linear quadratic tracking problem to economic stabilization policy IEEE Transactions on Automatic Control AC-17 1972 287-300
91. Pindyck R.S. Optimal Planning for Economic Stabilization 1973 North-Holland Amsterdam
92. Pindyck R.S. Optimal policies for economic stabilization Econometrica 41 1973 529-560
93. Prescott E.C. The multi-period control problem under uncertainty Econometrica 40 1972 1043-1058
94. Radner R. Stiglitz J.E. A nonconcavity in the value of information In: Boyer M. Kilhstrom R.E. (Eds.) Bayesian Models in Economic Theory 1983 33-52 North-Holland Amsterdam
95. Rust J. 1996. Using randomization to break the curse of dimensionality. Econometrica
96. Rustem B. A constrained min-max algorithm for rival models of the same economic system Math Programming 53 1992 279-295
97. Rustem B. Robust min-max decisions with rival models In: Berley D. (Ed.) Computational Technique for Econometrics and Economic Analysis 1994 109-136 Kluwer Academic Dordrecht, The Netherlands
98. Rustem B. Algorithms for Nonlinear Programming and Multiple Objective Decisions 1998 Wiley New York
99. Rustem B. Howe M. Algorithms for Worst-Case Design with Applications to Risk Management 2002 Princeton University Press Princeton, NJ
100. Rustem B. Wieland V. Zakovic S. 2001. A continuous min-max problem and its application to inflation targeting. In: Zaccour G. (Ed.), Decision and Control in Management Science, Essays in Honor of Alan Haurie. Kluwer, Boston, MA, pp. 201-219 (Chapter 11)
101. Sarris A.H. A bayesian approach to the estimation of time-varying regression coefficients Annals of Economic and Social Measurement 2 1973 501-523
102. Shupp F.R. Uncertainty and stabilization policies for a nonlinear macroeconomic model Quarterly Journal of Economics 80 1972 94-110
103. Shupp F.R. Uncertainty and optimal stabilization policies Journal of Public Finances 6 1976 243-253
104. Simon H.A. Dynamic programming under uncertainty with a quadratic criterion function Econometrica 24 1956 74-81
105. Sims C.A. 1996. Solving linear rational expectations models. Research Paper, Department of Economics, Yale University
106. Swamy P.A.V.B. Tinsley P.A. 1980. Linear prediction and estimation methods for regression models with stationary coefficients. Journal of Econometrics 108-142
107. Taylor J.B. Asymptotic properties of multiperiod control rules in the linear regression model International Economic Review 15 1974 472-482
108. Taylor J.B. Macroeconomic Policy in a World Economy 1993 W.W. Norton - Company New York
109. Taylor J.B. Discretion versus policy rules in practice Carnegie-Rochester Conference Series on Public Policy 39 1993 195-214
110. Taylor J.B. (Ed.), 1999. Monetary Policy Rules. University of Chicago Press, Chicago
111. Tetlow R. 2000. The fed is not as ignorant as you think. Presented at the Society of Computational Economics Conference in Barcelona, June 2000, Barcelona
112. Tetlow R. von zur Muehlen P. Simplicity versus optimality: The choice of monetary policy rules when agents must learn Journal of Economic Dynamics and Control 25 2001 245-279
113. Tetlow R. von zur Muehlen P. Robust monetary policy with misspecified models: Does model uncertainty always call for attenuated policy? Journal of Economic Dynamics and Control 25 2001 911-949
114. Tetlow R. von zur Muehlen P. 2001c. Avoiding Nash inflation: Bayesian and robust responses to model uncertainty. Working paper, Board of Governors of the Federal Reserve System, Washington, DC
115. Theil H. A note on certainty equivalence in dynamic planning Econometrica 25 1957 346-349
116. Tinsley P. Craine R. Havenner A. 1974. On NEREF solutions of macroeconomic tracking problems. 3rd NBER Stochastic Control Conference, Washington
117. Tinsley P. von zur Muehlen P. Fries G. 1982. The short-run volatility of money stock targeting. Journal of Monetary Economics, 215-237.
118. Tse E. Bar-Shalom Y. An actively adaptive control of linear systems with random parameters IEEE Transactions on Automatic Control AC-18 1973 109-117
119. Tucci M. 1989. Time varying parameters in adaptive control. Ph.D. Dissertation, Department of Economics, University of Texas, Austin, TX
120. Tucci M. Adaptive control in the presence of time-varying parameters Journal of Economic Dynamics and Control 22 1997 39-47
121. Tucci M. The non-convexities problem in adaptive control models: a simple computational solution Computational Economics 12 1998 203-222
122. Tucci M. A note on global optimization in adaptive control, econometrics and macroeconomics Journal of Economic Dynamics and Control 26 2002 1739-1764
123. Turnovsky S.J. Optimal stabilization policies for deterministic and stochastic linear systems Review of Economic Studies 40 1973 79-96
124. Turnovsky S.J. Optimal choice of monetary instruments in a linear economic model with stochastic coefficients Journal of Money Credit Banking 7 1975 51-80
125. Turnovsky S.J. 1977. Optimal control of linear systems with stochastic coefficients and additive disturbances. Ch. 11. In: Pitchford, J.D., Turnovsky, S.J. (Eds.), Applications of Control Theory to Economic Analysis, North-Holland, Amsterdam
126. Turnovsky S.J. Methods of Macroeconomic Dynamics 2000 MIT Cambridge, MA
127. Turnovsky S.J. Brock W.A. Time consistency and optimal government policies in perfect foresight equilibrium Journal of Public Economics 13 1980 183-212
128. Tustin A. The Mechanism of Economic Systems 1953 Heinemann London
129. Vallee Th. Deissenberg C. Basar T. Optimal open loop cheating in dynamic reversed linear-quadratic stackelberg games Annals of Operations Research 88 1999 247-266
130. von zur Muehlen P. Activist vs. non-activist monetary policy: optimal rules under extreme uncertainty 1982 Mimeo, Board of Governors of the Federal Reserve System Washington, DC
131. Wieland V. Learning by doing and the value of optimal experimentation Journal of Economics Dynamics and Control 24 2000 501-543
132. Wieland V. Monetary policy, parameter uncertainty and optimal learning Journal of Monetary Economics 46 2000 199-228
133. Wieland V. 2001. Learning, stabilization and credibility: Optimal monetary policy in a changing economy. Paper Presented at the Seventh International Conference of the Society of Computational Economics, Yale University, New Haven, CT
134. Williams J.C. 1999. Simple Rules for Monetary Policy, Finance and Economics Discussion Series 1999-12. Board of Governors of the Federal Reserve System, Washington, DC
135. Woodford M. 1999. Optimal monetary policy inertia. Working Paper 7261, National Bureau of Economic Research, Cambridge, MA
136. Zadrozny P. Chen B. 1999. Perturbation solutions of nonlinear rational expectations models. Presented at the Fifth International Conference of the Society for Computational Economics, June 1999, Boston College