Myopic solutions of homogeneous sequential decision processes

Operations Research

Volumn 58, Issue 4 PART 2, 2010, Pages 1235-1246

  Sobel, Matthew J ^a   Wei, Wei ^a  

^a CASE WESTERN RESERVE UNIVERSITY   (United States)

Author keywords

Dynamic program; Homogeneous; Markov decision process; Myopic; Sequential game

Indexed keywords

DYNAMIC PROGRAMS; HOMOGENEOUS; MARKOV DECISION PROCESSES; MYOPIC; SEQUENTIAL GAME;

ECONOMICS;

MARKOV PROCESSES;

EID: 77955902006     PISSN: 0030364X     EISSN: 15265463     Source Type: Journal    
DOI: 10.1287/opre.1090.0767     Document Type: Article

References (29)

1. Alvarez, F., N. L. Stokey. 1998. Dynamic programming with homogeneous functions. J. Econom. Theory 82 167-189.
2. Arrow, K. J. 1962. Optimal capital adjustment. Applied Probability and Management Science. Stanford University Press, Stanford, CA, 1-17.
3. Arrow, K. J., M. J. Beckmann, S. Karlin. 1958. The optimal expansion of thecapacity of a firm. Studies in the Mathematical Theory of Inventory and Production. Stanford University Press, Stanford, CA, 92-105.
4. Boyaci, T., S. Ray, Y. Song. 2006. Dynamic decision-making in a decentralized price-setting supply chain. Unpublished manuscript, McGill University, Montreal, Quebec
5. Denardo, E. V. 1967. Contraction mappings in the theory underlying dynamic programming. SIAM Rev. 9 165-177.
6. Dhrymes, P. J. 1962. On optimal advertising capital and research expenditures under dynamic conditions. Econometrica 39 275-279.
7. Hakansson, N. H. 1970. Optimal investment and consumption strategies under risk for a class of utility functions. Econometrica 38 587-607.
8. Heyman, D. P., M. J. Sobel. 2004. Stochastic Models in Operations Research, Vol.II. Dover Publications, Mineola, NY.
9. Ignall, E., A. F. Veinott Jr. 1969. Optimality of myopic inventory policies for several substitute products. Management Sci. 15 284-304.
10. Kirman, A. P., M. J. Sobel. 1974. Dynamic oligopoly with inventories.Econometrica 42 279-287.
11. Köchel, P. 1985. A note on "Myopic solutions of Markovian decision processes and stochastic games." Oper. Res. 33 1394-1398.
12. McGill, J. I., G. J. van Ryzin. 1999. Revenue management: Research overview and prospects. Transportation Sci. 33 233-256.
13. Milgrom, P., J. Roberts. 1994. Comparing equilibria. Amer. Econom. Rev.84 441-459.
14. Milgrom, P., C. Shannon. 1998. Monotonecomparati vestatics. Econometrica 62 157-180.
15. Monahan, G. E., N. C. Petruzzi, W. Zhao. 2004. The dynamic pricing problem from a newsvendor's perspective. Manufacturing Service Oper. Management 6 73-91.
16. Nerlove, M., K. J. Arrow. 1962. Optimal advertising under dynamic conditions.Economica 22 129-142.
17. Netessine, S., R. A. Shumsky. 2005. Revenue management games: Horizontal and vertical competition. Management Sci. 51 813-831.
18. Petruzzi, N., M. Dada. 1999. Pricing and the newsvendor problem: A review with extensions. Oper. Res. 47 183-194.
19. Simon, H. A. 1956. Dynamic programming under uncertainty with a quadratic criterion function. Econometrica 24 74-81.
20. Sobel, M. J. 1981. Myopic solutions of Markov decision processes and stochastic games. Oper. Res. 29 995-1009.
21. Sobel, M. J. 1988. Isotone comparative statics in supermodular games.Working paper, Harriman School, SUNY at Stony Brook, Stony Brook, NY.
22. Sobel, M. J. 1990a. Myopic solutions of affine dynamic models. Oper.Res. 38 847-853.
23. Sobel, M. J. 1990b. Higher order and average reward myopic-affine dynamic models. Math. Oper. Res. 15 299-310.
24. Talluri, K. T., G. J. van Ryzin. 2004. The Theory and Practice of Revenue Management. Kluwer Academic Publishers, Norwell, MA.
25. Theil, H. 1957. A note on certainty equivalence in dynamic planning. Econometrica 25 346-349.
26. Topkis, D. M. 1979. Equilibrium points in nonzero-sum n-person submodular games. SIAM J. Control Optim. 17 773-787.
27. Topkis, D. M. 1998. Supermodularity and Complementarity. Princeton University Press, Princeton, NJ.
28. Veinott, A. F., Jr. 1965. Optimal policy for a multi-product, dynamic nonstationary inventory problem. Management Sci. 12 206-222.
29. Wagner, H. M. 1960. On theoptimality of purestrate gies. Management Sci. 6 268-269.