A partially observed markov decision process for dynamic pricing

Management Science

Volumn 51, Issue 9, 2005, Pages 1400-1416

  Aviv, Yossi ^a   Pazgal, Amit ^a  

^a WASHINGTON UNIVERSITY IN ST LOUIS   (United States)

Author keywords

Learning; Partially observed Markov decision processes; Pricing; Revenue management

Indexed keywords

LEARNING; PARTIALLY OBSERVED MARKOV DECISION PROCESSES; PRICING; REVENUE MANAGEMENT;

COSTS; HEURISTIC METHODS; OPTIMIZATION; PUBLIC POLICY;

DECISION MAKING;

EID: 25844499294     PISSN: 00251909     EISSN: 15265501     Source Type: Journal    
DOI: 10.1287/mnsc.1050.0393     Document Type: Article

References (30)

1. Astrom, K. 1965. Optimal control of Markov processes with incomplete state information. J. Math. Anal. Appl. 10 174-205.
2. Aviv, Y., A. Pazgal. 2002. Pricing of short life-cycle products through active learning. Working paper, Washington University in St. Louis, St. Louis, MO.
3. Baivers, R. J., T. F. Cosimano. 1990. Actively learning about demand and the dynamics of price adjustments. Econom. J. 100 882-898.
4. Bertsekas, D. P. 1995. Dynamic Programming and Optimal Control. Athena Scientific, Belmont, MA.
5. Bitran, R. G., S. V. Mondschein. 1997. Periodic pricing of seasonal products in retailing. Management Sci. 43 64-79.
6. Braden, D. J., S. S. Oren. 1994. Nonlinear pricing to produce information. Marketing Sci. 13(3) 310-326.
7. Carvalho, A. X., M. L. Puterman. 2003. Dynamic pricing and learning over short time horizons. Working paper, University of British Columbia, Vancouver, BC, Canada.
8. Desiraju, R., S. M. Shugan. 1999. Strategic service pricing and yield management. J. Marketing 63(1) 44-56.
9. Federgruen, A., A. Heching. 1999. Combined pricing and inventory control under uncertainty. Oper. Res. 47 454-475.
10. Fisher, M. L., A. Raman, A. McClelland. 2000. Rocket science retailing is almost here - Are you ready. Harvard Bus. Rev. (July-August) 115-124.
11. Gallego, G., G. van Ryzin. 1994. Optimal dynamic pricing of inventories with stochastic demand over finite horizons. Management Sci. 40 999-1020.
12. Hammond, J. H., A. Raman. 1996. Sport Obermeyer, Ltd. Case study 9-695-022, Harvard Business School, Boston, MA.
13. Hu, C., W. S. Lovejoy, S. L. Shafer. 1996. Comparison of some sub-optimal control policies in medical drug therapy. Oper. Res. 44(5) 696-709.
14. Johnson, M. E. 2001. Learning from toys: Lessons in managing supply chain risk from the toy industry. California Management Rev. 43(3) 106-124.
15. Lane, D. E. 1989. A partially observed model for decision making by fishermen. Oper. Res. 37(2) 240-254.
16. Lariviere, M. A., E. L. Porteus. 1999. Stalking information: Bayesian inventory management with unobserved lost sales. Management Sci. 45(3) 346-363.
17. Li, L. 1988. A stochastic theory of the firm. Math. Oper. Res. 13 447-166.
18. Lovejoy, W. S. 1991. Computationally feasible bounds for partially observed Markov decision processes. Oper. Res. 39(1) 162-175.
19. Lovejoy, W. S. 1993. Suboptimal policies, with bounds, for parameter adaptive decision processes. Oper. Res. 41(3) 583-599.
20. Monahan, G. E. 1982. A survey of partially observable Markov decision processes: Theory, models, and algorithms. Management Sci. 28(1) 1-16.
21. Petruzzi, N. C., M. Dada. 2002. Dynamic pricing and inventory control with learning. Naval Res. Logist. 49 303-325.
22. Sethi, S. P., F. Cheng. 1997. Optimality of (s, S) policies in inventory models with Markovian demand. Oper. Res. 45(6) 931-939.
23. Smallwood, R. D., E. J. Sondik. 1973. The optimal control of partially observable Markov processes over a finite horizon. Oper. Res. 21 1071-1088.
24. Sondik, E. 1971. The optimal control of partially observable Markov processes. Ph.D. dissertation, Department of Engineering-Economic Systems, Stanford University, Stanford, CA.
25. Song, J., P. Zipkin. 1993. Inventory control in a fluctuating demand environment. Oper. Res. 41(2) 351-370.
26. Treharne, J. T., C. R. Sox. 2002. Adaptive inventory control for non-stationary demand and partial information. Management Sci. 48(5) 607-624.
27. Van Hee, K. M. 1978. Bayesian control of Markov chains. Mathematical Centre Tract 95, Amsterdam, The Netherlands.
28. White, C. C. 1976. Applications of two inequality results for concave functions to a stochastic optimization problem. J. Math. Anal. Appl. 55 347-350.
29. White, C. C., W. T. Scherer. 1989. Solution procedures for partially observed Markov decision processes. Oper. Res. 37(5) 791-797.
30. Ziya, S., H. Ayhan, R. D. Foley. 2004. Technical note: Relationships among three assumptions in revenue management. Oper. Res. 52(5) 804-809.