Real-time dynamic pricing in a non-stationary environment using model-free reinforcement learning

Omega (United Kingdom)

Volumn 47, Issue , 2014, Pages 116-126

  Rana, Rupal ^a   Oliveira, Fernando S ^b  

^a LOUGHBOROUGH UNIVERSITY   (United Kingdom)

^b ESSEC BUSINESS SCHOOL   (France)

Author keywords

Dynamic pricing; Reinforcement learning; Revenue management; Simulation

Indexed keywords

COSTS; ECONOMICS; INTELLIGENT SYSTEMS; LEARNING ALGORITHMS; MONTE CARLO METHODS;

DYNAMIC PRICING; LEARN+; MODEL FREE; NON-STATIONARY ENVIRONMENT; PRICING POLICY; REAL-TIME DYNAMICS; REINFORCEMENT LEARNING ALGORITHMS; REINFORCEMENT LEARNINGS; REVENUE MANAGEMENT; SIMULATION;

REINFORCEMENT LEARNING;

EID: 84899975067     PISSN: 03050483     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.omega.2013.10.004     Document Type: Article

References (33)

1. Lin K. Dynamic pricing with real-time demand learning. European Journal of Operational Research 2006, 174:522-538.
2. Tsaia W.H., Hung S.j. Dynamic pricing and revenue management process in Internet retailing under uncertainty. an integrated real options approach. Omega 2009, 37:471-481.
3. Anjos R., Cheng R.C.H., Currie C. Optimal pricing policies for perishable products. European Journal of Operational Research 2005, 166:246-254.
4. Pan K., Lai K.K., Liang L., Leung S.C.H. Two-period pricing and ordering policy for the dominant retailer in a two-echelon supply chain with demand uncertainty. Omega 2009, 37:919-929.
5. Gallego G., van Ryzin G.j. Optimal dynamic pricing of inventories with stochastic demand over finite horizons. Management Science 1994, 40:999-1020.
6. Ramesesh R.V. Lot-sizing decisions under limited-time price incentives. a review. Omega 2010, 39:118-135.
7. Chiang W.C., Chen J.C.H., Xu X. An overview of research on revenue management. current issues and future research. International Journal of Revenue Management 2007, 1:97-128.
8. Bitran G.R., Caldentey R. An overview of pricing models for revenue management. Manufacturing and Service Operations Management 2003, 53(3):203-229.
9. Elmaghraby W., Keskinocak P. Dynamic pricing in the presence of inventory considerations. research overview, current practices, and future directions. Management Science 2003, 49(10):1287-1309.
10. McGill J.I., van Ryzin G.J. Revenue management. research overview and prospects. Transportation Science 1999, 33(2):233-256.
11. Weatherford L., Bodily S. A taxonomy and research overview of perishable-asset revenue management. yield management, overbooking and pricing. Operations Research 1992, 40:831-844.
12. Belobaba P. Airline yield management an overview of seat inventory control. Transportation Science 1987, 21:63-73.
13. Chenavaz R. Dynamic pricing, product and process innovation. European Journal of Operational Research 2012, 222:553-557.
14. Marbn S., van der Zwaan R., Grigoriev A., Hiller B., Vredeveld T. Dynamic pricing problems with elastic demand. Operations Research Letters 2012, 40:175-179.
15. Zhang J., Chiang W.K., Liang L. Strategic pricing with reference effects in a competitive supply chain. Omega 2013, 41:345-353.
16. Tesauro G., Kephart J.O. Pricing in agent economies using multi-agent Q-learning. Autonomous Agents and Multi-Agent Systems 2002, 5:289-304.
17. Peng J., Williams R.J. Incremental multi-step Q-learning. Machine Learning 1996, 22:283-290.
18. Anjos R., Cheng R.C.H., Currie C. Maximizing revenue in the airline industry under one-way pricing. Journal of Operational Research Society 2004, 55:535-541.
19. Aviv Y., Pazgal A. A partially observed Markov decision process for dynamic pricing. Management Science 2005, 51(9):1400-1416.
20. Berk E., Gurler l., Yildirim G. On pricing of perishable assets with menu costs. International Journal of Production Economics 2009, 121:678-699.
21. Zhao L., Tian P., Xiangyong L. Dynamic pricing in the presence of consumer inertia. Omega 2012, 40:137-148.
22. Dasu S., Tong C. Dynamic pricing when consumers are strategic: analysis of posted and contingent pricing schemes. European Journal of Operational Research 2010, 204:662-671.
23. Banerjee P.K., Turner T.R. A flexible model for the pricing of perishable assets. Omega 2012, 40:533-540.
24. Li G., Xiong Z., Zhou Y., Xiong Y. Dynamic pricing for perishable products with hybrid uncertainty in demand. Applied Mathematics and Computation 2013, 219:10366-10377.
25. Lim A.E.B., Shanthikumar J.G. Relative entropy, exponential utility, and robust dynamic pricing. Operations Research 2007, 55:198-214.
26. Besbes O., Zeevi A. Dynamic pricing without knowing the demand function. risk bounds and near-optimal algorithms. Operations Research 2009, 57(6):1407-1420.
27. Gosavi A., Bandla N., Das T.K. A reinforcement learning approach to a single leg airline revenue management problem with multiple fare classes and overbooking. IIE Transactions 2002, 34:729-752.
28. Raju C., Narahari Y., Ravikumar K. Learning dynamic prices in electronic retail markets with customer segmentation. Annals of Operations Research 2006, 59-75.
29. Carvalho AX, Puterman ML. Dynamic pricing and reinforcement learning. In: Proceedings of the international conference on neural networks, vol. 4; 2003. p. 2916-21.
30. Cheng Y. Real-time demand learning-based Q-learning approach for dynamic pricing in e-retailing setting. In: International symposium on information engineering and electronic commerce; 2009. p. 594-8.
31. Sutton R.S., Barto A.G. Reinforcement learning. an introduction 1998, Cambridge, Bradford.
32. Szepesvri C., Littman M.L. A unified analysis of value-function-based reinforcement learning algorithms. Neural Computation 1999, 11:2017-2060.
33. Gosavi A. Target-sensitive control of Markov and semi-Markov processes. International Journal of Control, Automation, and Systems 2011, 9(5):1-11.