Learning dynamic prices in electronic retail markets with customer segmentation

Annals of Operations Research

Volumn 143, Issue 1, 2006, Pages 59-75

  Raju, C V L ^a   Narahari, Y ^a   Ravikumar, K ^b  

^a INDIAN INSTITUTE OF SCIENCE   (India)

^b GENERAL MOTORS CORPORATION   (United States)

Author keywords

Captives; Customer segmentation; Dynamic pricing; Electronic retail market; Inventory replenishment; Markov decision process; Q learning; Reinforcement learning; Shoppers; Volume discounts

Indexed keywords

EID: 33646596261     PISSN: 02545330     EISSN: 15729338     Source Type: Journal    
DOI: 10.1007/s10479-006-7372-3     Document Type: Conference Paper

References (18)

1. Abounadi, J., D. Bertsekas, and V. Borkar. (1996) "Learning algorithms for Markov decision processes with average cost." Technical report, Lab. for Info. and Decision Systems, M.I.T., USA.
2. Bertsekas, D. P. and J. Tsitsiklis. (1996). Neuro-dynamic Programming. Boston, MA, USA: Athena Scientific.
3. Brooks, C., R. Fay, R. Das, J. K. MacKie-Mason, J. Kephart, and E. Durfee. (1999). "Automated strategy searches in an electronic goods market: Learning and complex price schedules." In: Proceedings of the First ACM Conference on Electronic Commerce (EC-99). 31-40.
4. Carvalho, A. and M. Puttman. (2003). "Dynamic Pricing and Reinforcement Learning, URL: gg.nwu.edu/academic/deptprog/meds-dep/OR-Seminars/ Puterman.pdf."
5. DiMicco, J. M., A. Greenwald, and P. Maes. (2002), "Learning Curve: A Simulation-based Approach to Dynamic Pricing."
6. Elmaghraby, W. and P. Keskinocak. (2002). "Dynamic Pricing: Research Overview. Current Practices and Future Directions, URL: http://www.isye.gatech. edu/pinar/dynamic-pricing.pdf."
7. Gupta. M., K. Ravikumar, and M. Kumar. (2002). "Adaptive strategies for price markdown in a multi-unit descending price auction: A comparative study." In: Proceedings of the IEEE Conference on Systems, Man, and Cybernetics 373-378.
8. Hu, J. and Y. Zhang. (2002). "Online Reinformcenet Learning in Multiagent Systems, URL: cimon.roehester.edu/public-html/papers/priceagent1.pdf. "
9. Mcgill, J. and G. van Ryzin. (1999). "Revenue management: Research overview and prospects." Transportation Science 33 (2), 233-256.
10. Narahari, Y., C. Raju, and S. Shah. (2003). "Dynamic Pricing Models for Electronic Business." Technical report, Electronic Enterprises Laboratory, Department of Computer Science an d Automation, Indian Institute of Science.
11. Salop, S. and J. Stiglitz. (1982) "The theory of sales: A simple model of equilibrium price dispersion with identical agents." The American Economic Review 72 (5), 1121-1130.
12. Singh, S. (1994). "Learning to solve Markovian Decision Processes." Ph.d dissertation, University of Michigan, Ann Arbor.
13. Smith, B., D. Gunther, B. Rao, and R. Ratliff. (2001 ). "E-commerce and operations research in airline planning, marketing, and distribution." Interfaces 31 (2).
14. Smith, M., J. Bailey, and E. Brynjolfsson. (2000). Understanding Digital Markets: Review and Assessment. Cambridge. MA: MIT Press.
15. Sutton, R. S. and A. G. Barto. (1998). Reinforcement Learning: An Introduction. Cambridge. MA: MIT Press.
16. Swann, J. (1999). "Flexible Pricing Policies: Introduction and a Survey of Implementation in Various Industries." Technical Report Contract Report # CR-99/04/ESL. General Motors Corporation.
17. Varian, H. R. (1980). "A Model of Sales." The American Economic Review pp. 651-659.
18. Watkins, C. J. C. H. and P. Dayan. (1992). "Q-learning." Machine Learning 8, 279-292.