A reinforcement learning approach for inventory replenishment in vendor-managed inventory systems with consignment inventory

EMJ - Engineering Management Journal

Volumn 22, Issue 4, 2010, Pages 44-53

  Sui, Zheng ^a   Gosavi, Abhijit ^b   Lin, Li ^c  

^a Terra Technology   (United States)

^b MISSOURI UNIVERSITY OF SCIENCE AND TECHNOLOGY   (United States)

^c UNIVERSITY AT BUFFALO   (United States)

Author keywords

Simulation; Supply Chains; Vendor Managed Inventory

Indexed keywords

DYNAMIC PROGRAMMING; INVENTORY CONTROL; REINFORCEMENT LEARNING;

INVENTORY MANAGEMENT; INVENTORY REPLENISHMENT; NEWSVENDORS; OPTIMIZATION MODELS; REINFORCEMENT LEARNING APPROACH; REPLENISHMENT STRATEGIES; SIMPLE MODELING; SIMULATION; VENDOR MANAGED INVENTORY; VENDOR-MANAGED INVENTORY SYSTEMS;

SUPPLY CHAINS;

EID: 79951532175     PISSN: 10429247     EISSN: None     Source Type: Journal    
DOI: 10.1080/10429247.2010.11431878     Document Type: Article

References (49)

1. Askin, Ronald., and Jeffrey Goldberg, Design and Analysis of Lean Production Systems, Wiley (2002).
2. Automotive Warehouse Distributors Association, 2003 AWDA Technology Survey, www.awda.org (2003).
3. Axsater, Sven, (2001) “A Note on Stock Replenishment and Shipment Scheduling for Vendor-Managed Inventory Systems” Management Science, 47(9), pp. 1306-1310.
4. Bahill, Terry, and Eric D. Smith, “An Industry Standard Risk Analysis Technique,” Engineering Management Journal, 21:4 (2009), pp. 16-29.
5. Bellman, Richard E., Dynamic Programming, Princeton University Press (1957).
6. Bernstein, Fernando, and Awi Federgruen, (2003) “Pricing and Replenishment Strategies in a Distribution System with Competing Retailers,” Operations Research, 51(3), pp. 409-426.
7. Bertrand, Louise P., and James H. Bookbinder, (1998) “Stock Redistribution in Two-Echelon Logistics Systems,” The Journal of the Operational Research Society, 49(9), pp. 966-975.
8. Bertsekas, Dimitri P., Dynamic Programming (2nd ed.), Athena Scientific (1995).
9. Bertsekas, Dimitri P., and John Tsitsiklis, Neuro-Dynamic Programming, Athena Scientific (1996).
10. Betts, Mitch, (1994) “Manage My Inventory Or Else,” Computerworld, 28(5), pp. 93-95.
11. Cetinkaya, Sila, and Chung Y. Lee, (2000) “Stock Replenishment and Shipment Scheduling for Vendor-Managed Inventory Systems,” Management Science, 46(2), pp. 217-232.
12. Chaouch, Benjamin A., (2001) “Stock Levels and Delivery Rates in Vendor-Managed Inventory Programs,” Production and Inventory Management, 10(1), pp. 31-44.
13. Cheung, Ki L., and Hau Lee, (2002) “The Inventory Benefit of Shipment Coordination and Stock Rebalancing in a Supply Chain,” Management Science, 48(2), pp. 300-306.
14. Clark, Theodore, and James L. McKenny, “Campbell Soup Company: A Leader in Continuous Replenishment Innovations” in Harvard Business School Case, Harvard Business School, Harvard University (1994).
15. Crites, Robert, and Andrew Barto, “Elevator Group Control Using Multiple Reinforcement Learning Agents” Machine Learning, 33:2-3 (1998), pp. 235-262.
16. DeCroix, Gregory A., and Antonio Arreola-Risa, (1998) “Optimal Production and Inventory Policy for Multiple Products under Resource Constraints” Management Science, 44(7), pp. 950-961.
17. Deuermeyer, Brian L., and Leroy Schwarz, “The Model for the Analysis of System Service Level in Warehouse/Retailer Distribution Systems: The Identical Retailer Case,” in MultiLevel Production/Inventory Control Systems: Theory and Practice, North-Holland (1981).
18. Emigh, Jacqueline, “Vendor-Managed Inventory” Computerworld, 33 (1999), pp. 52-55.
19. Evans, Richard V., (1967) “Inventory Control of a Multiproduct System with a Limited Production Resource” Naval Research Logistics Quarterly, 14(2), pp. 173-184.
20. Fry, Michael J., Collaborative and Cooperative Agreements in the Supply Chain, unpublished Ph. D dissertation, University of Michigan (2002).
21. Fry, Michael J., Roman Kapuscinski, and Tava L. Olsen, (2001) “Coordinating Production and Delivery Under a (z, Z)-Type Vendor-Managed Inventory Contract” Manufacturing & Service Operations Management, 3(2), pp. 151-173.
22. Gavirneni, Srinagesh, Roman Kapuscinski, and Sridhar Tayur, (1999) “Value of Information in Capacitated Supply Chains,” Management Science, 45(1), pp. 16-24.
23. Gendreau, Michel, Alain Hertz, and Gilbert Laporte, (1994) “A Tabu Search Heuristic for the Vehicle Routing Problem,” Management Science, 40(10), pp. 1276-1290.
24. Gosavi, Abhijit, Simulation-Based Optimization: Parametric Optimization Techniques and Reinforcement Learning, Springer (2003).
25. Gosavi, Abhijit, “Adaptive Critics for Airline Revenue Management” in Proceedings of the 18th Annual Conference of the Production and Operations Management Society (2007).
26. Graves, Stephen C., “A Multi-Echelon Inventory Model With Fixed Reorder Intervals,” Technical Report, Sloan School of Management, MIT, Cambridge (1996).
27. Hammond, Janice, “Barilla SpA (A) and (B)” In Harvard Business School Case. Cambridge, MA: Harvard Business School, Harvard University (1994).
28. Hibbard, Janet, “Supply-Side Economics” InformationWeek, 707 (1998), pp. 85-87.
29. Higginson, James, and James Bookbinder, (1995) “Markovian Decision Processes in Shipment Consolidation,” Transportation Science, 29(3), pp. 242-255.
30. Jackson, Peter L., “Stock Allocation in a Two Echelon Distribution System or 'What to do Until Your Ship Comes In'“Management Science, 34 (1988), pp. 880-895.
31. Jonsson, Horace, and Silver, Edward A., “Analysis of a Two-Echelon Inventory Control System with Complete Redistribution” Management Science, 33 (1987), pp. 215-227.
32. Kanellos, Michael, “Intel to Manage PC Inventory” http://ww.cnet.com (1998).
33. Kurt Salmon Associates., Survey of Supply Chain Effectiveness, Food Distribution International (2002).
34. Nahmias, Steven, Production and Operations Analysis (4th ed.), McGraw-Hill (2001).
35. Nahmias, Steven, and Stephen A. Simth, “Mathematical Models of Retailer Inventory Systems: A Review” in R. Sarin (Ed.), Perspectives on Operations Management (pp. 249-278), Kluwer Academic Publishers (1993).
36. Ross, Sheldon M., Introduction to Probability Models (8th Ed.) Academic Press (2002).
37. Sethi, Suresh P., Han Yan, and Qin Zhang, (2001) “Peeling Layers of an Onion: Inventory Model with Multiple Delivery Modes and Forecast Updates” Journal of Optimization Theory and Applications, 108(2), pp. 253-281.
38. Simpson, Kenneth F., (1959) “A Theory of Allocation of Stocks to Warehouses” Operations Research, 7(6), pp. 797-805.
39. Subramaniam, Ganesh, and Abhijit Gosavi, (2007) “Simulation-Based Optimization for Material Dispatching in a Retailer Network” International Journal of Simulation and Process Modeling, 3(4), pp. 238-245.
40. Suo, Hansheng, Jingchun Wang, and Yihui Jin., “Coordinating a Loss-Averse Newsvendor with Vendor Managed Inventory” in Proceedings of the IEEE Conference on Systems, Man, and Cybernetics (2004), pp. 6026-6030.
41. Survey, Distributor Customer Evaluation Survey on electronic components Electronic Buyers News (2003).
42. Sutton, Richard S., and Andrew Barto, Reinforcement Learning: An Introduction, MIT Press (1998).
43. Tesauro, Gerald, (1995) “Temporal Difference Learning and Td-gammon,” Communications of the Association for Computing Machinery, 38(3), pp. 58-68.
44. Van Roy, Benjamin, Dimitri P. Bertsekas, Yuchus Lee, and John N. Tsitsiklis, “A Neuro-Dynamic Programming Approach to Retailer Inventory Management” Proceedings of the 36th IEEE Conference on Decision and Control, pp. 4052-4057 (1997).
45. Veinott, Arthur F., (1965) “Optimal Policies for a Multi-Product, Dynamic Non-Stationary Inventory Model with Several Demand Classes” Operations Research, 13(5), pp. 761-778.
46. Waller, Matt, Eric Johnson, and Tom Davis, “Vendor-Managed Inventory in the Retailer Supply Chain,” Journal of Business Logistics, 20 (1999), pp. 183-203.
47. Watkins, Chris J., Learning from Delayed Rewards, unpublished Ph.D. thesis, Kings College, Cambridge, England (1989).
48. Werbos, Paul J., Beyond Regression: New Tools for Prediction and Analysis of Behavioral Sciences, Ph.D. thesis, Harvard University, Cambridge, MA (1974).
49. Wong, Wai-Keung, Jian Qi, and Sunney Leung, “Coordinating Supply Chains with Sales Rebate Contracts and Vendor-Managed Inventory,” to appear in International Journal of Production Economics (2009).