Using stochastic approximation methods to compute optimal base-stock levels in inventory control problems

Operations Research

Volumn 56, Issue 3, 2008, Pages 646-664

  Kunnumkal, Sumit ^a   Topaloglu, Huseyin ^b  

^a INDIAN SCHOOL OF BUSINESS   (India)

^b Cornell University   (United States)

Author keywords

Dynamic programming optimal control: Applications. Area of review : Stochastic models; Inventory production: Uncertainty, stochastic

Indexed keywords

BASE STOCKS; BASE-STOCK POLICIES; DEMAND INFORMATIONS; DYNAMIC PROGRAMMING/OPTIMAL CONTROL: APPLICATIONS. AREA OF REVIEW : STOCHASTIC MODELS; INVENTORY CONTROL PROBLEMS; INVENTORY/PRODUCTION: UNCERTAINTY, STOCHASTIC; STOCHASTIC APPROXIMATION METHODS;

APPROXIMATION THEORY; INVENTORY CONTROL; OPTIMIZATION; RANDOM PROCESSES; RANDOM VARIABLES; STOCHASTIC CONTROL SYSTEMS;

STOCHASTIC MODELS;

EID: 61449199362     PISSN: 0030364X     EISSN: 15265463     Source Type: Journal    
DOI: 10.1287/opre.1070.0477     Document Type: Article

References (27)

1. Arrow, K. J., S. Karlin, H. Scarf. 1958. Studies in the Mathematical Theory of Inventory and Production. Stanford University Press, Stanford, CA.
2. Azoury, K. S. 1985. Bayes solutions to dynamic inventory models under unknown demand distribution. Management Sci. 31(9) 1150-1160.
3. Bashyam, S., M. C. Fu. 1998. Optimizaton of (s, S) inventory systems with, random lead times and a service level constraint. Management Sci. 44(12) 243-256.
4. Bertsekas, D. P., J. N. Tsitsiklis. 1996. Neuro-Dynamic Programming. Athena Scientific, Belmont, MA.
5. Braden, D. B., M. Freimer. 1991. Informational dynamics of censored observations. Management Sci. 37(11) 1390-1404.
6. Conrad, S. A. 1976. Sales data and the estimation of demand. Oper. Res. Quart. 27(1) 123-127.
7. Ding, X. 2002. Estimation and optimization in discrete inventory models. Ph.D. thesis, University of British Columbia, Vancouver, British Columbia, Canada.
8. Fu, M. C. 1994. Sample path derivatives for (s, S) inventory systems. Oper. Res. 42(2) 351-363.
9. Glasserman, P. 1994. Perturbation analysis of production networks. D. D. Yao, ed. Stochastic Modeling and Analysis of Manufacturing Systems. Springer, New York, 233-280.
10. Glasserman, P., S. Tayur. 1995. Sensitivity analysis for base-stock levels in multiechelon production-inventory systems. Management Sci. 41(2) 263-281.
11. Godfrey, G. A., W. B. Powell. 2001. An adaptive, distribution-free approximation for the newsvendor problem with censored demands, with applications to inventory and distribution problems. Management Sci. 47(8) 1101-1112.
12. Iglehart, D. L. 1964. The dynamic inventory problem with unknown demand distribution. Management Sci. 10(3) 429-440.
13. Karaesmen, I., G. van Ryzin. 2004. Overbooking with substitutable inventory classes. Oper. Res. 52(1) 83-104.
14. Kushner, H. J., D. S. Clark. 1978. Stochastic Approximation Methods for Constrained and Unconstrained Systems. Springer-Verlag, Berlin, Germany.
15. L'Ecuyer, P., P. Glynn. 1994. Stochastic optimization by simulation: Convergence proofs for the GI/G/1 queue in steady state. Management Sci. 40 1245-1261.
16. Levi, R., R. Roundy, D. M. Shmoys. 2005. Computing provably nearoptimal sample-based policies for stochastic inventory control models. Technical report, School of Operations Research and Industrial Engineering, Cornell University, Ithaca, NY.
17. Mahajan, S., G. van Ryzin. 2001. Stocking retail assortments under dynamic customer substitution. Oper. Res. 49(3) 334-351.
18. Nascimento, J. M., W. B. Powell. 2006. An optimal approximate dynamic programming algorithm for the lagged asset acquisition problem. Technical report, Department of Operations Research and Financial Engineering, Princeton University, Princeton, NJ.
19. Neveu, J. 1975. Discrete Parameter Martingales. North-Holland, Amsterdam, The Netherlands.
20. Porteus, E. L. 1990. Stochastic inventory theory. Handbooks in Operations Research and Management Science: Stochastic Models, Vol. 2, Chapter 12. North-Holland, Amsterdam, The Netherlands, 605-652.
21. Powell, W. B., A. Ruszczynski, H. Topaloglu. 2004. Learning algorithms for separable approximations of stochastic optimization problems. Math. Oper. Res. 29(4) 814-836.
22. Scarf, H. 1960. Some remarks on Bayes solutions to the inventory problem. Naval Res. Logist. Quart. 7 591-596.
23. Sutton, R. S. 1988. Learning to predict by the methods of temporal differences. Machine Learning 3 9-44.
24. Topaloglu, H., W. B. Powell. 2003. An algorithm, for approximating piecewise linear functions from sample gradients. Oper. Res. Lett. 31 66-76.
25. Tsitsiklis, J. N. 1994. Asynchronous stochastic approximation and Q-learning. Machine Learning 16 185-202.
26. van Ryzin, G., G. Vulcano. 2008. Simulation-based optimization of virtual nesting controls for network revenue management. Oper. Res. Forthcoming.
27. Zipkin, P. 2000. Foundations of Inventory Management. McGraw-Hill, Boston, MA.