An approximate dynamic programming approach for job releasing and sequencing in a reentrant manufacturing line

Proceedings of the 2007 IEEE Symposium on Approximate Dynamic Programming and Reinforcement Learning, ADPRL 2007

Volumn , Issue , 2007, Pages 201-208

  Ramírez Hernández, José A ^a   Fernandez, Emmanuel ^a  

^a University of Cincinnati   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; APPROXIMATION THEORY; BENCHMARKING; COMPUTER SIMULATION; OPTIMIZATION; PROBLEM SOLVING;

JOB RELEASING; REENTRANT MANUFACTURING LINE; SEQUENCING;

DYNAMIC PROGRAMMING;

EID: 34548800497     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ADPRL.2007.368189     Document Type: Conference Paper

References (37)

1. C. H. Papadimitriou and J. N. Tsitsiklis, "The complexity of optimal queueing network control," Mathematics of Operations Research, vol. 24, no. 2, pp. 293-305, 1999.
2. P. R. Kumar, "Re-entrant lines," Queueing Systems: Theory and Applications, vol. 13, pp. 87-110, 1993.
3. R. Uzsoy, C. Lee, and L. A. Martin-Vega, "A review of production planning and scheduling models in the semiconductor industry part II: Shop-floor control," HE Transactions, vol. 26, no. 6, pp. 44-55, 1994.
4. L. M. Wein, "Scheduling semiconductor wafer fabrication," IEEE Transactions on Semiconductor Manufacturing, vol. 1, pp. 115-130, 1988.
5. C. H. Lu, D. Ramaswamy, and P. R. Kumar, "Efficient scheduling policies to reduce mean and variance of cycle-time in semiconductor manufacturing plants," IEEE Transactions on Semiconductor Manufacturing, vol. 7, no. 3, pp. 374-388, 1994.
6. S. Kumar and P. R. Kumar, "Queueing network models in the design and analysis of semiconductor wafer fabs," IEEE Transactions on Robotics and Automation, vol. 17, no. 5, pp. 548-561, 2001.
7. P. R. Kumar, "Scheduling semiconductor manufacturing plants," IEEE Control Systems Magazine, vol. 39, no. 11, pp. 33-40, 1994.
8. R. Uzsoy, C. Lee, and L. A. Martin-Vega, "A review of production planning and scheduling models in the semiconductor industry part ii: shop-foor control," HE Transactions, vol. 24, pp. 45-55, 1994.
9. J. W. Fowler, G. L. Hogg, and S. J. Mason, "Workload control in the semiconductor industry," Production Planning & Control, vol. 13, no. 7, pp. 568-578, 2002.
10. R. S. Sutton and A. G. Barto, Reinforcement Learning: An Introduction. Cambridge, MA: MIT Press, 1998.
11. D. P. Bertsekas and J. N. Tsitsiklis, Neuro-Dynamic Programming. Bellmont, MA: Athena Scientific, 1996.
12. J. A. Ramírez-Hernández, H. Li, E. Fernandez, C. R. McLean, and S. Leong, "A framework for standard modular simulation in semiconductor wafer fabrication systems," in Proceedings of the 2005 Winter Simulation Conference, Orlando, FL, December 2005, pp. 2162-2171.
13. M. L. Puterman, Markov Decision Processes: Discrete Stochastic Dynamic Programming. New York, NY: John Wiley & Sons, Inc, 1994, ch. Discounted Markov Decision Problems, pp. 142-266.
14. D. P. Bertsekas, Dynamic Programming and Optimal Control, 2nd ed. Bellmont, MA: Athena Scientific, 2000, vol. II.
15. J. A. Ramírez-Hernández and E. Fernandez, "A case study in scheduling reentrant manufacturing lines: Optimal and simulation-based approaches," in Proceedings of the 44th IEEE Conference on Decision and Control, and the European Control Conference 2005, Seville, Spain, December 12-15 2005, pp. 2158-2163.
16. _, "Optimal job sequencing control in a benchmark reentrant manufacturing line," January 2007, manuscript.
17. _, "Optimal job releasing and sequencing for a reentrant manufacturing line with finite capacity buffers," in Proceedings of the 45th IEEE Conference on Decision and Control, San Diego, CA, December 13-15, 2006, pp. 6654-6659.
18. _, "Optimal job sequencing in a benchmark reentrant line with finite capacity buffers," in Proceedings of the 17th International Symposium on Mathematical Theory of Networks and Systems, Kyoto, Japan, July 24-28, 2006, pp. 1214-1219.
19. Semiconductor Industry Association (SIA). (2005) International Technology Road Map for Semiconductors (ITRS) 2005. [Online]. Available: http://public.itrs.net
20. M. Venables, "Small is beautiful: small low volume semiconductor manufacturing plants," IE Review, pp. 26-27, March 2005.
21. st 2003, pp. 111-117.
22. J.-B. Suk and C. G. Cassandras, "Optimal control of a storage-retrieval queuing system," in Proceedings of the 28th IEEE Conference on Decision and Control, 1989, pp. 1093-1098.
23. R.-R. Chen and S. Meyn, "Value iteration and optimization of multiclass queueing networks," Queueing Systems, vol. 32, pp. 65-97, 1999.
24. J. A. Ramírez-Hernández and E. Fernandez. (2007) Corrigendum to optimal job releasing and sequencing for a reentrant manufacturing line with finite capacity buffers. [Online], Available: http://www.ececs.uc.edu/~ramirejs/CorrigendumOptimalControlRML.pdf
25. M. L. Puterman, Markov Decision Processes: Discrete Stochastic Dynamic Programming. New York, NY: John Wiley & Sons, Inc, 1994.
26. C. J. C. H. Watkins, "Learning from delayed rewards," Ph.D. thesis, Cambridge University, Cambridge, UK, 1989.
27. C. J. C. H. Watkins and P. Dayan, "Q-leaming," Machine Learning, vol. 8, pp. 279-292, 1992.
28. C. Liu, H. Jin, Y. Tian, and H. Yu, "A reinforcement learning approach to re-entrant manufacturing system scheduling," in Proceedings of ICII 2001 International Conferences on Info-tech and Info-net, vol. 3, Beijing, China, October 29th to November 1st 2001, pp. 280-285.
29. J.-Y. Choi and S. Reveliotis, "Relative value function approximation for the capacitated re-entrant line scheduling problem," IEEE Transactions on Automation Science and Engineering, vol. 2, no. 3, pp. 285-299, 2005.
30. J. N. Tsitsiklis and B. Van Roy, "An analysis of temporal-difference learning with function approximation," IEEE Transactions on Automatic Control, vol. 42, no. 5, pp. 674-690, 1997.
31. S. A. Lippman, "Applying a new device in the optimization of exponential queuing systems," Operations Research, vol. 23, pp. 687-710, 1975.
32. J. Walrand, An Introduction to Queueing Networks. Englewood Cliffs, NJ: Prentice Hall, 1988.
33. G. A. Rummery, "Problem solving with reinforcement learning," Ph.D. thesis, Cambridge University, 1995.
34. B. Van Roy, "Learning and value function approximation in complex decision processes," Ph.D. thesis, Massachusetts Institute of Technology, Cambridge, MA, 1998.
35. J. N. Tsitsiklis and B. Van Roy, "Feature-based methods for large scale dynamic programming," Machine Learning, vol. 22, pp. 59-94, 1996.
36. R. S. Sutton, "Learning to predict by the methods of temporal differences," Machine Learning, vol. 3, pp. 9-44, 1988.
37. W. D. Kelton, R. P. Sadowski, and D. T. Sturrock, Simulation with Arena, 4th ed. USA: McGraw-Hill, 2006.