Control of a re-entrant line manufacturing model with a reinforcement learning approach

Proceedings - 6th International Conference on Machine Learning and Applications, ICMLA 2007

Volumn , Issue , 2007, Pages 330-335

  Ramírez Hernández, José A ^a   Fernandez, Emmanuel ^a  

^a 705 Engineering Research Center   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; EDUCATION; REINFORCEMENT; REINFORCEMENT LEARNING; ROBOT LEARNING;

ACTION SPACES; CONTROL ACTIONS; GRADIENT DESCENT (GD); INTERNATIONAL CONFERENCES; MACHINE-LEARNING; MANUFACTURING MODELS; NUMERICAL EXPERIMENTS; OPTIMAL ACTIONS; OPTIMAL CONTROL; OPTIMAL COST FUNCTIONS; OPTIMAL STRATEGIES; REINFORCEMENT LEARNING (RL); REINFORCEMENT LEARNING APPROACH;

LEARNING SYSTEMS;

EID: 47349128955     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICMLA.2007.35     Document Type: Conference Paper

References (20)

1. D. P. Bertsekas. Dynamic Programming and Optimal Control, volume II. Athena Scientific, Bellmont, MA, second edition, 2000.
2. D. P. Bertsekas. Dynamic programming and suboptimal control: A survey from ADP to MPC. European Journal of Control, 11(4-5):310-334, 2005.
3. D. P. Bertsekas and J. N. Tsitsiklis. Neuro-Dynamic Programming. Athena Scientific, Bellmont, MA, 1996.
4. W. D. Kelton, R. P. Sadowski, and D. T. Sturrock. Simulation with Arena. McGraw-Hill, USA, fourth edition, 2006.
5. P. R. Kumar. Re-entrant lines. Queueing Systems: Theory and Applications, 13:87-110, 1993.
6. S. Kumar and P. R. Kumar. Queueing network models in the design and analysis of semiconductor wafer fabs. IEEE Transactions on Robotics and Automation, 17(5):548-561, 2001.
7. C. H. Papadimitriou and J. N. Tsitsiklis. The complexity of optimal queueing network control. Mathematics of Operations Research, 24(2):293-305, 1999.
8. M. L. Puterman. Markov Decision Processes: Discrete Stochastic Dynamic Programming, chapter Discounted Markov Decision Problems, pages 142-266. John Wiley & Sons, Inc, New York, NY 1994.
9. J. A. Ramírez-Hernández and E. Fernandez. A case study in scheduling reentrant manufacturing lines: Optimal and simulation-based approaches. In Proceedings of the 44th IEEE Conference on Decision and Control, and. the European Control Conference 2005, pages 2158-2163, Seville, Spain, December 12-15 2005.
10. J. A. Ramírez-Hernández and E. Fernandez. Optimal job releasing and sequencing for a reentrant manufacturing line with finite capacity buffers. In Proceedings of the 45th IEEE Conference on Decision and Control, pages 6654-6659, San Diego, CA, December 13-15 2006.
11. J. A. Ramírez-Hernández and E. Fernandez. An approximate dynamic programming approach for job releasing and sequencing in a reentrant manufacturing line. In Proceedings of the 2007 IEEE Symposium on Approximate Dynamic Programming and Reinforcement Learning (ADPRL 2007), pages 201-208, Honolulu, HI, April 2007.
12. J. A. Ramírez-Hernández and E. Fernandez. Optimal job sequencing control in a re-entrant line manufacturing model, manuscript, August 2007.
13. J. A. Ramírez-Hernández, H. Li, E. Fernandez, C. R. McLean, and S. Leong. A framework for standard modular simulation in semiconductor wafer fabrication systems. In Proceedings of the 2005 Winter Simulation Conference, pages 2162-2171, Orlando, FL, December 2005.
14. D. Sofge and D. White. Applied Learning-Optimal Control for Manufacturing, in Handbook of Intelligent Control: Neural, Fuzzy, and Adaptive Approaches, pages 259-282. Van Nostrand Reinhold, 1992.
15. J.-B. Suk and C. G. Cassandras. Optimal control of a storage-retrieval queuing system. In Proceedings of the 28th IEEE Conference on Decision and Control, pages 1093-1098, 1989.
16. R. S. Sutton and A. G. Barto. Reinforcement Learning: An Introduction. MIT Press, Cambridge, MA, 1998.
17. Semiconductor Industry Association. International Technology Road Map for Semiconductors (ITRS) 2005, 2007.
18. R. Uzsoy, C. Lee, and L. A. Martin-Vega. A review of production planning and scheduling models in the semiconductor industry part ii: shop-foor control. HE Transactions, 24:45-55, 1994.
19. J. Walrand. An Introduction to Queueing Networks. Prentice Hall, Englewood Cliffs, NJ, 1988.
20. L. M. Wein. Scheduling semiconductor wafer fabrication. IEEE Transactions on Semiconductor Manufacturing, 1:115-130, 1988.