A model-free reinforcement learning approach using Monte Carlo method for production Ramp-up policy improvement - A copy exactly test case

IFAC Proceedings Volumes (IFAC-PapersOnline)

Volumn 14, Issue PART 1, 2012, Pages 1628-1634

  Doltsinis, Stefanos C ^a   Lohse, Niels ^a  

^a UNIVERSITY OF NOTTINGHAM   (United Kingdom)

Author keywords

Assembly; Intelligent Manufacturing Systems; Learning; Manufacturing; Monte Carlo; Production

Indexed keywords

ASSEMBLY; DECISION MAKING; ENGINEERING EDUCATION; INTELLIGENT SYSTEMS; LEARNING SYSTEMS; MONTE CARLO METHODS; PRODUCTION; REINFORCEMENT LEARNING; SUPERVISED LEARNING;

INTELLIGENT MANUFACTURING SYSTEM; LEARNING; MANUFACTURING LINES; MONTE CARLO APPROACH; PRODUCTION RAMP-UP; REINFORCEMENT LEARNING APPROACH; SUPPORT KNOWLEDGE; SYSTEMATIC FRAMEWORK;

MANUFACTURE;

EID: 84866078531     PISSN: 14746670     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.3182/20120523-3-RO-2023.00288     Document Type: Conference Paper

References (15)

1. Carrillo, J. E., & Franza, R. M. (2006). Investing in product development and production capabilities: The crucial linkage between time-to-market and ramp-up time. European Journal of Operational Research, 171, 536-556.
2. Ceglarek, D., Huang, W., Zhou, S., Ding, Y., Kumar, R., & Zhou, Y. (2004). Time-based competition in multistage manufacturing: Stream-of-variation analysis (SOVA) methodology - Review. International Journal of Flexible Manufacturing Systems, 16, 11-44+111.
3. Fjällström, S., Säfsten, K., Harlin, U., & Stahre, J. (2009). Information enabling production ramp-up. Journal of Manufacturing Technology Management, 20, 178-196.
4. Fujii, N., Hatono, I., & Ueda, K. (2004). Reinforcement learning approach to self-organization in a biological manufacturing system framework. Proceedings of the Institution of Mechanical Engineers, Part B: Journal of Engineering Manufacture, 218, 667-673.
5. Haller, M., Peikert, A., & Thoma, J. (2003). Cycle time management during production ramp-up. Robotics and Computer-Integrated Manufacturing, 19, 183-188.
6. Hong, J., & Prabhu, V. V. (2004). Distributed reinforcement learning control for batch sequencing and sizing in justin-time manufacturing systems. Applied Intelligence, 20, 71-87.
7. Kirsch, A., & Beetz, M. (2007). Training on the job -collecting experience with hierarchical hybrid automata. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (Vol. 4667 LNAI, pp. 473-476).
8. Leha, A., Pangercic, D., Ruhr, T., & Beetz, M. (2009). Optimization of simulated production process performance using machine learning. In ETFA 2009-2009 IEEE Conference on Emerging Technologies and Factory Automation.
9. Mahadevan, S., Marchalleck, N., Das, T., & Gosavi, A. (1997). Self-improving factory simulation using continuous-time average-reward reinforcement learning. Proceedings of the International Confernce on Machine Learning, Nashville, TN, Morgan Kaufmann.
10. Monostori, L., Markus, A., Van Brussel, H., & Westkämpfer, E. (1996). Machine learning approaches to manufacturing. CIRP Annals - Manufacturing Technology, 45, 675-x677.
11. Sutton, R. S., & Barto, A. G. (1998). Reinforcement Learning an Introduction. Cambridge, Massachusetts: The MIT Press.
12. Terwiesch, C., & Bohn, R. E. (2001). Learning and process improvement during production ramp-up. International Journal of Production Economics., 70pp, 1-19.
13. Terwiesch, C., & Xu, Y. (2004). The Copy-Exactly Ramp-Up Strategy: Trading-Off Learning With Process Change. IEEE Transactions on Engineering Management, 51, 70-84.
14. Ueda, K., Hatono, I., Fujii, N., & Vaario, J. (2000). Reinforcement learning approaches to Biological Manufacturing System. CIRP Annals - Manufacturing Technology, 49, 343-346.
15. Wang, G., & Mahadevan, S. (1998). A greedy divide-and-conquer approach to optimizing large manufacturing systems using reinforcement learning. In NIPS'98 Workshop on Abstraction and Hierarchy in Reinforcement Learning.