Dynamic job-shop scheduling using reinforcement learning agents

Robotics and Autonomous Systems

Volumn 33, Issue 2, 2000, Pages 169-178

  Aydin, M Emin ^a   Öztemel, Ercan ^a,b  

^a SAKARYA UNIVERSITY   (Turkey)

^b MATERIALS INSTITUTE   (Turkey)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; COMPUTER SIMULATION; DECISION SUPPORT SYSTEMS; DECISION THEORY; LEARNING ALGORITHMS; LEARNING SYSTEMS; REAL TIME SYSTEMS; SCHEDULING;

DYNAMIC JOB-SHOP SCHEDULING; REINFORCEMENT LEARNING ALGORITHMS;

COMPUTER INTEGRATED MANUFACTURING;

EID: 0034325416     PISSN: 09218890     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0921-8890(00)00087-7     Document Type: Article

References (41)

1. Arzi Y. On-line scheduling in a multi-cell flexible manufacturing systems. International Journal of Production Research. 33(12):1995;3283-3300.
2. M.E. Aydin, E. Öztemel, Q-III: Generalization of experiences for reinforcement learning, in: Proceedings of the Seventh Turkish Artificial Intelligence and Neural Networks Symposium, Ankara, June 24-26, 1998, pp. 11-17.
3. Asada M., Noda S., Tawaratsumida S., Hosoda K. Purposive behavior acquisition for a real robot by vision-based reinforcement learning. Machine Learning. 23:1996;279-303.
4. R.K. Baker, Introduction to Sequencing and Scheduling, Wiley, Toronto, 1974.
5. J. Banks, J.S.II. Carson, B.L. Nelson, Discrete-event System Simulation, Prentice-Hall, Englewood Cliffs, NJ, 1996.
6. Barto A.G., Bradtke S.J., Singh S.P. Learning to act using real-time dynamic programming. Artificial Intelligence. 72:1995;81-138.
7. C. Bierwirth, H. Kopfer, D.C. Mattfeld, I. Rixen, Genetic algorithm based scheduling in a dynamic manufacturing system, in: Proceedings of the IEEE Conference on Evolutionary Computation, Perth, 1995, pp. 439-443.
8. R. Brooks, Intelligence without reason, in: Proceedings of the 1991 International Joint Conference on Artificial Intelligence (IJCAI-91), Sydney, Australia, 1991, pp. 569-595.
9. P. Burke, P. Prosser, Distributed asynchronous scheduling, in: M. Zweben, M. Fox (Eds.), Intelligent Scheduling, Morgan Kaufmann, Los Altos, CA, 1994.
10. F.-C. Chang, A knowledge-based real-time decision support system for job shop scheduling at the shop floor level, Ph.D. Thesis, The Ohio State University, Columbus, OH, 1985.
11. S.K. Das, A. El-Kholy, C.A. Harrison, V. Liatsos, B. Richards, A multi-agent view of planning and scheduling, in: Proceedings of the 1995 Conference on Expert Systems, 1995, pp. 361-367.
12. Dorigo M., Colombetti M. Robot shaping: Developing autonomous agents through learning. Artificial Intelligence. 71(2):1994;321-370.
13. Hayes-Roth B. Architectural foundations for real-time performance in intelligent agents. The Real-Time Systems. 2:1990;99-125.
14. Heger M. The loss from imperfect value functions in expectation-based and minimax-based tasks. Machine Learning. 22:1996;197-225.
15. Ishii N., Talavage J.J. A transient-based real-time scheduling algorithm in FMS. International Journal of Production Research. 29(12):1991;2501-2520.
16. Koenig S., Simmson R.G. The effect of representation and knowledge on goal-directed exploration with reinforcement learning. Machine Learning. 22:1996;227-250.
17. S.C. Lin, E.D. Goodman, W.F. Punch, A genetic algorithm approach to dynamic job shop scheduling problems, in: Proceedings of the Seventh Conference on Genetic Algorithms, Morgan Kaufmann, San Francisco, CA, 1997, pp. 481-488.
18. Lin L.J. Self-improving reactive agents based on reinforcement learning, planning and teaching. Machine Learning. 8:1992;293-321.
19. Maclin R., Shavlik J.W. Creating advice-taking reinforcement learning. Machine Learning. 22:1996;251-281.
20. P. Maes, R. Brooks, Learning to coordinate behaviors, in: Proceedings of the AAAI-82, Boston, MA, Morgan Kaufmann, Los Altos, CA, 1990, pp. 796-802.
21. Mahadevan S., Connell J. Automatic programming of behavior-based robots using reinforcement learning. Artificial Intelligence. 55:1992;311-365.
22. Matsuura H., Tsubone H., Kanezashi M. Sequencing, dispatching and switching in a dynamic manufacturing environment. International Journal of Production Research. 31(7):1993;1671-1688.
23. Nakasuka S., Yoshida T. Dynamic scheduling system utilizing machine learning as a knowledge acquisition tool. International Journal of Production Research. 30(2):1992;411-431.
24. E. Öztemel, M.E. Aydin, Learning in intelligent agents: Q-I algorithm, in: New Trends in Artificial Intelligence and Neural Networks, EMO, Ankara, 1997, pp. 200-206.
25. E. Öztemel, M.E. Aydin, Q-II: An improved learning algorithm for intelligent agents, in: Proceedings of the 11th European Simulation Multi-Conference, Istanbul, June 1-4, 1997, pp. 275-279.
26. Piggott P., Sattar A. Reinforcement learning of iterative behavior with multiple sensors. Journal of Applied Intelligence. 4:1994;351-365.
27. T.J. Ross, Fuzzy Logic with Engineering Applications, McGraw-Hill, New York, 1995.
28. S.J. Russell, P. ve Norvig, Artificial Intelligence: A Modern Approach, Prentice-Hall, Englewood Cliffs, NJ, 1995.
29. Shaw M.J., Park S., Raman N. Intelligent scheduling with machine learning capabilities: The induction of scheduling knowledge. IIE Transactions. 24(2):1992;156-168.
30. Sim S.K., Yeo K.T., Lee W.H. An expert neural network system for dynamic job shop scheduling. International Journal of Production Research. 32(8):1994;1759-1773.
31. Singh S.P. Transfer of learning by composing solution of elemental sequential tasks. Machine Learning. 8:1992;323-339.
32. N. Singh, Systems Approach to Computer Integrated Design and Manufacturing, Wiley, New York, 1996.
33. L. Steels, The artificial life roots of artificial intelligence, Artificial Life Journal 1 (1) (1994).
34. Sun D., Lin L. A dynamic job shop scheduling framework: A backward approach. International Journal of Production Research. 32(4):1994;967-985.
35. Sutton R.S. Learning to predict by the methods of temporal differences. Machine Learning. 3:1988;9-44.
36. Tesauro G. Practical issues in temporal difference learning. Machine Learning. 8:1992;257-277.
37. C.J.C.H. Watkins, Learning from delayed rewards, Ph.D. Thesis, Cambridge University, Cambridge, 1989.
38. S.D. Whitehead, L.J. Lin, Reinforcement learning of non-Markov decision processes, Artificial Intelligence 73 (1995) 271-306.
39. Wooldridge M., Jennings N.R. Intelligent agent: theory and practice. The Knowledge Engineering Review. 10(2):1995;115-152.
40. Yih Y., Thesen A. Semi-Markov decision models for real-time scheduling. International Journal of Production Research. 29(11):1991;2331-2346.
41. W. Zhang, T. Dietterich, A reinforcement learning approach to job shop scheduling, in: Proceedings of the IJCAI-95, Montreal, Quebec, 1995, pp. 1114-1120.