Application of reinforcement learning for agent-based production scheduling

Engineering Applications of Artificial Intelligence

Volumn 18, Issue 1, 2005, Pages 73-82

  Wang, Yi Chi ^a,b   Usher, John M ^a  

^a MISSISSIPPI STATE UNIVERSITY   (United States)

^b KUN SHAN UNIVERSITY   (Taiwan)

Author keywords

Dispatching rule selection; Q learning; Reinforcement learning

Indexed keywords

ALGORITHMS; AUTONOMOUS AGENTS; NUMERICAL CONTROL SYSTEMS; PROBLEM SOLVING; PRODUCTION CONTROL; REINFORCEMENT; SCHEDULING;

DISPATCHING RULE SELECTION; PRODUCTION SCHEDULING; Q-LEARNING; REINFORCEMENT LEARNING (RL);

LEARNING SYSTEMS;

EID: 10844274625     PISSN: 09521976     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.engappai.2004.08.018     Document Type: Article

References (27)

1. Aydin, M.E., Oztemel, E., 2000. Dynamic job-shop scheduling using reinforcement learning agents. Robotics and Autonomous Systems 33, 169-178.
2. Brenner, W., Zarnekow, R., Witting, H., 1998. Intelligent Software Agents. Springer, Berlin, pp. 19-117.
3. Brucker, P., 2001. Scheduling Algorithms. Springer, Berlin.
4. Crites, R.H., Barto, A.G., 1996. Improving elevator performance using reinforcement learning. In: Touretzky, D.S., Mozer, M.C., Hasselmo, M.E. (Eds.), Advances in Neural Information Processing Systems: Proceedings of the 1995 Conference. MIT Press, Cambridge, MA, pp. 1017-1023.
5. Crowe, T.J., Stahlman, E.J., 1995. A proposed structure for distributed shop floor control. Integrated Manufacturing Systems 6 (6), 31-36.
6. Das, T.K., Gosavi, A., Mahadevan, S., Marchalleck, N., 1999. Solving semi-Markov decision problems using average reward reinforcement learning. Management Science 45 (4), 560-574.
7. Dilts, D.M., Boyd, N.P., Whorms, H.H., 1991. The evolution of control architectures for automated manufacturing systems. Journal of Manufacturing Systems 10 (1), 79-93.
8. Duffie, N.A., Prabhu, V.V., 1994. Real-time distributed scheduling of heterarchical manufacturing systems. Journal of Manufacturing Systems 13 (2), 94-107.
9. Mahadevan, S., Kaelbling, L.P., 1996. The NSF Workshop on Reinforcement Learning: Summary and Observations. AI Magazine Winter, 89-97.
10. Mahadevan, S., Theocharous, G., 1998. Optimizing production manufacturing using reinforcement learning. The Eleventh International FLAIRS Conference, AAAI Press, pp. 372-377.
11. Mahadevan, S., Khaleeli, N., Marchalleck, N., 1997a. Designing agent controllers using discrete-event Markov models. AAAI Fall Symposium on Model-Directed Autonomous Systems, MIT, Cambridge.
12. Mahadevan, S., Marchalleck, N., Das, T.K., Gosavi, A., 1997b. Self-improving factory simulation using continuous-time average-reward reinforcement learning. Proceedings of the Fourth International Machine Learning Conference, pp. 202-210.
13. Morton, T.E., Pentico, D.W., 1993. Heuristic Scheduling Systems. Wiley, New York.
14. Murch, R., Johnson, T., 1998. Intelligent Software Agents. Prentice-Hall, Englewood Cliffs, NJ.
15. Panwalkar, S.S., Iskander, W., 1977. A survey of scheduling rules. Operations Research 25 (1), 45-62.
16. Paternina-Arboleda, C.D., Das, T.K., 2001. Intelligent dynamic control policies for serial production lines. IIE Transactions 33, 65-77.
17. Pinedo, M., 1995. Scheduling Theory, Algorithms, and Systems. Prentice-Hall, Englewood Cliffs, NJ.
18. Shen, W., Norrie, D.H., 1999. Agent-based systems for intelligent manufacturing: a state-of-the-art survey. Knowledge and Information Systems: an International Journal 1 (2), 129-156.
19. Shen, W., Norrie, D.H., Barthés, J.-P.A., 2000. Multi-Agent Systems for Concurrent Intelligent Design and Manufacturing. Taylor & Francis, London.
20. Singh, S.P., Bertsekas, D., 1997. Reinforcement learning for dynamic channel allocation in cellular telephone systems. Advances in Neural Information Processing Systems: Proceedings of the 1996 Conference. MIT Press, Cambridge, MA, pp. 974-980.
21. Smith, R., 1980. The contract net protocol: high level communication and control in distributed problem solver. IEEE Transactions on Computers 29 (12), 1104-1113.
22. Sutton, R.S., 1996. Generalization in reinforcement learning: successful examples using spare coarse coding. In: Touretzky, D.S., Mozer, M.C., Hasselmo, M.E. (Eds.), Advances in Neural Information Processing Systems: Proceedings of the 1995 Conference. MIT Press, Cambridge, MA, pp. 1038-1044.
23. Sutton, R.S., Barto, A.G., 1999. Reinforcement Learning: An Introduction. The MIT Press, Cambridge, MA.
24. Tesauro, G., 1995. Temporal difference learning and TD-Gammon. Communications of the ACM 38 (3), 58-67.
25. Watkins, C.J.C.H., Dayan, P., 1992. Q-learning. Machine Learning 8, 279-292.
26. Weiss, G., 1999. Multiagent Systems: A Modern Approach to Distributed Artificial Intelligence. MIT Press, Cambridge, MA.
27. Zhang, W., Dietterich, T.G., 1995. A reinforcement learning approach to job-shop scheduling. Proceedings of the 14th International Joint Conference on Artificial Intelligence, pp. 1114-1120.