Manufacturing scheduling in decentralised holonic systems using artificial intelligence techniques

International Journal of Manufacturing Technology and Management

Volumn 11, Issue 3-4, 2007, Pages 389-410

  Babiceanu, Radu F ^a   Chen, F Frank ^b  

^a University of Arkansas at Little Rock ^*  (United States)

^b The University of Texas at San Antonio   (United States)

Author keywords

Artificial Intelligence (AI); Best first search algorithm; Decentralised scheduling; Holonic systems; Reinforcement Learning (RL)

Indexed keywords

DECISION MAKING; GLOBAL OPTIMIZATION; HEURISTIC ALGORITHMS; LEARNING ALGORITHMS; REINFORCEMENT LEARNING; SCHEDULING;

BEST-FIRST SEARCH ALGORITHMS; DECENTRALISED SCHEDULING; HOLONIC SYSTEMS;

ARTIFICIAL INTELLIGENCE;

EID: 34249793979     PISSN: 13682148     EISSN: None     Source Type: Journal    
DOI: 10.1504/IJMTM.2007.013327     Document Type: Article

References (27)

1. Alonso, E., d'Inverno, M., Kudenko, D., Luck, M. and Noble, J. (2001) 'Learning in multi-agent systems', The Knowledge Engineering Review, Vol. 16, No. 3, pp.277-284.
2. Aydin, M.E. and Oztemel, E. (2000) 'Dynamic job-shop scheduling using reinforcement learning agents', Robotics and Autonomous Systems, Vol. 33, pp.169-178.
3. Babiceanu, R.F., Chen, F.F. and Sturges, R.H. (2004) 'Framework for the control of automated material-handling systems using the holonic manufacturing approach', International Journal of Production Research, Vol. 42, No. 17, pp.3551-3564.
4. Babiceanu, R.F., Chen, F.F. and Sturges, R.H. (2005a) 'The influence of material handling operations on the schedule makespan in manufacturing cell environments', Transactions of NAMRI/SME, Vol. 33, pp.195-202.
5. Babiceanu, R.F., Chen, F.F. and Sturges, R.H. (2005b) 'Real-time holonic scheduling of material handling operations in a dynamic manufacturing environment', Robotics and Computer-Integrated Manufacturing, Vol. 21, Nos. 4/5, pp.328-337.
6. Barto A.G. and Dietterich T.G. (2004) 'Reinforcement learning and its relationship to supervised learning', in J. Si, A.G. Barto, W.B. Powell and D. Wunsch II (Eds). Handbook of Learning and Approximate Dynamic Programming, Institute of Electrical and Electronics Engineers, Inc., pp.47-63.
7. Cardon, A., Galinho, T. and Vacher, J-P. (2000) 'Genetic algorithms using multi-objectives in a multi-agent system", Robotics and Autonomous Systems, Vol. 33, pp.179-190.
8. Claus, C. and Boutilier, C. (1998) The dynamics of reinforcement learning in cooperative multi-agent systems', Proceedings of the 15th National Conference on Artificial Intelligence, AAAI-98.
9. d'Inverno, M. and Luck, M. (2001) Understanding Agent Systems, Berlin: Springer-Verlag.
10. Heragu, S.S., Graves, R.J., Kim, B-I. and St. Onge, A. (2002) 'Intelligent agent based framework for manufacturing systems control', IEEE Transactions on Systems, Man, and Cybernetics-Part A: Systems and Humans, Vol. 32, No. 5, pp.560-573.
11. Kim, B-Y., Heragu, S.S., Graves, R.J. and St. Onge, A. (2004) 'Intelligent agent based control for warehouse control', Proceedings of the IEEE 37th Hawaii International Conference on System Sciences, pp. 1-10.
12. Kretchmar, R.M. (2002) 'Parallel reinforcement learning', Proceedings of the Sixth World Conference on Systemics, Cybernetics, and Informatics, Orlando, FL.
13. Marik, V. and Pechoucek, M. (2001) 'Holons and agents: recent developments and mutual impacts', Twelfth International Workshop on Database and Expert Systems Applications, IEEE Computer Society, pp.605-607.
14. Marik, V., Pechoucek, M., Vrba, P. and Hrdonka, V. (2003) 'FIPA standards and holonic manufacturing', in S.M. Deen (Ed). Agent-Based Manufacturing: Advances in the Holonic Approach, Berlin: Springer-Verlag, pp.89-119.
15. Meystel, A.M. and Albus, J.S. (2002) Intelligent Systems, Architecture, Design and Control, New York: John Wiley & Sons, Inc.
16. Russell, S.J. and Norvig, P. (2003) Artificial Intelligence: A Modern Approach, 2nd edition, Upper Saddle River, NJ: Pearson Education, Inc.
17. Pendharkar, P.C. (1999) 'A computational study on design and performance issues of multi-agent intelligent systems for dynamic scheduling environments', Expert Systems with Applications, Vol. 16, pp. 121-133.
18. Pinedo, M. (2002) Scheduling Theory, Algorithms, and Systems, Inc., Upper Saddle River, NJ: Prentice-Hall.
19. Sallans, H. and Hinton, G. (2001) 'Using free energies to represent q-values in a multi-agent reinforcement learning task', Advances in Neural Information Processing Systems, Vol. 13, MIT Press.
20. Smith, R.G. (1980) "The contract net protocol: high-level communication and control in a distributed problem solver', IEEE Transactions on Computers, Vol. C-29, No. 12, pp.1104-1113.
21. Sun, J. and Xue, D. (2001) 'A dynamic reactive scheduling mechanism for responding to changes of production orders and manufacturing resources', Computers in Industry, Vol. 46, pp. 189-207.
22. Sutton, R.S. and Barto, A.C. (1998) Reinforcement Learning; An Introduction, Bradford Books, Cambridge, MA: MIT Press.
23. Vrba, P. and Hrdonka, V. (2001) 'Material handling problem: FIPA compliant agent implementation', Proceedings of the 12th International Workshop on Database and Expert Systems Applications, pp.635-639.
24. Wang, Y-C. and Usher, J.M. (2004) 'A reinforcement learning approach for developing routing policies in multi-agent production scheduling', Proceedings of the 2004 Industrial Engineering Research Conference, Houston, TX.
25. Weiss, G. (1996) 'Adaptation and learning in multi-agent systems: some remarks and a bibliography', in G. Weiss and S. Sen (Ed). Adaptation and Learning in Multi-Agent Systems, Springer-Verlag.
26. Zhang, W. and Dietterich, T.G. (1995) 'A reinforcement learning approach to job-shop scheduling', Proceedings of the 14th International Joint Conference on Artificial Intelligence, pp.1114-1120.
27. Zhang, W. and Dietterich, T.G. (1996) 'High-performance job-shop scheduling with a time-delay TD(A.) network', Advances in Neural Information Processing Systems: Proceedings of the 1995 Conference, Cambridge, MA: MIT Press, pp. 1024-1030.