Dynamic scheduling of maintenance tasks in the petroleum industry: A reinforcement approach

Engineering Applications of Artificial Intelligence

Volumn 22, Issue 7, 2009, Pages 1089-1103

  Aissani, N ^a   Beldjilali, B ^a   Trentesaux, D ^b  

^a UNIVERSITY OF ORAN   (Algeria)

^b UNIVERSITÉ DE VALENCIENNES   (France)

Author keywords

Maintenance tasks; Multi agent system; On line scheduling; Petroleum industry; Reinforcement learning

Indexed keywords

CONTINUOUS IMPROVEMENTS; DYNAMIC SCHEDULING; MAINTENANCE SCHEDULING; MAINTENANCE TASKS; MULTI-AGENT APPROACH; ON-LINE SCHEDULING; PRODUCTION EFFICIENCY; PRODUCTION SYSTEM; SAFETY LEVEL; SARSA ALGORITHM; SOLUTION QUALITY;

COMPUTER SIMULATION; DISTRIBUTED PARAMETER CONTROL SYSTEMS; EDUCATION; LEARNING ALGORITHMS; MAINTAINABILITY; MULTI AGENT SYSTEMS; MULTITASKING; PETROLEUM REFINERIES; PRODUCTION ENGINEERING; REINFORCEMENT; REINFORCEMENT LEARNING; SCHEDULING ALGORITHMS;

PETROLEUM INDUSTRY;

EID: 70149084778     PISSN: 09521976     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.engappai.2009.01.014     Document Type: Article

References (49)

1. Agre, P.E., 1988. The dynamic structure of everyday life. Ph.D. Thesis, Massachusetts Institute of Technology Cambridge (MIT) Artificial Intelligence Lab.
2. Aissani, N., Trentesaux, D., Beldjilali, B., 2008. Efficient and effective reactive scheduling of manufacturing system using SARSA-multi-objective-agents. In: Lamouri, S.Et., Thomas, A., Artiba, A.Et., Vernadat, F. (Eds.), MOSIM'08: Seventh International Conference on Modelisation & Simulation. Tec&Doc, Lavoisier, pp. 698-707.
3. Albadawi Z., Boulet B., DiRaddo R., Girard P., Rail A., and Thomson V. Agent-based control of manufacturing processes. International Journal of Manufacturing Research (IJMR) 1 4 (2006) 466-481
4. Barlow R.E., and Hunter L.C. Optimal preventive maintenance policies. Operations Research Journal 8 (1960) 90-100
5. Bidot, J., Vidal, T., Laborie, P., Beck, J.C., 2007. A general framework for scheduling in a stochastic environment. In: Proceedings of the International Joint Conference on Artificial Intelligence IJICAI07, pp. 56-61.
6. Bousbia, S., Trentesaux, D., 2002. Self-organization in distributed manufacturing control: state-of-the-art and future trends. In: IEEE International Conference on Systems, Man & Cybernetics, Hammamet, Tunisia, vol. 5, 6pp.
7. Bousbia, S., Trentesaux, D., 2004. Towards an intelligent heterarchical manufacturing control system for continuous improvement of manufacturing systems performances. In: Fifth International Conference on Integrated Design and Manufacturing in Mechanical Engineering-IDMME'2004, University of Bath, UK, April 2004, Paper #123, 10pp.
8. Cavory G., Dupas R., and Goncalves G. A genetic approach to the scheduling of preventive maintenance tasks on a single product manufacturing production line. International Journal of Production Economics 74 (2001) 135-146
9. Chan F.T.S., Lau H.C.W., Ip R.W.L., Chan H.K., and Kong S. Implementation of total productive maintenance: a case study. International Journal of Production Economics 95 1 (2005) 71-94
10. Chana F.T.S., Chunga S.H., Chana L.Y., Finkeb G., and Tiwaric M.K. Solving distributed FMS scheduling problems subject to maintenance: genetic algorithms approach. Robotics and Computer-Integrated Manufacturing 22 (2006) 493-504
11. Charton, R., Boyer, A., Charpillet, F., 2003. Learning of mediation strategies for heterogeneous agents cooperation. In: Werner, B. (Ed.), 15th IEEE International Conference on Tools with Artificial Intelligence-ICTAI'2003, Sacramento, CA, USA, IEEE Computer Society, pp. 330-337.
12. Chelbi A., and Ait-Kadi D. Joint optimal buffer inventory and preventive maintenance strategy for a randomly failing production unit. Journal of Decision Systems 12 (2003) 21-30
13. Chelbia A., and Rezgin N. Analysis of a production/inventory system with randomly failing production unit subjected to a minimum required availability level. International Journal of Production Economics 9 (2006) 131-143
14. Chen R., Lu K., and Chang C. Application of the multi-agent approach in just-in-time production control system. International Journal of Computer Applications in Technology (IJCAT) 17 2 (2003) 90-100
15. Choy M.C., Cheu R.L., Srinivasan D., and Logi F. Real-time coordinated signal control through use of agents with online reinforcement learning. Transportation Research Board 1836 (2003) 64-75
16. Csaji, B.C., Monostori, L., 2006. Adaptive algorithms in distributed resource allocation. In: Proceedings of the Sixth International Workshop on Emergent Synthesis (IWES-06), August 18-19, The University of Tokyo, Japan, pp. 69-75.
17. Dongbing G., and Yang E. Fuzzy policy reinforcement learning in cooperative multi-robot systems. Journal of Intelligent and Robotic Systems 48 1 (2007) 7-22
18. Dossier special Algérie/Special Issue on the Petroleum Industry in Algery (2nd part), 2002. Pétrole et techniques, No. 440 (in French).
19. Ferber, J., Gutknecht, O., 1998. Un méta-modèle organisationnel pour l'analyse, la conception et l'execution de systèmes multi-agents. In: Proceedings of Third International Conference on Multi-Agent Systems ICMAS'98, pp. 128-135.
20. Gang Q., Greenwood G.W., Donglin L., and Sharon H. Searching for multi-objective preventive maintenance schedules: combining preferences with evolutionary algorithms. European Journal of Operational Research 177 3 (2007) 1969-1984
21. Humphrys, M., 1996. Action selection methods using reinforcement learning. In: Proceedings of the Fourth ICSAB'96, International Conference on Simulation of Adaptive Behavior, pp. 135-144.
22. Haruno M., and Kawato M. Heterarchical reinforcement-learning model for integration of multiple cortico-striatal loops: FMRI examination in stimulus-action-reward association learning. Neural Networks 19 Special Issue (2006) 1242-1254
23. Katalinic, B., Kordic, V., 2004. Bionic assembly system: concept, structure and function. In: the Fifth International Conference on Integrated Design and Manufacturing in Mechanical Engineering, IDMME 2004, Bath, UK, April 5-7, 2004.
24. Kenne J.P., and Boukas E.K. Hierarchical control of production and maintenance rates in manufacturing systems. Journal of Quality in Maintenance Engineering 9 1 (2003) 66-82
25. Kenne J.P., and Gharbib A. Stohastic optimal production control problem with corrective maintenance. Computers & Industrial Engineering 46 (2004) 865-875
26. Leitao P., and Restivo F. A holonic approach to dynamic manufacturing scheduling. Robotics and Computer-Integrated Manufacturing 24 (2008) 625-634
27. Le Quéré Y., Sevaux M., Tahon C., and Trentesaux D. Reactive scheduling of complex system maintenance in a cooperative environment with communication times. IEEE Transactions on Systems, Man & Cybernetics, Part C: Applications and Reviews 33 2 (2003) 225-234
28. Marthi, B., Russell, S., Latham, D., Guestrin, C., 2005. Concurrent hierarchical reinforcement learning. In: International Joint Conference on Artificial Intelligence, IJCAI-05, pp. 779-785.
29. McCulloch W.S. A heterarchy of values determined by the topology of nervous nets. Bulletin of Mathematical Biophysics 7 (1945) 89-93
30. Meller R.D., and Kim D.S. The impact of preventive maintenance on system cost and buffer size. European Journal of Operational Research 95 (1996) 577-591
31. Prabhu V.V. Stability and fault adaptation in distributed control of heterarchical manufacturing job shops. IEEE Transactions on Robotics and Automation 19 1 (2003) 142-147
32. Priore P., De la Fuente D., Puente J., and Parreno J. A comparison of machine-learning algorithms for dynamic scheduling of flexible manufacturing systems. Engineering Applications of Artificial Intelligence 19 (2006) 247-255
33. Pujo, P., Brun-Picard, D., 2002. Pilotage sans plan prévisionnel ni ordonnancement préalable. Méthodes du pilotage des systèmes de production, Hermès, 2002, pp. 129-162.
34. Retour D., Bouche M., and et Plauchu V. Où va la maintenance industrielle. Problèmes Économiques 2.159 (1990) 7-13
35. Ruiz R., García-Díaz J.C., and Maroto C. Considering scheduling and preventive maintenance in the flowshop sequencing problem. Computers & Operations Research 11 34 (2007) 3314-3330
36. Russell, S., Norvig, P., 1995. Artificial intelligence: a modern approach. The Intelligent Agent Book, 1995, Prentice-Hall Series in Artificial Intelligence.
37. Sallez Y., Trentesaux D., Berger T., and Tahon C. Product-based and resource-based heterarchical approaches for dynamic FMS scheduling. Computer and Industrial Engineering 46 (2004) 611-623
38. Shen W., Wang L., and Hao Q. Agent-based distributed manufacturing process planning and scheduling: a state-of-the-art survey. IEEE Transactions on Systems, Man, and Cybernetics Part C: Applications and Reviews 36 4 (2006) 563-577
39. Singh S., and Sutton R. Reinforcement learning with replacing eligibility traces. Machine Learning 22 (1996) 1-3
40. Sortrakul N., Nachtmann H.L., and Cassady C.R. Computers in Industry 56 (2005) 161-168
41. Smith R.G. The Contract Net Protocol: high-level communication and control in a distributed problem solver. IEEE Transactions on Computers C 29 12 (1980) 1104-1113
42. Sprague, N., Ballard, D., 2003. Multiple goal reinforcement learning with modular Sarsa(0). In: International Joint Conference on Artificial Intelligence IJCAI, 2003.
43. Trentesaux D., Dindeleux R., and Tahon C. A multicriteria decision support system for dynamic task allocation in a distributed production activity control structure. International Journal of Computer Integrated Manufacturing 11 1 (1998) 3-17
44. Trentesaux D., Pesin P., and Tahon C. Distributed artificial intelligence for FMS scheduling, control and design support. Journal of Intelligent Manufacturing 11 6 (2000) 573-589
45. Valdez-Flores C., and Feldman R.M. A survey of preventive maintenance models for stochastically deteriorating single-unit systems. Naval Research Logistics 36 (1989) 419-446
46. Van Brussel H., Wyns J., Valckenaers P., Bongaerts L., and Peeters L. Reference architecture for holonic manufacturing systems: PROSA. Computers in Industry 37 3 (1998) 255-274
47. Van der Duyn Schouen F.A., and Vanneste S.G. Maintenance optimization of a production system with buffer capacity. European Journal of Operational Research 82 2 (1995) 323-338
48. Wang, J.H., 1999. Scheduling shipboard maintenance tasks using genetic algorithms and a heuristic method. Degree of Master of Science, Mississippi State University.
49. Watkins, C.J.C.H., 1989. Learning from delayed rewards. Ph.D. Thesis, Cambridge University, Cambridge, England.