Agent learning in autonomic manufacturing execution systems for enterprise networking

Computers and Industrial Engineering

Volumn 63, Issue 4, 2012, Pages 901-925

  Rolón, Milagros ^a   Martínez, Ernesto ^a  

^a El INGAR Instituto de Desarollo y Diseno   (Argentina)

Author keywords

Agent based simulation; Autonomic systems; Distributed production control; Enterprise networking; Manufacturing execution systems; Multi agent learning

Indexed keywords

AGENT BASED SIMULATION; AUTONOMIC SYSTEMS; ENTERPRISE NETWORKING; MANUFACTURING EXECUTION SYSTEM; MULTI-AGENT LEARNING;

BEHAVIORAL RESEARCH; INDUSTRY; LEARNING ALGORITHMS; MANUFACTURE; PRODUCTION CONTROL; REINFORCEMENT LEARNING;

ENGINEERING EDUCATION;

EID: 84868191783     PISSN: 03608352     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.cie.2012.06.004     Document Type: Article

References (75)

1. P. Anussornnitisarn, S. Nof, and O. Etzion Descentralized control of cooperative and autonomous agents for solving the distributed resource allocation problem International Journal of Production Economics 98 2005 114 128 (Pubitemid 41406172)
2. A. Azadegan, and K. Dooley Complexity and the rise of distributed control in operations management SAGE handbook of complexity and management 2010 Sage Publications London (pp. 420-437)
3. M. Bauer, and S. Stoeter Enterprise connectivity Collaborative process automation systems 2010 ISA 1036 1043
4. M. Benaïm, and M. Hirsch Mixed equilibria and dynamical systems arising from fictitious play in perturbed games Games and Economic Behavior 29 1999 36 72
5. P. Blanc, I. Demongodin, and P. Castagna A holonic approach for manufacturing execution system design: An industrial application Engineering Applications of Artificial Intelligence 21 2008 315 330
6. R. Blumenthal Manufacturing execution systems to optimize the pharmaceutical supply chain Pharmind, Pharmazeutische Industrie 11a 2004 1414 1424 (Pubitemid 39611270)
7. C. Brecher Integrative production technology for high-wage countries 2012 Springer-Verlag Berlin, Heidelberg
8. L. Camarinha-Matos Execution system for distributed business processes in a virtual enterprise Future Generation Computer Systems 17 2001 1009 1021 (Pubitemid 32471310)
9. M. Canavesio, and E. Martinez Enterprise modeling of a project-oriented fractal company for SMEs networking Computers in Industry 54 2007 794 813 (Pubitemid 47464644)
10. S. Chaharsoogui, J. Heydari, and S. Zegorki A reinforcement learning model for supply chain ordering management: An application to the beer game Decision Support Systems 45 2008 949 959
11. C. Cheong, and M. Winikoff Improving flexibility and robustness in agent interactions: Extending Prometheus with Hermes Software Engineering for Multi-Agent Systems 6 2006 189 206 (Pubitemid 350253744)
12. Chirn, J.; McFarlane, D. (2000). A component-based approach to the holonic control of a robot assembly cell. In Proceedings of the IEEE 17th international conference on robotics and automation, ICRA 2000.
13. W. Chung, A. Yam, and M. Chan Networking enterprise: A new business model for global sourcing International Journal of Production Economics 87 2004 267 280
14. V. Cicirello, and S. Smith Wasp-like agents for distributed factory coordination Autonomous Agents and Multi-Agent Systems 8 2004 237 266 (Pubitemid 39019799)
15. W. Covanich, and D. McFarlane Assessing ease of reconfiguration of conventional and holonic manufacturing systems: Approach and case study Engineering Applications of Artificial Intelligence 22 7 2009 1015 1024
16. H. ElMaraghy The cognitive factory. In changeable and reconfigurable manufacturing systems (pp. 1015-1024) 2009 Springer London
17. J.M. Epstein Generative social science: Studies in agent-based computational modeling 2006 Princeton University Press Princeton
18. J. Epstein, and R. Axtell Growing artificial societies. Social science from the bottom-up 1996 Brooking Institution Press Washington
19. J. Ferber Multi-agent systems. An introduction to distributed artificial intelligence 1999 Addison-Wesley Boston
20. N. Gilbert Agent-based models 2008 Sage Publications London
21. E. Grant, and R. Leavenworth Control Estadístico de Calidad 1996 Compañía Editorial Continental Mexico D.F.
22. Grossmann, I. (2009). Research challenges in planning and scheduling for enterprise-wide optimization of process industries. In 10th International symposium on process systems engineering: Part A (pp. 15-21).
23. Hadeli, P. Valckenaers, M. Kollingbaumb, and H. Van Brussel Multi-agent coordination and control based on stigmergy Computers in Industry 53 2004 75 96
24. I. Harjunkoski, R. Nyström, and A. Horch Integration of scheduling and control - Theory or practice? Computers and Chemical Engineering 33 12 2009 1909 1918
25. J. Hofbauer, and E. Hopkins Learning in perturbed asymmetric games Games and Economic Behavior 52 2005 133 152 (Pubitemid 40792429)
26. B. Huang A framework for virtual enterprise control with the holonic manufacturing paradigm Computers in Industry 49 3 2002 299 310 (Pubitemid 35411822)
27. IBM Corporation (2006). An architectural blueprint for autonomic computing. < http://www-03.ibm.com/autonomic/pdfs/ AC%20Blueprint%20White%20Paper%20V7.pdf > Accessed 30.05.12.
28. F. Jovane, E. Westkämper, and D. Williams The manufuture road: Towards competitive and sustainable high-adding-value manufacturing 2009 Springer Verlag Berlin
29. Kaihara, T.; Fujii, N, Toide, S.; Ishibashi, H.; Nakano, T. (2010). A proposal of socio-inspired manufacturing scheduling concept and its application into flexible flowshop. In Proceedings of the 43rd CIRP conference on, manufacturing systems (pp. 813-820).
30. J. Kephart, and D.M. Chess The vision of autonomic computing Computer 36 1 2003 41 50
31. T. Kinder Go to the flow - A conceptual framework for supply relations in the era of the extended enterprise Research Policy 2003 503 523
32. J. Kletti Manufacturing execution systems - MES 2007 Springer-Verlag Berlin
33. P. Leitão, A. Colombo, and F. Restivo ADACOR: A collaborative production automation and control architecture IEEE Intelligent Systems 20 2005 58 66 (Pubitemid 40325695)
34. D. Leslie, and E. Collins Individual Q-learning in normal form games SIAM Journal on Control and Optimization 44 2005 495 514
35. K. Mallidi, A. Praskevopoulos, and P. Paganelli Process modelling in small-medium enterprise networks Computers in Industry 38 1999 149 158
36. S. Mannor, and J. Shamma Multi-agent learning for engineers Artificial Intelligence 171 2007 417 422 (Pubitemid 46802418)
37. M. McClellan Applying manufacturing execution systems 2000 McGraw-Hill New York
38. M. McClellan Collaborative manufacturing - Using real-time information to support the supply chain 2003 St. Lucie Press New York
39. H. Meyer, F. Fuchs, and K. Thiel Manufacturing execution systems (MES): Optimal design, planning, and deployment 2009 McGraw-Hill New York
40. I. Mezgár, G. Kovács, and P. Paganelli Co-operative production planning for small- and medium-sized enterprises International Journal of Production Economics 64 2000 37 48 (Pubitemid 30557641)
41. J. Miller, and S. Page Complex adaptive systems: An introduction to computational models of social life 2007 Princeton University Press Princeton
42. F. Nilsson, and V. Darley On complex adaptive systems and agent-based modeling for improved decision-making in manufacturing and logistics settings International Journal of Operations and Production Management 26 2006 1351 1373 (Pubitemid 44505587)
43. M. North, and M. Macal Managing business complexity, discovering strategic solution with agent-based modeling and simulation 2007 Oxford University Press Oxford
44. Rolón, M.; Martinez, E. (2010). Agent-based simulation modeling of an interaction mechanism for detailed design of autonomic manufacturing execution systems. In Proceedings of the 43rd CIRP international conference on, manufacturing systems (pp. 1036-1043).
45. M. Rolón, M. Canavesio, and E. Martinez Agent based modeling and simulation of intelligent distributed scheduling systems Computer Aided Chemical Engineering 26 2009 985 990
46. M. Rolón, and E. Martinez Agent-based modeling and simulation of an autonomic manufacturing execution system Computers in Industry 63 2012 53 78
47. T.C. Schelling Micromotives and macrobehavior 1978 Norton New York
48. Y. Shohan, and K. Leyton-Brown Multiagent systems. Algorithm, game-theoretic and logical foundations 2009 Cambridge University Press New York
49. R. Smith The contract net protocol: High level communication and control in a distributed problem solver IEEE Transactions on Computers C-29 12 1980 1104 1113 (Pubitemid 11460672)
50. R. Sutton, and A. Barto Reinforcement learning: An introduction (pp. 24-49) 1998 The MIT Press Cambridge
51. T. Tran Protecting buying agents in e-marketplaces by direct experience trust modelling Knowledge and Information Systems 22 1 2010 65 100
52. D. Trentesaux Distributed control of production systems Engineering Applications of Artificial Intelligence 22 2009 971 978
53. Ueda, K. (1992). A concept for bionic manufacturing systems based on DNA-type information. In Proceedings of the IFIP TC5/WG5.3 eight international PROLAMAT conference on human aspects in computer integrated manufacturing, B-3 (pp. 853-863).
54. K. Ueda, N. Fujii, and R. Inoue Emergent synthesis approaches to control and planning in make to order manufacturing environments CIRP Annals - Manufacturing Technology 53 1 2004 385 388
55. J. Vaario, and K. Ueda An emergent modelling method for dynamic scheduling Journal of Intelligent Manufacturing 9 2 1998 129 140 (Pubitemid 128517764)
56. Valckenaers, P.; Van Brussel, H.; Saint Germain, B.; Van Belle, J. (2010). Networked manufacturing control: An industrial case. In Proceedings of the 43rd CIRP conference on manufacturing systems (pp. 129-136).
57. P. Valckenaers, and H. Van Brussel Holonic manufacturing execution systems CIRP Annals - Manufacturing Technology 54 1 2005 129 136
58. P. Valckenaers, H. Van Brussel, P. Verstraete, P. Saint Germain, and Hadeli Schedule execution in autonomic manufacturing execution systems Journal of Manufacturing Systems 26 2007 75 84
59. A. Valluri, and D. Croson Agent learning in supplier selection models Decision Support Systems 39 2005 219 240
60. A. Valluri, M. North, and C. Macal Reinforcement learning in supply chains International Journal of Neural Systems 19 5 2009 331 344
61. H. Van Brussel, J. Wyns, P. Valckenaers, and L. Bongaerts Reference architecture for holonic manufacturing systems: PROSA Computers in Industry 37 1998 255 274 (Pubitemid 128419944)
62. S.M. Veres Knowledge of machines: Review and forward look Proceedings of the Institution of Mechanical Engineers. Part I: Journal of Systems and Control Engineering 225 1 2011 3 10
63. F. Vernadata Technical, semantic and organizational issues of enterprise interoperability and networking Annual Reviews in Control 34 2010 139 144
64. Vidal, J. (2010). Fundamentals of multiagent systems with NetLogo examples. Unpublished textbook. < http://www.damas.ift.ulaval.ca/~coursMAS/ ComplementsH10/mas-Vidal.pdf > Accessed 30.05.12.
65. N. Vlassis A concise introduction to multiagent systems and distributed artificial intelligence 2007 Morgan and Claypool Publishers Amsterdam
66. Y. Wang, and J. Usher Application of reinforcement learning for agent-based production scheduling Engineering Applications of Artificial Intelligence 18 2004 73 82
67. H.J. Warnecke The fractal company: A revolution in corporate culture 1993 Springer-Verlag Berlin
68. Watkins, C. (1989). Learning from delayed rewards. PhD thesis. Cambridge University.
69. E. Westkamper, M. Huser, and R. Van Briel Transicion processes: A survey of German industry Journal of Materials Processing Technology 106 2000 141 151 (Pubitemid 32027657)
70. C. White Productivity analysis of a large multiproduct batch processing facility Computers and Chemical Engineering 13 1989 239 245
71. H. Wiendahl, H. ElMaraghy, P. Nyhuis, M. Zäh, H. Wiendahl, and N. Duffie Changeable manufacturing - Classification, design and operation CIRP Annals - Manufacturing Technology 56 2 2007 783 809 (Pubitemid 350122467)
72. Wilensky, U. (1999). Netlogo modeling environment. < http://ccl.northwestern.edu/netlogo/download.shtml > Accessed 30.05.12.
73. J. Wilson Gantt charts: A centenary appreciation European Journal of Operational Research 149 2003 430 437
74. N. Wu, and P. Su Selection of partners in virtual enterprise paradigm Robotics and Computers-Integrated Manufacturing 21 2 2005 119 131
75. W. Xu, Y. Wei, and Y. Fan Virtual enterprise and its intelligence management Computers and Industrial Engineering 42 2002 199 205 (Pubitemid 34410747)