Discrete Event Simulation and Virtual Reality Use in Industry: New Opportunities and Future Trends

IEEE Transactions on Human-Machine Systems

Volumn 46, Issue 6, 2016, Pages 882-894

  Turner, Christopher J ^a   Hutabarat, Windo ^a   Oyekan, John ^a   Tiwari, Ashutosh ^a  

^a CRANFIELD UNIVERSITY   (United Kingdom)

Author keywords

Augmented reality (AR); computer simulation; human computer interaction; virtual reality (VR)

Indexed keywords

DATA VISUALIZATION; DECISION MAKING; DISCRETE EVENT SIMULATION; GESTURE RECOGNITION; IMAGE PROCESSING; INDUSTRIAL RESEARCH; MANUFACTURING DATA PROCESSING; VIRTUAL REALITY;

CURRENT LIMITATION; DESIGN CONSIDERATIONS; DIGITAL MANUFACTURING; FUTURE RESEARCH DIRECTIONS; INTERACTIVE SIMULATIONS; REAL TIME INTEGRATION; REAL-TIME DATA STREAMS; STATE OF THE ART;

BIG DATA;

EID: 84983087848     PISSN: 21682291     EISSN: None     Source Type: Journal    
DOI: 10.1109/THMS.2016.2596099     Document Type: Article

References (100)

1. J. Akpan and R. J. Brooks, "Practitioners' perception of the impacts of virtual reality on discrete-event simulation," in Proc.Winter Simul. Conf., 2005, pp. 1976-198.
2. G. Fishman, Discrete-Event Simulation: Modeling, Programming, and Analysis. Heidelberg, Germany: Springer, 2013.
3. G. C. Burdea and P. Coiffet, Virtual Reality Technology, vol. 1. New York, NY, USA: Wiley, 2003.
4. T. Mazuryk and M. Gervautz, "Virtual reality history, applications, technology and future," Inst. Comput. Graph. Algorithms, Vienna Univ. Technol., Vienna, Austria, Tech. Rep. TR-186-2-96-06, 1996.
5. E. H. Page and R. Smith, "Introduction to military training simulation: A guide for discrete event simulationists," in Proc. 30th Winter Simul. Conf., 1998, pp. 53-60.
6. J. J. Kelsick and J.M. Vance, "The VR factory: Discrete event simulation implemented in a virtual environment," presented at the ASME Design Eng. Tech. Conf./Design Manuf., Atlanta, GA, USA, Sep. 1998.
7. P. Waurzyniak, "Visualizing manufacturing," Manuf. Eng., vol. 142, no. 6, p. 41, 2009.
8. R. Steffan, U. Schull, and T. Kuhlen, "Integration of virtual reality based assembly simulation into CAD/CAM environments," in Proc. 24th Annu. Conf. IEEE Ind. Electron. Soc., 1998, vol. 4, pp. 2535-2537.
9. M. C. Leu, "CAD model based virtual assembly simulation, planning and training," CIRP Ann., Manuf. Technol., vol. 62, no. 2, pp. 799-822, 2013.
10. T. Kim, J. Lee, and P. Fishwick, "A two-stage modeling and simulation process for web-based modeling and simulation," ACM Trans. Model. Comput. Simul., vol. 12, no. 3, pp. 230-248, 2002.
11. P. A. Fishwick, "RUBE: An XML-based architecture for 3D process modeling and model fusion," Proc. SPIE, vol. 4716, pp. 330-335, 2002.
12. A. P. Waller and J. Ladbrook, "Virtual worlds: Experiencing virtual factories of the future," in Proc. 34th Winter Simul. Conf.: Exploring New Frontiers, 2002, pp. 513-517.
13. J. Kelsick, J. M. Vance, L. Buhr, and C. Moller, "Discrete event simulation implemented in a virtual environment," J. Mech. Design, vol. 125, no. 3, pp. 428-433, 2003.
14. E. Freund and M. Schluse, "Object oriented discrete event based simulation and control of complex 3D systems," in Proc. IEEE Conf. Robot. Autom. Mechatronics, 2004, vol. 2, pp. 863-868.
15. Y. Zhong and B. Shirinzadeh, "Virtual factory for manufacturing process visualization," Complexity Int., vol. 12, pp. 1-22, 2005.
16. W. Dangelmaier, K. Mahajan, D. Huber, and B. Mueck, "A two-tier method for evaluating alternative policies to support interactive analysis of 3D material flow simulations," in Proc. Winter Simul. Conf., 2005, p. 10.
17. P. Cunha, J. DionÍsio, and E. Henriques, "An architecture to support the manufacturing system design and planning," Int. J. Comput. Integr. Manuf., vol. 16, pp. 605-612, 2003.
18. A. Lektauers, "A mixed reality framework for visualization and execution of DEVS-based simulation models," in Proc. 19th Eur. Conf. Model. Simul., 2005, pp. 1-4.
19. S. Robinson, "Discrete-event simulation: From the pioneers to the present, what next?" J. Oper. Res. Soc., vol. 56, no. 6, pp. 619-629, 2005.
20. S. Nielebock, F. Ortmeier, M. Schumann, and A.Winge, "From discrete event simulation to virtual reality environments," in Computer Safety, Reliability, and Security. Berlin, Germany: Springer, 2012, pp. 508-516.
21. M. Fumarola, M. Seck, and A. Verbraeck, "An approach for loosely coupled discrete event simulation models and animation components," in Proc. Winter Simul. Conf., 2010, pp. 2161-2170.
22. P. V. Rekapalli, J. C. Martínez, and V. R. Kamat, "Algorithm for accurate three-dimensional scene graph updates in high-speed animations of previously simulated construction operations," Comput.-Aided Civil Infrastructure Eng., vol. 24, no. 3, pp. 186-198, 2009.
23. P. V. Rekapalli and J. C. Martinez, "Discrete-event simulation-based virtual reality environments for construction operations: Technology introduction," J. Construction Eng. Manage., vol. 137, no. 3, pp. 214-224, 2010.
24. P. V. Rekapalli and J. C. Martinez, "Time advance synchronization in concurrent discrete-event simulation and animation of construction operations," presented at the 11th Int. Conf. Civil, Struct., Environ. Eng. Comput., Stirling, U.K., 2007.
25. P. V. Rekapalli and J. C. Martinez, "Gaming perspective based visual interactive simulation for validation of simulated construction operations," in Proc. Int. Workshop Comput. Civil Eng., 2007, pp. 435-442.
26. P. V. Rekapalli, "Discrete event simulation based virtual reality environments for construction operations," Ph.D. dissertation, Sch. Civil Eng., Purdue Univ., West Lafayette, IN, USA, 2008.
27. J. Akpan and R. J. Brooks, "Practitioners' perception of the impacts of virtual reality on discrete-event simulation," in Proc.Winter Simul. Conf., 2005, p. 9.
28. I. J. Akpan and R. J. Brooks, "Users' perceptions of the relative costs and benefits of 2D and 3D visual displays in discrete-event simulation," Simulation, vol. 88, no. 4, pp. 464-480, 2012.
29. S. Jain, N. F. Choong, K. M. Aye, and M. Luo, "Virtual factory: An integrated approach to manufacturing systems modeling," Int. J. Oper. Prod. Manage., vol. 21, nos. 5/6, pp. 594-608, 2001.
30. M. C. F. Souza, M. Sacco, and A. J. V. Porto, "Virtual manufacturing as a way for the factory of the future," J. Intell. Manuf., vol. 17, no. 6, pp. 725-735, 2006.
31. T. Tolio, M. Sacco, W. Terkaj, and M. Urgo, "Virtual factory: An integrated framework for manufacturing systems design and analysis," Procedia CIRP, vol. 7, pp. 25-30, 2013.
32. L. Xu, P. de Vrieze, and L. Wei, "Supporting interoperability of virtual factories," in Collaborative Systems for Smart Networked Environments. Berlin, Germany: Springer, 2014, pp. 510-517.
33. S. Jain and G. Shao, "Virtual factory revisited for manufacturing data analytics," in Proc. Winter Simul. Conf., 2014, pp. 887-898.
34. B.Kádár,W. Terkaj, andM. Sacco, "SemanticVirtual Factory supporting interoperable modelling and evaluation of production systems," CIRP Ann., Manuf. Technol., vol. 62, no. 1, pp. 443-446, 2013.
35. S. Choi, K. Jung, and S. D. Noh, "Virtual reality applications in manufacturing industries: Past research, present findings, and future directions," Concurrent Eng., vol. 23, no. 1, pp. 40-63, 2015.
36. J. L. Bijl and C. A. Boer, "Advanced 3D visualization for simulation using game technology," in Proc. Winter Simul. Conf., 2011, pp. 2815-2826.
37. B. Y. Ren and T. Guan, "Research on Real-time interactive simulation for concrete dam construction process based on vega," Appl. Mech. Mater., vol. 256, pp. 2849-2853, 2013.
38. U. Ghani, R. Monfared, and R. Harrison, "Real time energy consumption analysis for manufacturing systems using integrative virtual and discrete event simulation," Int. J. Energy Eng., vol. 2, no. 3, pp. 69-73, 2012.
39. U. Ghani, R. Monfared, and R. Harrison, "Integration approach to virtual-driven discrete event simulation for manufacturing systems," Int. J. Comput. Integr. Manuf., vol. 28, no. 8, pp. 1-17, 2015.
40. D. V. Dorozhkin, J. M. Vance, G. D. Rehn, andM. Lemessi, "Coupling of interactive manufacturing operations simulation and immersive virtual reality," Virtual Reality, vol. 16, no. 1, pp. 15-23, 2012.
41. R. Akhavian and A. H. Behzadan, "An integrated data collection and analysis framework for remote monitoring and planning of construction operations," Adv. Eng. Informat., vol. 26, no. 4, pp. 749-761, 2012.
42. N. S. S. Hamid, F. A. Aziz, and A. Azizi, "Virtual reality applications in manufacturing system," in Proc. Sci. Inf. Conf., 2014, pp. 1034-1037.
43. S. Nielebock, F. Ortmeier, M. Schumann, and A.Winge, "From discrete event simulation to virtual reality environments," in Computer Safety, Reliability, and Security. Berlin, Germany: Springer, 2012, pp. 508-516.
44. P. Milgram and F. Kishino, "A taxonomy of mixed reality visual displays," IEICE Trans. Inf. Syst., vol. 77, no. 12, pp. 1321-1329, 1994.
45. S. K. Ong, M. L. Yuan, and A. Y. C. Nee, "Augmented reality applications in manufacturing: A survey," Int. J. Prod. Res., vol. 46, no. 10, pp. 2707-2742, 2008.
46. A. H. Behzadan, S. Dong, and V. R. Kamat, "Mobile and pervasive construction visualization using outdoor augmented reality," in Mobile and Pervasive Computing in Construction, C. J. Anumba and X. Wang, Eds. Oxford, U.K.: Wiley-Blackwell, 2012, pp. 54-85.
47. A. H. Behzadan and V. R. Kamat, "Enabling smooth and scalable dynamic 3D visualization of discrete-event construction simulations in outdoor augmented reality," in Proc. 39th Winter Simul. Conf., 2007, pp. 2168-2176.
48. H. M. Chen and P. H. Huang, "3D AR-based modeling for discrete-event simulation of transport operations in construction," Autom. Construction, vol. 33, pp. 123-136, 2013.
49. M. Back, "The virtual chocolate factory: Building a real world mixedreality system for industrial collaboration and control," in Proc. IEEE Int. Conf. Multimedia Expo, Jul. 19-23, 2010, pp. 1160-1165.
50. P. F. Casas, X. Pi, J. Casanovas, and J. Jové, "Definition of virtual reality simulation models using specification and description language diagrams," in Proc. 16th Int. SDL Forum, 2013, pp. 258-274.
51. A. Sawhney, A. Mund, and J. Koczenasz, "Internet-based interactive construction management learning system," J. Construction Edu., vol. 6, no. 3, pp. 124-138, 2001.
52. K. Gajananan, A. Nantes, M. Miska, A. Nakasone, and H. Prendinger, "An experimental space for conducting controlled driving behavior studies based on a multiuser networked 3D virtual environment and the scenario markup language," IEEE Trans. Human-Mach. Syst., vol. 43, no. 4, pp. 345-358, Jul. 2013.
53. R. Radkowski and M. Hilus, "Unified modeling language to enhance the specification of discrete event systems for virtual reality applications," in Proc. ASME World Conf. Innovative Virtual Reality, 2011, pp. 31-40.
54. J. Rossmann, M. Schluse, and R. Waspe, "Creating hybrid simulation systems using a flexible meta data approach," in Simulation Modeling Methodologies, Technologies and Applications. New York, NY, USA: Springer, 2015, pp. 23-36.
55. E. Lindskog, J. Berglund, J. Vallhagen, R. Berlin, and B. Johansson, "Combining point cloud technologies with discrete event simulation," in Proc. Winter Simul. Conf., 2012, p. 281.
56. U. Gurevich and R. Sacks, "Examination of the effects of a KanBIM production control system on subcontractors' task selections in interior works," Autom. Construction, vol. 37, pp. 81-87, 2014.
57. R. Sacks, U. Gurevich, and B. Belaciano, "Hybrid discrete event simulation and virtual reality experimental setup for construction management research," J. Comput. Civil Eng., vol. 29, no. 1, pp. 04014029-1-04014029-9, 2015
58. B. Kádár, A. Pfeiffer, and L. Monostori, "Building agent-based systems in a discrete-event simulation environment," in Multi-Agent Systems and Applications IV. Berlin, Germany: Springer, 2005, pp. 595-599.
59. I. Cho, X. Wang, and Z. J. Wartell, "HyFinBall: A two-handed, hybrid 2D/3D desktop VR interface for multi-dimensional visualization," Proc. SPIE, vol. 9017, p. 90170E, 2014.
60. T. Skripcak, P. Tanuska, U. Konrad, and N. Schmeisser, "Toward nonconventional human-machine interfaces for supervisory plant process monitoring," IEEE Trans. Human-Mach. Syst., vol. 43, no. 5, pp. 437-450, Sep. 2013.
61. J. G. Richards, "The measurement of human motion: A comparison of commercially available systems," Human Movement Sci., vol. 18, no. 5, pp. 589-602, 1999.
62. Oculus Rift. 2015. [Online]. Available: https://www.oculus.com/enus/ rift/. Accessed on: Feb. 9, 2016.
63. Sixense STEM: Wireless Motion Tracking System. 2015. [Online]. Available: http://sixense.com/wireless/. Accessed on Feb. 9, 2016.
64. Xsens: Inertial Motion Tracking. 2015. [Online]. Available: https://www.xsens.com/products/. Accessed on: Feb. 9, 2016.
65. Perception Neuron: Inertial Motion Tracking. 2015. Accessed on Feb. 9, 2016. [Online]. Available: https://neuronmocap.com/
66. Y. Liu and Y. Zhang, "Toward welding robot with human knowledge: A remotely-controlled approach," IEEE Trans. Autom. Sci. Eng., vol. 12, no. 2, pp. 769-774, Apr. 2015.
67. E. Vogiatzaki and A. Krukowski, "Virtual reality gaming with immersive user interfaces," in Modern Stroke Rehabilitation through e-Health-based Entertainment. New York, NY, USA: Springer, 2016, pp. 195-214.
68. M. Sacco, S. Mottura, G. Viganò, A. Avai, and C. R. Boër, "Tools for the innovation: Virtual reality and discrete events simulation to build the 2000 factory," in Proc. Int. Conf. Adv. Manuf. Syst. Manuf. Autom., Guangzhou, China, 2000, pp. 19-22.
69. B. Bick, M. Kampker, G. Starke, and M. Weyrich, "Realistic 3Dvisualisation of manufacturing systems based on data of a discrete event simulation," in Proc. 24th Annu. Conf. IEEE Ind. Electron. Soc., 1998, vol. 4, pp. 2543-2548.
70. E. A. Orady, T. A. Osman, and C. P. Bailo, "Virtual reality software for robotics and manufacturing cell simulation," Comput. Ind. Eng., vol. 33, no. 1, pp. 87-90, 1997.
71. K. Vasudevan and Y. J. Son, "Concurrent consideration of evacuation safety and productivity in manufacturing facility planning using multiparadigm simulations," Comput. Ind. Eng., vol. 61, no. 4, pp. 1135-1148, 2011.
72. G. Alves, J. Roßmann, and R. Wischnewski, "A discrete-eventsimulation approach for logistic systems with real time resource routing and VR integration," World Acad. Sci., Eng. Technol., vol. 58, pp. 821-826, 2009.
73. W. P. Dong, H. H. Zhu, and X. J. Li, "GIS-based visual simulation of the underground transformer substation construction," in Proc. 6th Int. Conf. Adv. Opt. Mater. Devices, 2008, p. 714311.
74. F. Lambiase and A. Lambiase, "An integrated approach to the analysis of automotive assembly activities using digital manufacturing tools," Int. J. Internet Manuf. Serv., vol. 1, no. 2, pp. 160-175, 2008.
75. L. Whitman, V. Madhavan, D. Malzahn, J. Twomey, and K. Krishnan, "Using virtual reality to address competency gaps," in Proc. Amer. Soc. Eng. Edu. Annu. Conf. Expo., 2002, pp. 7.1285.1-7.1285.11.
76. V. R. Kamat and J. C. Martinez, "Dynamic three-dimensional visualization of fluid construction materials," J. Comput. Civil Eng., vol. 18, no. 3, pp. 237-247, 2004.
77. V. R. Kamat and J. C. Martinez, "Automated generation of dynamic, operations level virtual construction scenarios," Electron. J. Inf. Technol. Construction, vol. 8, pp. 65-84, 2003.
78. V. R. Kamat and J. C. Martinez, "Enabling smooth and scalable dynamic 3D visualization of discrete-event construction simulations," in Proc. 33rd Winter Simul. Conf., 2001, pp. 1528-1533.
79. D. Mourtzis, N. Papakostas, D. Mavrikios, S. Makris, and K. Alexopoulos, "The role of simulation in digital manufacturing: Applications and outlook," Int. J. Comput. Integr. Manuf., vol. 28, no. 1, pp. 3-24, 2015.
80. H. Kagermann, J. Helbig, A. Hellinger, and W. Wahlster, "Recommendations for Implementing the Strategic Initiative INDUSTRIE 4.0: Securing the Future of GermanManufacturing Industry," Final Report of the Industrie 4.0 Working Group. Forschungsunion. 2013. Accessed on Feb. 9, 2016. [Online].Available: http://www.acatech.de/fileadmin/user- upload/Baumstruktur-nach-Website/Acatech/root/de/Material-fuer- Sonderseiten/Industrie-4.0/Final-report-Industrie-4.0-accessible.pdf
81. Industrial Internet Consortium. Introduction, 2016. Accessed on Feb. 9, 2016. [Online]. Available: http://www.iiconsortium.org/about-us.htm
82. X. Xu, "From cloud computing to cloud manufacturing," Robot. Comput.-Integr. Manuf., vol. 28, no. 1, pp. 75-86, 2012.
83. D. Mourtzis and M. Doukas, "Design and planning of manufacturing networks for mass customisation and personalisation: Challenges and outlook," Procedia CIRP, vol. 19, pp. 1-13, 2014.
84. D. Wu, D. W. Rosen, L. Wang, and D. Schaefer, "Cloud-based design and manufacturing: A new paradigm in digital manufacturing and design innovation," Comput.-Aided Design, vol. 59, pp. 1-14, 2015.
85. J. Posada et al., "Visual computing as a key enabling technology for industrie 4.0 and industrial internet," IEEE Comput. Graph. Appl., vol. 35, no. 2, pp. 26-40, Mar./Apr. 2015.
86. A. Radziwon, A. Bilberg, M. Bogers, and E. S. Madsen, "The smart factory: Exploring adaptive and flexible manufacturing solutions," Procedia Eng., vol. 69, pp.1184-1190, 2014.
87. T. James, "Smart factories," Eng. Technol., vol. 7, no. 6, pp. 64-67, 2012.
88. S. Robinson, Simulation: The Practice of Model Development and Use. London, U.K.: Palgrave Macmillan, 2014.
89. D. Merfeld, "GE is in a startup state of mind," Res. Technol. Manage., vol. 57, no. 6, pp. 26-32, 2014.
90. H. Chen, A. S. Lee, M. Swift, and J. C. Tang, "3D collaboration method over HoloLensTM and SkypeTM end points," in Proc. 3rd Int.Workshop o Immersive Media Experiences, Oct. 2015, pp. 27-30.
91. E. Uhlemann, "Connected-vehicles applications are emerging [connected vehicles]," IEEE Veh. Technol.Mag., vol. 11, no. 1, pp. 25-96, Mar. 2016.
92. J. C. Roberts, P. D. Ritsos, S. K. Badam, D. Brodbeck, J. Kennedy, and N. Elmqvist, "Visualization beyond the desktop - The next big thing," IEEE Comput. Graph. Appl., vol. 34, no. 6, pp. 26-34, Nov./Dec. 2014, doi:10.1109/MCG.2014.82.
93. S. Webel, M. Olbrich, T. Franke, and J. Keil, "Immersive experience of current and ancient reconstructed cultural attractions," in Proc. Digital Heritage Int. Congr., Oct. 2013, vol. 1, pp. 395-398.
94. J. Orlosky, M. Weber, Y. Gu, D. Sonntag, and S. A. Sosnovsky, "An interactive pedestrian environment simulator for cognitive monitoring and evaluation," in Proc. 20th Int. Conf. Intell. User Interfaces Companion, Mar. 2015, pp. 57-60.
95. T. Hilfert and M. König, "Low-cost virtual reality environment for engineering and construction," Vis. Eng., vol. 4, no. 1, pp. 1-18, 2016, doi:10.1186/s40327-015-0031-5.
96. J. Araullo and L. E. Potter, "Experiences using emerging technology," in Proc. 26th Aust. Comput.-Human Interaction Conf. Designing Futures, Dec. 2014, pp. 523-526.
97. M. Čertický, M. Jakob, and R. Píbil, "Analyzing on-demand mobility services by agent-based simulation," J. Ubiquitous Syst. Pervasive Netw., vol. 6, no. 1, pp. 17-26, 2015.
98. J. Wu, I. Yildirim, J. J. Lim, B. Freeman, and J. Tenenbaum, "Galileo: Perceiving physical object properties by integrating a physics engine with deep learning," in Proc. Adv. Neural Inf. Process. Syst. Conf., 2015, pp. 127-135.
99. V. A. Prabhu, A. Tiwari, W. Hutabarat, and C. Turner, "Capture, digitisation and segmentation of human-workpiece interactions in a manual assembly operation using KinectTM," Int. J. Design Eng., vol. 6, no. 1, pp. 61-85, 2015.
100. K. Lebeck, T. Kohno, and F. Roesner, "How to safely augment reality: Challenges and Directions," in Proc. 17th Int.Workshop Mobile Comput. Syst. Appl., Feb. 2016, pp. 45-50.