A fog computing and cloudlet based augmented reality system for the industry 4.0 shipyard

Sensors (Switzerland)

Volumn 18, Issue 6, 2018, Pages

  Fernández Caramés, Tiago M ^a   Fraga Lamas, Paula ^a   Suárez Albela, Manuel ^a   Vilar Montesinos, Miguel ^b  

^a UNIVERSITY OF A CORUÑA   (Spain)

^b Unidad de Producción de Ferrol   (Spain)

Author keywords

Augmented reality; Cloudlet; Fog computing; IIoT; Industrial augmented reality; Industrial operator support; Industry 4.0; Microsoft HoloLens; Shipyard

Indexed keywords

AUGMENTED REALITY; COMPUTER ARCHITECTURE; FOG; INDUSTRY 4.0; NETWORK ARCHITECTURE; QUALITY CONTROL; SHIPBUILDING; SHIPS; SHIPYARDS;

CLOUDLET; IIOT; INDUSTRIAL AUGMENTED REALITY; MICROSOFT; OPERATOR SUPPORT;

FOG COMPUTING;

ARTICLE; CLOUD COMPUTING; HUMAN;

EID: 85048061167     PISSN: 14248220     EISSN: None     Source Type: Journal    
DOI: 10.3390/s18061798     Document Type: Article

References (70)

1. Fraga-Lamas, P.; Fernández-Caramés, T.M.; Castedo, L. Towards the Internet of Smart Trains: A Review on Industrial IoT-Connected Railways. Sensors 2017, 17, 1457. [CrossRef] [PubMed]
2. Qi, Q.; Tao, F. Digital Twin and Big Data Towards Smart Manufacturing and Industry 4.0: 360 Degree Comparison. IEEE Access 2018, 6, 3585–3593. [CrossRef]
3. Robla-Gómez, S.; Becerra, V.M.; Llata, J.R.; González-Sarabia, E.; Torre-Ferrero, C.; Pérez-Oria, J. Working Together: A Review on Safe Human-Robot Collaboration in Industrial Environments. IEEE Access 2017, 5, 26754–26773. [CrossRef]
4. Fernández-Caramés, T.M.; Fraga-Lamas, P. A Review on Human-Centered IoT-Connected Smart Labels for the Industry 4.0. IEEE Access 2018, accepted. [CrossRef]
5. Hernández-Rojas, D.L.; Fernández-Caramés, T.M.; Fraga-Lamas, P.; Escudero, C.J. Design and Practical Evaluation of a Family of Lightweight Protocols for Heterogeneous Sensing through BLE Beacons in IoT Telemetry Applications. Sensors 2018, 18, 57. [CrossRef] [PubMed]
6. Fraga-Lamas, P. Enabling Technologies and Cyber-Physical Systems for Mission-Critical Scenarios. May 2017. Available online: http://hdl.handle.net/2183/19143 (accessed on 1 May 2018).
7. Blanco-Novoa, O.; Fernández-Caramés, T.M.; Fraga-Lamas, P.; Castedo, L. An Electricity-Price Aware Open-Source Smart Socket for the Internet of Energy. Sensors 2017, 17, 643. [CrossRef] [PubMed]
8. Fraga-Lamas, P.; Fernández-Caramés, T.M.; Suárez-Albela, M.; Castedo, L.; González-López, M. A Review on Internet of Things for Defense and Public Safety. Sensors 2016, 16, 1644. [CrossRef] [PubMed]
9. Fernández-Caramés, T.M.; Fraga-Lamas, P.; Suárez-Albela, M.; Castedo, L. A Methodology for Evaluating Security in Commercial RFID Systems, Radio Frequency Identification. In Radio Frequency Identification, 1st ed.; Crepaldi, P.C., Pimenta, T.C., Eds.; INTECH: Rijeka, Croatia, 2016.
10. Sutherland, I.E. The Ultimate Display. In Proceedings of the IFIP 65, New York, NY, USA, 24–29 May 1965; pp. 506–508.
11. Sutherland, I.E. A head-mounted three dimensional display. In Proceedings of the AFIPS 68, San Francisco, CA, USA, 9–11 December 1968; pp. 757–764.
12. Azuma, R.T. A survey of augmented reality. Presence Teleoperators Virtual Environ. 1997, 6, 355–385. [CrossRef]
13. Wohlgemuth, W.; Triebfürst, G. ARVIKA: Augmented Reality for development, production and service. In Proceedings of the DARE 2000, Elsinore, Denmark, 12–14 April 2000; pp. 151–152.
14. Friedrich, W. ARVIKA-Augmented Reality for Development, Production and Service. In Proceedings of the International Symposium on Mixed and Augmented Reality, Darmstadt, Germany, 1 October 2002; pp. 3–4.
15. Navab, N. Developing Killer Apps for Industrial Augmented Reality. IEEE Comput. Graph. Appl. 2004, 24, 16–20. [CrossRef] [PubMed]
16. Novak-Marcincin, J.; Barna, J.; Janak, M.; Novakova-Marcincinova, L.; Torok, J. Visualization of intelligent assembling process by augmented reality tools application. In Proceedings of the 14th IEEE International Symposium on Logistics and Industrial Informatics, Smolenice, Slovakia, 5–7 September 2012; pp. 33–36.
17. Li, G.; Xi, N.; Chen, H.; Saeed, A. Augmented reality enhanced “top-down” nano-manufacturing. In Proceedings of the 4th IEEE Conference on Nanotechnology, Munich, Germany, 16–19 August 2004; pp. 352–354.
18. Fruend, J.; Grafe, M.; Matysczok, C.; Vienenkoetter, A. AR-based product design in automobile industry. In Proceedings of the First IEEE International Workshop Augmented Reality Toolkit, Darmstadt, Germany, 29 September 2002.
19. Gausenmeier, J.; Matysczok, C.; Radkowski, R. AR-based modular construction system for automobile advance development. In Proceedings of the IEEE International Augmented Reality Toolkit Workshop, Tokyo, Japan, 7 October 2003.
20. Park, H.S.; Choi, H.W.; Park, J.W. Augmented Reality based Cockpit Module Assembly System. In Proceedings of the International Conference on Smart Manufacturing Application, Gyeonggi-do, South Korea, 9–11 April 2008; pp. 130–135.
21. Arumugam, D.D.; Engels, D.W. Characterization of RF Propagation in Helical and Toroidal Metal Pipes for Passive RFID Systems. In Proceedings of the IEEE International Conference on RFID, Las Vegas, NV, USA, 16–17 April 2008; pp. 269–276.
22. Wong, S.F.; Zheng, Y. The effect of metal noise factor to RFID location system. In Proceedings of the IEEE International Conference on Industrial Engineering and Engineering Management, Bangkok, Thailand, 10–13 December 2013; pp. 310–314.
23. Mocanu, B.; Tapu, R.; Petrescu, T.; Tapu, E. A experimental evaluation of 3D mesh decimation techniques. In Proceedings of the International Symposium on Signals, Circuits and Systems, Lasi, Romania, 30 June–1 July 2011; pp. 1–4.
24. Ma, T.; Gong, G.; Yan, J. A 3D model simplification algorithm based on edge-collapse. In Proceedings of the IEEE 10th International Conference on Industrial Informatics, Beijing, China, 13 September 2012; pp. 776–779.
25. Ng, K.W.; Low, Z.W. Simplification of 3D Triangular Mesh for Level of Detail Computation. In Proceedings of the 11th International Conference on Computer Graphics, Imaging and Visualization, Singapore, 23 October 2014; pp. 11–16.
26. Bonomi, F.; Milito, R.; Zhu, J.; Addepalli, S. Fog Computing and its Role in the Internet of Things. In Proceedings of the First Edition of the MCC Workshop on Mobile Cloud Computing, Helsinki, Finland, 17 August 2012; pp. 13–16.
27. Suárez-Albela, M.; Fernández-Caramés, T.M.; Fraga-Lamas, P.; Castedo, L. A Practical Evaluation of a High-Security Energy-Efficient Gateway for IoT Fog Computing Applications. Sensors 2017, 17, 1978. [CrossRef] [PubMed]
28. Dolui, K.; Datta, S.K. Comparison of edge computing implementations: Fog computing, cloudlet and mobile edge computing. In Proceedings of the Global Internet of Things Summit (GIoTS), Geneva, Switzerland, 6–9 June 2017; pp. 1–6.
29. Microsoft HoloLens Official Web Page. Available online: https://www.microsoft.com/en-us/hololens (accessed on 1 May 2018).
30. Augmented Reality Systems Set to Revolutionise Battlefield Operations. Available online: https://www.baes ystems.com/en/article/augmented-reality-systems-set-to-revolutionise-battlefield-operations (accessed on 1 May 2018).
31. BAE Systems Unveils Latest Wearable Display Technology at DSEI. Available online: https://www.baes ystems.com/en-uk/article/bae-systems-unveils-latest-wearable-display-technology-at-dsei (accessed on 1 May 2018).
32. Virtual Reality Technology Transforms Design of UK Warships. Available online: http://www.baesystems.com/en/article/virtual-reality-technology-transforms-design-of-uk-warships (accessed on 1 May 2018).
33. Index AR Solutions Official Web Page. Available online: https://www.indexarsolutions.com/about-us (accessed on 1 May 2018).
34. Newport News Shipbuilding Official Web Page. Available online: http://nns.huntingtoningalls.com/ar (accessed on 1 May 2018).
35. Mizell, D.W. Virtual Reality and Augmented Reality in Aircraft Design and Manufacturing. In Proceedings of the WESCON/94, Anaheim, CA, USA, 27–29 September 1994.
36. Aiteanu, D.; Hillers, B.; Graser, A. A step forward in manual welding: demonstration of augmented reality helmet. In Proceedings of the Second IEEE and ACM International Symposium on Mixed and Augmented Reality, Tokyo, Japan, 10 October 2003; pp. 309–310.
37. Andersen, R.S.; Bøgh, S.; Moeslund, T.B.; Madsen, O. Task space HRI for cooperative mobile robots in fit-out operations inside ship superstructures. In Proceedings of the 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), New York, NY, USA, 26–31 August 2016; pp. 880–887.
38. Fast, K.; Gifford, T.; Yancey, R. Virtual training for welding. In Proceedings of the third IEEE and ACM International Symposium on Mixed and Augmented Reality, Arlington, VA, USA, 5 November 2005; pp. 298–299.
39. Olbrich, M.; Wuest, H.; Riess, P.; Bockholt, U. Augmented reality pipe layout planning in the shipbuilding industry. In Proceedings of the 10th IEEE International Symposium on Mixed and Augmented Reality, Basel, Switzerland, 26–29 October 2011; pp. 269–270.
40. Havard, V.; Baudry, D.; Louis, A.; Mazari, B. Augmented reality maintenance demonstrator and associated modelling. In Proceedings of the IEEE Virtual Reality (VR), Arles, France, 23–27 March 2015; pp. 329–330.
41. Goode, O.R.; Dallinger, J.F. Quality control in shipbuilding. Naval Eng. J. 1964, 76, 397–407. [CrossRef]
42. Loch, F.; Quint, F.; Brishtel, I. Comparing Video and Augmented Reality Assistance in Manual Assembly. In Proceedings of the 12th International Conference on Intelligent Environments (IE), London, UK, 14–16 September 2016; pp. 147–150.
43. Fraga-Lamas, P.; Noceda-Davila, D.; Fernández-Caramés, T.M.; Díaz-Bouza, M.A.; Vilar-Montesinos, M. Smart Pipe System for a Shipyard 4.0. Sensors 2016, 16, 2186. [CrossRef] [PubMed]
44. Fraga-Lamas, P.; Fernández-Caramés, T. M.; Noceda-Davila, D.; Vilar-Montesinos, M. RSS Stabilization Techniques for a real-time passive UHF RFID Pipe Monitoring System for Smart Shipyards. In Proceedings of the IEEE International Conference on RFID, Phoenix, AZ, USA, 9–11 May 2017; pp. 161–166.
45. Fraga-Lamas, P.; Fernández-Caramés, T.M.; Noceda-Davila, D.; Díaz-Bouza, M.; Vilar-Montesinos, M.; Pena-Agras, J.D.; Castedo, L. Enabling automatic event detection for the pipe workshop of the shipyard 4.0 In Proceedings of the 2017 56th FITCE Congress, Madrid, Spain, 14–15 September 2017; pp. 20–27.
46. Narzt, W.; Pomberger, G.; Ferscha, A.; Kolb, D.; Müller, R.; Wieghardt, J.; Hörtner, H.; Lindinger, C. Augmented reality navigation systems. Univers. Access Inf. Soc. 2005, 4, 177–187. [CrossRef]
47. Kalkofen, D.; Veas, E.; Zollmann, S.; Steinberger, M.; Schmalstieg, D. Adaptive ghosted views for Augmented Reality. In Proceedings of the IEEE International Symposium on Mixed and Augmented Reality (ISMAR), Adelaide, Australia, 1–4 October 2013; pp. 1–9.
48. Fraga-Lamas, P.; Fernández-Caramés, T.M.; Blanco-Novoa, Ó.; Vilar-Montesinos, M.A. A Review on Industrial Augmented Reality Systems for the Industry 4.0 Shipyard. IEEE Access 2018, 6, 13358–13375 [CrossRef]
49. Berning, M.; Riedel, T.; Karl, D.; Schandinat, F.; Beigl, M.; Fantana, N. Augmented service in the factory of the future. In Proceedings of the International Conference on Networked Sensing (INSS), Antwerp, Belgium, 11–14 June 2012; pp. 1–2.
50. Cordonnier, M.; Martino, S.; Boisseau, C.; Paslier, S.; Recapet, J.-P.; Blanc, F.; Augustin, B. Contribution of augmented reality to the maintenance of network equipment. Open Access Proc. J. 2017, 2017, 87–90. [CrossRef]
51. Smparounis, K.; Mavrikios, D.; Pappas, M.; Xanthakis, V.; Viganó, G.P.; Pentenrieder, K. A virtual and augmented reality approach to collaborative product design and demonstration. In Proceedings of the IEEE International Technology Management Conference (ICE), Lisbon, Portugal, 23–28 June 2008; pp. 1–8.
52. Flatt, H.; Koch, N.; Röcker, C.; Günter, A.; Jasperneite, J. A context-aware assistance system for maintenance applications in smart factories based on augmented reality and indoor localization. In Proceedings of the IEEE 20th Conference on Emerging Technologies Factory Automation (ETFA), Luxembourg, 8–11 September 2015; pp. 1–4.
53. Rao, Q.; Grünler, C.; Hammori, M.; Chakrabort, S. Design methods for augmented reality in-vehicle infotainment systems. In Proceedings of the 51st ACM/EDAC/IEEE Design Automation Conference (DAC), San Francisco, CA, USA, 1–5 June 2014; pp. 1–6.
54. Schroeder, G.; Steinmetz, C.; Pereira, C.E. Visualising the digital twin using web services and augmented reality. In Proceedings of the 14th IEEE International Conference on Industrial Informatics (INDIN), Poitiers, France, 19–21 July 2016; pp. 522–527.
55. Schneider, M.; Rambach, J.; Stricker, D. Augmented reality based on edge computing using the example of remote live support. In Proceedings of the IEEE International Conference on Industrial Technology (ICIT), Toronto, ON, Canada, 22–25 March 2017; pp. 1277–1282.
56. Blanco-Novoa, Ó.; Fernández-Caramés, T.M.; Fraga-Lamas, P.; Vilar-Montesinos, M.A. A Practical Evaluation of Commercial Industrial Augmented Reality Systems in an Industry 4.0 Shipyard. IEEE Access 2018, 6, 8201–8218. [CrossRef]
57. SAP Official Web Page. Available online: https://www.sap.com (accessed on 1 May 2018).
58. Windchill Official Web Page. Available online: https://www.ptc.com/en/products/plm/plm-products/wi ndchill (accessed on 1 May 2018).
59. FORAN Official Web Page. Available online: http://www.marine.sener/foran (accessed on 1 May 2018).
60. ThingWorx Official Web Page. Available online:https://www.ptc.com/en/products/iot(accessed on 1 May 2018).
61. Epson Moverio Glasses Official Web Page. Available online:https://epson.com/moverio-augmented-reali ty (accessed on 1 May 2018).
62. ODG R-7 glasses official web page. Available online: https://www.osterhoutgroup.com/r-7-glasses-syste m.html (accessed on 1 May 2018).
63. Vuzix Glasses Official Web Page. Available online:https://www.vuzix.com/Business-and-Enterprise-Sol utions (accessed on 1 May 2018).
64. Daqri Smarthelmet Glasses Official Web Page. Available online: https://daqri.com/products/smart-helmet (accessed on 1 May 2018).
65. Fujitsu Ubiquitousware HMD Official Web Page. Available online: http://www.fujitsu.com/fts/products/computing/peripheral/wearables/hmd-iot001/(accessed on 1 May 2018).
66. ARToolKit Official Web Page. Available online: https://artoolkit.org (accessed on 1 May 2018).
67. Mixare Official Web Page. Available online: http://www.mixare.org (accessed on 1 May 2018).
68. Vuforia Official Web Page. Available online: https://www.vuforia.com (accessed on 1 May 2018).
69. Wikitude Official Web Page. Available online: https://www.wikitude.com (accessed on 1 May 2018).
70. Blender Official Website. Available online: https://www.blender.org (accessed on 1 May 2018).