Virtual and augmented reality applications in manufacturing

IFAC Proceedings Volumes (IFAC-PapersOnline)

Volumn 46, Issue 9, 2013, Pages 15-26

  Nee, A Y C ^a   Ong, S K ^a  

^a NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

Author keywords

Augmented Reality; Manufacturing; Virtual reality

Indexed keywords

AUGMENTED REALITY; MANUFACTURE; MILITARY APPLICATIONS; PRODUCT DESIGN; ROBOT PROGRAMMING; VIRTUAL REALITY;

ASSEMBLY PLANNING; CNC MACHINING SIMULATIONS; FACILITIES LAYOUT; INDUSTRIAL STANDARDS; MANUFACTURING ACTIVITIES; MANUFACTURING OPERATIONS; STRINGENT REQUIREMENT; VIRTUAL AND AUGMENTED REALITY;

ENGINEERING EDUCATION;

EID: 84884320796     PISSN: 14746670     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.3182/20130619-3-RU-3018.00637     Document Type: Conference Paper

References (79)

1. ARTool 2.11 (Last accessed on June 29 2011).
2. Azuma, R., Baillot, Y., Behringer, R., Feiner, S., Julier, S., and B. MacIntyre (2001). "Recent advances in augmented reality", IEEE Computer Graphics and Applications, Vol. 21, no. 6, pp. 34-47.
3. Burdea, G.C. (1996). "Virtual reality and robotics in medicine", Proceedings of the IEEE International Workshop on Robot and Human Communication, Tsukuba, Japan: 11-14 November 1996, pp. 16-25.
4. Byun, H.E. and K. Cheverst (2004). "Utilizing context history to provide dynamic adaptations", Applied Artificial Intelligence, Vol. 18, no. 6, pp. 533-548.
5. Calderon, C., and M. Cavazza (2003). "A New Approach to Virtual Design for Spatial Configuration Problems", Proceedings of the Seventh International Conference on Information Visualization (IV '03), pp. 518-523.
6. Chen, C.J., Ong, S.K., Nee, A.Y.C., and Y.Q. Zhou (2010). "Haptic-based Interactive Path Planning for a Virtual Robot Arm", International Journal of Interactive Design and Manufacturing, Vol. 4, no. 2, pp. 113-123.
7. Chintamani, K., Cao, A., Ellis, R.D., and A.K. Pandya (2010). "Improved tele-manipulator navigation during display-control misalignments using Augmented Reality cues", IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans, Vol. 40, no. 1, pp. 29-39.
8. Chong, J.W.S., Nee, A.Y.C., Ong, S.K., and K. Youcef-Toumi (2009). "Robot Programming using Augmented Reality: an Interactive Method for Planning Collision-Free Paths", International Journal of Robotics and Computer-Integrated Manufacturing, Vol. 25, no. 3, pp. 689-701.
9. Coutee, A.S. and B. Bras (2002). "Collision detection for virtual objects in a haptic assembly and disassembly simulation environment", In: ASME design engineering technical conferences and computers and information in engineering conference, Montreal, Quebec, Canada, 2002, pp. 11-20.
10. Coutee, A.S., McDermott, S.D., and B. Bras (2001). "A haptic assembly and disassembly simulation environment and associated computational load optimization techniques", J. Comput. Inf. Sci. Eng., Vol. 1, no. 2, pp. 113-122.
11. Cruz-Neira, C., Sandin, D.J., DeFanti, T.A., Kenyon, R.V., and J.C. Hart (1992). "The CAVE: audio visual experience automatic virtual environment", Communications of the ACM, Vol. 35, no. 6, pp. 64-72.
12. Cruz-Neira, C., Sandin, D.J., and T.A. DeFanti, (1993). "Sur-round-screen projection-based virtual reality: the design and implementation of the CAVE", In: Proceedings of the 20th annual conference on Computer graphics and interactive techniques, Anaheim, CA, USA, 1993, pp. 135-142.
13. Delmia (2009). DELMIA Virtual NC, http://www.delmia.com. (Last accessed 3 June 2009).
14. Dey., A.K. (2001). "Understanding and using context", Personal and Ubiquitous Computing, Vol. 5, no. 1, pp. 4-7.
15. Dong, S., and V.R. Kamat (2010). "Robust mobile computing framework for visualization of simulated processes in augmented reality", Proceedings of the 2010 Winter Simulation Conference (WSC '10), pp. 3111-3122.
16. Easy-rob (2009). EASY-ROB NC Simulation, http://www.easy-rob.com/en/ product/apis-additional-options/nc-simulation.html. (Last accessed 3 June 2009).
17. Fang, H.C., Ong, S.K., Nee, A.Y.C, 2009, Robot Programming using Augmented Reality, International Conference on Cyberworlds, 7-11 September 2009 University of Bradford, UK, 13-20.
18. Fang, H.C., Ong, S.K., and A.Y.C. Nee (2012). "Interactive Robot Trajectory Planning and Simulation using Augmented Reality", Robotics and Computer-Integrated Manufacturing, Vol. 28, no. 2, pp. 227-237.
19. Feiner, S., Macintyre, B., and D. Seligmann (1993). "Knowledge-based Augmented Reality", Communications of the ACM, Vol. 36, pp. 53-62.
20. Freund, E., and J. Rossmann (2005). "Projective virtual reality as a basis for on-line control of complex systems-not only-over the Internet", Journal of Robotic Systems, Vol. 22, no. 3, pp. 147-155.
21. Fründ, J., Gausemeier, J., Matysczok, C., and R. Radkowski (2005). "Using Augmented Reality Technology to Support Automobile Development", Lecture Notes in Computer Science, Vol. 3168, pp. 289-298.
22. st International Symposium on Virtual Reality Innovation 2011 (ISVRI 2011), March 19-20, 2011, Singapore, pp. 267-272.
23. Hakkarainen, M., Woodward, C., and M. Billinghurst (2008). "Augmented Assembly using a Mobile Phone", Proceedings 7th IEEE International Symposium on Mixed and Augmented Reality (ISMAR 2008), 2008 September 16-18, Cambridge, pp. 167-168.
24. HyperMILL by OPEN MIND (2009). http://www.openmind-tech.com/zv. (Last accessed 3 Jun 2009).
25. Iqbal, M., and M.S.J. Hashmi (2001). "Design and Analysis of a Virtual Factory Layout", Journal of Material Processing Technology, Vol. 118, pp. 403-410.
26. Israel, J.H., Wiese, E., Mateescu, M., Zollner, C., and R. Stark (2009). "Investigating three-dimensional sketching for early conceptual design - Results from expert discussion and user studies", Computers and Graphics, Vol. 33, no. 462-473.
27. Jacobs, M.C., Livingston, M.A., and A. State (1997). "Managing Latency in Complex Augmented Reality Systems", Proceedings of the 1997 Symposium on Interactive 3D Graphics, pp. 49-54.
28. Jayaram, S., Connacher, H.I., and K.W. Lyons (1997). "Virtual assembly using virtual reality techniques", Computer Aided Design, Vol. 29, no. 8, pp. 575-584.
29. Jayaram, S., Jayaram, U., Wang, Y., Tirumali, H., Lyons, K., and P. Hart (1999). "VADE:a virtual assembly design environment", Comput Graph Appl, Vol. 19, no. 6, pp. 44-50.
30. Jayaram, S., Jayaram, U., Wang, Y., and K. Lyons (2000a). "CORBA-based Collaboration in a Virtual Assembly Design Environment", In: Proceedings of ASME design engineering technical conferences and computers and information in engineering conference, Baltimore, MD, USA, 2000.
31. Jayaram, U., Tirumali, H., and S. Jayaram (2000b). "A tool/part/human interaction model for assembly in virtual environments", In: Proceedings of ASME design engineering technical conferences, Baltimore, MD, USA, 2000.
32. Jiang, S. and A.Y.C. Nee (2013). "A novel facility layout planning and optimization methodology", CIRP Annals - Manufacturing Technology, Vol. 62, no. 1 (to appear).
33. nd IEEE and ACM International Workshop on Augmented Reality, CA, USA, pp. 85-94.
34. Kim, S. and A.K. Dey (2010) "AR interfacing with prototype 3D applications based on user-centered interactivity", Computer Aided Design, Vol. 42, no. 5, pp. 373-386.
35. th International Symposium on Mixed and Augmented Reality (ISMAR '07, Nara), pp. 250-259.
36. Kuehne, R. and J. Oliver (1995). "A virtual environment for interactive assembly planning and evaluation", In: Proceedings of ASME design automation conference, Boston, MA, USA, 1995.
37. Liang, J., Shaw, C., and M. Green (1991). "On temporal-spatial realism in the virtual reality environment", Proceeding of 1991 Symposium on User Interface Software and Technology, Hilton Head, South Carolina, ACM New York, pp. 19-25.
38. Liu, Z., Bu, W., and J. Tan (2010). "Motion navigation for arc welding robots based on feature mapping in a simulation environment", Robotics and Computer-Integrated Manufacturing, 26/2:137-144.
39. Nee, A.Y.C., Ong, S.K., Chryssolouris G., and D. Mourtzis (2012). "Augmented Reality Applications in Design and Manufacturing", CIRP Annals - Manufacturing Technology, Vol. 61, no. 2, pp. 657-679.
40. Ng, L.X. Ong, S.K., and A.Y.C. Nee (2010). "ARCADE: A Simple and Fast Aug-mented Reality Computer-Aided Design Environment Using Everyday Objects", Proceedings of IADIS Interfaces and Human Computer Interaction 2010 Conference (IHCI 2010), pp. 227-234.
41. Olwal, A., Gustafsson, J., and C. Lindfors (2008). "Spatial augmented reality on industrial CNC machines", Proceedings of the International Conference on The Engineering Reality of Virtual Reality 2008, Vol. 6804; 2008 Jan 27-31; San José, California; 2008, 680409:1-9.
42. Olwal, A., Lindfors, C., Gustafsson, J., Kjellberg, T., and L. Mattson (2005). "ASTOR: An autostereoscopic optical see-through augmented reality system", Proceedings of IEEE and ACM International Symposium on Mixed and Augmented Reality, pp. 24-27.
43. Ong, S.K., Chong, J.W.S., and A.Y.C. Nee (2010). "A Novel AR-Based Robot Programming And Path Planning Methodology", Robotics and Computer-Integrated Manufacturing Journal, Vol. 26, no. 3, pp. 240-249.
44. Ong, S.K. and A.Y.C. Nee (2004). Virtual and Augmented Reality Applications in Manufacturing, London, Springer, ISBN 1-85233-796-6.
45. Ong, S.K., Pang, Y., and A.Y.C. Nee (2007). "Augmented reality aided assembly design and planning", CIRP Annals - Manufacturing Technology, Vol. 56, no. 1, pp. 49-52.
46. Ong, S.K. and Y. Shen (2009). "A Mixed Reality Environment for Collaborative Product Design and Development", CIRP Annals - Manufacturing Technology, Vol. 58, no. 1, pp. 139-142.
47. Ong, S.K. and Z.B. Wang (2011). "Augmented assembly technologies based on 3D bare-hand interaction", CIRP Annals - Manufacturing Technology, Vol. 60, no. 1, pp. 1-4.
48. Ong, S.K., Yuan M.L., and A.Y.C. Nee (2008). "Augmented reality applications in manufacturing: a survey", International Journal of Production Research, Vol. 46, no. 10, pp. 2707-2742.
49. Ong, S.K. and J. Zhu (2013). "A novel maintenance system for equipment serviceability improvement", CIRP Annals - Manufacturing Technology, Vol. 62, no. 1 (to appear).
50. Padmos, P., and M.V. Milders (1992). "Quality criteria for simulator images: A literature review", Human Factors, Vol. 34, no. 6, pp. 727-748.
51. th Annual Symposium of Electronic Imaging, San Jose, CA, 6813:03-17.
52. Park, J. (2008). "Augmented Reality Based Re-formable Mock-Up for Design Evaluation", Proceedings of the 2008 International Symposium on Ubiquitous Virtual Reality, IEEE Computer Society Washington, DC, USA, 2008, pp. 17-20.
53. Pasman, W., van der Schaaf, A., Lagendijk, R.L., and F.W. Jansen (1999). "Accurate overlaying for mobile augmented reality", Computer & Graphics, Vol. 23, no. 6, pp. 875-881.
54. Pere, E., Langrana, N., Gomez, D., and G Burdea (1996). "Virtual mechanical assembly on a PC-based system", In: Proceedings of ASME design engineering technical conferences and computers and information in engineering conference (DETC1996/DFM-1306), Irvine, CA, USA, 1996.
55. Poupyrev, I., Tan, D.S., Billinghurst, M., Kato, H., Regenbrecht, H., and N. Tetsutani (2002). "Developing a generic augmented-reality interface", IEEE Journal of Computers, Vol. 35, no. 3, pp. 44-50.
56. Reinhart, G, Munzert, U, and W. Vogl (2008). "A programming system for robot-based remote-laser-welding with conventional optics", CIRP Annals - Manufacturing Technology, Vol. 57, no. 1, pp. 37-40.
57. Reinhart, G and C. Patron (2003). "Integrating Augmented Reality in the Assembly Domain-Fundamentals, Benefits and Applications", CIRP Annals - Manufacturing Technology, Vol. 52, no. 1, pp. 5-8.
58. Ong, S.K., Pang Y., and A.Y.C. Nee (2007). "Augmented Reality Aided Assembly Design and Planning". CIRP Annals - Manufacturing Technology, Vol. 56, no. 1, pp. 49-52.
59. Setchi, R. and D. White (2003). "The development of a hypermedia maintenance manual for an advanced manufacturing company", The International Journal of Advanced Manufacturing Technology, Vol. 22, no. 5-6, pp. 456-464.
60. Seth, A., Su, HJ., and J.M. Vance (2005), "A desktop networked haptic VR interface for mechanical assembly", In: ASME 2005 International Mechanical Engineering Congress & Exposition, Orlando, Florida, USA, 2005, pp. 173-180.
61. Seth, A., Su, HJ., and J.M. Vance (2006). "SHARP: A System for Haptic Assembly & Realistic Prototyping", In: ASME 2006 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, Philadelphia, Pennsylvania, USA, 2006, pp. 905-912.
62. Stark, R., Israel, J.H., and T. Wöhler (2010). "Towards hybrid modeling environments - Merging desktop-CAD and virtual reality- technologies", CIRP Annals - Manufacturing Technology, Vol. 59, pp. 179-182.
63. Stutzman, B., Nilsen, D., Broderick, T., and J. Neubert (2009). "MARTI: Mobile Augmented Reality Tool for Industry", Proceedings of 2009 World Congress on Computer Science and Information Engineering (CSIE2009), 2009, March 31 - April 2, Los Angeles, USA, pp. 425-429.
64. Taylor, F., Jayaram, S., and U. Jayaram (2000). "Functionality to facilitate assembly of heavy machines in a virtual environment", in Proceedings of ASME design engineering technical conferences, Baltimore, MD, USA, 2000.
65. Valentini, P.P. (2009). "Interactive virtual assembling in augmented reality", International Journal of Interactive Design and Manufacturing, Vol. 3, no. 2, pp. 109-119.
66. van Houten, F.J.A.M., Tomiyama T., and O.W. Salomons (1998). "Product modeling for model-based maintenance", CIRP Annals - Manufacturing Technology, Vol. 47, no. 1, pp. 123-128.
67. van Houten, F.J.A.M. and F. Kimura (2000). "The virtual maintenance system: A computer-based support tool for robust design, product monitoring, fault diagnosis and maintenance planning". CIRP Annals - Manufacturing Technology, Vol. 49, no. 1, pp. 91-94.
68. Weinert, K., Zabel, A., Ungemach, E., and S. Odendahl (2008). "Improved NC Path Validation and Manipulation with Augmented Reality Methods", Production Engineering, Vol. 2, no. 4, pp. 371-376.
69. th International Conference on Human-Computer Interaction, HCI 2009, pp. 485-489.
70. Xie, W. and N.V. Sahinidis (2008). "A Branch-and-bound Algorithm for the Continuous Facility Layout Problem", Computers and Chemical Engineering, Vol. 32, no. 4, pp. 1016-1028.
71. Xin, M., Sharlin, E., and M.C Sousa (2008). "Napkin Sketch - Handheld Mixed Reality 3D Sketching", Proceedings of 15th ACM Symposium on Virtual Reality Software and Technology (VRST 2008), 2008, October 27-29, Bordeaux, France, 2008, pp. 223-226.
72. Yuan, ML, Ong, S.K., and A.Y.C. Nee (2004). "The virtual interaction panel: an easy control tool in augmented reality system", Computer Animation and Virtual Worlds Journal, Vol. 15, no. 3-4, pp. 425-432.
73. Yuan, M.L., Ong, S.K., and A.Y.C. Nee (2008a). "Augmented Reality Applications in Manufacturing: A Survey", International Journal of Production Research, Vol. 46, no. 10, pp. 2702-2742.
74. Yuan, ML., Ong, S.K., and A.Y.C. Nee (2008b). "Augmented reality for assembly guidance using a virtual interactive tool", International Journal of Production Research, Vol. 46, no. 7, pp. 1745-1767.
75. Zaeh, M.F. and W. Vogl (2006). "Interactive laser-projection for programming industrial robots", Proceedings of the International Symposium on Mixed and Augmented Reality. Santa Barbara, CA: 22-25 October 2006, pp. 125-128.
76. Zetu, D., Schneider, P., and P. Banerjee (1998). "Data Input Model for Virtual Reality-aided Factory Layout", IIE Transactions, Vol. 30, no. 7, pp. 597-620.
77. th International Conference on Virtual-Reality Continuum & its Applications in Industry, 2008 Dec 8-9; Singapore.
78. Zhang, J., Ong, S.K., and A.Y.C. Nee (2010a). "Development of an AR system Achieving in situ machining simulation on a 3-axis CNC machine", Computer Animation and Virtual Worlds, Vol. 21, no. 2, pp. 103-115.
79. Zhang, J., Ong, S.K., and A.Y.C. Nee (2010b). "A MultiRegional Computation Scheme in an AR-Assisted in situ CNC Simulation Environment", Computer-Aided Design, Vol. 42, no. 12, pp. 1167-1177.