AR interfacing with prototype 3D applications based on user-centered interactivity

CAD Computer Aided Design

Volumn 42, Issue 5, 2010, Pages 373-386

  Kim, Seungjun ^a   Dey, Anind K ^a  

^a Carnegie Mellon University   (United States)

Author keywords

3D application prototyping; Augmented reality; Human computer interaction; Ubiquitous computing

Indexed keywords

3D APPLICATION; AR APPLICATION; ARCHITECTURAL FRAMEWORKS; CONCEPTUAL SCHEMAS; DE FACTO; DIFFERENT DOMAINS; END USERS; END-PRODUCTS; ENGINEERING SYSTEMS; GEOSPACE; GIS-DATABASE; IMMERSIVE; INTERACTIVITY; KEY ELEMENTS; MEDIA PRODUCTION; PROTOTYPE TESTS; PROTOTYPING; RESEARCH ACTIVITIES; SIMULATION TESTS; TECHNICAL CHALLENGES; TECHNICAL REVIEWS; TECHNOLOGY ISSUES; TWO STAGE; UBICOMP; USER-CENTERED;

AUGMENTED REALITY; COMPUTER AIDED ENGINEERING; HUMAN COMPUTER INTERACTION; KNOWLEDGE MANAGEMENT; RESEARCH; SOFTWARE PROTOTYPING; TEST FACILITIES; TESTING; THREE DIMENSIONAL; THREE DIMENSIONAL COMPUTER GRAPHICS; UBIQUITOUS COMPUTING; VIRTUAL REALITY;

ARGON;

EID: 77950188688     PISSN: 00104485     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.cad.2008.10.009     Document Type: Article

References (93)

1. (a) Adcock M, Hutchins M, Gunn C. Augmented reality haptics: Using ARToolKit for display of haptic applications. In: IEEE int. augmented reality toolkit workshop. 2003. p. 1-2
2. (b) Adcock M, Hutchins M, Gunn C. Haptic collaboration with augmented reality. In: ACM SIGGRAPH 2004 posters. 2004. p. 41
3. (a) Ailon A. Analysis and synthesis of an output feedback for an uncertain robot model with flexible joints. In: Proc. IFAC conf. system structure and control. 1995. p. 370-5
4. (b) Ailon A, Grinberg B, Segev R, Gil M. A simple output-based stabilizing controller for attitude regulation of a rigid spacecraft with gas-jet actuators. In: Proc. 2001 American control conf, vol. 3. 2001. p. 2345-50
5. Anabuki M., Kakuta H., Yamamoto H., and Tamura H. Welbo: An embodied conversational agent living in mixed reality space. CHI '00 extended abstracts on human factors in computing systems (2000), ACM, The Hague (The Netherlands) 10-11
6. ARToolKit. Human Interface Technology Laboratory (HIT Lab) at Univ. Washington. Available: http://www.hitl.washington.edu/artoolkit
7. ARVIKA Consortium. 2002. Available: http://www.arvika.de
8. Augmented reality in the Lagadic INRIA team. Available: http://www.irisa.fr/lagadic/demo/demo-ar/demo-ar-eng.html
9. Azuma R. A survey of augmented reality. Presence: Teleoper Virtual Environ 6 (1997) 355-385
10. Azuma R., Baillot Y., Behringer R., Feiner S., Julier S., and MacIntyre B. Recent advanced in augmented reality. IEEE Comput Graph Appl 21 (2001) 34-47
11. Bederson B.B. Audio augmented reality: A prototype automated tour guide. Conf. companion on human factors in computing systems (1995), ACM 210-211
12. Bimber O, Raskar R. Modern approaches to augmented reality. In: 2004 Proc. eurographics, tutorial 8. 2004
13. Buchmann V., Violich S., Billinghurst M., and Cockburn A. FingARtips: Gesture based direct manipulation in augmented reality. Proc. 2nd int. conf. computer graphics and interactive techniques in Australasia and South East Asia, Singapore (2004), ACM 212-221
14. Bukowska M. Winky Dink half a century later-Interaction with broadcast content: Concept development based on an interactive storytelling application for children. Tech. rep.; Eindhoven: Media Interaction Group, Philips Research Lab.; 2001
15. Cha J., Lee B., Kim J., Kim S., and Ryu J. Smooth haptic interaction in broadcasted augmented reality. Proc. of 10th IFIP TC13 int. conf. human-computer interaction. LNCS vol. 3585 (2005), Springer, Berlin/Heidelberg 1046-1049
16. (b) Cha J, Ryu J, Kim S, Ahn B. A haptically enhanced broadcasting system. In: Proc. 1st joint eurohaptics conf. and symp. haptic interfaces for virtual environment and teleoperator systems. 2005. p. 515-6
17. (c) Cha J, Ryu J, Kim S, Eom S, Ahn B. Haptic interaction in realistic multimedia broadcasting. In: Proc. 5th Pacific rim conf. multimedia (PCM2004) on advances in multimedia information processing, Part III. 2004. p. 482-90
18. Cognitive load. Available: http://en.wikipedia.org/wiki/Cognitive_load
19. Comport A.I., Marchand E., Pressigout M., and Chaumette F. Real-time markerless tracking for augmented reality: The virtual visual servoing framework. IEEE Trans Vis Comput Graphics 12 (2006) 615-628
20. Demiris AM, Traka M, Reusens E, Walczak K, Garcia C, Klein K. et al. Enhanced sports broadcasting by means of augmented reality in MPEG-4. In: Int. conf. augmented, virtual environments and three-dimensional imaging. 2001. p. 10-3
21. (a) Dey AK, Salber D, Abowd GD. A context-based infrastructure for smart environments. In: Proc. 1st int. workshop managing interactions in smart environments. 1999. p. 114-28
22. Dey A.K. Understanding and using context. Pers Ubiquitous Comput (2001) 4-7
23. Dow S., Mehta M., Harmon E., MacIntyre B., and Mateas M. Presence and engagement in an interactive drama. Proceedings of the SIGCHI conference on human factors in computing systems (2007), ACM, New York (NY) 1475-1484
24. Drascic D., Grodski J.J., Milgram P., Ruffo K., Wong P., and Zhai S. ARGOS: A display system for augmenting reality. Proc. INTERACT '93 and CHI '93 conf. human factors in computing systems (1993), ACM, Amsterdam, The Netherlands 521
25. (b) Drascic D, Milgram P. Perceptual issues in augmented reality. In: Bolas MT, Fisher SS, Merritt JO, editors. Stereoscopic displays and virtual reality systems III. SPIE, vol. 2653. 1996. p. 123-34
26. Dunston P.S., and Wang X. Mixed reality-based visualization interfaces for the AEC Industry. J Constr Eng Manag Am Soc Civ Eng (ASCE) 131 (2005) 1301-1309
27. Farbiz F., Cheok A.D., Wei L., ZhiYing Z., Ke X., Prince S., et al. Live three-dimensional content for augmented reality. IEEE Trans Multimed 7 (2005) 514-523
28. (a) Feiner S, Fuchs H, Kanade T, Klinker G, Milgram P, Tamura H. Mixed reality: Where real and virtual worlds meet. In: ACM SIGGRAPH '99 conf. abstracts and applications. 1999. p. 156-8
29. Feiner S., MacIntyre B., and Seligmann D. Knowledge-based augmented reality. Commun ACM 36 (1993)
30. Fitzmaurice G.W., and Buxton W. An empirical evaluation of graspable user interfaces: Towards specialized, space-multiplexed input. Proc. SIGCHI conf. human factors in computing systems (1997), ACM 43-50
31. Friedrich W. ARVIKA-augmented reality for development, production and service. In: Proc. int. symp. mixed and augmented reality. 2002. p. 3-4
32. Gelenbe E., Hussain K., and Kaptan V. Enabling simulation with augmented reality. Modeling, analysis, and simulation on computer and telecommunication systems. LNCS vol. 2965 (2004), Springer Berlin, Heidelberg 290-310
33. HARP (Handheld Augmented Reality Project) at the Harvard Graduate School of Education. Univ. Wisconsin at Madison, and the Teacher Education Program at MIT. Available: http://isites.harvard.edu/icb/icb.do?keyword=harp
34. Hedley N.R., Billinghurst M., Postner L., May R., and Kato H. Explorations in the use of augmented reality for geographic visualization. Presence: Teleoper Virtual Environ 11 (2002) 119-133
35. Hedley N.R., Drew C.H., Arfin E.A., and Lee A. Hagerstrand revisited: Interactive space-time visualizations of complex spatial data. Informatica 23 (1999) 155-168
36. Hoff B, Azuma R. Autocalibration of an electronic compass in an outdoor augmented reality system. In: Proc. IEEE and ACM int. symp. augmented reality. 2000. p. 159-64
37. Hollerer T., Feiner S., Terauchi T., Rashid G., and Hallaway D. Exploring MARS: Developing indoor and outdoor user interfaces to a mobile augmented reality system. Computers & Graphics vol. 23 (1999), Elsevier Science Limited 779-785
38. Holloway R, Lastra A. Virtual environments: A survey of the technology. Tech. rep. TR93-033. Chapel Hill (NC): Univ. North Carolina; 1993
39. Kammann TD. Interactive augmented reality in digital broadcasting environments. Diploma thesis. 2005
40. Kim J, Ryu J. Hardware based 2.5D haptic rendering algorithm using localized occupance map instance. In: Proc. 14th int. conf. artificial reality and telexistence. 2004. p. 132-7
41. (a) Kim S. Implementation of a PC-based 3-D robot simulator using OpenGL. M.S. thesis. Gwangju (Korea): Dept. Mechatronics, Gwangju Inst. Sci. Tech. (GIST); 2000
42. (b) Kim S. Integration of augmented reality interfacing method for prototype 3D applications. Ph.D. dissertation. Gwangju (Korea): Dept. Mechatronics, Gwangju Inst. Sci. Tech. (GIST); 2006
43. Kim S., Cha J., Kim J., Ryu J., Eom S., Mahalik, et al. A novel test-bed for immersive and interactive broadcasting production using augmented reality and haptics. IEICE Trans Inf Sys: Special Sect Artif Real Telexist E89-D (2006) 106-110
44. (d) Kim S, Choi E, Ahn B. The development of 3-D robot simulators using OpenGL. In: Proc. KIEE summer annu. conf. 2000
45. (e) Kim S, Eom S, Byun S, Yang S, Ahn B. Traveler guidance system based on 3D street modeling. In: Proc. 2004 Int. conf. control, automation and systems. 2004. p. 1187-90
46. Kim S., Kim H., Eom S., Mahalik N.P., and Ahn B. A reliable new 2-stage distributed interactive TGS system based on GIS database and augmented reality. IEICE Trans Inf Syst: Special Sect Artif Real Telexist E89-D (2006) 98-105
47. (g) Kim S, Lee S, Jeong W, Ahn B. PC-based 3D graphic spacecraft simulator using OpenGL. In: 2002 Int. conf. control, automation and systems; 2002
48. Kim S., Mahalik N.P., Dey A.K., Ryu J., and Ahn B. Feasibility and infrastructure study of AR interfacing and intuitive simulation on 3D nonlinear systems. Comput. Stand. Interfaces vol. 30 (2007), Elsevier Science 36-51
49. (i) Kim S, Yun J, Kim S, Ahn B. AR over MPEG-2 TS. In: Proc. 20th int. technical conf. circuits/system, computers and communications, vol. 1. 2005. p. 287-8
50. Kiyokawa K., Takemura H., and Yokoya N. Seamless design for 3D object creation. IEEE Multimed 7 (2000) 22-33
51. Lalioti V, Woolard A. Mixed reality production of the future. BBC R&D White Paper, published in the conference publication of the Int. Broadcasting Convention. 2003
52. Mahalik N.P., Ryu J., and Ahn B. Simulation integrated management for embedded DCN. Comput. Stand. Interfaces vol. 28 (2006), Elsevier Science 508-522
53. Milgram P., and Colquhoun H. A taxonomy of real and virtual world display integration. In: Ohta Y., and Tamura H. (Eds). Mixed reality, merging real and virtual worlds (1999), Springer Verlag, Berlin 1-16
54. Milgram P., and Kishino F. A taxonomy of mixed reality visual displays. IEICE Trans Inf Syst E77-D (1994) 1321-1329
55. (c) Milgram P, Yin S, Grodski J. An augmented reality based teleoperation interface for unstructured environments. In: Proc. ANS 7th topical meeting on robotics and remote systems. 1997. p. 966-73
56. (d) Milgram P, Zhai S, Drascic D, Grodski J. Applications of augmented reality for human-robot communication. In: Proc. 1993 IEEE/RSJ int. conf. intelligent robots and systems '93, vol. 3. 1993. p. 1467-72
57. MARS (Mobile Augmented Reality System). Computer Graphics and User Interfaces Lab, Univ. Columbia. Available: http://www1.cs.columbia.edu/graphics/projects/mars/
58. Navab N. Developing killer apps for industrial augmented reality. IEEE Comput Graph Appl 24 (2004) 16-20
59. (b) Navab N, Bascle B, Appel M, Cubillo E. Scene augmentation via the fusion of industrial drawings and uncalibrated images with a view to marker-less calibration. In: Proc. 2nd IEEE and ACM int. workshop augmented reality. 1999. p. 125-33
60. O'Modhrain S, Oakley I. TouchTV: Adding feeling to broadcast media. In: Proc. 1st European conf. interactive television: From viewer to actors. 2003. p. 41-7
61. Phantom. SensAble Technologies. Available: http://www.sensable.com
62. Piekarski W. Interactive 3D modelling in outdoor augmented reality worlds. Ph.D. dissertation. Wearable Computer Lab, School of Computer and Information Science, Univ. South Australia; 2004
63. Pingali G, Pinhanez C, Levas A, Kjeldsen R, Podlaseck M, Chen H. et al. Steerable interfaces for pervasive computing spaces. In: Proc. 1st IEEE int. conf. pervasive computing and communications. 2003. p. 315-22
64. Pinhanez C. The everywhere displays projector: A device to create ubiquitous graphical interfaces. Proc. 3rd int. conf. ubiquitous computing. LNCS vol. 2201 (2001), Springer, Berlin/Heidelberg 315-331
65. Pollock E., Chandler P., and Sweller J. Assimilating complex information. Learn Instr 12 (2002) 61-86
66. Poupyrev I., Tan D.S., Billinghurst M., Kato H., Regenbrecht H., and Tetsutani N. Developing a generic augmented-reality interface. IEEE J Comput 35 (2002) 44-50
67. Reddy M., Leclerc Y., Iverson L., and Bletter N. TerraVisionII: Visualizing massive terrain databases in VRML. IEEE Comput Graph Appl 19 (1999) 30-38
68. Reitmayr G. On software design for augmented reality. Ph.D. dissertation. Vienna (Austria): Vienna Univ. Technology; 2004
69. Rekimoto J., and Saitoh M. Augmented surfaces: A spatially continuous work space for hybrid computing environments. Proc. SIGCHI conf. human factors in computing systems: The CHI is the limit (1999), ACM 378-385
70. Rosenthal M., State A., Lee J., Hirota G., Ackerman J., Keller K., et al. Augmented reality guidance for needle biopsies: A randomized, controlled trial in phantoms. Proc. 4th int. conf. medical image computing and computer-assisted intervention. LNCS vol. 2208 (2001), Springer-Verlag 240-248
71. Rozier J, Karahalios K, Donath J. Hear & There: An augmented reality system of linked audio. In: Proc. int. conf. auditory display. 2000
72. Schmalstieg D, Fuhrmann A, Hesina G. Bridging multiple user interface dimensions with augmented reality. In: Proc. IEEE and ACM int. symp. augmented reality. 2000. p. 20-9
73. Schmidt A. Implicit human computer interaction through context. Pers Technol 4 (2000) 191-199
74. Schmidt A., Kranz M., and Holleis P. Interacting with the ubiquitous computer: Towards embedding interaction. Proc. 2005 joint conf. smart objects and ambient intelligence: Innovative context-aware services: Usages and technologies (2005), ACM 147-152
75. Schwald B., and de Laval B. An augmented reality system for training and assistance to maintenance in the industrial context. J WSCG 11 (2003) 425-432
76. Shin D., Dunston P.S., and Wang X. View changes in augmented reality computer-aided-drawing. ACM Trans Appl Percept (TAP) 2 (2005) 1-14
77. SimTech and GIST. Web-based 3D traveler guidance system. Korea, Final Research Rep. 2001
78. Slocum T.A., Blok C., Jiang B., Koussoulakou A., Montello D.R., Fuhrmann S., et al. Cognitive and usability issues in geovisualization. Cartograph Geograph Inf Sci 28 (2001) 61-75
79. Sukaviriya N., Podlaseck M., Kjeldsen R., Levas A., Pingali G., and Pinhanez C. Augmenting a retail environment using steerable interactive displays. CHI '03 extended abstracts on human factors in computing systems (2003), ACM 978-979
80. Sundareswaran V, Wang K, Chen S, Behringer R, McGee J, Tam C. et al. 3D audio augmented reality: Implementation and experiments. In: Proc. 2nd IEEE and ACM int. symp. mixed and augmented reality. 2003. p. 296-7
81. Tinmith Project. Wearable Computer Lab, the School of Computer and Information Science, Univ. South Australia. Available: http://www.tinmith.net/
82. (a) Vallino JR. Interactive augmented reality. Ph.D. dissertation. Rochester (NY, USA): Univ. Rochester; 1998
83. (b) Vallino JR, Brown C. Haptics in augmented reality. In: Proc. IEEE int. conf. multimedia computing and systems, vol. 1. 1999. p. 195-200
84. (a) Verlinden J, Horvath I. A critical systems position on augmented prototyping systems for industrial design. In: ASME CIE'07, DETC2007-35642. 2007. p. 1-9
85. Verlinden J., Suurmeijer C., and Horvath I. Which prototype to augment? A retrospective case study on industrial and user interface design. HCI International 2007. Lecture notes in computer science LNCS vol. 4563 (2007), Springer 574-583
86. Wang X., and Dunston P.S. Compatibility issues in augmented reality systems for AEC: An experimental prototype study. Automation in construction vol. 15 (2006), Elsevier 314-326
87. Weiser M. The computer for the twenty-first century. Sci Am 265 (1991) 94-104
88. Wellner P. Interacting with paper on the digital desk. Commun ACM 36 (1993) 87-96
89. White S, Feiner S, Kopylec J. Virtual vouchers: Prototyping a mobile augmented reality user interface for botanical species identification 3D user interfaces, 2006. In: IEEE symp. 3DUI. 2006. p. 119-26
90. Woolard A, Lalioti V, Hedley N, Carrigan N, Hammond M, Julien J. Case studies in application of augmented reality in future media production. In: Proc. 2nd IEEE and ACM int. symp. mixed and augmented reality. 2003. p. 294-5
91. Yun G, Kim S, Eom S, Ahn B. 3D augmented reality map with fingertip interaction. In: Proc. 2004 Korea human computer interaction. 2004. p. 598-604
92. Zhou Z., Cheok A.D., and Qiu Y. The role of 3-D sound in human reaction and performance in augmented reality environments. IEEE Trans Syst Man Cybern A 37 March (2007) 262-272
93. Zhu C, Tan EC, Chan TK. 3D terrain visualization for web GIS. In: Proc. map Asia 2003, AD65. 2003