Calibration, registration, and synchronization for high precision augmented reality haptics

IEEE Transactions on Visualization and Computer Graphics

Volumn 15, Issue 1, 2009, Pages 138-149

  Harders, M ^a   Bianchi, G ^a   Knoerlein, B ^a   Szekely, G ^a  

^a ETH ZURICH   (Switzerland)

Author keywords

Augmented reality; Calibration; Haptic; Registration

Indexed keywords

CALIBRATION METHOD; CO-LOCATED; DISTRIBUTED FRAMEWORK; HAPTIC; HAPTICS; HIGH PRECISION; HYBRID TRACKING; LOW LATENCY; MEDICAL TRAINING; MULTI-MODAL; OPEN SURGERY; PROTOTYPE SYSTEM; REGISTRATION; VIRTUAL SCENES; VISUO-HAPTIC; VISUO-HAPTIC INTEGRATION;

CALIBRATION; HAPTIC INTERFACES; SYSTEM STABILITY; VIRTUAL REALITY;

AUGMENTED REALITY;

ALGORITHM; ARTICLE; CALIBRATION; COMPUTER; COMPUTER GRAPHICS; COMPUTER INTERFACE; INFORMATION RETRIEVAL; METHODOLOGY; STANDARD; SWITZERLAND; TOUCH;

ALGORITHMS; CALIBRATION; COMPUTER GRAPHICS; COMPUTER PERIPHERALS; INFORMATION STORAGE AND RETRIEVAL; SWITZERLAND; TOUCH; USER-COMPUTER INTERFACE;

EID: 59449086335     PISSN: 10772626     EISSN: None     Source Type: Journal    
DOI: 10.1109/TVCG.2008.63     Document Type: Article

References (34)

1. R.T. Azuma, "A Survey of Augmented Reality," Presence: Teleoperators and Virtual Environments, vol. 6, no. 4, pp. 355-385, 1997.
2. M. Slater and A. Steed, "A Virtual Presence Counter," Presence: Teleoperators and Virtual Environments, vol. 9, no. 5, pp. 413-434, 2000.
3. F. Mantovani and G. Castelnuovo, Being There: Concepts, Effects and Measurement of User Presence in Synthetic Environments, ch. Sense of Presence in Virtual Training: Enhancing Skills Acquisition and Transfer of Knowledge through Learning Experience in Virtual Environments. IOS Press, 2003.
4. D. Romano and P. Brna, "Presence and Reflection in Training: Support for Learning to Improve Quality Decision-Making Skills under Time Limitations," Cyberpsychology and Behavior, vol. 4, pp. 265-277, 2001.
5. J.R. Vallino and C.M. Brown, "Haptics in Augmented Reality," Proc. IEEE Int'l Conf. Multimedia Computing and Systems (ICMCS '99), vol. 1, pp. 195-200, 1999.
6. T. Nojima, D. Sekiguchi, M. Inami, and S. Tachi, "The Smarttool: A System for Augmented Reality of Haptics," Proc. IEEE Virtual Reality Conf. (VR '02), pp. 67-72, 2002.
7. G. Ye, J.J. Corso, G.D. Hager, and A.M. Okamura, "Vishap: Augmented Reality Combining Haptics and Vision," Proc. IEEE Intl. Conf. Systems, Man, and Cybernetics (SMC '03), pp. 3425-3431, 2003.
8. M. Adcock, M. Hutchins, and C. Gunn, "Augmented Reality Haptics: Using AR Toolkit for Display of Haptic Applications," Proc. Second IEEE Int'l Augmented Reality Toolkit Workshop (ART '03), pp. 1-2, 2003.
9. B. Grant, A. Helser, and R. Taylor, "Adding Force Display to a Stereoscopic Head-Tracked Projection Display," Proc. IEEE Virtual Reality Ann. Int'l Symp. (VRAIS '98), pp. 81-88, 1998.
10. K. Reinig, R. Tracy, H. Glimore, and T. Mahalik, "Some Calibration Information for a Phantom 1.5 a," Proc. Second PHANToM Users Group Workshop, 1997.
11. M. Ikits, C. Hansen, and C. Johnson, "A Comprehensive Calibration and Registration Procedure for the Visual Haptic Workbench," Proc. Joint Seventh Immersive Projection Technology and Seventh Eurographics Virtual Environments Workshop (IPT/EGVE '03), pp. 247-254, 2003.
12. A. State, G. Hirota, D. Chen, W. Garett, and M. Livingston, "Superior Augmented Reality Registration by Integrating Landmark Tracking and Magnetic Tracking," Proc. ACM SIGGRAPH '96, pp. 429-438, 1996.
13. T. Auer and A. Pinz, "Building a Hybrid Tracking System: Integration of Optical and Magnetic Tracking," Proc. Second IEEE and ACM Int'l Workshop Augmented Reality (IWAR '99), pp. 13-22, 1999.
14. S. You, U. Neumann, and R. Azuma, "Hybrid Inertial and Vision Tracking for Augmented Reality Registration," Proc. IEEE Virtual Reality Conf. (VR '99), pp. 260-267, 1999.
15. M. Aron, G. Simon, and M.-O. Berger, "Handling Uncertain Sensor Data in Vision-Based Camera Tracking," Proc. Third IEEE and ACM Int'l Symp. Mixed and Augmented Reality (ISMAR '04), pp. 58-67, 2004.
16. W. Hoff and T. Vincent, "Analysis of Head Pose Accuracy in Augmented Reality," IEEE Trans. Visualization and Computer Graphics, vol. 6, no. 4, pp. 319-334, Oct.-Dec. 2000.
17. H. Najafi, N. Navab, and G. Klinker, "Automated Initialization for Marker-Less Tracking: A Sensor Fusion Approach," Proc. Third IEEE and ACM Int'l Symp. Mixed and Augmented Reality (ISMAR '04), pp. 79-88, 2004.
18. R. Lapeer, M. Chen, and J. Villagrana, "An Augmented Reality Based Simulation of Obstetric Forceps Delivery," Proc. Third IEEE and ACM Int'l Symp. Mixed and Augmented Reality (ISMAR '04), pp. 274-275, 2004.
19. T. Sielhorst, T. Obst, R. Burgkart, R. Riener, and N. Navab, "An Augmented Reality Delivery Simulator for Medical Training," Int'l Workshop Augmented Environments for Medical Imaging-MIC-CAI Satellite Workshop, pp. 11-20, 2004.
20. S. Botden, S. Buzink, M. Schijven, and J. Jakimowicz, "Augmented versus Virtual Reality Laparoscopic Simulation: What Is the Difference?" World J. Surgery, vol. 31, pp. 764-772, 2007.
21. J. Heikkila and O. Silven, "A Four-Step Camera Calibration Procedure with Implicit Image Correction," Computer Vision and Pattern Recognition, pp. 1106-1112, 1997.
22. Z. Zhang, "A Flexible New Technique for Camera Calibration," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 11, pp. 1330-1334, Nov. 2000.
23. R. Tsai and R. Lenz, "A New Technique for Fully Autonomous and Efficient 3D Robotics Hand-Eye Calibration," IEEE Trans. Robotics and Automation, vol. 5, pp. 345-358, 1989.
24. G. Bianchi, C. Jung, B. Knoerlein, M. Harders, and G. Szekely, "Misalignment Errors between the Real and Virtual World in Augmented Reality," Mixed Reality and Computing in the Physical World, Workshop Abstract, 2005.
25. G. Bianchi, B. Knoerlein, G. Szekely, and M. Harders, "High Precision Augmented Reality Haptics," Proc. EuroHaptics '06, pp. 169-178, 2006.
26. S. Lavallee, P. Cinquin, and J. Troccaz, Contemporary Perspectives in Three-Dimensional Biomedical Imaging. ch. Computer Integrated Surgery and Therapy: State of the Art. pp. 239-310, IOS Press, 1997.
27. M.C. Cavusoglu, D. Feygin, and F. Tendick, "A Critical Study of the Mechanical and Electrical Properties of the PHANToM Haptic Interface and Improvements for High-Performance Control," Presence: Teleoperators and Virtual Environments, vol. 11, no. 6, pp. 555-568, 2002.
28. G. Bianchi, C. Wengert, M. Harders, P. Cattin, and G. Szekely, "Camera-Marker Alignment Framework and Comparison with Hand-Eye Calibration for Augmented Reality Applications," Proc. Fourth IEEE and ACM Int'l Symp. Mixed and Augmented Reality (ISMAR '05), pp. 188-189, 2005.
29. G. Bianchi, C. Jung, B. Knörlein, M. Harders, and G. Szekely, "High-Fidelity Visuo-Haptic Interaction with Virtual Objects in Multi-Modal AR Systems," Proc. Sixth IEEE and ACM Int'l Symp. Mixed and Augmented Reality (ISMAR '06), pp. 187-196, 2006.
30. W. Press, S. Teukolsky, W. Vetterling, and B. Flannery, Numerical Recipes in C: The Art of Scientific Computing. Cambridge Univ. Press, 1992.
31. A. Liu, F. Tendick, K. Cleary, and C. Kaufmann, "A Survey of Surgical Simulation: Applications, Technology, and Education," Presence: Teleoperators and Virtual Environments, vol. 12, no. 6, pp. 599-614, 2003.
32. C. Basdogan, M. Sedef, M. Harders, and S. Wesarg, "Virtual Reality Supported Simulators for Training in Minimally Invasive Surgery," IEEE Computer Graphics and Applications, vol. 27, no. 2, pp. 54-66, Mar./Apr. 2007.
33. M. Teschner, B. Heidelberger, M. Mueller, and M. Gross, "A Versatile and Robust Model for Geometrically Complex Deform-able Solids," Proc. IEEE Computer Graphics Int'l (CGI '04), pp. 312-319, 2004.
34. D. Gaba, S. Howard, B. Flanagan, B.S.K. Fish, and R. Botney, "Assessment of Clinical Performance During Simulated Crises Using Both Technical and Behavioral Ratings," Anesthesiology, vol. 89, no. 1, pp. 8-18, 1998.