Advanced medical displays: A literature review of augmented reality

IEEE/OSA Journal of Display Technology

Volumn 4, Issue 4, 2008, Pages 451-467

  Sielhorst, Tobias ^a   Feuerstein, Marco ^b   Navab, Nassir ^a  

^a TECHNICAL UNIVERSITY OF MUNICH   (Germany)

^b NAGOYA UNIVERSITY   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

DATA VISUALIZATION; ULTRASONIC IMAGING; VIRTUAL REALITY; VISUALIZATION;

AUGMENTED REALITIES; DESIGN AND DEVELOPMENTS; DISPLAY TECHNOLOGIES; FUNCTIONAL DATUMS; INTRAOPERATIVE DATUMS; LITERATURE REVIEWS; MEDICAL AUGMENTED REALITIES; MEDICAL DISPLAYS; MEDICAL IMAGING TECHNOLOGIES; MULTIDISCIPLINARY RESEARCHES; OPTICAL IMAGING; PATIENT SPECIFICS; SURGICAL PROCEDURES;

MEDICAL IMAGING;

EID: 56749164034     PISSN: 1551319X     EISSN: None     Source Type: Journal    
DOI: 10.1109/JDT.2008.2001575     Document Type: Article

References (141)

1. H. Steinhaus, "Sur la localisation au moyen des rayons x," Comptes Rendus de L'Acad. des Sci., vol. 206, pp. 1473-1475, 1938.
2. I. Sutherland, "A head-mounted three dimensional display," in Proc. Fall Joint Computer Conf., 1968, pp. 757-764.
3. D. Roberts, J. Strohbehn, J. Hatch, W. Murray, and H. Kettenberger, "A frameless stereotaxic integration of computerized tomographic imaging and the operating microscope," J. Neurosurg., vol. 65, no. 4, pp. 545-549, 1986.
4. T. Caudell and D. Mizell, "Augmented reality: An application of heads-up display technology to manual manufacturing technology augmented reality," in Proc. Hawaii Int. Conf. on Syst. Sci., 1992.
5. W. Mackay, G. Velay, K. Carter, C. Ma, and D. Pagani, "Augmenting reality: Adding computational dimensions to paper," Commun. ACM, vol. 36, no. 7, pp. 96-97, 1993.
6. S. Feiner, B. Macintyre, and D. Seligmann, "Knowledge-based augmented reality," Commun. ACM, vol. 36, no. 7, pp. 53-62, 1993.
7. P. Wellner, W. Mackay, and R. Gold, "Computer augmented environments: Back to the real world," Commun. ACM, vol. 36, no. 7, pp. 24-26, 1993.
8. P. Milgram and F. Kishino, "A taxonomy of mixed reality visual displays," IEICE Trans. Inf. Syst., pp. 1321-1329, 1994.
9. R. T. Azuma, "A survey of augmented reality," Presence: Teleoperators and Virtual Environments, vol. 6, no. 4, pp. 355-385, 1997.
10. R. T. Azuma, Y. Baillot, R. Behringer, S. Feiner, S. Julier, and B. Macintyre, "Recent advances in augmented reality," IEEE Comput. Graphics Appl., vol. 21, pp. 34-47, 2001.
11. F. P. Brooks, "The computer scientist as toolsmith ii," Commun. ACM, vol. 39, no. 3, pp. 61-68, 1996.
12. M. Bajura, H. Fuchs, and R. Ohbuchi, "Merging virtual objects with the real world: Seeing ultrasound imagery within the patient," in Proc. 19th Annu. Conf. on Computer Graphics and Intel-active Techniques, 1992, pp. 203-210.
13. M. Bajura and U. Neumann, "Dynamic registration correction in video-based augmented reality systems," IEEE Comput. Graph. Appl., vol. 15, no. 5, pp. 52-60, 1995.
14. M. C. Jacobs, M. A. Livingston, and A. State, "Managing latencyin complex augmented reality systems," in Proc. ACM 1997 Symp. on Interactive 3D Graphics, 1997, pp. 49-54.
15. A. State, M. A. Livingston, W. F. Garrett, G. Hirota, M. C. Whitton, E. D. Pisano, and H. Fuchs, "Technologies for augmented reality systems: Realizing ultrasound-guided needle biopsies," in SIGGRAPH'96: Proc. 23rd Annu. Conf. on Computer Graphics and Interactive Techniques, New York, NY, USA, 1996, pp. 439-446.
16. M. Rosenthal, A. State, J. Lee, G. Hirota, J. Ackerman, E. D. P. K. Keller, M. Jiroutek, K. Muller, and H. Fuchs, "Augmented reality guidance for needle biopsies: An initial randomized, controlled trial in phantoms," Medical Image Anal., vol. 6, no. 3, pp. 313-320, 2002.
17. F. Sauer, F. Wenzel, S. Vogt, Y. Tao, Y. Gene, and A. Bani-Hashemi, "Augmented workspace: Designing an AR testbed," in Proc. IEEE and ACM Int. Symp. on Augmented Reality, 2000, pp. 47-53.
18. W. A. Hoff and T. L. Vincent, "Analysis of head pose accuracy in augmented reality," IEEE Trans. Visualiz. Computer Graphics, vol. 6, 2000.
19. D. L. Wright, J. P. Rolland, and A. R. Kancherla, "Using virtual reality to teach radiographic positioning," Radiologic Int. Technol., vol. 66, no. 4, pp. 233-238, 1995.
20. Y. Argotti, L. Davis, V. Outters, and J. Rolland, "Dynamic superimposition of synthetic objects on rigid and simple-deformable real objects," Computers & Graphics, vol. 26, no. 6, pp. 919-930, 2002.
21. T. Sielhorst, T. Blum, and N. Navab, "Synchronizing 3d movements for quantitative comparison and simultaneous visualization of actions," in Proc. IEEE and ACM Int. Symp. on Mixed and Augmented Reality (ISMAR), 2005.
22. G. Luo and E. Peli, "Use of an augmented-vision device for visual search by patients with tunnel vision," Investigative Ophthalmology & Visual Science, vol. 47, no. 9, pp. 4152-4159, 2006.
23. J. P. Rolland and H. Fuchs, "Optical versus video see-through head-mounted displays in medical visualization," Presence, vol. 9, pp. 287-309, 2000.
24. O. Cakmakci and J. Rolland, "Head-worn displays: A review," Int. J. Display Int. Technol., vol. 2, pp. 199-216, Sept. 2006.
25. P. J. Kelly, G. Alker, and S. Goerss, "Computer-assisted stereotactic laser microsurgery for the treatment of intracranial neoplasms," Neurosurgery, vol. 10, pp. 324-331, 1982.
26. J. Hatch and J. S. D. W. Roberts, "Reference-display system for the integration of CT scanning and the operating microscope," in Proc. 11th Annu. Northeast Bioeng. Conf., 1985.
27. E. M. Friets, J. W. Strohbehn, J. F. Hatch, and D. W. Roberts, "A frameless stereotaxic operating microscope for neurosurgery," IEEE Trans. Biomed. Eng., vol. 36, no. 6, Jun. 1989.
28. P. J. Edwards, D. D. Hill, D. D. Hawkes, and D. A. Colchester, "Neurosurgical guidance using the stereo microscope," in Proc. First Int. Conf. Computer Vision, Virtual Reality and Robotics in Medicine (CVRMed'95), 1995.
29. A. P. King, P. J. Edwards, C. R. Maurer, Jr., D. A. de Cunha, D. J. Hawkes, D. L. G. Hill, R. P. Gaston, M. R. Fenlon, A. J. Strong, C. L. Chandler, A. Richards, and M. J. Gleeson, "Design and evaluation of a system for microscope-assisted guided interventions," IEEE Trans. Med. Imag., vol. 19, no. 11, pp. 1082-1093, Nov. 2000.
30. J. Berger and D. Shin, "Computer-vision-enabled augmented reality fundus biomicroscopy," Ophthalmology, vol. 106, no. 10, pp. 1935-1941, 1999.
31. W. Birkfellner, M. Figl, K. Huber, F. Watzinger, F. Wanschitz, J. Hummel, R. Hanel, W. Greimel, P. Homolka, R. Ewers, and H. Bergmann, "A head-mounted operating binocular for augmented reality visualization in medicine - Design and initial evaluation," IEEE Trans. Med. Imag., vol. 21, no. 8, pp. 991-997, Aug. 2002.
32. W. Birkfellner, K. Huber, F. Watzinger, M. Figl, F. Wanschitz, R. Hanel, D. Rafolt, R. Ewers, and H. Bergmann, "Development of the variosco-pear - A see-through hmd for computer-aided surgery," in Proc. IEEE and ACM Int. Symp. on Augmented Reality, 2000, pp. 54-59.
33. M. Figl, C. Ede, J. Hummel, F. Wanschitz, R. Ewers, H. Bergmann, and W. Birkfellner, "A fully automated calibration method for an optical see-through head-mounted operating microscope with variable zoom and focus," IEEE Trans. Med. Imag., vol. 24, no. 11, pp. 1492-1499, Nov. 2005.
34. R. Holloway, "Registration error analysis for augmented reality," Presence: Teleoperators and Virtual Env., vol. 6, no. 4, pp. 413-432, 1997.
35. Y. Masutani, M. Iwahara, O. Samuta, Y. Nishi, N. Suzuki, M. Suzuki, T. Dohi, H. Iseki, and K. Takakura, "Development of integral photography-based enhanced reality visualization system for surgical support." Proc. ISCAS, vol. 95, pp. 16-17, 1995.
36. H. Liao, S. Nakajima, M. Iwahara, E. Kobayashi, I. Sakuma, N. Yahagi, and T. Dohi, "Intra-operative real-time 3-D information display system based on integral videography," in Proc. Int. Conf. Med. Image Computing and Computer Assisted Intervention (MICCAI), 2001, pp. 392-400.
37. H. Liao, N. Hata, S. Nakajima, M. Iwahara, I. Sakuma, and T. Dohi, "Surgical navigation by autostereoscopic image overlay of integral videography," IEEE Trans. Int. Technol. Biomed., vol. 8, no. 2, pp. 114-121, 2004.
38. M. Blackwell, C. Nikou, A. M. D. Gioia, and T. Kanade, I. W. M. Wells, A. C. F. Colchester, and S. L. Delp, Eds., "An image overlay system for medical data visualization," in Proc. First Int. Conf. of Medical Image Computing and Computer-Assisted Intervention (MICCAI) Lecture Notes in Comput. Sci., Cambridge, MA, Oct. 1998, vol. 1496, pp. 232-240.
39. G. Goebbels, K. Troche, M. Braun, A. Ivanovic, A. Grab, K. von Lübtow, R. Sader, F. Zeilhofer, K. Albrecht, and K. Praxmarer, "Arsystricorder - development of an augmented reality system for intraoperative navigation in maxillofacial surgery," in Proc. IEEE and ACM Int. Symp. on Mixed and Augmented Reality (ISMAR), 2003.
40. S. Wesarg, E. Firle, B. Schwald, H. Seibert, P. Zogal, and S. Roeddiger, R. L. Galloway, Jr., Ed., "Accuracy of needle implantation in brachytherapy using a medical AR system.: A phantom study," Proc. 2004 SPIEMedical Imaging: Visualization, Image-Guided Procedures, and Display, vol. 5367, pp. 341-352, 2004.
41. W. Lorensen, H. Cline, C. Nafis, R. Kikinis, D. Altobelli, L. Gleason, G. Co, and N. Schenectady, "Enhancing reality in the operating room," in IEEE Conf. on Visualization, 1993, pp. 410-415.
42. W. E. L. Grimson, T. Lozano-Perez, W. M. Wells III, G. J. Ettinger, S. J. White, and R. Kikinis, "An automatic registration method for frameless stereotaxy, image guided surgery, and enhanced reality visualization," IEEE Trans. Med. Imag., vol. 15, no. 2, pp. 129-140, Apr. 1996.
43. Y. Sato, M. Nakamoto, Y. Tamaki, T. Sasama, I. Sakita, Y. Nakajima, M. Monden, and S. Tamura, "Image guidance of breast cancer surgery using 3-d ultrasound images and augmented reality visualization," IEEE Trans. Med. Imag., vol. 17, no. 5, Oct. 1998.
44. S. Nicolau, X. Pennec, L. Soler, and N. Ayache, "An accuracy certified augmented reality system for therapy guidance," in Proc. 8th Eur. Conf. on Computer Vision (ECCV 04), Prague, May 2004, vol. 3023, pp. 79-91, Lecture Notes in Computer Science.
45. W. Lau, "History of endoscopic and laparoscopic surgery," World Int. J.f Surgery, vol. 21, no. 4, pp. 444-453, 1997.
46. G. Litynski, "Endoscopic surgery: The history, the pioneers," World Int. J. Surgery, vol. 23, no. 8, pp. 745-753, 1999.
47. G. Berci and K. A. Forde, "History of endoscopy - What lessons have we learned from the past?," Surgical Endoscopy, vol. 14, pp. 5-15, 2002.
48. W. Freysinger, A. Gunkel, and W. Thumfart, "Image-guided endoscopicent surgery," Eur. Archives of Otorhinolaryngology, vol. 254, no. 7, pp. 343-346, 1997.
49. R. Shahidi, B. Wang, M. Epitaux, R. Grzeszczuk, and J. Adler, I. W. M. Wells, A. C. F. Colchester, and S. L. Delp, Eds., "Volumetric image guidance via a stereotactic endoscope," in Proc. First Int. Conf. Med Image Computing and Computer-Assisted Intervention (MICCAI), Cambridge, MA, Oct. 1998, vol. 1496, pp. 241-252, Lecture Notes in Computer Science.
50. M. Scholz, W. Konen, S. Tombrock, B. Fricke, and L. Adams, "Development of an endoscopic navigation system based on digitalimage processing," Computer Aided Surgery, vol. 3, pp. 134-143, 1998.
51. F. Mourgues and È. Coste-Manière, "Flexible calibration of actuated stereoscopic endoscope for overlay in robot assisted surgery," in Proc. Int. Conf. Med. Image Computing and Computer Assisted Intervention (MICCAI), 2002, pp. 25-34.
52. R. Khadem, M. R. Bax, J. A. Johnson, E. P. Wilkinson, and R. Shahidi, "Endoscope calibration and accuracy testing for 3d/2d image registration," in Proc. Int. Conf. Medical Image Computing and Computer-Assisted Intervention (MICCAI), 2001, pp. 1361-1362.
53. W. E. Smith, N. Vakil, and S. A. Maislin, "Correction of distortion in endoscope images," IEEE Trans. Med. Imag., vol. 11, no. 1, pp. 117-122, Feb. 1992.
54. S. De Buck, J. Van Cleynenbreuge, I. Geys, T. Koninckx, P. R. Koninck, and P. Suetens, "A system to support laparoscopic surgery by augmented reality visualization," in Proc. Int. Conf. Medical Image Computing and Computer Assisted Intervention (MICCAI), 2001, pp. 691-698.
55. R. Shahidi, M. R. Bax, C. R. Maurer, Jr., J. A. Johnson, E. P. Wilkinson, B. Wang, J. B. West, M. J. Citardi, K. H. Manwaring, and R. Khadem, "Implementation, calibration and accuracy testing of an image-enhanced endoscopy system," IEEE Trans. Med Imag., vol. 21, no. 12, pp. 1524-1535, 2002.
56. J. Heikkilä and O. Silvén, "A four-step camera calibration procedure with implicit image correction," in Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), 1997, pp. 1106-1112.
57. R. Tsai, "A versatile camera calibration technique for high accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses," IEEE Int. J. Robot. Autom., vol. RA-3, no. 4, pp. 323-344, 1987.
58. Z. Zhang, "A flexible new technique for camera calibration," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, pp. 1330-1334, Nov. 2000.
59. D. Stoyanov, A. Darzi, and G. Z. Yang, "Laparoscope self-calibration for robotic assisted minimally invasive surgery," in Proc. Int. Conf. Med. Image Computing and Computer Assisted Intervention (MICCAI), J. Duncan and G. Gerig, Eds., 2005, vol. 3750, pp. 114-121, Lecture Notes in Computer Science.
60. R. Willson, "Modeling and calibration of automated zoom lenses.," Ph.D. dissertation, Robotics Inst., Carnegie Mellon Univ., Pittsburgh, PA, Jan. 1994.
61. G. Bianchi, C. Wengert, M. Harders, P. Cattin, and G. Székely, "Camera-marker alignment framework and comparison with hand-eye calibration for augmented reality applications 2005," ISMAR, pp. 188-189, Oct. 2005.
62. S. Nicolau, L. Goffin, and L. Soler, "A low cost and accurate guidance system for laparoscopic surgery: Validation on an abdominal phantom," in ACM Symp. on Virtual Reality Software and Int. Technol., Nov. 2005, pp. 124-133.
63. M. Scheuering, A. Schenk, A. Schneider, B. Preim, and G. Greiner, "Intraoperative augmented reality for minimally invasive liver interventions," Proc. 2003 SPIE Medical Imag.: Visualization, Image-Guided Prvcedures, and Display, 2003.
64. J. Schmidt, F. Vogt, and H. Niemann, "Robust hand-eye calibration of an endoscopic surgery robot using dual quaternions," in 25th DAGM Symp. Pattern Recogn., B. Michaelis and G. Krell, Eds., 2003, vol. 2781, pp. 548-556, Lecture Notes in Computer Science.
65. G. Marti, V. Bettschart, J.-S. Billiard, and C. Baur, "Hybrid method forboth calibration and registration of an endoscope with an active optical tracker," Comput. Assisted Radiology and Surgery, 2004.
66. T. Yamaguchi, M. Nakamoto, Y. Sato, K. Konishi, M. Hashizume, N. Sugano, H. Yoshikawa, and S. Tamura, "Development of a camera model and calibration procedure for oblique-viewing endoscopes," Computer Aided Surgery, vol. 9, no. 5, pp. 203-214, 2004.
67. S. De Buck, F. Maes, A. D'Hoore, and P. Suetens, N. Ayache, S. Ourselin, and A. Maeder, Eds., "Evaluation of a novel calibration technique for optically tracked oblique laparoscopes," in Proc. Int. Conf. Medical Image Computing and Computer Assisted Intervention (MICCAI), Brisbane, Australia, Oct./Nov. 2007, vol. 4791, pp. 467-474, Lecture Notes in Computer Science.
68. I. Bricault, G. Ferretti, and P. Cinquin, "Registration of real and CT-derived virtual bronchoscopic images to assist transbronchial biopsy," IEEE Trans. Med. Imag., vol. 17, no. 5, pp. 703-714, 1998.
69. K. Mori, D. Deguchi, J. Ichi Hasegawa, Y. Suenaga, J. ichiro Toriwaki, H. Takabatake, and H. Natori, "A method for tracking the camera motion of real endoscope by epipolar geometry analysis and virtual endoscopy system," in Proc. Int. Conf. Medical Image Computing and Computer Assisted Inteivention (MICCAI), 200.1, vol. 2208, pp. 1-8, Lecture Notes in Computer Science.
70. K. Mori, D. Deguchi, K. Akiyama, T. Kitasaka, C. R. Maurer Jr., Y. Suenaga, H. Takabatake, M. Mori, and H. Natori, "Hybrid bronchoscope tracking using a magnetic tracking sensor and image registration," in Proc. Int. Conf. Medical Image Computing and Computer Assisted Intervention (MICCAI), 2005, pp. 543-550.
71. I. Wegner, M. Vetter, M. Schoebinger, I. Wolf, and H. Meinzer, K. R. Cleary and R. L. Galloway Jr., Eds., "Development of a navigation system for endoluminal brachytherapy in human lungs," in Proc. SPIE Medical Imaging 2006: Visualization, Image-Guided Procedures, and Display, Mar. 2006, vol. 6141, pp. 23-30.
72. T. Klein, J. Traub, H. Hautmann, A. Ahmadian, and N. Navab, "Fiducial free registration procedure for navigated bronchoscopy," in Proc. Int. Conf. Medical Image Computing and Computer Assisted Intervention (MICCAI), 2007.
73. S. Krüger, F. Vogt, W. Hohenberger, D. Paulus, H. Niemann, and C. H. Schick, "Evaluation of computer-assisted image enhancementin minimal invasive endoscopic surgery," Methods Inf. Med., vol. 43, no. 4, pp. 362-366, 2004.
74. H. Fuchs, M. A. Livingston, R. Raskar, D. Colucci, K. Keller, A. State, J. R. Crawford, P. Rademacher, S. H. Drake, and A. A. Meyer, I. W. M. Wells, A. C. F. Colchester, and S. L. Delp, Eds., "Augmented reality visualization for laparoscopic surgery," in Proc. First Int. Conf. of Medical Image Computing and Computer-Assisted Intervention (MICCAI), Cambridge, MA, Oct. 1998, vol. 1496, pp. 934-943, Lecture Notes in Computer Science.
75. D. Dey, D. Gobbi, P. Slomka, K. Surry, and T. Peters, "Automatic fusion of freehand endoscopic brain images to three-dimensional surfaces: Creating stereoscopic panoramas," IEEE Trans. Med. Imag., vol. 21, no. 1, pp. 23-30, Jan. 2002.
76. T. Kawamata, H. Iseki, T. Shibasaki, and T. Hori, "Endoscopic augmented reality navigation system for endonasal transsphenoidal surgery to treat pituitary tumors: Technical note," Neurosurgery, vol. 50, no. 6, pp. 1393-1397, 2002.
77. J. Ellsmere, J. Stoll, D. W. Rattner, D. Brooks, R. Kane, W. M. Wells III, R. Kikinis, and K. Vosburgh, R. E. Ellis and T. M. Peters, Eds., "A navigation system for augmenting laparoscopic ultrasound," in Proc. Int. Conf. Medical Image Computing and Computer Assisted Intervention (MICCAI), 2003, pp. 184-191, Lecture Notes in Computer Science.
78. N. Navab, M. Mitschke, and A. Bani-Hashemi, "Merging visible and invisible: Two camera-augmented mobile C-arm (CAMC) applications," in Proc. IEEE and ACM Int. Workshop on Augmented Reality, San Francisco, CA, 1999, pp. 134-141.
79. G. Fichtinger, A. Deguet, K. Masamune, E. Balogh, G. S. Fischer, H. Mathieu, R. H. Taylor, S. J. Zinreich, and L. M. Fayad, "Image overlay guidance for needle insertion in ct scanner," IEEE Trans. Biomed. Engl., vol. 52, no. 8, pp. 1415-1424, Aug. 2005.
80. K. Masamune, Y. Masutani, S. Nakajima, I. Sakuma, T. Dohi, H. Iseki, and K. Takakura, "Three-dimensional slice image overlay system with, accurate depth perception for surgery," in Proc. Int. Conf. Medical Image Computing and Computer Assisted Intervention (MICCAI), Oct. 2000, vol. 1935, pp. 395-402, Lecture Notes in Computer Science.
81. G. Fischer, A. Deguet, D. Schlattman, L. Fayad, S. Zinreich, R. Taylor, and G. Fichtinger, "Image overlay guidance for mri arthrography needle insertion," Computer Aided Surgery, vol. 12, no. 1, pp. 2-4, 2007.
82. G. D. Stetten and V. S. Chib, "Overlaying ultrasound images on direct vision," Int. J. Ultrasound in Medicine, vol. 20, pp. 235-240, 2001.
83. G. Stetten, V. Chib, and R. Tamburo, "Tomographic reflection to merge ultrasound images with direct vision," in IEEE Proc. Applied Imagery Pattern Recognition (AIPR) Annu. Workshop, 2000, pp. 200-205.
84. N. Glossop and Z. Wang, R. E. Ellis and T. M. Peters, Eds., "Laser projection augmented reality system for computer assisted surgery," in Proc. Int. Conf. Medical Image Computing and Computer Assisted Intervention (MICCAI), 2003, vol. 2879, pp. 239-246, Lecture Notes in Computer Science.
85. T. Sasama et al., "A novel laser guidance system for alignment of linear surgical tools: Its principles and performance evaluation as a man-machine system," in Proc. Int. Conf. Medical Image Computing and Computer Assisted Intervention (MICCAI), London, U.K., 2002, pp. 125-132.
86. T. Wendler, J. Traub, S. Ziegler, and N. Navab, R. Larsen, M. Nielsen, and J. Sporring, Eds., "Navigated threedimensional beta probe for optimal cancer resection," in Proc. Int. Conf. Medical Image Computing and Computer Assisted Intervention (MICCAI) vol. 4190 of Lecture Notes in Computer Science, Copenhagen, Denmark, Oct. 2006, pp. 561-569.
87. D. A. Bowman, E. Kruijff, J. J. LaViola, and I. Poupyrev, 3D User-Interfaces: Theory and Practice. Redwood City, CA, USA: Addison Wesley Longman Publishing Co., Inc., 2004.
88. J. Traub, P. Stefan, S.-M. Heining, T. Sielhorst, C. Riquarts, E. Eu-ler, and N. Navab, R. Larsen, M. Nielsen, and J. Sporring, Eds., "Hybrid navigation interface for orthopedic and trauma surgery," in Proc. Int. Conf. Medical Image Computing and Computer Assisted Intervention (MICCAI), Copenhagen, Denmark, Oct. 2006, vol. 4190, pp. 373-380, Lecture Notes in Computer Science.
89. T. Peters, C. Henri, P. Munger, A. Takahashi, A. Evans, B. Davey, and A. Olivier, "Integration of stereoscopic DSA and 3D MRI for image-guided neurosurgery," Comput Med Imaging Graph., vol. 18, no. 4, pp. 289-299, 1994.
90. C. Calvano, M. Moran, L. Tackett, P. Reddy, K. Boyle, and M. Pankra-tov, "New visualization techniques for in utero surgery: Amnioscopy with, a three-dimensional head-mounted display and a computer-controlled endoscope.," J. Endourol., vol. 12, no. 5, pp. 407-410, 1998.
91. G. Hanna, S. Shimi, and A. Cuschieri, "Task performance in endoscopic surgery is influenced by location of the image display," Ann. Surg., vol. 227, no. 4, pp. 481-484, 1998.
92. J. B. A. Maintz and M. A. Viergever, "A survey of medical image registration," Medical Image Analysis, vol. 2, pp. 1-36, Mar. 1998.
93. M. Tuceryan, D. S. Greer, R. T. Whitaker, D. E. Breen, C. Crampton, E. Rose, and K. H. Ahlers, "Calibration requirements and proceduresfor a monitor-based augmented reality system," IEEE Trans. Visualiz. Computer Graphics, vol. 1, pp. 255-273, Sept. 1995.
94. C. R. Maurer Jr., J. M. Fitzpatrick, M. Y. Wang, J. Robert, L. Galloway, R. J. Maciunas, and G. S. Allen, "Registration of head volume images using implantable fiducial markers," IEEE Trans. Med. Imag., vol. 16, no. 4, pp. 447-462, Aug. 1997.
95. J. D. Stefansic, A. J. Herline, Y. Shyr, W. C. Chapman, J. M. Fitzpatrick, and R. L. Galloway, "Registration of physical space to laparoscopic image space for use in minimally invasive hepatic surgery," IEEE Trans. Medical Imaging, vol. 19, no. 10, pp. 1012-1023, Oct. 2000.
96. M. Feuerstein, S. M. Wildhirt, R. Bauernschmitt, and N. Navab, J. S. Duncan and G. Gerig, Eds., "Automatic patient registration for port placement in minimally invasive endoscopic surgery," in Proc. Int. Conf. Medical Image Computing and Computer Assisted Intervention (MICCAI), Palm Springs, CA, Sept. 2005, vol. 3750, pp. 287-294, Lecture Notes in Computer Science.
97. M. Feuerstein, T. Mussack, S. M. Heining, and N. Navab, "Intra-operative laparoscope augmentation for port placement and resection planning in minimally invasive liver resection," IEEE Trans. Med. Imag., vol. 27, pp. 355-369, Mar. 2008.
98. M. Baumhauer, T. Simpfendörfer, R. Schwarz, M. Seitel, B. Müller-Stich, C. Gutt, J. Rassweiler, H.-P. Meinzer, and I. Wolf, K. R. Cleary and M. I. Miga, Eds., "Soft tissue navigation for laparoscopic prostatectomy: Evaluation of camera pose estimation for enhanced visualization," in Proc. SPIE Medical Imaging 2007: Visualization and Image-Guided Procedures, San Diego, CA, Feb. 2007.
99. R. U. Thoranaghatte, G. Zheng, F. Langlotz, and L.-P. Nolte, "Endoscope-based hybrid navigation system for minimally invasive ventral spine surgeries," Computer Aided Surgery, vol. 10, pp. 351-356, Sept./Nov. 2005.
100. J. M. Fitzpatrick, J. B. West, and C. R. Maurer Jr., "Predicting error in rigid-body point-based registration," IEEE Trans. Med. Imag., vol. 14, no. 5, pp. 694-702, Oct. 1998.
101. R. Grzeszczuk, S. Chin, R. Fahrig, H. Abassi, H. Holz, J. A. Daniel Kiml, and R. Shahidi, "A fluoroscopic x-ray registration processfor three-dimensional surgical navigation," in Proc. Int. Conf. Medical Image Computing and Computer Assisted Inteivention (MICCAI), Lecture Notes in Computer Science, 2000, Springer-Verlag.
102. M. J. Murphy, "An automatic six-degree-of-freedom image registration algorithm for image-guided frameless stereotaxic radiosurgery," Medical Phys., vol. 24, no. 6, pp. 857-866, 1997.
103. M. Feuerstein, T. Mussack, S. M. Heining, andN. Navab, K. R. Cleary and M. I. Miga, Eds., "Registration-free laparoscope augmentation for intra-operative liver resection planning," in Medical Imaging 2007: Visualization and Image-Guided Procedures, Proc. SPIE, San Diego, CA, Feb. 2007.
104. 3D mobile C-arm," Electromedica, vol. 71, no. 1, pp. 7-16, 2003.
105. D. Burschka, M. Li, R. Taylor, and G. D. Hager, "Scale- invarianlregistration of monocular endoscopic images to ct-scans for sinus surgery," in Proc. Int. Conf. Medical Image Computing and Computer Assisted Intervention (MICCAI), C. Barillol, D. Haynor, and P. Hellier, Eds., 2004, vol. 3217, pp. 413-421, Lecture Notes in Computer Science.
106. C. Wengert, P. Cattin, J. M. Duff, C. Baur, and G. Székely, "Markerless endoscopic registration and referencing," in Proc. Int. Conf. Medical Image Computing and Computer Assisted Intervention (MICCAI), R. Larsen, M. Nielsen, and J. Sporring, Eds., 2006, Lecture Notes in Computer Science.
107. C. Maurer, Jr., "Investigation of intraopera live brain deformation using a 1.5-T interventional MR system: Preliminary results," IEEE Trans. Med. Imag., vol. 17, no. 5, p. 817, Oct. 1998.
108. M. Nakamoto, Y. Sato, M. Miyamoto, Y. Nakamjima, K. Konishi, M. Shimada, M. Hashizume, and S. Tamura, "3d ultrasound system using a magneto-optic hybrid tracker for augmented reality visualization in laparoscopic liver surgery," in Proc. Int. Conf. Medical Image Computing and Computer Assisted Intervention (MICCAI), T. Dohiand and R. Kikinis, Eds., 2002, vol. 2489, pp. 148-155, Lecture Notes in Computer Science.
109. J. Leven, D. Burschka, R. Kumar, G. Zhang, S. Blumenkranz, X. D. Dai, M. Awad, G. D. Hager, M. Marohn, M. Choli, C. Hasser, and R. H. Taylor, "Davinci canvas: A teterobotic surgical system wilh integrated, robot-assisted, laparoscopic ultrasound capability," in Proc. Int. Conf. Medical Image Computing and Computer Assisted Intervention (MICCAI), Vol. 3749 of Lecture Notes in Computer Science, Sept. 2005, pp. 811-818, Springer-Verlag.
110. M. Feuerstein, T. Reichl, J. Vogel, A. Schneider, H. Feussner, and N. Navab, "Magneto-optic tracking of a flexible laparoscopic ultrasound transducer for laparoscope augmentation," in Proc. Int. Conf. Medical Image Computing and Computer Assisted Intervention (MICCAI), N. Ayache, S. Ourselin, and A. Maeder, Eds., Brisbane, Australia, Oct./ Nov. 2007, vol. 4791, pp. 458-466, Lecture Notes in Computer Science.
111. F. S. Azar, D. N. Metaxas, and M. D. Schnall, "Methods for modeling and predicting mechanical deformations of the breast under external perturbations," Medical Image Analysis, vol. 6, no. 1, pp. 1-27, 2002.
112. J. W. Wong, M. B. Sharpe, D. A. Jaffray, V. R. Kini, J. M. Robertson, J. S. Stromberg, and A. A. Martinez, "The use of active breathing control (abc) to reduce margin for breathing motion," Int. Int. J. Radiation Oncology*Biology*Phys., vol. 44, pp. 911-919, July 1999.
113. J. M. Bailer, L. A. Dawson, S. Kazanjian, C. McGinn, K. K. Brock, T. Lawrence, and R. T. Haken, "Determination of ventilatory liver movement via radiographic evaluation of diaphragm position," Int., J. Radiation Oncology*Biology*Phys., vol. 51, pp. 267-270, Sept. 2001.
114. M. Baumhauer, M. Feuerstein, H.-P. Meinzer, and J. Rassweiler, "Navigation in endoscopic soft tissue surgery: Perspectives and limitations," Int. J. Endourology, vol. 22, pp. 1-16, Apr. 2008.
115. F. Vogl, "Augmented light field visualization and real-time image enhancement for computer assisted endoscopic surgery," Ph.D. dissertation, Universilal Erlangen-Nürnberg, 2005.
116. C. Ware and R. Balakrishnan, "Reaching for objects in VR displays: Lag and frame rate," ACM Trans. Computer-Human Interaction, vol. 1, no. 4, pp. 331-356, 1994.
117. T. Sielhorst, C. Bichlmeier, S. M. Heining, and N. Navab, "Depth, perception a major issue in medical ar: Evaluation study by twenty surgeons," in Proc. Int. Conf. Medical Image Computing and Computer Assisted Intervention (MICCAI), R. Larsen, M. Nielsen, and J. Spoiling, Eds., 2006, Lecture Notes in Computer Science.
118. T. Sielhorst, W. Sa, A. Khamene, F. Sauer, and N. Navab, "Measurement of absolute latency for video see through augmented reality," in Proc. IEEE and ACM Int. Symp. on Mixed and Augmented Reality (ISMAR), 2007.
119. B. Mactntyre, E. M. Coelho, and S. Julier, "Estimating and adapting to registration errors in augmented reality systems," in Proc. IEEE Virtual Reality (VR), 2002.
120. T. Sielhorst, M. A. Bauer, O. Wenisch, G. Klinker, and N. Navab, "Online estimation of the target registration error for n-ocular optical-tracking systems," in Proc. Int. Conf. Medical Image Computing and Computer Assisted Intervention (MICCAI), 2007, To appear at.
121. C. Nafis, V. Jensen, L. Beauregard, and P. Anderson, "Method for estimating dynamic em tracking accuracy of surgical navigation tools," in Proc. SPIE Medical Imaging 2006: Visualization, Image Guided Procedures, and Display, K. R. Cleary and R. L. Galloway, Jr., Eds., Mar. 2006, vol. 6141.
122. P. Jannin, J. Fitzpatrick, D. Hawkes, X. Pennec, R. Shahidi, and M. Vannier, "Validation of medical image processing in image-guided therapy," IEEE Trans. Med. Imag., vol. 21, no. 12, pp. 1445-1449, Dec. 2002.
123. D. Drascic and P. Milgram, "Perceptual issues in augmented reality," SPIE Volume 2653: Stereoscopic Displays and Virtual Reality Syst., vol. 2653, pp. 123-134, 1996.
124. J. E. Cutting and P. M. Vishton, W. Epstein and S. Rogers, Eds., "Perceiving layout and knowing distances: The integration, relative potency, and contextual use of different information about depth," Perception of Space and Motion, pp. 69-117, 1995.
125. L. G. Johnson, P. Edwards, and D. Hawkes, "Surface transparency makes stereo overlays unpredictable: The implications for augmented reality," in Medicine Meets Virtual Reality (MMVR), Vol. 94 of Studies in Health Int. Technol and Inf., J. D. Westwood, Ed. : IOS Press, 2002, pp. 131-136.
126. C. Furmanski, R. Azuma, and M. Daily, "Augmented-reality visualizations guided by cognition: Perceptual heuristics for combining visible and obscured information," in Proc. IEEE and ACM Int. Symp. on Mixed and Augmented Reality (ISMAR), 2002.
127. M. Livingston, I. JE, H. JL, H. TH, and S. D. Julier, "Resolving multiple occluded layers in augmented reality," in Proc. IEEE and ACM Int. Symp. on Mixed and Augmented Reality (ISMAR), 2003, pp. 56-65.
128. M. Lerotic, A. J. Chung, G. Mylonas, and G.-Z. Yang, "pq-space based non-photorealistic rendering for augmented reality," in Proc. Int. Conf. Medical Image Computing and Computer Assisted Intervention (MICCAI), 2007, pp. 102-109.
129. F. A. Biocca and J. P. Rolland, "Virtual eyes can rearrange your body: Adaptation to visual displacement in see-through, head-mounted displays," Presence: Teleoperators and Virtual Env., vol. 7, pp. 262-277, 1998.
130. E. M. Kolasinski, S. L. Goldberg, and J. H. Hiller, Simulator sickness in virtual environments U.S. Army Research Institute - Simulator Syst. Research Unit, Technical Report 1027, 1995.
131. G. Riccio, "An ecological theory of motion and postural instability," Ecological Psychology, vol. 3, no. 3, pp. 195-240, 1991.
132. W. E. Lorensen and H. E. Cline, "Marching cubes: A high resolution 3d surface construction algorithm," in Proc. 14th Annu. Conf. on SIGGRAPH'87: Computer Graphics and Interactive Techniques, New York, NY, 1987, pp. 163-169.
133. J. Krüger and R. Westermann, "Acceleration techniques for GPU-based volume rendering," Proceedings IEEE Visualization 2003, 2003.
134. M. Levoy, "Display of surfaces from volume data," IEEE Computer Graphics and Appl., vol. 8, no. 3, pp. 29-37, 1988.
135. A. Van Gelder and K. Kim, "Direct volume rendering with shading via three-dimensional textures," in Proc. 1996 Symp. on Volume Visualization, Piscataway, NJ, 1996, pp. 23-30.
136. B. Reitinger, A. Bornik, R. Beichel, and D. Schmalstieg, "Liver surgery planning using virtual reality," IEEE Computer Graphics and Applications, vol. 26, no. 6, pp. 36-47, 2006.
137. N. Navab, M. Feuerstein, and C. Bichlmeier, "Laparoscopic virtual mirror - New interaction paradigm for monitor based augmented reality," in Virtual Reality, Charlotte, NC, Mar. 2007, pp. 43-50.
138. S.-A. Ahmadi, T. Sielhorst, R. Stauder, M. Horn, H. Feussner, and N. Navab, "Recovery of surgical workflow without explicit models," in Proc. Int. Conf. Medical Image Computing and Computer Assisted Intervention (MICCAI), 2006, pp. 420-428.
139. C. Bichlmeier, F. Wimmer, H. S. Michael, andN. Nassir, "Con-textual anatomic mimesis: Hybrid in-situ visualization method for improving multi-sensory depth, perception in medical augmented reality," in Proc. IEEE and ACM Int. Symp. on Mixed and Augmented Reality (ISMAR), Nov. 2007, pp. 129-138.
140. D. Kalkofen, E. Mendez, and D. Schmalstieg, "Interactive focus and context visualization for augmented reality," in Proc. IEEE and ACM Int. Symp. on Mixed and Augmented Reality (ISMAR), 2007.
141. C. Pettey and L. Goasduff, Emerging Technologies Hype Cycle. Stamford, CT: Gartner, 2006.