A portable image overlay projection device for computer-aided open liver surgery

IEEE Transactions on Biomedical Engineering

Volumn 58, Issue 6, 2011, Pages 1855-1864

  Gavaghan, Kate A ^a   Peterhans, Matthias ^a   Oliveira Santos, Thiago ^a   Weber, Stefan ^a  

^a UNIVERSITY OF BERN   (Switzerland)

Author keywords

Augmented reality (AR); computer aided surgery; liver surgery; projection

Indexed keywords

ANATOMICAL STRUCTURES; CAMERA CALIBRATION TECHNIQUES; COMPUTER AIDED SURGERY; CRITICAL STRUCTURES; DISPLAY SCREEN; EXTRINSIC PARAMETER; IMAGE OVERLAY; LIVER SURGERY; MINIATURE LASERS; MODEL GENERATION; ORGAN SURFACES; PATIENT REGISTRATION; PIG LIVER; POSITION SENSORS; PROJECTION; PROJECTION DEVICES; PROJECTION ERROR; STERILE ENVIRONMENTS; SURGICAL WORKFLOW; VIRTUAL CAMERA;

AUGMENTED REALITY; CALIBRATION; CAMERAS; DISPLAY DEVICES; MAMMALS; MEDICAL COMPUTING; NAVIGATION; NAVIGATION SYSTEMS; SURFACE TESTING; TISSUE; TRANSPLANTATION (SURGICAL); VIRTUAL REALITY;

THREE DIMENSIONAL;

ACCURACY; ARTICLE; CALIBRATION; COMPUTER AIDED OPEN LIVER SURGERY; COMPUTER ASSISTED SURGERY; COMPUTER PROGRAM; HUMAN; IMAGE OVERLAY PROJECTION DEVICE; IMAGE OVERLAY PROJECTOR DEVICE; LIVER SURGERY; MEDICAL INSTRUMENTATION; NONHUMAN; PARAMETERS OF MEASUREMENT AND ANALYSIS; PORTABLE EQUIPMENT; SWINE; THREE DIMENSIONAL IMAGING; WORKFLOW;

ANIMALS; DIGESTIVE SYSTEM SURGICAL PROCEDURES; EQUIPMENT DESIGN; FEASIBILITY STUDIES; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; LIVER; SURGERY, COMPUTER-ASSISTED; SWINE; USER-COMPUTER INTERFACE;

EID: 79956347111     PISSN: 00189294     EISSN: 15582531     Source Type: Journal    
DOI: 10.1109/TBME.2011.2126572     Document Type: Article

References (26)

1. J. Shuhaiber, "Augmented reality in surgery," Arch Surg, vol. 139, pp. 170-174, 2004. (Pubitemid 38174711)
2. J. Marescaux,F.Rubino, M.Arenas, D.Mutter, andL.Soler, "Augmented-reality-assisted laparoscopic adrenalectomy," J. Amer. Med. Assoc., vol. 292, pp. 2214-2215, 2004.
3. A. DiGioia, B. Colgan, and N. Koerbel, "Computer-aided surgery," in Cybersurgery: Advanced Technologies for Surgical Practice, R. Satava, Ed., New York: Wiley, 1998, pp. 121-139.
4. M. Blackwell, C. Nikou, A. DiGioia, and T. Kanade, "An image overlay system for medical data visualization," Lecture Notes in Computer Science, Medical Image Computing and Computer-Assisted Intervention\MICCAI'98, Cambridge MA: Springer-Verlag, 1998.
5. G. Fichtinger, A. Deguet, K. Masamune, E. Balogh, G. Fischer, H. Math-ieu, R. Taylor, L. Fayad, and S. Zinreich, "Needle insertion in CT scanner with image overlay-cadaver studies," in Lecture Notes in Computer Science, Berlin, Heidelberg: Springer-Verlag, 2004, vol. 3217, pp. 795-803. (Pubitemid 40787298)
6. K. Masamune, Y. Masutani, S. Nakajima, I. Sakuma, T. Dohi, H. Iseki, and K. Takakura, "Three-dimensional slice image overlay system with accurate depth perception for surgery," in Lecture Notes in Computer Science, London, U.K.: Springer-Verlag, 2000, vol. 1935, pp. 385-402.
7. G. Stetten, V. Chib, and R. Tamburo, "Tomographic reflection to merge ultrasound images with direct vision," in Proc. IEEE Appl. Recog. (AIPR) Annu. Workshop, 2000, pp. 200-205.
8. H. Fuchs, A. State, H. Yang, T. Peck, S. Lee, M. Rosenthal, A. Bulysheva, and C. Burke, "Optimizing a head-tracked stereo display system to guide hepatic tumor ablation," Studies Health Technol. Informat., vol. 132, pp. 126-131, 2008.
9. F. Sauer, A. Khamene, B. Bascle, L. Schinunang, F. Wenzel, and S. Vogt, "Augmented reality visualization of ultrasound images: System description, calibration and features," in Proc. IEEE ACM Int. Symp. Augmented Reality, 2001, pp. 30-39.
10. M. Sugimoto, H. Yasuda, K. Koda, M. Suzuki, M. Yamazaki, T. Tezuka, C. Kosugi, R. Higuchi, Y. Watayo, Y. Yagawa, S. Uemura, H. Tsuchiya, and T. Azuma, "Image overlay navigation by markerless surface registration in gastrointestinal, hepatobiliary and pancreatic surgery," J. Hepatobiliary Pancreat. Surg, vol. 17, no. 5, pp. 629-636, Oct. 2009.
11. F. Volonte, P. Bucher, F. Pugin, A. Carecchio, M. Sugimoto, O. Ratib, and P. Morel1, "Mixed reality for laparoscopic distal pancreatic resection," Int. J. Comput. Assisted Radiol. Surg., vol. 5, suppl. 1, pp. 122-130, 2010.
12. J. Tardif, S. Roy, and J. Meunier, "Projector-based augmented reality in surgery without calibration," Studies Health Technol. Informat., vol. 85, pp. 204-206, 2002.
13. M. Peterhans, A. vom Berg, Dagon, D. Inderbitzin, C. Baur, D. Can-dinas, and S. Weber, "A navigation system for open liver surgery: Design, workflow, and first clinical applications,", IJMRCAS, 2010, to be published.
14. K. J. Oldhafer, G. A. Stavrou, G. Prause, H. O. Peitgen, T. C. Lueth, and S. Weber S, "How to operate a liver tumour you cannot see," Langenbecks Arch. Surg., vol. 394, pp. 489-494, 2009.
15. Micro vision PicoP Evaluation Kit (PEK) Interface Control Document, no. DC0124473, Rev. C. 2009.
16. A. Schenk, S. Zidowitz, H. Bourquain, M. Hindennach, C. Hansen, H. Hahn, and H. Peitgen, "Clinical relevance of model based computer-assisted diagnosis and therapy," Medical Imaging 2008: Computer-Aided Diagnosis, vol. 6915, pp. 691502-691519, 2008.
17. A. Griesser and L. Van Gool, "Automatic interactive calibration of multi-projector-camera systems," in Proc. IEEE Comput. Soc. Conf. Comput. Vision Pattern Recog., New York, 17-22 Jun. 2006, p. 8.
18. M. Kimura, M. Mochimaru, and T. Kanade, "Projector calibration using arbitrary planes and calibrated camera," presented at the IEEE Computer Society Confon Computer Vision and Pattern Recognition, Minneapolis, MN, Jun. 18-23, 2007.
19. Z. Zhang, "A flexible new technique for camera calibration," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 11, pp. 1330-1334, Nov. 2000.
20. J. Wernecke, The Inventor Mentor: Programming Object-Oriented 3D Graphics with Open Inventor, Release 2, Addison-Wesley, 1994, pp 80-90.
21. S. Li, G. Zhang, and Z. Wei, "The determination of the intrinsic and extrinsic parameters of virtual camera based on OpenGL," 6th Int. Symp. Instrum. Control Technol.: Sensors, Automat. Meas., Control, Comput. Simul. SPIE, vol. 6358 C-1, 2006.
22. J.-Y Bouguet, "Camera calibration toolbox for Matlab®," (2010). [Online]. Available: http://www.vision.caltech.edu/bouguetj/calib-doc
23. R. Thoranaghatte, J. Garcia, M. Caversaccio, D. Widmer, M. A. Gonzalez Ballester, L. P. Nolte, and G. Zheng, "Landmark-based augmented reality system for paranasal and transnasal endoscopic surgeries," Int. J. Med. Robot., vol. 5, no. 4, pp. 415-422, Dec. 2009.
24. J. Garćia, R. Thoranaghatte, G. Marti, G. Zheng, M. Caversaccio, and M. A. Gonzalez Ballester, "Calibration of a surgical microscope with automated zoom lenses using an active optical tracker," Int. J. Med. Robot., vol. 4, no. 1, pp. 87-93, Mar. 2008. (Pubitemid 351428336)
25. S. Weber, M. Klein, A. Hein, T. Krueger, T. C. Lüth, and J. Bier, "The navigated image viewer-evaluation in maxillofacial surgery," in Lecture Notes in Computer Science, Berlin, Heidelberg: Springer-Verlag, Oct. 2003, vol. 2878, pp. 762-769.
26. C. Hansen, J. Wieferich, F. Ritter, C. Rieder, and H. Peitgen, "Illustrative visualization of 3D planning models for augmented reality in liver surgery," Int. J. Comput. Assisted Radiol. Surg., vol. 5, no. 2, pp. 133-141, Mar. 2010.