Image overlay navigation by markerless surface registration in gastrointestinal, hepatobiliary and pancreatic surgery

Journal of Hepato-Biliary-Pancreatic Sciences

Volumn 17, Issue 5, 2010, Pages 629-636

  Sugimoto, Maki ^a,b   Yasuda, Hideki ^a   Koda, Keiji ^a   Suzuki, Masato ^a   Yamazaki, Masato ^a   Tezuka, Tohru ^a   Kosugi, Chihiro ^a   Higuchi, Ryota ^a   Watayo, Yoshihisa ^a   Yagawa, Yohsuke ^a   Uemura, Shuichiro ^a   Tsuchiya, Hironori ^a   Azuma, Takeshi ^b  

^a TEIKYO UNIVERSITY CHIBA MEDICAL CENTER   (Japan)

^b KOBE UNIVERSITY GRADUATE SCHOOL OF MEDICINE   (Japan)

Author keywords

Augmented reality; Cholesystectomy; DICOM viewer OsiriX; Image overlay navigation surgery; Laparoscopy; Mixed reality; Surface volume rendering; Virtual reality

Indexed keywords

ABDOMINAL WALL; ARTICLE; BILE DUCT; BODY SURFACE; CHOLANGIOGRAPHY; CHOLECYSTECTOMY; CLINICAL ARTICLE; COLON RESECTION; COLORECTAL CANCER; COMPUTER ANALYSIS; COMPUTER PROGRAM; DIGITAL IMAGING AND COMMUNICATIONS IN MEDICINE; GASTRECTOMY; HUMAN; IMAGE ANALYSIS; IMAGE OVERLAY NAVIGATION; IMAGE OVERLAY NAVIGATION SURGERY; IMAGE PROCESSING; IMAGE RECONSTRUCTION; IMAGE REGISTRATION; IMAGING SYSTEM; MULTIDETECTOR COMPUTED TOMOGRAPHY; NATURAL ORIFICE TRANSLUMINAL ENDOSCOPIC SURGERY; NON INVASIVE PROCEDURE; STOMACH CANCER; SURGICAL ANATOMY; SURGICAL TECHNOLOGY; THREE DIMENSIONAL IMAGING; VIRTUAL REALITY; ABDOMINAL SURGERY; BILE DUCT DISEASE; COMPARATIVE STUDY; COMPUTER ASSISTED SURGERY; COMPUTER ASSISTED TOMOGRAPHY; EQUIPMENT DESIGN; GASTROINTESTINAL DISEASE; INSTRUMENTATION; LAPAROSCOPE; METHODOLOGY; PANCREAS DISEASE; REPRODUCIBILITY;

BILE DUCT DISEASES; DIGESTIVE SYSTEM SURGICAL PROCEDURES; EQUIPMENT DESIGN; GASTROINTESTINAL DISEASES; HUMANS; IMAGING, THREE-DIMENSIONAL; LAPAROSCOPES; PANCREATIC DISEASES; REPRODUCIBILITY OF RESULTS; SURGERY, COMPUTER-ASSISTED; TOMOGRAPHY, X-RAY COMPUTED;

EID: 79952108527     PISSN: 18686974     EISSN: 18686982     Source Type: Journal    
DOI: 10.1007/s00534-009-0199-y     Document Type: Article

References (30)

1. Tang SL, Kwoh CK, Teo MY, Sing NW, Ling KV. Augmented reality systems for medical applications. IEEE Eng Med Biol Mag. 1998;17:49-58.
2. Marescaux J, Rubino F, Arenas M, Mutter D, Soler L. Augmented-reality- assisted laparoscopic adrenalectomy. JAMA. 2004;292:2214-5. (Pubitemid 39473158)
3. Shuhaiber JH. Augmented reality in surgery. Arch Surg. 2004;139:170-4. (Pubitemid 38174711)
4. Milgram P, Kishino AF. Taxonomy of mixed reality visual displays. IEICE Trans Inform Syst 1994; E77-D:1321-9.
5. Rosset A, Spadola L, Ratib O, Osiri X. An open-source software for navigating in multidimensional DICOM images. J Digit Imaging. 2004;17:205-16. (Epub ahead of print).
6. Rosset C, Rosset A, Ratib O. General consumer communication tools for improved image management and communication in medicine. J Digit Imaging. 2005;18:270-9. (Pubitemid 41609325)
7. Rosset A, Spadola L, Pysher L, Ratib O. Informatics in radiology (infoRAD): navigating the fifth dimension: innovative interface for multidimensional multimodality image navigation. Radiographics. 2006;26:299-308. (Pubitemid 43235019)
8. Bauernschmitt R, Feuerstein M, Traub J, Schirmbeck EU, Klinker G, Lange R. Optimal port placement and enhanced guidance in robotically assisted cardiac surgery. Surg Endosc. 2007;21:684-7. (Epub 2006 Dec 16).
9. Fichtinger G, Deguet A, Masamune K, Balogh E, Fischer GS, Mathieu H, et al. Image overlay guidance for needle insertion in CT scanner. IEEE Trans Biomed Eng. 2005;52:2-1415.
10. Das M, Sauer F, Schoepf UJ, Khamene A, Vogt SK, Schaller S, et al. Augmented reality visualization for CT-guided interventions: system description, feasibility, and initial evaluation in an abdominal phantom. Radiology. 2006;240:230-5. (Epub 2006 May 23).
11. Nicolau SA, Pennec X, Soler L, Ayache N. A complete augmented reality guidance system for liver punctures: first clinical evaluation. Med Image Comput Comput Assist Interv Int Conf Med Image Comput Comput Assist Interv. 2005;8:539-47. (Pubitemid 43828293)
12. Deutschmann H, Steininger P, Nairz O, Kopp P, Merz F, Wurstbauer K, et al. "Augmented reality" in conventional simulation by projection of 3-D structures into 2-D images: a comparison with virtual methods. Strahlenther Onkol. 2008;184:93-9.
13. Iseki H, Masutani Y, Iwahara M, Tanikawa T, Muragaki Y, Taira T, et al. Volumegraph (overlaid three-dimensional image-guided navigation): clinical application of augmented reality in neurosurgery. Stereotact Funct Neurosurg. 1997;68:18-24. (Pubitemid 28312089)
14. Masutani Y, Dohi T, Yamane F, Iseki H, Takakura K. Augmented reality visualization system for intravascular neurosurgery. Comput Aided Surg. 1998;3:239-47. (Pubitemid 29180708)
15. Lovo EE, Quintana JC, Puebla MC, Torrealba G, Santos JL, Lira IH, et al. A novel, inexpensive method of image coregistration for applications in image-guided surgery using augmented reality. Neurosurgery. 2007;60:366-71. discussion 371-2.
16. Ackerman JD, Keller K, Fuchs H. Real-time anatomical 3D image extraction for laparoscopic surgery. Stud Health Technol Inform. 2001;81:18-22. (Pubitemid 33320029)
17. Kawamata T, Iseki H, Shibasaki T, Hori T. Endoscopic augmented reality navigation system for endonasal transsphenoidal surgery to treat pituitary tumors: technical note. Neurosurgery. 2002;50:1393-7. (Pubitemid 36322785)
18. Falk V, Mourgues F, Vieville T, Jacobs S, Holzhey D, Walther T, et al. Augmented reality for intraoperative guidance in endoscopic coronary artery bypass grafting. Surg Technol Int. 2005;14:231-5.
19. Ukimura O, Gill IS. Imaging-assisted endoscopic surgery: Cleveland clinic experience. J Endourol. 2008;22:803-10.
20. Nakamoto M, Nakada K, Sato Y, Konishi K, Hashizume M, Tamura S. Intraoperative magnetic tracker calibration using a magneto-optic hybrid tracker for 3-D ultrasound-based navigation in laparoscopic surgery. IEEE Trans Med Imaging. 2008;27:255-70.
21. Yuan ML, Ong SK, Nee AY. Registration using natural features for augmented reality systems. IEEE Trans Vis Comput Graph. 2006;12:569-80. (Pubitemid 43824569)
22. Marmulla R, Lüth T, Mühling J, Hassfeld S. Markerless laser registration in image-guided oral and maxillofacial surgery. J Oral Maxillofac Surg. 2004;62:845-51. (Pubitemid 38881131)
23. Comport AI, Marchand E, Pressigout M, Chaumette F. Real-time markerless tracking for augmented reality: the virtual visual serving framework. IEEE Trans Vis Comput Graph. 2006;12:615-28. (Pubitemid 43824572)
24. Marmulla R, Mühling J, Wirtz CR, Hassfeld S. High-resolution laser surface scanning for patient registration in cranial computer-assisted surgery. Minim Invasive Neurosurg. 2004;47:72-8. (Pubitemid 38937802)
25. Uenohara M, Kanade T. Vision-based object registration for real-time image overlay. Comput Biol Med. 1995;25:249-60.
26. Sugimoto M, Yasuda H, Koda K, Suzuki M, Yamazaki M, Tezuka T, et al. Evaluation for transvaginal and transgastric NOTES cholecystectomy in human and animal natural orifice translumenal endoscopic surgery. J Hepatobiliary Pancreat Surg. 2009;16:255-60. (Epub 2009 Apr 10).
27. Sugimoto M. Natural orifice translumenal endoscopic surgery (NOTES) for innovation in hepatobiliary and pancreatic surgery: preface. J Hepatobiliary Pancreat Surg. 2009;16:247-8. (Epub 2009 Apr 14).
28. Sugimoto M, Yasuda H, Koda K, Suzuki M, Yamazaki M, Tezuka T, et al. Rendezvous gastrotomy technique using direct percutaneous endoscopic gastrostomy for transgastric cholecystectomy in hybrid natural orifice translumenal endoscopic surgery. J Hepatobiliary Pancreat Surg. 2009. doi:10.1007/s00534-009- 0143-1. (Epub 2009 Jul 15).
29. Vosburgh KG, San José Estépar R. Natural orifice transluminal endoscopic surgery (NOTES): an opportunity for augmented reality guidance. Stud Health Technol Inform. 2007;125:485-90.
30. Estépar RS, Stylopoulos N, Ellis R, Samset E, Westin CF, Thompson C, et al. Towards scarless surgery: an endoscopic ultrasound navigation system for transgastric access procedures. Comput Aided Surg. 2007;12:311-24. (Pubitemid 350232918)