Image mapping of untracked free-hand endoscopic views to an ultrasound image-constructed 3D placenta model

International Journal of Medical Robotics and Computer Assisted Surgery

Volumn 11, Issue 2, 2015, Pages 223-234

  Yang, Liangjing ^a   Wang, Junchen ^a   Kobayashi, Etsuko ^a   Ando, Takehiro ^a   Yamashita, Hiromasa ^b   Sakuma, Ichiro ^a   Chiba, Toshio ^b  

^a UNIVERSITY OF TOKYO   (Japan)

^b NATIONAL CENTER FOR CHILD HEALTH AND DEVELOPMENT   (Japan)

Author keywords

Image mapping; Minimally invasive fetal endoscopic surgery; Mosaic; Surgical navigation; Twin to twin transfusion syndrome

Indexed keywords

ENDOSCOPY; ERRORS; MAPPING; SURGERY; ULTRASONICS;

ENDOSCOPIC SURGERY; IMAGE MAPPING; IMAGE-BASED LOCALIZATIONS; MINIMALLY INVASIVE; MINIMALLY INVASIVE FETAL ENDOSCOPIC SURGERY; MOSAIC; SURGICAL NAVIGATION; TWIN-TO-TWIN TRANSFUSION SYNDROME; ULTRASOUND IMAGES; VISUAL GUIDANCE;

NAVIGATION;

ARTICLE; CONTROLLED STUDY; DIMENSIONAL MEASUREMENT ACCURACY; ENDOSCOPE; ENDOSCOPIC ECHOGRAPHY; FEASIBILITY STUDY; IMAGE ANALYSIS; IMAGE MAPPING; IMAGE OVERLAY; IMAGING AND DISPLAY; IMAGING PHANTOM; PRINCIPAL COMPONENT ANALYSIS; SIMULATION; ULTRASOUND CONSTRUCTED THREE DIMENSIONAL PLACENTA MODEL; VIDEOENDOSCOPY; ANATOMIC MODEL; COMPUTER SIMULATION; ECHOGRAPHY; FEMALE; FETOFETAL TRANSFUSION; FETOSCOPY; HUMAN; MINIMALLY INVASIVE SURGERY; PLACENTA; PREGNANCY; PROCEDURES; THREE DIMENSIONAL IMAGING; VALIDATION STUDY;

COMPUTER SIMULATION; FEMALE; FETOFETAL TRANSFUSION; FETOSCOPY; HUMANS; IMAGING, THREE-DIMENSIONAL; MINIMALLY INVASIVE SURGICAL PROCEDURES; MODELS, ANATOMIC; PLACENTA; PREGNANCY;

EID: 84930164476     PISSN: 14785951     EISSN: 1478596X     Source Type: Journal    
DOI: 10.1002/rcs.1592     Document Type: Article

References (30)

1. Bruner JP, Anderson TL, Rosemond RL. Placental pathophysiology of the twin oligohydramnios-polyhydramnios sequence and the twin-twin transfusion syndrome. Placenta 1998; 19(1): 81-86.
2. Rossi AC, D'Addario V. Laser therapy and serial amnioreduction as treatment for twin-twin transfusion syndrome: a metaanalysis and review of literature. Am J Obstet Gynecol 2008; 198(2): 147-152.
3. Baud D, Windrim R, Keunen J, et al. Fetoscopic laser therapy for twin-twin transfusion syndrome before 17 and after 26weeks' gestation. Am J Obstet Gynecol 2013 March; 208(3): 165-166.
4. Fowler SF, Sydorak RM, Albanese CT, et al. Fetal endoscopic surgery: lessons learned and trends reviewed. J Pediat Surg 2002; 37(12): 1700-1702.
5. Rauskolb R. Fetoscopy - a new endoscopic approach. Endoscopy 1979; 11(2): 107-113.
6. Ville Y, Hyett J, Hecher K, Nicolaides K. Preliminary experience with endoscopic laser surgery for severe twin-to-twin transfusion syndrome. New Engl J Med 1995; 332(4): 224-227.
7. Ville Y, Hecher K, Gagnon A, et al. Endoscopic laser coagulation in the management of severe twin-to-twin transfusion syndrome. BJOG Int J Obstet Gynaecol 1998; 105(4): 446-453.
8. Liao H, Tsuzuki M, Kobayashi E, Sakuma I. GPU-based fast 3D ultrasound-endoscope image fusion for complex-shaped objects. In World Congress on Medical Physics and Biomedical Engineering, September 7-12, 2009, Munich, Germany, vol 25/5, IFMBE Proceedings, Dossel O, Schlegel W (eds). Springer: Berlin/Heidelberg, 2009a; 206-209.
9. Liao H, Tsuzuki M, Mochizuki T, et al. Fast image mapping of endoscopic image mosaics with three-dimensional ultrasound image for intrauterine fetal surgery. Minimal Invas Ther Allied Technol 2009b; 18(6): 332-340.
10. Sato I, Nakamura R. Positioning error evaluation of GPU-based 3D ultrasound surgical navigation system for moving targets by using optical tracking system. Intl Jf Comput Assist Radiol Surg 2013 May; 8(3): 379-393.
11. Cleary K, Peters TM. Image-guided interventions: technology review and clinical applications. Annl Rev Biomed Eng 2012; 12(1): 119-142.
12. Yang L, Wang J, Kobayashi E, et al. An intraoperative framework for mapping of untracked endoscopic vision to 3D ultrasound placenta. Int J Comput Assist Radiol Surg 2013a; 8(Suppl 1): S152-153.
13. Yang L, Wang J, Kobayashi E, Liao H, Yamashita H, Sakuma I, Chiba T. Ultrasound Image-based Endoscope Localization for Minimally Invasive Fetoscopic Surgery. Proceeding of 35th Annual International Conference of the IEEE, Jul 3-7, 2007; 1411-1413.
14. Yang L, Wang J, Kobayashi E, et al. Ultrasound image-guided mapping of endoscopic views on a 3D placenta model: a tracker-less approach. In Augmented Reality Environments for Medical Imaging and Computer-Assisted Interventions, Liao H, Linte CA, Masamune K, Peters TM, Zheng G (eds). Springer Berlin: Heidelberg; 2013b; 107-116.
15. Reeff M, Gerhard F, Cattin P, Szekely G. Mosaicing of endoscopic placenta images. GI Jahrestagung 2006; 93(1): 467-474.
16. Atasoy S, Noonan D, Benhimane S, Navab N, Yang G-Z. A global approach for automatic fibroscopic video mosaicing in minimally invasive diagnosis. In Medical Image Computing and Computer-Assisted Intervention 2008, vol 5241, Metaxas D, Axel L, Fichtinger G (eds). Lecture Notes in Computer Science, Springer: Berlin/Heidelberg, 2008; 850-857.
17. Seshamani S, Smith MD, Corso JJ, Filipovich MO, Natarajan A, Hager GD. Direct global adjustment methods for endoscopic mosaicking. Proceeding of SPIE 7261, Medical Imaging 2009: Visualization, Image-Guided Procedures, and Modeling, 72611D, 2009.
18. Wang X, Zhang Q, Han Q, et al. Endoscopic video texture mapping on pre-built 3-D anatomical objects without camera tracking. Med Imag IEEE Trans 2010; 29(6): 1213-1223.
19. Grasa OG, Civera J, Guemes A, Munoz V, Montiel JMM. EKF Monocular SLAM 3D modeling, measuring and augmented reality from endoscope image sequences. In Proceedings of AMI-ARCS: 5th workshop on augmented environments for medical imaging including augmented reality in computer-aided surgery, 2009; 102-109.
20. Mountney P, Yang G-Z, Jiang T, et al. Motion Compensated SLAM for Image Guided Surgery In Medical Image Computing and Computer-Assisted Intervention MICCAI 2010, vol 6362. Lecture Notes in Computer Science. Springer: Berlin/Heidelberg, 2010; 496-504.
21. Richa R, Bó A, Poignet P, et al. Robust 3D Visual Tracking for Robotic-Assisted Cardiac Interventions In Medical Image Computing and Computer-Assisted Intervention - MICCAI 2010, vol 6361. Lecture Notes in Computer Science. Springer: Berlin/Heidelberg, 2010; 267-274.
22. Richa Rogerio BZ, Balicki M, Hager G, Taylor R. Hybrid Tracking and Mosaicking for Information Augmentation in Retinal Surgery. In Medical Image Computing and Computer-Assisted Intervention MICCAI 2012, vol 7510, Ayache N, Delingette H, Golland P, Mori K (eds). Lecture Notes in Computer Science, Springer: Berlin Heidelberg, 2012; 397-404.
23. Carroll R, Seitz S. Rectified surface mosaics. Int J Comput Vision 2009; 85(3): 307-315.
24. Azzari P, Di Stefano L, Mattoccia S, et al. An Evaluation Methodology for Image Mosaicing Algorithms Advanced Concepts for Intelligent Vision Systems. In, vol 5259. Lecture Notes in Computer Science. Springer Berlin Heidelberg, 2008; 89-100.
25. Rosten E, Drummond T, Leonardis A, et al. Machine Learning for High-Speed Corner Detection Computer Vision - ECCV 2006. vol 3951. Lecture Notes in Computer Science. Springer: Berlin/Heidelberg; 2006; 430-443.
26. Fischler MA, Martin A, Bolles RC. Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun ACM 1981; 24(6): 381-395.
27. Brown D. Decentering distortion of lenses. Photometric Eng 1966; 32(3): 444-462.
28. Heikkila J, Silven O. A four-step camera calibration procedure with implicit image correction. Proceedings of 1997 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Jun 17-19, 1997; 1106-1112.
29. Camera Calibration Toolbox for Matlab by Jean-Yves Bouguet (last updated 2013 Oct 10; cited 2013 Nov 25) Available from: http://www.vision.caltech.edu/bouguetj/calib_doc/
30. Hartley R, Zisserman A. Multiple View Geometry (2nd edn). Cambridge University Press, 2004.