Pose-aware C-arm for automatic re-initialization of interventional 2D/3D image registration

International Journal of Computer Assisted Radiology and Surgery

Volumn 12, Issue 7, 2017, Pages 1221-1230

  Fotouhi, Javad ^a   Fuerst, Bernhard ^a   Johnson, Alex ^b   Lee, Sing Chun ^a   Taylor, Russell ^c   Osgood, Greg ^b   Navab, Nassir ^a,d   Armand, Mehran ^b,c,e  

^a JOHNS HOPKINS UNIVERSITY   (United States)

^b JOHNS HOPKINS UNIVERSITY SCHOOL OF MEDICINE   (United States)

^c Johns Hopkins University   (United States)

^d TECHNICAL UNIVERSITY OF MUNICH   (Germany)

^e JOHNS HOPKINS UNIVERSITY APPLIED PHYSICS LABORATORY   (United States)

Author keywords

2D 3D registration; C arm; Initialization; Intra intervention; RGBD camera

Indexed keywords

ARTICLE; AUTOMATION; C ARM FLUOROSCOPY; COMPUTED TOMOGRAPHY SCANNER; FLUOROSCOPY; FLUOROSCOPY SYSTEM; IMAGE PROCESSING; LEARNING ALGORITHM; PHANTOM; PRIORITY JOURNAL; THREE DIMENSIONAL IMAGING; TWO-DIMENSIONAL IMAGING; X RAY CAMERA; X-RAY COMPUTED TOMOGRAPHY; CALIBRATION; FEMUR; HUMAN; IMAGING PHANTOM; MINIMALLY INVASIVE SURGERY; MULTIMODAL IMAGING; PELVIS; PROCEDURES;

CALIBRATION; FEMUR; HUMANS; IMAGING, THREE-DIMENSIONAL; MINIMALLY INVASIVE SURGICAL PROCEDURES; MULTIMODAL IMAGING; PELVIS; PHANTOMS, IMAGING;

EID: 85019579642     PISSN: 18616410     EISSN: 18616429     Source Type: Journal    
DOI: 10.1007/s11548-017-1611-8     Document Type: Article

References (35)

1. Bay H, Tuytelaars T, Van Gool L (2006) Surf: speeded up robust features. In: European conference on computer vision. Springer, Berlin, pp 404–417
2. Van der Bom M, Bartels L, Gounis M, Homan R, Timmer J, Viergever M, Pluim J (2010) Robust initialization of 2D–3D image registration using the projection-slice theorem and phase correlation. Med Phys 37(4):1884–1892
3. Endres F, Hess J, Engelhard N, Sturm J, Cremers D, Burgard W (2012) An evaluation of the RGB-D SLAM system. In: 2012 IEEE international conference on robotics and automation (ICRA). IEEE, pp 1691–1696 (2012)
4. Euler E, Heining S, Riquarts C, Mutschler W (2003) C-arm-based three-dimensional navigation: a preliminary feasibility study. Comput Aided Surg 8(1):35–41
5. Fischer M, Fuerst B, Lee SC, Fotouhi J, Habert S, Weidert S, Euler E, Osgood G, Navab N (2016) Preclinical usability study of multiple augmented reality concepts for K-wire placement. Int J Comput Assist Radiol Surg 11(6):1007–1014
6. Fischler MA, Bolles RC (1981) Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun ACM 24(6):381–395
7. Fotouhi J, Fuerst B, Lee SC, Keicher M, Fischer M, Weidert S, Euler E, Navab N, Osgood G (2016) Interventional 3D augmented reality for orthopedic and trauma surgery. In: 16th annual meeting of the international society for computer assisted orthopedic surgery (CAOS)
8. Fotouhi J, Fuerst B, Wein W, Navab N (2017) Can real-time rgbd enhance intraoperative cone-beam CT? Int J Comput Assist Radiol Surg 1–9. doi:10.1007/s11548-017-1572-y
9. Fuerst B, Fotouhi J, Navab N (2015) Vision-based intraoperative cone-beam ct stitching for non-overlapping volumes. In: International conference on medical image computing and computer-assisted intervention. Springer, Berlin, pp 387–395
10. Geiger A, Moosmann F, Car Ö, Schuster B (2012) Automatic camera and range sensor calibration using a single shot. In: 2012 IEEE international conference on robotics and automation (ICRA). IEEE, pp 3936–3943
11. Gendrin C, Furtado H, Weber C, Bloch C, Figl M, Pawiro SA, Bergmann H, Stock M, Fichtinger G, Georg D (2012) Monitoring tumor motion by real time 2D/3D registration during radiotherapy. Radiother Oncol 102(2):274–280
12. Glassner AS (1989) An introduction to ray tracing. Elsevier, Amsterdam
13. Goitein M, Abrams M, Rowell D, Pollari H, Wiles J (1983) Multi-dimensional treatment planning: Ii. beam’s eye-view, back projection, and projection through ct sections. Int J Radiat Oncol Biol Phys 9(6):789–797
14. Gong RH, Güler Ö, Kürklüoglu M, Lovejoy J, Yaniv Z (2013) Interactive initialization of 2D/3D rigid registration. Med Phys 40(12):121911
15. Grisetti G, Kümmerle R, Stachniss C, Frese U, Hertzberg C (2010) Hierarchical optimization on manifolds for online 2D and 3D mapping. In: 2010 IEEE international conference on robotics and automation (ICRA). IEEE, pp 273–278
16. Jain A, Fichtinger G (2006) C-arm tracking and reconstruction without an external tracker. In: International conference on medical image computing and computer-assisted intervention. Springer, Berlin, pp 494–502 (2006)
17. Knaan D, Joskowicz L (2003) Effective intensity-based 2D/3D rigid registration between fluoroscopic X-ray and CT. In: International conference on medical image computing and computer-assisted intervention. Springer, Berlin, pp 351–358
18. Kümmerle R, Grisetti G, Strasdat H, Konolige K, Burgard W (2011) g2o: a general framework for graph optimization. In: 2011 IEEE international conference on robotics and automation (ICRA). IEEE, pp 3607–3613
19. Lee SC, Fuerst B, Fotouhi J, Fischer M, Osgood G, Navab N (2016) Calibration of RGBD camera and cone-beam CT for 3D intra-operative mixed reality visualization. Int J Comput Assist Radiol Surg 11(6):967–975
20. Lemieux L, Jagoe R, Fish D, Kitchen N, Thomas D (1994) A patient-to-computed-tomography image registration method based on digitally reconstructed radiographs. Med Phys 21(11):1749–1760
21. Mitrović U, Pernuš F, Likar B, Špiclin Ž (2015) Simultaneous 3D–2D image registration and c-arm calibration: application to endovascular image-guided interventions. Med Phys 42(11):6433–6447
22. Navab N, Bani-Hashemi A, Nadar MS, Wiesent K, Durlak P, Brunner T, Barth K, Graumann R (1998) 3D reconstruction from projection matrices in a c-arm based 3D-angiography system. In: International conference on medical image computing and computer-assisted intervention. Springer, Berlin, pp 119–129
23. Newcombe RA, Izadi S, Hilliges O, Molyneaux D, Kim D, Davison AJ, Kohi P, Shotton J, Hodges S, Fitzgibbon A (2011) Kinectfusion: real-time dense surface mapping and tracking. In: 2011 10th IEEE international symposium on mixed and augmented reality (ISMAR). IEEE, pp 127–136
24. Otake Y, Armand M, Armiger RS, Kutzer MD, Basafa E, Kazanzides P, Taylor RH (2012) Intraoperative image-based multiview 2D/3D registration for image-guided orthopaedic surgery: incorporation of fiducial-based c-arm tracking and gpu-acceleration. IEEE Trans Med Imaging 31(4):948–962
25. Otake Y, Armand M, Sadowsky O, Armiger RS, Kutzer MD, Mears SC, Kazanzides P, Taylor, RH (2010) An image-guided femoroplasty system: development and initial cadaver studies. In: SPIE medical imaging. International Society for Optics and Photonics, pp 76250P–76250P (2010)
26. Otake Y, Schafer S, Stayman J, Zbijewski W, Kleinszig G, Graumann R, Khanna A, Siewerdsen J (2012) Automatic localization of vertebral levels in X-ray fluoroscopy using 3D–2D registration: a tool to reduce wrong-site surgery. Phys Med Biol 57(17):5485
27. Powell MJ (2009) The BOBYQA algorithm for bound constrained optimization without derivatives. Cambridge NA Report NA2009/06, University of Cambridge, Cambridge (2009)
28. Rusinkiewicz S, Levoy M (2001) Efficient variants of the ICP algorithm. In: Proceedings. Third international conference on 3-D digital imaging and modeling, 2001. IEEE, pp 145–152
29. Sadowsky O, Chintalapani G, Taylor RH (2007) Deformable 2D-3D registration of the pelvis with a limited field of view, using shape statistics. In: International conference on medical image computing and computer-assisted intervention. Springer, Berlin, pp 519–526 (2007)
30. Uneri A, Otake Y, Wang A, Kleinszig G, Vogt S, Khanna AJ, Siewerdsen J (2013) 3D–2D registration for surgical guidance: effect of projection view angles on registration accuracy. Phys Med Biol 59(2):271
31. Varnavas A, Carrell T, Penney G (2013) Increasing the automation of a 2D–3D registration system. IEEE Trans Med Imaging 32(2):387–399
32. Varnavas A, Carrell T, Penney G (2015) Fully automated 2D–3D registration and verification. Med Image Anal 26(1):108–119
33. Wein W (2003) Intensity based rigid 2D-3D registration algorithms for radiation therapy. Master’s thesis, Technische Universität München
34. Yang L, Wang J, Kobayashi E, Ando T, Yamashita H, Sakuma I, Chiba T (2015) Image mapping of untracked free-hand endoscopic views to an ultrasound image-constructed 3D placenta model. Int J Med Robot Comput Assist Surg 11(2):223–234
35. Zhang Z (2000) A flexible new technique for camera calibration. IEEE Trans Pattern Anal Mach Intell 22(11):1330–1334