Calibration of RGBD camera and cone-beam CT for 3D intra-operative mixed reality visualization

International Journal of Computer Assisted Radiology and Surgery

Volumn 11, Issue 6, 2016, Pages 967-975

  Lee, Sing Chun ^a   Fuerst, Bernhard ^a,b   Fotouhi, Javad ^a   Fischer, Marius ^a,c   Osgood, Greg ^d   Navab, Nassir ^a,b  

^a JOHNS HOPKINS UNIVERSITY   (United States)

^b TECHNICAL UNIVERSITY OF MUNICH   (Germany)

^c LUDWIG MAXIMILIANS UNIVERSITY   (Germany)

^d JOHNS HOPKINS UNIVERSITY SCHOOL OF MEDICINE   (United States)

Author keywords

3D 3D calibration; Augmented reality; C arm; Cone beam CT; Intra operative imaging

Indexed keywords

ACCURACY; ALGORITHM; ARTICLE; CALIBRATION; CAMERA; CONE BEAM COMPUTED TOMOGRAPHY; CONE BEAM COMPUTED TOMOGRAPHY SCANNER; HISTOGRAM; HUMAN; ORTHOPEDIC SURGERY; PRIORITY JOURNAL; RGBD CAMERA; SIMULATION; THREE DIMENSIONAL IMAGING; IMAGING PHANTOM; INTRAOPERATIVE MONITORING; PROCEDURES; REPRODUCIBILITY;

ALGORITHMS; CALIBRATION; CONE-BEAM COMPUTED TOMOGRAPHY; HUMANS; IMAGING, THREE-DIMENSIONAL; MONITORING, INTRAOPERATIVE; PHANTOMS, IMAGING; REPRODUCIBILITY OF RESULTS;

EID: 84964009633     PISSN: 18616410     EISSN: 18616429     Source Type: Journal    
DOI: 10.1007/s11548-016-1396-1     Document Type: Article

References (21)

1. Dickerson MT, Scot Drysdale RL, McElfresh SA, Welzl E (1994) Fast greedy triangulation algorithms. In: Proceedings of the tenth annual symposium on computational geometry, SCG ’94. pp 211–220. ACM, New York, NY, USA
2. Diotte B, Fallavollita P, Wang L, Weidert S, Thaller PH, Euler E, Navab N (2012) Radiation-free drill guidance in interlocking of intramedullary nails. In: Ayache N, Delingette H, Golland P, Mori K (eds) Medical image computing and computer-assisted intervention—MICCAI. Springer, Berlin, Heidelberg, pp 18–25
3. Foix S, Alenya G, Torras C (2011) Lock-in time-of-flight (ToF) cameras: a survey. Sens J IEEE 11(9):1917–1926
4. Fuerst B, Fotouhi J, Navab N (2015) Vision-based intraoperative cone-beam ct stitching for non-overlapping volumes. In: Navab N, Hornegger J, Wells WM, Frangi AF (eds) Medical image computing and computer-assisted intervention—MICCAI 2015. Springer, Cham, pp 387–395
5. Habert S, Gardiazabal J, Fallavollita P, Navab N (2015) RGBDX: first design and experimental validation of a mirror-based RGBD Xray imaging system. In: International symposium on mixed and augmented reality (ISMAR). Fukuoka
6. Habert S, Meng M, Kehl W, Wang X, Tombari F, Fallavollita P, Navab N (2015) Augmenting mobile c-arm fluoroscopes via stereo-RGBD sensors for multimodal visualization. In: International symposium on mixed and augmented reality (ISMAR). Fukuoka
7. Kim CW, Lee YP, Taylor W, Oygar A, Kim WK (2008) Use of navigation-assisted fluoroscopy to decrease radiation exposure during minimally invasive spine surgery. Spine J 8(4):584–590
8. Matthews F, Hoigne DJ, Weiser M, Wanner GA, Regazzoni P, Suhm N, Messmer P (2007) Navigating the fluoroscope’s c-arm back into position: an accurate and practicable solution to cut radiation and optimize intraoperative workflow. J Orthop Trauma 21(10):687–692
9. Merloz P, Troccaz J, Vouaillat H, Vasile C, Tonetti J, Eid A, Plaweski S (2007) Fluoroscopy-based navigation system in spine surgery. Proc Inst Mech Eng Part H J Eng Med 221(7):813–820
10. Navab N, Blum T, Wang L, Okur A, Wendler T (2012) First deployments of augmented reality in operating rooms. Computer 7:48–55
11. Navab N, Heining SM, Traub J (2010) Camera augmented mobile c-arm (camc): calibration, accuracy study, and clinical applications. Med Imaging IEEE Trans 29(7):1412–1423
12. Newcombe RA, Izadi S, Hilliges O, Molyneaux D, Kim D, Davison AJ, Kohi P, Shotton J, Hodges S, Fitzgibbon A (2011) Kinectfusion: Real-time dense surface mapping and tracking. In: International symposium on mixed and augmented reality (ISMAR), pp 127–136
13. Nicolau S, Lee P, Wu H, Huang M, Lukang R, Soler L, Marescaux J (2011) Fusion of c-arm x-ray image on video view to reduce radiation exposure and improve orthopedic surgery planning: first in-vivo evaluation. In: 15th Annual conference of the international society for computer aided surgery. Computer Assisted Radiology and Surgery
14. Pfaff JA, Moore GP (2007) Reducing risk in emergency department wound management. Emerg Med Clin N Am 25(1):189–201
15. Reaungamornrat S, Otake Y, Uneri A, Schafer S, Mirota D, Nithiananthan S, Stayman JW, Kleinszig G, Khanna AJ, Taylor RH, Siewerdsen JH (2012) An on-board surgical tracking and video augmentation system for c-arm image guidance. Int J Comput Assist Radiol Surg 7(5):647–665
16. Rusu R, Blodow N, Beetz M (2009) Fast point feature histograms (FPFH) for 3D registration. In: Robotics and automation (ICRA), IEEE international conference on, pp 3212–3217
17. Rusu RB, Cousins S (2011) 3d is here: Point cloud library (pcl). In: Robotics and automation (ICRA), IEEE international conference on, pp 1–4. IEEE
18. Torr P, Zisserman A (2000) Mlesac: a new robust estimator with application to estimating image geometry. Comput Vision Image Underst 78(1):138–156
19. van de Kraats EB, van Walsum T, Kendrick L, Noordhoek NJ, Niessen WJ (2006) Accuracy evaluation of direct navigation with an isocentric 3d rotational X-ray system. Med Image Anal 10(2):113–124
20. Wang X, Habert S, Meng M, Wang X, Huang CH, Fallavollita P, Navab N (2015) Rgb-d/c-arm calibration and application in medical augmented reality. In: International symposium on mixed and augmented reality (ISMAR). Fukuoka, Japan
21. Zhang Z (2000) A flexible new technique for camera calibration. IEEE Trans Pattern Anal Mach Intell 22(11):1330–1334