Video-guided calibration of an augmented reality mobile C-arm

International Journal of Computer Assisted Radiology and Surgery

Volumn 9, Issue 6, 2014, Pages 987-996

  Chen, Xin ^a   Naik, Hemal ^a   Wang, Lejing ^a   Navab, Nassir ^a   Fallavollita, Pascal ^a  

^a TECHNICAL UNIVERSITY OF MUNICH   (Germany)

Author keywords

C arm fluoroscopy; Calibration; Medical augmented reality; Multi modalities; Orthopedic and trauma surgery; Video guidance; Visualization

Indexed keywords

CALIBRATION; CLINICAL COMPETENCE; COMPUTER ASSISTED DIAGNOSIS; EQUIPMENT DESIGN; EVALUATION STUDY; FLUOROSCOPY; HUMAN; IMAGE ENHANCEMENT; IMAGING PHANTOM; ORTHOPEDIC SURGERY; PROCEDURES; VIDEORECORDING; X-RAY COMPUTED TOMOGRAPHY;

CALIBRATION; CLINICAL COMPETENCE; EQUIPMENT DESIGN; FLUOROSCOPY; HUMANS; ORTHOPEDIC PROCEDURES; PHANTOMS, IMAGING; RADIOGRAPHIC IMAGE ENHANCEMENT; RADIOGRAPHIC IMAGE INTERPRETATION, COMPUTER-ASSISTED; TOMOGRAPHY, X-RAY COMPUTED; VIDEO RECORDING;

EID: 84896433616     PISSN: 18616410     EISSN: 18616429     Source Type: Journal    
DOI: 10.1007/s11548-014-0995-y     Document Type: Article

References (34)

1. Paul P, Fleig O, Jannin P (2005) Augmented virtuality based on stereoscopic reconstruction in multimodal image-guided neurosurgery: methods and performance evaluation. IEEE Trans Med Imaging 24(11):1500–1511
2. Birkfellner W, Figl M, Huber K, Watzinger F, Wanschitz F, Hummel J, Hanel R, Greimel W, Homolka P, Ewers R, Bergmann H (2002) A head-mounted operating binocular for augmented reality visualization in medicine—design and initial evaluation. IEEE Trans Med Imaging 21(8):991–997
3. Grimson WEL, Lozano-Perez T, Wells WM III, Ettinger GJ, White SJ, Kikinis R (1996) An automatic registration method for frameless stereotaxy, image guided surgery, and enhanced reality visualization. IEEE Trans Med Imaging 15(2):129–140
4. Bajura M, Fuchs H, Ohbuchi R (1992) Merging virtual objects with the real world: seeing ultrasound imagery within the patient. In: Proceedings of the 19th annual conference on computer graphics and interactive techniques. ACM Press, pp 203–210
5. State A, Chen DT, Tector C, Brandt A, Chen H, Ohbuchi R, Bajura M, Fuchs H (1994) Case study: observing a volume rendered fetus within a pregnant patient. In: Proceedings of the conference on visualization ’94. IEEE Computer Society Press, pp 364–368
6. Sauer F, Khamene A, Bascle B, Rubino GJ (2001) A head-mounted display system for augmented reality image guidance: towards clinical evaluation for imri-guided neurosurgery. In: Proceeings of the international conference on medical image computing and computer assisted intervention (MICCAI). Springer, London, pp 707–716
7. Sauer F, Schoepf UJ, Khamene A, Vogt S, Das M, Silverman SG (2003) Augmented reality system for ct-guided interventions: system description and initial phantom trials. In: Medical imaging: visualization, image-guided procedures, and display
8. Blackwell M, Nikou C, DiGioia AM, Kanade T (2000) An image overlay system for medical data visualization. Med Image Anal 4(1):67–72
9. Sielhorst T, Feuerstein M, Navab N (2008) Advanced medical displays: a literature review of augmented reality. IEEE/OSA J Disp Technol. Special issue on Medical Displays, 4(4):451–467
10. Stetten G, Cois A, Chang W, Shelton D, Tamburo R, Castellucci J, von Ramm O (2005) C-mode real-time tomographic reflection for a matrix array ultrasound sonic flashlight. Acad Radiol 12: 535–543
11. Fichtinger G, Deguet A, Masamune K, Balogh E, Fischer GS, Mathieu H, Taylor RH, Zinreich SJ, Fayad LM (2005) Image overlay guidance for needle insertion in CT scanner. IEEE Trans Bio-Med Eng 52:1415–1424
12. Fischer GS, Deguet A, Csoma C, Taylor RH, Fayad L, Carrino JA, Zinreich SJ, Fichtinger G (2007) MRI image overlay: application to arthrography needle insertion. Comput Aided Surg Off J Int Soc Comput Aided Surg 12:2–14
13. Feuerstein M, Mussack T, Heining SM, Navab N (2008) Intraoperative laparoscope augmentation for port placement and resection planning in minimally invasive liver resection. IEEE Trans Med Imaging 27:355–369
14. Wendler T, Feuerstein M, Traub J, Lasser T, Vogel J, Daghighian F, Ziegler SI, Navab N (2007) Real-time fusion of ultrasound and gamma probe for navigated localization of liver metastases. In: International conference on medical image computing and computer-assisted intervention MICCAI 10, pp 252–260
15. Moult E et al (2011) Automatic C-arm pose estimation via 2D/3D hybrid registration of a radiographic fiducial. In: SPIE medical imaging. p 79642S
16. Fallavollita P et al (2010) C-arm pose estimation in prostate brachytherapy by registration to ultrasound. In: MICCAI (3). LNCS, Springer, pp 311–318
17. Navab N, Mitschke M, Schütz O (1999) Camera-augmented mobile C-arm (CAMC) application: 3D reconstruction using a low-cost mobile C-arm. In: International conference on medical image computing and computer-assisted intervention, Lecture notes in computer science, vol 1679/1999, pp 688–697
18. Navab N, Heining SM, Traub J (2010) Camera augmented mobile C-arm (CAMC): calibration, accuracy study, and clinical applications. IEEE Trans Med Imaging 29(7):1412–1423
19. Wang L, Traub J, Weidert S, Heining SM, Euler E, Navab N (2010) Parallax-free intraoperative X-ray image stitching. Med Image Anal 14(5):674–686
20. Navab N, Wiesner S, Benhimane S, Euler E, Heining SM (2006) Visual servoing for intraoperative positioning and repositioning of mobile C-arms. In: International conference on medical image computing and computer-assisted intervention, vol 19, no 1, pp 551–560
21. Wang L, Landes J, Weidert S et al (2010) First animal cadaver study for interlocking of intramedullary nails under camera augmented mobile C-arm. A surgical workflow based preclinical evaluation. In: IPCAI’10 Proceedings of the first international conference on information processing in computer-assisted interventions, pp 56–66
22. Diotte B, Fallavollita P, Wang L, Weidert S, Thaller P, Euler E, Navab N (2012) Radiation-free drill guidance in interlocking of intramedullary nails. In: 15th international conference on medical image computing and computer-assisted intervention, vol 7510, pp 18–25
23. Londei R, Esposito M, Diotte B, Weidert S, Euler E, Thaller P, Navab N, Fallavollita P (2014) The ‘augmented’ circles: a video-guided solution for the down-the-beam positioning of IM nail holes. In: Information processing in computer-assisted interventions (IPCAI) (in press)
24. Wang L, Fallavollita P, Zou R, Chen X, Weidert S, Navab N (2012 May) Closed-form inverse kinematics for interventional C-arm X-ray imaging with six degrees of freedom: modeling and application. IEEE Trans Med Imaging 31(5):1086–1099
25. Chen X, Wang L, Fallavollita P, Navab N (2013) Precise X-ray and video overlay for augmented reality fluoroscopy. Int J Comput Assist Radiol Surg 8(1):29–38
26. Chen X, Wang L, Fallavollita P, Navab N (2012) Error analysis of the X-ray projection geometry of camera-augmented mobile C-arm. In: SPIE medical imaging. International Society for Optics and Photonics, pp 83160P–83160P
27. Pati S, Erat O, Wang L, Weidert S, Euler E, Navab N, Fallavollita P (2013) Accurate pose estimation using single marker single camera calibration system. In: SPIE medical imaging. International Society for Optics and Photonics, pp 867126–867126
28. Wang L, Fallavollita P, Brand A, Erat O, Weidert S, Thaller P-H, Euler E, Navab N (2012) Intra-op measurement of the mechanical axis deviation: an evaluation study on 19 human cadaver legs. In: Medical image computing and computer-assisted intervention-MICCAI. Springer, Berlin, pp 609–616
29. Erat O, Pauly O, Weidert S, Thaller P, Euler E, Mutschler W, Navab N, Fallavollita P (2013) How a surgeon becomes superman by visualization of intelligently fused multi-modalities. In: SPIE medical imaging. International Society for Optics and Photonics, pp 86710L–86710L
30. Pauly O, Katouzian A, Eslami A, Fallavollita P, Navab N (2012) Supervised classification for customized intraoperative augmented reality visualization. In: IEEE international symposium on mixed and augmented reality (ISMAR), pp 311–312
31. Pauly O, Diotte B, Habert S, Weidert S, Euler E, Fallavollita P, Navab N (2014) Visualization inside the operating room: “learning” what the surgeon wants to see. In: Information processing in computer-assisted interventions (IPCAI) (in press)
32. Bradski G (2000) The OpenCV library. Dr Dobb’s J 25(11):120–126
33. Wright R et al (2010) OpenGL SuperBible: comprehensive tutorial and reference. Pearson Education, Upper Saddle River
34. Suzuki S, Abe K (1985) Topological structural analysis of digital binary images by border following. CVGIP 30(1):32–46