RGBDX: First design and experimental validation of a mirror-based RGBD X-ray imaging system

Proceedings of the 2015 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2015

Volumn , Issue , 2015, Pages 13-18

  Habert, Severine ^a   Gardiazabal, Jose ^a   Fallavollita, Pascal ^a   Navab, Nassir ^a,b  

^a TECHNICAL UNIVERSITY OF MUNICH   (Germany)

^b JOHNS HOPKINS UNIVERSITY   (United States)

Author keywords

Medical Augmented Reality; Multi modal Visualization; Range Imaging; X ray imaging

Indexed keywords

AUGMENTED REALITY; CAMERAS; IMAGING SYSTEMS; MEDICAL IMAGING; MIRRORS; THREE DIMENSIONAL COMPUTER GRAPHICS; VISUALIZATION; X RAY ANALYSIS;

DEPTH MEASUREMENTS; EXPERIMENTAL VALIDATIONS; MEDICAL AUGMENTED REALITIES; MULTI-MODAL VISUALIZATION; RANGE IMAGING; VISUALIZATION APPLICATION; X RAY IMAGING SYSTEM; XRAY IMAGING;

IMAGE RECONSTRUCTION;

EID: 84962322478     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ISMAR.2015.17     Document Type: Conference Paper

References (24)

1. M. Bass, E. Van Stryland, D. Williams, and W. Wolfe. Handbook of Optics. McGraw-Hill, 1996.
2. C. Bichlmeier, F. Wimme, S. M. Heining, and N. Navab. Contextual anatomic mimesis hybrid in-situ visualization method for improving multi-sensory depth perception in medical augmented reality. In ISMAR 2007, 6th, pages 129-138. IEEE, 2007.
3. T. Blum, V. Kleeberger, C. Bichlmeier, and N. Navab. mirracle: An augmented reality magic mirror system for anatomy education. In Virtual Reality Workshops (VR), 2012 IEEE, pages 115-116, 2012.
4. X. Chen, H. Naik, L. Wang, N. Navab, and P. Fallavollita. Videoguided calibration of an augmented reality mobile c-arm. International journal of computer assisted radiology and surgery, 9(6):987-996, 2014.
5. X. Chen, L. Wang, P. Fallavollita, and N. Navab. Precise x-ray and video overlay for augmented reality fluoroscopy. International journal of computer assisted radiology and surgery, 8(1):29-38, 2013.
6. B. Diotte, P. Fallavollita, L. Wang, S. Weidert, E. Euler, P. Thaller, and N. Navab. Multi-modal intra-operative navigation during distal locking of intramedullary nails. Medical Imaging, IEEE Transactions on, 34(2):487-495, 2015.
7. J. Fritz, P. U-Thainual, T. Ungi, A. J. Flammang, N. B. Cho, G. Fichtinger, I. I. Iordachita, and J. A. Carrino. Augmented reality visualization with image overlay for mri-guided intervention: accuracy for lumbar spinal procedures with a 1.5-t mri system. American Journal of Roentgenology, 198(3):W266-W273, 2012.
8. C. Herrera, J. Kannala, J. Heikkilä, et al. Joint depth and color camera calibration with distortion correction. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 34(10):2058-2064, 2012.
9. C. Huang, C. Hsieh, J. Lee, W. Huang, S. Lee, C. Wu, Y. Sun, and Y. Wu. A ct-ultrasound-coregistered augmented reality enhanced image-guided surgery system and its preliminary study on brain-shift estimation. Journal of Instrumentation, 7(08):P08016, 2012.
10. K. Khoshelham and S. O. Elberink. Accuracy and resolution of kinect depth data for indoor mapping applications. Sensors, 12(2):1437-1454, 2012.
11. R. Londei, M. Esposito, B. Diotte, S. Weidert, E. Euler, P. Thaller, N. Navab, and P. Fallavollita. The augmentedcircles: a video-guided solution for the down-the-beam positioning of im nail holes. In Information Processing in Computer-Assisted Interventions, pages 100-107. Springer, 2014.
12. T. Mallick, P. P. Das, and A. K. Majumdar. Characterizations of noise in kinect depth images: a review. Sensors Journal, IEEE, 14(6):1731-1740, 2014.
13. N. Navab, T. Blum, L. Wang, A. Okur, and T. Wendler. First deployments of augmented reality in operating rooms. Computer, (7):48-55, 2012.
14. N. Navab, S.-M. Heining, and J. Traub. Camera augmented mobile c-arm (camc): Calibration, accuracy study, and clinical applications. Medical Imaging, IEEE Transactions on, 29(7):1412-1423, 2010.
15. R. A. Newcombe, A. J. Davison, S. Izadi, P. Kohli, O. Hilliges, J. Shotton, D. Molyneaux, S. Hodges, D. Kim, and A. Fitzgibbon. Kinectfusion: Real-time dense surface mapping and tracking. In ISMAR, 2011 10th, pages 127-136. IEEE, 2011.
16. S. Nicolau, P. Lee, H.Wu, et al. Fusion of c-arm x-ray image on video view to reduce radiation exposure and improve orthopedic surgery planning: first in-vivo evaluation. In Proceedings of 15th CARS, 2011.
17. A. Okur, S.-A. Ahmadi, A. Bigdelou, T.Wendler, and N. Navab. Mr in or: First analysis of ar/vr visualization in 100 intra-operative freehand spect acquisitions. In ISMAR, 2011 10th, pages 211-218. IEEE, 2011.
18. S. Pati, O. Erat, L. Wang, S. Weidert, E. Euler, N. Navab, and P. Fallavollita. Accurate pose estimation using single marker single camera calibration system. In SPIE medical imaging, pages 867126-867126. International Society for Optics and Photonics, 2013.
19. O. Pauly, B. Diotte, S. Habert, S.Weidert, E. Euler, P. Fallavollita, and N. Navab. Relevance-based visualization to improve surgeon perception. In Information Processing in Computer-Assisted Interventions, pages 178-185. Springer, 2014.
20. J. Shotton, T. Sharp, A. Kipman, A. Fitzgibbon, M. Finocchio, A. Blake, M. Cook, and R. Moore. Real-time human pose recognition in parts from single depth images. Communications of the ACM, 56(1):116-124, 2013.
21. D. Teber, S. Guven, T. Simpfendörfer, M. Baumhauer, E. O. Güven, F. Yencilek, A. S. Gözen, and J. Rassweiler. Augmented reality: a new tool to improve surgical accuracy during laparoscopic partial nephrectomy? preliminary in vitro and in vivo results. European urology, 56(2):332-338, 2009.
22. L. Wang, P. Fallavollita, A. Brand, O. Erat, S. Weidert, P.-H. Thaller, E. Euler, and N. Navab. Intra-op measurement of the mechanical axis deviation: an evaluation study on 19 human cadaver legs. In Medical Image Computing and Computer-Assisted Intervention-MICCAI 2012, pages 609-616. Springer, 2012.
23. L. Wang, P. Fallavollita, R. Zou, X. Chen, S. Weidert, and N. Navab. Closed-form inverse kinematics for interventional c-arm x-ray imaging with six degrees of freedom: modeling and application. Medical Imaging, IEEE Transactions on, 31(5):1086-1099, 2012.
24. X. L.Wang, P. J. Stolka, E. Boctor, G. Hager, and M. Choti. The kinect as an interventional tracking system. In SPIE Medical Imaging, pages 83160U-83160U, 2012.