On-the-fly augmented reality for orthopedic surgery using a multimodal fiducial

Journal of Medical Imaging

Volumn 5, Issue 2, 2018, Pages

  Andress, Sebastian ^a,b   Johnson, Alex ^c   Unberath, Mathias ^a   Winkler, Alexander Felix ^a,d   Yu, Kevin ^a,d   Fotouhi, Javad ^a   Weidert, Simon ^b   Osgood, Greg ^c   Navab, Nassir ^a,d  

^a JOHNS HOPKINS UNIVERSITY   (United States)

^b UNIVERSITY OF MUNICH   (Germany)

^c JOHNS HOPKINS UNIVERSITY SCHOOL OF MEDICINE   (United States)

^d TECHNICAL UNIVERSITY OF MUNICH   (Germany)

Author keywords

fluoroscopy; interventional imaging; registration; surgical guidance

Indexed keywords

ANATOMIC LANDMARK; ARTICLE; AUGMENTED REALITY; COMPUTER ASSISTED SURGERY; FEASIBILITY STUDY; FEMUR; FLUOROSCOPY; HUMAN; MINIMALLY INVASIVE SURGERY; ORTHOPEDIC SURGERY; WORKFLOW;

EID: 85041193218     PISSN: 23294302     EISSN: 23294310     Source Type: Journal    
DOI: 10.1117/1.JMI.5.2.021209     Document Type: Article

References (35)

1. S. B. Gay et al., " Percutaneous screw fixation of acetabular fractures with ct guidance: Preliminary results of a new technique.," AJR Am. J. Roentgenol. 158 (4), 819-822 (1992). http://dx.doi.org/10.2214/ajr.158.4.1546599
2. B. M. Boszczyk et al., " Fluoroscopic radiation exposure of the kyphoplasty patient.," Eur. Spine J. 15 (3), 347-355 (2006). http://dx.doi.org/10.1007/s00586-005-0952-0
3. G. Kirousis et al., " Dosimetry during intramedullary nailing of the tibia patient and occupational exposure.," Acta Orthop. 80 (5), 568-572 (2009). http://dx.doi.org/10.3109/17453670903350057
4. I. D. Sugarman, I. Adam and T. D. Bunker, " Radiation dosage during AO locking femoral nailing.," Injury 19 (5), 336-338 (1988). INJUBF http://dx.doi.org/10.1016/0020-1383(88)90107-6
5. J. E. Robb, I. H. Annan and M. F. Macnicol, " Guidewire damage during cannulated screw fixation for slipped capital femoral epiphysis.," J. Pediatr. Orthop. B 12 (3), 219-221 (2003). http://dx.doi.org/10.1097/01202412-200305000-00010
6. L. E. Zionts, P. Simonian and Jr. J. Harvey, " Transient penetration of the hip joint during in situ cannulated-screw fixation of slipped capital femoral epiphysis.," J. Bone Joint Surg. 73 (7), 1054-1060 (1991). http://dx.doi.org/10.2106/00004623-199173070-00015
7. F. Gras et al., " Screw placement for acetabular fractures: Which navigation modality (2-dimensional vs. 3-dimensional) should be used? An experimental study.," J. Orthop. Trauma 26 (8), 466-473 (2012). JORTE5 0890-5339 http://dx.doi.org/10.1097/BOT.0b013e318234d443
8. S. Maqungo et al., " Distal interlocking screw placement in the femur: Free-hand versus electromagnetic assisted technique (sureshot).," J. Orthop. Trauma 28 (12), e281-e283 (2014). JORTE5 0890-5339 http://dx.doi.org/10.1097/BOT.0000000000000125
9. N. Hawi et al., " Radiological outcome and intraoperative evaluation of a computer-navigation system for femoral nailing: A retrospective cohort study.," Injury 45 (10), 1632-1636 (2014). INJUBF http://dx.doi.org/10.1016/j.injury.2014.05.039
10. A. Wilharm et al., " 2D-fluoroscopic based navigation for Gamma 3 nail insertion versus conventional procedure: A feasibility study.," BMC Musculoskeletal Disord. 14 (1), 74 (2013). http://dx.doi.org/10.1186/1471-2474-14-74
11. N. M. Hamming, M. J. Daly and J. C. Irish, " Automatic image-to-world registration based on X-ray projections in cone-beam CT-guided interventions.," Med. Phys. 36, 1800-1812 (2009). MPHYA6 0094-2405 http://dx.doi.org/10.1118/1.3117609
12. T. Doke et al., " Fluoroscopy-based laser guidance system for linear surgical tool insertion depth control.," Int. J. Comput. Assisted Radiol. Surg. 10, 275-283 (2015). http://dx.doi.org/10.1007/s11548-014-1079-8
13. M. Kraus et al., " Computer-aided surgery does not increase the accuracy of dorsal pedicle screw placement in the thoracic and lumbar spine: A retrospective analysis of 2,003 pedicle screws in a level I trauma center.," Global Spine J. 5 (2), 93-101 (2015). http://dx.doi.org/10.1055/s-0034-1396430
14. J. Victor and D. Hoste, " Image-based computer-assisted total knee arthroplasty leads to lower variability in coronal alignment.," Clin. Orthop. Relat. Res. 428, 131-139 (2004). CORTBR 0009-921X http://dx.doi.org/10.1097/01.blo.0000147710.69612.76
15. L. Qian et al., " Towards virtual monitors for image guided interventions-real-time streaming to optical see-through head-mounted displays.," arXiv:1710.00808 (2017).
16. N. Navab, S.-M. Heining and J. Traub, " Camera augmented mobile C-arm (CAMC): Calibration, accuracy study, and clinical applications.," IEEE Trans. Med. Imaging 29 (7), 1412-1423 (2010). ITMID4 0278-0062 http://dx.doi.org/10.1109/TMI.2009.2021947
17. J. Fotouhi et al., " Plan in 2D, execute in 3D: An augmented reality solution for cup placement in total hip arthroplasty.," J. Med. Imaging 5 (2), 021205 (2018). JMEIET 0920-5497 http://dx.doi.org/10.1117/1.JMI.5.2.021205
18. S. C. Lee et al., " Calibration of RGBD camera and cone-beam ct for 3D intra-operative mixed reality visualization.," Int. J. Comput. Assisted Radiol. Surg. 11 (6), 967-975 (2016). http://dx.doi.org/10.1007/s11548-016-1396-1
19. M. Fischer et al., " Preclinical usability study of multiple augmented reality concepts for K-wire placement.," Int. J. Comput. Assisted Radiol. Surg. 11 (6), 1007-1014 (2016). http://dx.doi.org/10.1007/s11548-016-1363-x
20. J. Fotouhi et al., " Pose-aware C-arm for automatic re-initialization of interventional 2D/3D image registration.," Int. J. Comput. Assisted Radiol. Surg. 12, 1221-1230 (2017). http://dx.doi.org/10.1007/s11548-017-1611-8
21. E. Tucker et al., " Towards clinical translation of augmented orthopedic surgery: From pre-op CT to intra-op X-ray via RGBD sensing.," Proc. SPIE accepted. PSISDG 0277-786X
22. H. Wang et al., " Precision insertion of percutaneous sacroiliac screws using a novel augmented reality-based navigation system: A pilot study.," Int. Orthop. 40 (9), 1941-1947 (2016). http://dx.doi.org/10.1007/s00264-015-3028-8
23. H. Durrant-Whyte and T. Bailey, " Simultaneous localization and mapping: Part I.," IEEE Rob. Autom. Mag. 13 (2), 99-110 (2006). IRAMEB 1070-9932 http://dx.doi.org/10.1109/MRA.2006.1638022
24. H. Kato and M. Billinghurst, " Marker tracking and HMD calibration for a video-based augmented reality conferencing system.," in 2nd IEEE and ACM Int. Workshop on Augmented Reality (IWAR) Proc., pp. 85-94, IEEE (1999). http://dx.doi.org/10.1109/IWAR.1999.803809
25. W. A. Chilcote et al., " Digital subtraction angiography of the carotid arteries: A comparative study in 100 patients.," Radiology 139 (2), 287-295 (1981). RADLAX 0033-8419 http://dx.doi.org/10.1148/radiology.139.2.7012921
26. M. Unberath et al., " Virtual single-frame subtraction imaging.," in Proc. Int. Conf. Image Form X-Ray CT, pp. 89-92 (2016).
27. J. Fotouhi et al., " Interventional 3D augmented reality for orthopedic and trauma surgery.," in 16th Annual Meeting of the Int. Society for Computer Assisted Orthopedic Surgery (CAOS) (2016).
28. J. Fotouhi et al., " Can real-time RGBD enhance intraoperative cone-beam CT? " Int. J. Comput. Assisted Radiol. Surg. 12, 1211-1219 (2017). http://dx.doi.org/10.1007/s11548-017-1572-y
29. L. Qian et al., " Comparison of optical see-through head-mounted displays for surgical interventions with object-anchored 2D-display.," Int. J. Comput. Assisted Radiol. Surg. 12, 901-910 (2017). http://dx.doi.org/10.1007/s11548-017-1564-y
30. Microsoft Coordinate systems. " ( 2017) https://developer.microsoft.com/en-us/windows/mixed-reality/coordinate-systems 13 2017).
31. B. C. Kress and W. J. Cummings, " 11-1: Invited paper: Towards the ultimate mixed reality experience: HoloLens display architecture choices.," SID Symp. Dig. Tech. Pap. 48 (1), 127-131 (2017). DTPSDS 0097-966X http://dx.doi.org/10.1002/sdtp.11586
32. R. Hartley and A. Zisserman, Multiple View Geometry in Computer Vision, Cambridge University Press, Cambridge (2003).
33. S. Hollister, " Microsoft HoloLens hands-on: Incredible, amazing, prototype-y as hell. " (2017), https://gizmodo.com/project-hololens-hands-on-incredible-amazing-prototy-1680934585 (13 2017).
34. P. C. Chimenti and D. J. Mitten, " Google Glass as an alternative to standard fluoroscopic visualization for percutaneous fixation of hand fractures: A pilot study.," Plast. Reconstr. Surg. 136 (2), 328-330 (2015). http://dx.doi.org/10.1097/PRS.0000000000001453
35. J. W. Yoon et al., " Technical feasibility and safety of an intraoperative head-up display device during spine instrumentation.," Int. J. Med. Rob. Comput. Assisted Surg. 13 (3), e1770 (2016).