Three-dimensional augmented reality surgical navigation with hybrid optical and electromagnetic tracking for distal intramedullary nail interlocking

International Journal of Medical Robotics and Computer Assisted Surgery

Volumn 14, Issue 4, 2018, Pages

  Ma, Longfei ^a   Zhao, Zhe ^b   Zhang, Boyu ^a   Jiang, Weipeng ^a   Fu, Ligong ^b   Zhang, Xinran ^a   Liao, Hongen ^a  

^a Tsinghua University   (China)

^b BEIJING TSINGHUA CHANGGUNG HOSPITAL   (China)

Author keywords

augmented reality navigation; distal interlocking; hybrid optical and electromagnetic tracking; intramedullary nail

Indexed keywords

INFILL DRILLING; LOCKS (FASTENERS); NAILS; NAVIGATION; SURGERY;

AUGMENTED REALITY NAVIGATION; DISTAL INTERLOCKING; ELECTROMAGNETIC TRACKING; HYBRID OPTICAL AND ELECTROMAGNETIC TRACKING; INTERLOCKINGS; INTRAMEDULLARY NAILS; LONG BONE; NAVIGATION METHODS; OPTICAL TRACKING; SURGICAL NAVIGATION;

AUGMENTED REALITY;

ARTICLE; AUGMENTED REALITY GUIDED DRILLING; C ARM; EQUIPMENT DESIGN; FEASIBILITY STUDY; FLUOROSCOPY; INTRAMEDULLARY NAIL INTERLOCKING; INTRAMEDULLARY NAILING; MATHEMATICAL COMPUTING; MEASUREMENT ACCURACY; OPTICAL AND ELECTROMAGNETIC TRACKING; ORTHOPEDIC SURGERY; PATIENT SAFETY; SURGICAL TECHNIQUE; THREE DIMENSIONAL AUGMENTED SURGICAL NAVIGATION; ANATOMIC MODEL; BONE NAIL; COMPUTER ASSISTED SURGERY; COMPUTER INTERFACE; DEVICES; ELECTROMAGNETISM; ELECTRONIC DEVICE; EVALUATION STUDY; HUMAN; IMAGING PHANTOM; PROCEDURES; ROBOTIC SURGICAL PROCEDURE; ROBOTICS; THREE DIMENSIONAL IMAGING; TIBIA FRACTURE;

BONE NAILS; ELECTROMAGNETIC PHENOMENA; EQUIPMENT DESIGN; FEASIBILITY STUDIES; FLUOROSCOPY; FRACTURE FIXATION, INTRAMEDULLARY; HUMANS; IMAGING, THREE-DIMENSIONAL; MODELS, ANATOMIC; PHANTOMS, IMAGING; ROBOTIC SURGICAL PROCEDURES; ROBOTICS; SURGERY, COMPUTER-ASSISTED; TIBIAL FRACTURES; USER-COMPUTER INTERFACE; WEARABLE ELECTRONIC DEVICES;

EID: 85044387972     PISSN: 14785951     EISSN: 1478596X     Source Type: Journal    
DOI: 10.1002/rcs.1909     Document Type: Article

References (43)

1. Foote CJ, Guyatt GH, Vignesh KN, et al. Which surgical treatment for open tibial shaft fractures results in the fewest reoperations? A network meta-analysis. Clin Orthop Relat Res. 2015;473(7):2179-2192.
2. Ricci WM, Gallagher B, Haidukewych GJ. Intramedullary nailing of femoral shaft fractures: current concepts. J Am Acad Orthop Surgeons. 2009;17(5):296-305.
3. Krettek C, Mannss J, Miclau T, et al. Deformation of femoral nails with intramedullary insertion. J Orthop Res. 1998;16(5):572-575.
4. Skjeldal S, Backe S. Interlocking medullary nails—radiation doses in distal targeting. Arch Orthop Traum Surg. 1987;106(3):179-181.
5. Kesavachandran CN. Radiation exposure of eyes, thyroid gland and hands in orthopaedic staff: a systematic review. Eur J Med Res. 2012;17(1):1-10.
6. Matityahu A, Duffy RK, Goldhahn S, et al. The great unknown—A systematic literature review about risk associated with intraoperative imaging during orthopaedic surgeries. Injury. 2017;48(8):1727-1734.
7. Whatling GM, Nokes LD. Literature review of current techniques for the insertion of distal screws into intramedullary locking nails. Injury. 2006;37(2):109-119.
8. Abdlslam KM, Bonnaire F. Experimental model for a new distal locking aiming device for solid intramedullary tibia nails. Injury. 2003;34(5):363-366.
9. Anastopoulos G, Ntagiopoulos PG. Evaluation of the Stryker S2 IM nail distal targeting device for reduction of radiation exposure: a case series study. Injury. 2008;39(10):1210-1215.
10. Choi J, Kim J, Hwang JY, et al. A novel smart navigation system for intramedullary nailing in orthopedic surgery. Plos One. 2017;12(4):e0174407.
11. Suhm N, Jacob AL, Nolte LP, et al. Surgical navigation based on fluoroscopy—clinical application for computer-assisted distal locking of intramedullary implants. Comput Aided Surg. 2005;6:391-400.
12. Leloup T, El Kazzi W, Schuind F, Warzée N. A novel technique for distal locking of intramedullary nail based on two non-constrained fluoroscopic images and navigation. IEEE Trans Medl Imaging. 2008;27(9):1202-1212.
13. Zheng G, Zhang X, Haschtmann D, et al. A robust and accurate two-stage approach for automatic recovery of distal locking holes in computer-assisted intramedullary nailing of femoral shaft fractures. IEEE Trans Med Imaging. 2008;27(2):171-187.
14. Suhm N, Messmer P, Zuna I, et al. Fluoroscopic guidance versus surgical navigation for distal locking of intramedullary implants: A prospective, controlled clinical study. Injury. 2004;35(6):567-574.
15. Esfandiari H, Amiri S, Lichti DD, et al. A fast, accurate and closed-form method for pose recognition of an intramedullary nail using a tracked C-arm. Int J Comput Assist Radiol Surg. 2016;11(4):621-633.
16. Navab N, Heining SM, Traub J. Camera augmented mobile C-arm (CAMC): calibration, accuracy study, and clinical applications. IEEE Trans Med Imaging. 2010;29(7):1412-1423.
17. Diotte B, Fallavollita P, Wang L, et al. Multi-modal intra-operative navigation during distal locking of intramedullary nails. IEEE Trans Med Imaging. 2015;34(2):487-495.
18. Hoffmann M, Schröder M, Lehmann W, et al. Next generation distal locking for intramedullary nails using an electromagnetic X-ray-radiation-free real-time navigation system. J Trauma Acute Care Surg. 2012;73(1):243-248.
19. Liao H, Inomata T, Sakuma I, et al. 3-D augmented reality for MRI-guided surgery using integral videography autostereoscopic image overlay. IEEE Trans Biomed Eng. 2010;57(6):1476-1486.
20. Liao H, Hata N, Nakajima S, et al. Surgical navigation by autostereoscopic image overlay of integral videography. IEEE Trans Inform Technol Biomed. 2004;8(2):114-121.
21. Wang J, Suenaga H, Hoshi K, et al. Augmented reality navigation with automatic marker-free image registration using 3-D image overlay for dental surgery. IEEE Trans Biomed Eng. 2014;61(4):1295-1304.
22. Zhang X, Chen G, Liao H. High quality see-through surgical guidance system using enhanced 3D autostereoscopic augmented reality. IEEE Trans Biomed Eng. 2017;64(8):1815-1825.
23. Ma L, Zhao Z, Chen F, et al. Augmented reality surgical navigation with ultrasound-assisted registration for pedicle screw placement: a pilot study. Int J Comput Assist Radiol Surg. 2017;12(12):2205-2215.
24. Auer T, Pinz A. The integration of optical and magnetic tracking for multi-user augmented reality. Comput Graphics. 1999;23(6):805-808.
25. Schwald B, Seibert H. Registration tasks for a hybrid tracking system for medical augmented reality. J WSCG. 2004;12:411-418.
26. Konishi K, Nakamoto M, Kakeji Y, et al. A real-time navigation system for laparoscopic surgery based on three-dimensional ultrasound using magneto-optic hybrid tracking configuration. Int J Comput Assist Radiol Surg. 2007;2(1):1-10.
27. Feuerstein M, Reichl T, Vogel J, et al. Magneto-optical tracking of flexible laparoscopic ultrasound: model-based online detection and correction of magnetic tracking errors. IEEE Trans Med Imaging. 2009;28(6):951-967.
28. Glossop ND. Advantages of optical compared with electromagnetic tracking. J Bone Joint Surg Am. 2009;91(2):23-28.
29. Yaniv Z, Wilson E, Lindisch D, et al. Electromagnetic tracking in the clinical environment. Med Phys. 2009;36(3):876-892.
30. Maier-Hein L, Franz AM, Birkfellner W, et al. Standardized assessment of new electromagnetic field generators in an interventional radiology setting. Med Phys. 2012;39(6):3424-3434.
31. Qi Y, Sadjadi H, Yeo CT, et al. Electromagnetic tracking performance analysis and optimization. 36th Annual Int Conf IEEE Eng Med Biol Soc (EMBC). 2014;2014:6534-6538.
32. Sadjadi H, Hashtrudi-Zaad K, Fichtinger G. Simultaneous localization and calibration for electromagnetic tracking systems. Int J Med Robotics Comput Assist Surg. 2016;12(2):189-198.
33. Kindratenko VV. A survey of electromagnetic position tracker calibration techniques. Virtual Reality. 2000;5(3):169-182.
34. Zachmann G. Distortion correction of magnetic fields for position tracking. International Conference on Computer Graphics. IEEE Computer Society. 1997;5(5):213-220,251.
35. Kindratenko VV. Calibration of electromagnetic tracking devices. Virtual Reality. 1999;4(2):139-150.
36. Chung AJ, Edwards PJ, Deligianni F, et al. Freehand cocalibration of optical and electromagnetic trackers for navigated bronchoscopy. Medical Imaging and Augmented Reality: Proceedings Second International Workshop, MIAR2004, Beijing, China, August 19-20, 2004. DBLP, 2004:320–328.
37. Wang J, Suenaga H, Liao H, et al. Real-time computer-generated integral imaging and 3D image calibration for augmented reality surgical navigation. Comput Med Imaging Graphics. 2015;40:147-159.
38. Yaniv Z. Which pivot calibration? Proc SPIE. 2015;9415:941527.
39. Arun KS, Huang TS, Blostein SD. Least-squares fitting of two 3-D point sets. IEEE Trans Pattern Anal Machine Intell. 1987;PAMI-9(5):698-700.
40. Bajura M, Fuchs H, Ohbuchi R. Merging virtual objects with the real world: Seeing ultrasound imagery within the patient. ACM SIGGRAPH Computer Graphics. ACM. 1992;26(2):203-210.
41. Johnson LG, Edwards P, Hawkes D. Surface transparency makes stereo overlays unpredictable: the implications for augmented reality. Stud Health Technol Informat. 2003;131-136.
42. Lerotic M, Chung AJ, Mylonas G, et al. Pq-space based non-photorealistic rendering for augmented reality. In: International Conference on Medical Image Computing and Computer-Assisted Intervention. Berlin: Springer; 2007:102-109.
43. Uruc V, Ozden R, Dogramacı Y, et al. The comparison of freehand fluoroscopic guidance and electromagnetic navigation for distal locking of intramedullary implants. Injury. 2013;44(6):863-866.