Applicability of augmented reality in orthopedic surgery - A systematic review

BMC Musculoskeletal Disorders

Volumn 21, Issue 1, 2020, Pages

  Jud, Lukas ^a   Fotouhi, Javad ^b   Andronic, Octavian ^a   Aichmair, Alexander ^a   Osgood, Greg ^c   Navab, Nassir ^b,d   Farshad, Mazda ^a  

^a BALGRIST UNIVERSITY HOSPITAL   (Switzerland)

^b JOHNS HOPKINS UNIVERSITY   (United States)

^c JOHNS HOPKINS HOSPITAL   (United States)

^d TECHNICAL UNIVERSITY OF MUNICH   (Germany)

Author keywords

Augmented reality; Image overlay; Orthopaedic surgery; Trauma surgery

Indexed keywords

ARTICLE; AUGMENTED REALITY; BONE INJURY; CANCER SURGERY; CLINICAL ASSESSMENT TOOL; DATA BASE; DATA EXTRACTION; HUMAN; JOANNA BRIGGS INSTITUTE CRITICAL APPRAISAL CHECKLIST; MUSCULOSKELETAL DISEASE ASSESSMENT; ORTHOPEDIC SURGERY; OSTEOTOMY; PRACTICE GUIDELINE; PREFERRED REPORTING ITEMS FOR SYSTEMATIC REVIEWS AND META-ANALYSES; QUALITY APPRAISAL FOR CADAVERIC STUDIES SCALE; QUALITY CONTROL; SURGICAL TRAINING; SYSTEMATIC REVIEW; COMPUTER ASSISTED SURGERY; EDUCATION; PROCEDURES; SURGEON; THREE-DIMENSIONAL IMAGING; VIRTUAL REALITY;

AUGMENTED REALITY; HUMANS; IMAGING, THREE-DIMENSIONAL; ORTHOPEDIC PROCEDURES; SURGEONS; SURGERY, COMPUTER-ASSISTED; VIRTUAL REALITY;

EID: 85079516500     PISSN: None     EISSN: 14712474     Source Type: Journal    
DOI: 10.1186/s12891-020-3110-2     Document Type: Article

References (59)

1. Anderson KC, Buehler KC, Markel DC. Computer assisted navigation in total knee arthroplasty: comparison with conventional methods. J Arthroplast. 2005;20:132-8.
2. Bathis H, Perlick L, Tingart M, Luring C, Zurakowski D, Grifka J. Alignment in total knee arthroplasty. A comparison of computer-assisted surgery with the conventional technique. J Bone Joint Surg Br. 2004;86:682-7.
3. Chin PL, Yang KY, Yeo SJ, Lo NN. Randomized control trial comparing radiographic total knee arthroplasty implant placement using computer navigation versus conventional technique. J Arthroplast. 2005;20:618-26.
4. Hoffart HE, Langenstein E, Vasak N. A prospective study comparing the functional outcome of computer-assisted and conventional total knee replacement. J Bone Joint Surg Br. 2012;94:194-9.
5. Sugano N, Nishii T, Miki H, Yoshikawa H, Sato Y, Tamura S. Mid-term results of cementless total hip replacement using a ceramic-on-ceramic bearing with and without computer navigation. J Bone Joint Surg Br. 2007;89:455-60.
6. Synder M, Altimimi MA, Borowski A, Sibinski M, Drobniewski M. Evaluation of outcomes of Total knee replacement with and without a navigation system. Ortop Traumatol Rehabil. 2016;18:251-61.
7. Conditt MA, Roche MW. Minimally invasive robotic-arm-guided unicompartmental knee arthroplasty. J Bone Joint Surg Am. 2009;91(Suppl 1):63-8.
8. Elmallah RK, Cherian JJ, Jauregui JJ, Padden DA, Harwin SF, Mont MA. Robotic-arm assisted surgery in Total hip Arthroplasty. Surg Technol Int. 2015;26:283-8.
9. Schulz AP, Seide K, Queitsch C, von Haugwitz A, Meiners J, Kienast B, et al. Results of total hip replacement using the Robodoc surgical assistant system: clinical outcome and evaluation of complications for 97 procedures. Int J Med Robot. 2007;3:301-6.
10. Siebert W, Mai S, Kober R, Heeckt PF. Technique and first clinical results of robot-assisted total knee replacement. Knee. 2002;9:173-80.
11. Azuma RT. A survey of augmented reality. Presence Teleoperators Virtual Environ. 1997;6:355-85.
12. Wellner P, Mackay W, Gold R. Computer-augmented environments - Back to the real-world. Commun ACM. 1993;36:24-6.
13. Zlatanova S (2002) Augmented Reality Technology GISt Report No 17.
14. Wagner D, Langlotz T, Schmalstieg D (2008) Robust and unobtrusive marker tracking on Mobile phones. 7th Ieee international symposium on mixed and augmented reality 2008, proceedings 121-124.
15. Zhang X., Fronz S., Navab N. (2002) Visual marker detection and decoding in AR systems: a comparative study. In proceedings of the 1st international symposium on mixed and augmented reality (p 97) IEEE computer society.
16. Genc Y, Riedel S, Souvannavong F, Akinlar C, Navab N (2002) Marker-less tracking for AR: A learning-based approach. International symposium on mixed and augmented reality, proceedings;Doi 10.1109/Ismar.2002.1115122295-304.
17. Meola A, Cutolo F, Carbone M, Cagnazzo F, Ferrari M, Ferrari V (2016) Augmented reality in neurosurgery: a systematic review. Neurosurg rev;10.1007/s10143-016-0732-9.
18. Hallet J, Soler L, Diana M, Mutter D, Baumert TF, Habersetzer F, et al. Trans-thoracic minimally invasive liver resection guided by augmented reality. J Am Coll Surg. 2015;220:e55-60.
19. Ntourakis D, Memeo R, Soler L, Marescaux J, Mutter D, Pessaux P. Augmented reality guidance for the resection of missing colorectal liver metastases: an initial experience. World J Surg. 2016;40:419-26.
20. Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JP, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: explanation and elaboration. BMJ. 2009;339:b2700.
21. Jud L, Andronic O, Fotouhi J, Aichmair A, Osgood G, Nassir N, et al. (2019) The applicability of augmented reality in orthopaedic surgery: a systematic review PROSPERO CRD42019128569
22. Obremskey WT, Pappas N, Attallah-Wasif E, Tornetta P 3rd, Bhandari M. Level of evidence in orthopaedic journals. J Bone Joint Surg Am. 2005;87:2632-8.
23. Mayhew AD, Kabir M, Ansari MT. Considerations from the risk of bias perspective for updating Cochrane reviews. Syst Rev. 2015;4:136.
24. Aromataris E, Fernandez R, Godfrey CM, Holly C, Khalil H, Tungpunkom P. Summarizing systematic reviews: methodological development, conduct and reporting of an umbrella review approach. Int J Evid Based Healthc. 2015;13:132-40.
25. Wilke J, Krause F, Niederer D, Engeroff T, Nurnberger F, Vogt L, et al. Appraising the methodological quality of cadaveric studies: validation of the QUACS scale. J Anat. 2015;226:440-6.
26. Abe Y, Sato S, Kato K, Hyakumachi T, Yanagibashi Y, Ito M, et al. A novel 3D guidance system using augmented reality for percutaneous vertebroplasty: technical note. J Neurosurg Spine. 2013;19:492-501.
27. Elmi-Terander A, Burstrom G, Nachabe R, Skulason H, Pedersen K, Fagerlund M, et al. Pedicle screw placement using augmented reality surgical navigation with intraoperative 3D imaging: A first in-human prospective cohort study. Spine (Phila Pa 1976). 2019;44:517-25.
28. Ogawa H, Hasegawa S, Tsukada S, Matsubara M. A pilot study of augmented reality technology applied to the Acetabular cup placement during Total hip Arthroplasty. J Arthroplast. 2018;33:1833-7.
29. Ponce BA, Jennings JK, Clay TB, May MB, Huisingh C, Sheppard ED. Telementoring: use of augmented reality in orthopaedic education: AAOS exhibit selection. J Bone Joint Surg Am. 2014;96:e84.
30. Ponce BA, Menendez ME, Oladeji LO, Fryberger CT, Dantuluri PK. Emerging technology in surgical education: combining real-time augmented reality and wearable computing devices. Orthopedics. 2014;37:751-7.
31. Shen F, Chen B, Guo Q, Qi Y, Shen Y. Augmented reality patient-specific reconstruction plate design for pelvic and acetabular fracture surgery. Int J Comput Assist Radiol Surg. 2013;8:169-79.
32. Wu JR, Wang ML, Liu KC, Hu MH, Lee PY. Real-time advanced spinal surgery via visible patient model and augmented reality system. Comput Methods Prog Biomed. 2014;113:869-81.
33. Cho HS, Park MS, Gupta S, Han I, Kim HS, Choi H, et al. Can augmented reality be helpful in pelvic bone Cancer surgery? An in vitro study. Clin Orthop Relat Res. 2018;476:1719-25.
34. Cho HS, Park YK, Gupta S, Yoon C, Han I, Kim HS, et al. Augmented reality in bone tumour resection: an experimental study. Bone Joint Res. 2017;6:137-43.
35. Elmi-Terander A, Nachabe R, Skulason H, Pedersen K, Soderman M, Racadio J, et al. Feasibility and accuracy of thoracolumbar minimally invasive pedicle screw placement with augmented reality navigation technology. Spine (Phila Pa 1976). 2018;43:1018-23.
36. Fallavollita P, Brand A, Wang L, Euler E, Thaller P, Navab N, et al. An augmented reality C-arm for intraoperative assessment of the mechanical axis: a preclinical study. Int J Comput Assist Radiol Surg. 2016;11:2111-7.
37. Fichtinger G, Deguet A, Masamune K, Balogh E, Fischer GS, Mathieu H, et al. Image overlay guidance for needle insertion in CT scanner. IEEE Trans Biomed Eng. 2005;52:1415-24.
38. Fischer GS, Deguet A, Csoma C, Taylor RH, Fayad L, Carrino JA, et al. MRI image overlay: application to arthrography needle insertion. Comput Aided Surg. 2007;12:2-14.
39. Heining SM, Wiesner S, Euler E, Navab N. Pedicle screw placement under video-augmented flouroscopic control: first clinical application in a cadaver study. Int J Comput Assist Radiol Surg. 2006;1:189-90.
40. Ma L, Zhao Z, Chen F, Zhang B, Fu L, Liao H. Augmented reality surgical navigation with ultrasound-assisted registration for pedicle screw placement: a pilot study. Int J Comput Assist Radiol Surg. 2017;12:2205-15.
41. Navab N, Heining SM, Traub J. Camera augmented mobile C-arm (CAMC): calibration, accuracy study, and clinical applications. IEEE Trans Med Imaging. 2010;29:1412-23.
42. Wang H, Wang F, Leong AP, Xu L, Chen X, Wang Q. Precision insertion of percutaneous sacroiliac screws using a novel augmented reality-based navigation system: a pilot study. Int Orthop. 2016;40:1941-7.
43. Hummel E, Homan RJF, Babic D, Balguid A. Imaging system and method for enabling instrument guidance. Google Patents; 2015.
44. Gibby JT, Swenson SA, Cvetko S, Rao R, Javan R. Head-mounted display augmented reality to guide pedicle screw placement utilizing computed tomography. Int J Comput Assist Radiol Surg. 2019;14:525-35.
45. UT P, Fritz J, Moonjaita C, Ungi T, Flammang A, Carrino JA, et al. MR image overlay guidance: system evaluation for preclinical use. Int J Comput Assist Radiol Surg. 2013;8:365-78.
46. Fischer M, Fuerst B, Lee SC, Fotouhi J, Habert S, Weidert S, et al. Preclinical usability study of multiple augmented reality concepts for K-wire placement. Int J Comput Assist Radiol Surg. 2016;11:1007-14.
47. Andress S, Johnson A, Unberath M, Winkler AF, Yu K, Fotouhi J, et al. On-the-fly augmented reality for orthopedic surgery using a multimodal fiducial. J Med Imaging (Bellingham). 2018;5:021209.
48. Befrui N, Fischer M, Fuerst B, Lee SC, Fotouhi J, Weidert S, et al. 3D augmented reality visualization for navigated osteosynthesis of pelvic fractures. Unfallchirurg. 2018;121:264-70.
49. Londei R, Esposito M, Diotte B, Weidert S, Euler E, Thaller P, et al. Intra-operative augmented reality in distal locking. Int J Comput Assist Radiol Surg. 2015;10:1395-403.
50. Ma L, Zhao Z, Zhang B, Jiang W, Fu L, Zhang X, et al. Three-dimensional augmented reality surgical navigation with hybrid optical and electromagnetic tracking for distal intramedullary nail interlocking. Int J Med Robot. 2018;14:e1909.
51. Fotouhi J, Alexander CP, Unberath M, Taylor G, Lee SC, Fuerst B, et al. Plan in 2-D, execute in 3-D: an augmented reality solution for cup placement in total hip arthroplasty. J Med Imaging (Bellingham). 2018;5:021205.
52. Liu H, Auvinet E, Giles J, Rodriguez YBF. Augmented reality based navigation for computer assisted hip resurfacing: A proof of concept study. Ann Biomed Eng. 2018;46:1595-605.
53. Liu H, Bowyer S, Auvinet E, Baena FR. A smart registration assistant for joint replacement: a concept demonstration. Bone Jt J. 2017;99:58.
54. Wang L, Traub J, Weidert S, Heining SM, Euler E, Navab N. Parallax-free intra-operative X-ray image stitching. Med Image Anal. 2010;14:674-86.
55. Gavaghan K, Oliveira-Santos T, Peterhans M, Reyes M, Kim H, Anderegg S, et al. Evaluation of a portable image overlay projector for the visualisation of surgical navigation data: phantom studies. Int J Comput Assist Radiol Surg. 2012;7:547-56.
56. van Duren BH, Sugand K, Wescott R, Carrington R, Hart A. Augmented reality fluoroscopy simulation of the guide-wire insertion in DHS surgery: A proof of concept study. Med Eng Phys. 2018;55:52-9.
57. Hiranaka T, Fujishiro T, Hida Y, Shibata Y, Tsubosaka M, Nakanishi Y, et al. Augmented reality: the use of the PicoLinker smart glasses improves wire insertion under fluoroscopy. World J Orthop. 2017;8:891-4.
58. Yeo CT, Ungi T, UT P, Lasso A, RC MG, Fichtinger G. The effect of augmented reality training on percutaneous needle placement in spinal facet joint injections. IEEE Trans Biomed Eng. 2011;58:2031-7.
59. Condino S, Turini G, Parchi PD, Viglialoro RM, Piolanti N, Gesi M, et al. How to build a patient-specific hybrid simulator for Orthopaedic open surgery: benefits and limits of mixed-reality using the Microsoft HoloLens. J Healthc Eng. 2018;2018:5435097.