Comparison of optical see-through head-mounted displays for surgical interventions with object-anchored 2D-display

International Journal of Computer Assisted Radiology and Surgery

Volumn 12, Issue 6, 2017, Pages 901-910

  Qian, Long ^a,d   Barthel, Alexander ^a,b   Johnson, Alex ^c   Osgood, Greg ^c   Kazanzides, Peter ^d   Navab, Nassir ^a,b   Fuerst, Bernhard ^a  

^a JOHNS HOPKINS UNIVERSITY   (United States)

^b TECHNICAL UNIVERSITY OF MUNICH   (Germany)

^c JOHNS HOPKINS UNIVERSITY SCHOOL OF MEDICINE   (United States)

^d Johns Hopkins University   (United States)

Author keywords

Intervention; Mixed reality; Optical see through head mounted display; User study

Indexed keywords

ARTICLE; COMPARATIVE STUDY; EVALUATION STUDY; IMAGE ANALYSIS; IMAGE PROCESSOR; IMAGE QUALITY; IMAGING AND DISPLAY; IMAGING SOFTWARE; OPTICAL SEE THROUGH HEAD MOUNTED DISPLAY; PRIORITY JOURNAL; SURGERY; TWO-DIMENSIONAL IMAGING; VIRTUAL REALITY; COMPUTER GRAPHICS; COMPUTER INTERFACE; DEVICES; EQUIPMENT DESIGN; HEAD; HUMAN; INFORMATION PROCESSING; ORTHOPEDIC SURGERY;

COMPUTER GRAPHICS; DATA DISPLAY; EQUIPMENT DESIGN; HEAD; HUMANS; ORTHOPEDIC PROCEDURES; USER-COMPUTER INTERFACE;

EID: 85016181104     PISSN: 18616410     EISSN: 18616429     Source Type: Journal    
DOI: 10.1007/s11548-017-1564-y     Document Type: Article

References (42)

1. Abe Y, Sato S, Kato K, Hyakumachi T, Yanagibashi Y, Ito M, Abumi K (2013) A novel 3D guidance system using augmented reality for percutaneous vertebroplasty: technical note. J Neurosurg Spine 19(4):492–501
2. Armstrong DG, Rankin TM, Giovinco NA, Mills JL, Matsuoka Y (2014) A heads-up display for diabetic limb salvage surgery a view through the google looking glass. J Diabetes Sci Technol 8:951–956
3. Azimi E, Doswell J, Kazanzides P (2012) Augmented reality goggles with an integrated tracking system for navigation in neurosurgery. In: 2012 IEEE Virtual Reality Workshops (VRW), pp 123–124. doi:10.1109/VR.2012.6180913
4. Badiali G, Ferrari V, Cutolo F, Freschi C, Caramella D, Bianchi A, Marchetti C (2014) Augmented reality as an aid in maxillofacial surgery: validation of a wearable system allowing maxillary repositioning. J Craniomaxillofacial Surg 42(8):1970–1976
5. Bajura M, Fuchs H, Ohbuchi R (1992) Merging virtual objects with the real world: Seeing ultrasound imagery within the patient. SIGGRAPH 26(2):203–210. doi:10.1145/142920.134061
6. Bichlmeier C, Ockert B, Heining SM, Ahmadi A, Navab N (2008) Stepping into the operating theater: ARAV—augmented reality aided vertebroplasty. In: Proceedings of the 7th IEEE/ACM International Symposium on Mixed and Augmented Reality. ISMAR ’08, pp 165–166. IEEE Computer Society, Washington, DC. doi:10.1109/ISMAR.2008.4637348
7. Chen X, Xu L, Wang Y, Wang H, Wang F, Zeng X, Wang Q, Egger J (2015) Development of a surgical navigation system based on augmented reality using an optical see-through head-mounted display. J Biomed Inform 55:124–131
8. Cutolo F, Parchi PD, Ferrari V (2014) Video see through AR head-mounted display for medical procedures. In: 2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), p 393–396. doi:10.1109/ISMAR.2014.6948504
9. Hart SG (2006) NASA-task load index (NASA-TLX); 20 years later. In: Proceedings of the human factors and ergonomics society annual meeting, vol 50. Sage Publications, pp 904–908. doi:10.1177/154193120605000909
10. Herron D, Lantis Ii J, Maykel J, Basu C, Schwaitzberg S (1999) The 3-D monitor and head-mounted display. Surg Endosc 13(8):751–755
11. Hoffman DM, Girshick AR, Akeley K, Banks MS (2008) Vergence-accommodation conflicts hinder visual performance and cause visual fatigue. J Vision 8(3):33–33
12. Itoh Y, Amano T, Iwai D, Klinker G (2016) Gaussian light field: estimation of viewpoint-dependent blur for optical see-through head-mounted displays. IEEE Trans Vis Comput Graph 22(11):2368–2376
13. Janin AL, Mizell DW, Caudell TP (1993) Calibration of head-mounted displays for augmented reality applications. In: Proceedings of VR annual international symposium, p 246–255. doi:10.1109/VRAIS.1993.380772
14. Kersten-Oertel M, Jannin P, Collins DL (2012) DVV: a taxonomy for mixed reality visualization in image guided surgery. IEEE Trans Vis Comput Graph 18(2):332–352
15. Kersten-Oertel M, Jannin P, Collins DL (2013) The state of the art of visualization in mixed reality image guided surgery. Comput Med Imaging Graph 37(2):98–112
16. Koesveld J, Tetteroo G, Graaf E (2003) Use of head-mounted display in transanal endoscopic microsurgery. Surg Endosc 17(6):943–946
17. Kramida G (2016) Resolving the vergence-accommodation conflict in head-mounted displays. IEEE Trans Vis Comput Graph 22(7):1912–1931
18. Kress B, Starner T (2013) A review of head-mounted displays (HMD) technologies and applications for consumer electronics. Proc SPIE 8720:87200A–87200A-13. doi:10.1117/12.2015654
19. Liao H, Inomata T, Sakuma I, Dohi T (2010) Three-dimensional augmented reality for mriguided surgery using integral videography auto stereoscopic-image overlay. IEEE Trans Biomed Eng 57(6):1476–1486
20. Maithel S, Villegas L, Stylopoulos N, Dawson S, Jones D (2005) Simulated laparoscopy using a head-mounted display vs traditional video monitor: an assessment of performance and muscle fatigue. Surg Endosc 19(3):406–411
21. Martin-Gonzalez A, Heining SM, Navab N (2009) Head-mounted virtual loupe with sight-based activation for surgical applications. In: 2009 8th IEEE international symposium on mixed and augmented reality, pp 207–208
22. Mentler T, Wolters C, Herczeg M (2015) Use cases and usability challenges for head-mounted displays in healthcare. Curr Dir Biomed Eng 1(1):534–537
23. Milgram P, Colquhoun H (1999) A taxonomy of real and virtual world display integration. Mixed Real Merg Real Virtual World 1:1–26
24. Morisawa T, Kida H, Kusumi F, Okinaga S, Ohana M (2015) Endoscopic submucosal dissection using head-mounted display. Gastroenterology 149(2):290–291
25. Ortega G, Wolff A, Baumgaertner M, Kendoff D (2008) Usefulness of a head mounted monitor device for viewing intraoperative fluoroscopy during orthopaedic procedures. Arch Orthop Trauma Surg 128(10):1123–1126
26. Qian L, Winkler A, Fuerst B, Kazanzides P, Navab N (2016) Reduction of interaction space in single point active alignment method for optical see-through head-mounted display calibration. In: 2016 IEEE international symposium on mixed and augmented reality (ISMAR-Adjunct), pp 156–157
27. Queisner M (2016) Medical screen operations: how head-mounted displays transform action and perception in surgical practice. Mediat 6(1):30–51
28. Rolland JP, Fuchs H (2000) Optical versus video see-through head-mounted displays in medical visualization. Presence Teleoperator Virtual Environ 9(3):287–309
29. Sadda P, Azimi E, Jallo G, Doswell J, Kazanzides P (2012) Surgical navigation with a head-mounted tracking system and display. Stud Health Technol Inform 184:363–369
30. Shuhaiber JH (2004) Augmented reality in surgery. Arch Surg 139(2):170–174
31. Suthau T, Vetter M, Hassenpflug P, Meinzer HP, Hellwich O (2002) A concept work for augmented reality visualisation based on a medical application in liver surgery. ISPRS Arch 34(5):274–280
32. Sutherland IE (1968) A head-mounted three dimensional display. In: Proceedings of the fall joint computer conference, part I, ACM, p 757–764, 9–11 December 1968
33. Thomsen MN, Lang RD (2004) An experimental comparison of 3-dimensional and 2-dimensional endoscopic systems in a model. Arthroscopy 20(4):419–423
34. Thrun S, Leonard JJ (2008) Simultaneous localization and mapping. In: Siciliano B, Khatib O (eds) Springer handbook of robotics. Springer, Berlin, pp 871–889
35. Tuceryan M, Navab N (2000) Single point active alignment method (SPAAM) for optical see-through HMD calibration for AR. In: Proceedings IEEE and ACM international symposium on augmented reality (ISAR 2000), pp 149–158
36. Wagner D, Reitmayr G, Mulloni A, Drummond T, Schmalstieg D (2008) Pose Tracking from natural features on mobile phones. In: Proceedings of the 7th IEEE/ACM international symposium on mixed and augmented reality, Washington, DC, USA, pp 125–134
37. Wang H, Wang F, Leong APY, Xu L, Chen X, Wang Q (2015) Precision insertion of percutaneous sacroiliac screws using a novel augmented reality-based navigation system: a pilot study. Int Orthop 40:1–7
38. Wang J, Suenaga H, Hoshi K, Yang L, Kobayashi E, Sakuma I, Liao H (2014) Augmented reality navigation with automatic marker-free image registration using 3-d image overlay for dental surgery. IEEE Trans Biomed Eng 61(4):1295–1304
39. Wilcoxon F, Katti S, Wilcox RA (1970) Critical values and probability levels for the wilcoxon rank sum test and the wilcoxon signed rank test. Sel Table Math Stat 1:171–259
40. Yoon JW, Chen RE, Han PK, Si P, Freeman WD, Pirris SM (2016) Technical feasibility and safety of an intraoperative head-up display device during spine instrumentation. Int J Med Robot Comput Assist Surg. doi:10.1002/rcs.1770
41. Yoshida S, Kihara K, Takeshita H, Nakanishi Y, Kijima T, Ishioka J, Matsuoka Y, Numao N, Saito K, Fujii Y (2014) Head-mounted display for a personal integrated image monitoring system: ureteral stent placement. Urol Int 94(1):117–120
42. Zhang X, Chen G, Liao H (2016) High quality see-through surgical guidance system using enhanced 3d autostereoscopic augmented reality. IEEE Trans Biomed Eng. doi:10.1109/TBME.2016.2624632