Mixed Reality in Visceral Surgery

Annals of Surgery

Volumn 266, Issue 5, 2017, Pages 706-712

  Sauer, Igor M ^a,b,c   Queisner, Moritz ^d   Tang, Peter ^a,b,c   Moosburner, Simon ^a,b,c   Hoepfner, Ole ^a,b,c   Horner, Rosa ^a,b,c   Lohmann, Rudiger ^a,b,c   Pratschke, Johann ^a,b,c  

^a CHARITÉ UNIVERSITÄTSMEDIZIN BERLIN   (Germany)

^b FREIE UNIVERSITÄT BERLIN   (Germany)

^c BERLIN INSTITUTE OF HEALTH   (Germany)

^d Berlin Research Center Image Knowledge Gestaltung   (Germany)

Author keywords

3D; augmented reality; head mounted displays; image guided surgery; mixed reality; tele consulting; virtual reality

Indexed keywords

ANATOMIC MODEL; ANATOMICAL CONCEPTS; ARTICLE; COMPUTER ASSISTED SURGERY; COMPUTER ASSISTED TOMOGRAPHY; FEASIBILITY STUDY; HEPATIC ARTERY; HEPATIC PORTAL VEIN; HUMAN; INTRAOPERATIVE PERIOD; LIVER STRUCTURE; LIVER SURGERY; LIVER VEIN; MIXED REALITY; OPEN SURGERY; OPERATING ROOM; PHYSICIAN ATTITUDE; PRIORITY JOURNAL; SURGICAL TECHNIQUE; THREE DIMENSIONAL IMAGING; TWO-DIMENSIONAL IMAGING; VIRTUAL REALITY; VISUAL INFORMATION; WORKFLOW; COMPUTER INTERFACE; DEVICES; LIVER RESECTION; PROCEDURES;

FEASIBILITY STUDIES; HEPATECTOMY; HUMANS; IMAGING, THREE-DIMENSIONAL; SURGERY, COMPUTER-ASSISTED; USER-COMPUTER INTERFACE; WORKFLOW;

EID: 85031282139     PISSN: 00034932     EISSN: 15281140     Source Type: Journal    
DOI: 10.1097/SLA.0000000000002448     Document Type: Article

References (27)

1. Sielhorst T, Feuerstein M, Navab N. Advanced medical displays: A literature review of augmented reality. J Display Technol. 2008;4:451-467.
2. Wheatstone C. Contributions to the physiology of vision. Part the first. On some remarkable, and hitherto unobserved, phenomena of binocular vision. Philos Trans R Soc Lond. 1838;128:371-394.
3. Heilig ML. Sensorama Simulator [Google Patents web site]. 1962. Available at: http://www. google. com/patents/US3050870. Accessed March 7, 2017.
4. Sutherland IE. A Head-mounted Three Dimensional Display, Proceedings of the December 9-11 1968, Fall Joint Computer Conference. Part I: ACM. 1968;757-764.
5. Sutherland IE. The Ultimate Display. Proceedings of IFIP Congress. 1965; 506-508.
6. Ö zbek Y, Freysinger W. Stereo Augmented Reality in einem navigierten Operationsmikroskop (AROSCOPE). Proceedings of the 13th Annual Conference of the German Society for Computer-and Robotic Assisted Surgery (CURAC); Munich, Germany, September 11th-13th, 2014.
7. Microsoft. HoloLens [Microsoft web site]. Available at: https://www. microsoft. com/microsoft-hololens/de-de/hardware. Accessed March 7, 2017.
8. Metavision. Augmented Reality: Meet Meta [Metavision web site]. Available at: https://www. metavision. com/meet-meta. Accessed March 7, 2017.
9. Avegant. [Avegant web site]. Available at: https://www. Avegant. com. Accessed March 14, 2017.
10. Milgram P, Colquhoun H. A taxonomy of real and virtual world display integration. Mixed reality: merging real and virtual worlds. Proc Int Symp Mixed Reality. 1999;1:1-26.
11. Alphabet. Glass [Google Developers web site]. Available at: https://developers. google. com/glass/. Accessed March 7, 2017.
12. Saarikko P, Kostamo P. Waveguide [US Patent and Trademark Office web site]. 2016. Available at: http://pdfaiw. uspto. gov/. Aiw?docid=20160231568&-PageNum=1&IDKey=FB1492A48A BD&HomeUrl=http://appft. uspto. gov/ netacgi/nph-. Accessed March 7, 2017.
13. Microsoft. Hologram Stability [Microsoft web site]. Available at: https:// developer. microsoft. com/en-us/windows/holographic/hologram-stability. Accessed March 7, 2017.
14. Microsoft. Gestures [Microsoft web site]. Available at: https://developer. microsoft. com/en-us/windows/holographic/gestures. Accessed March 7, 2017.
15. Volonté F, Pugin F, Bucher P, et al. Augmented reality and image overlay navigation with OsiriX in laparoscopic and robotic surgery: not only a matter of fashion. J Hepatobiliary Pancreat Sci. 2011;18:506-509.
16. Radtke A, Sotiropoulos GC, Molmenti EP, et al. Computer-assisted surgery planning for complex liver resections: when is it helpful A single-center experience over an 8-year period. Ann Surg. 2010;252:876-883.
17. Andolfi C, Plana A, Kania P, et al. Usefulness of three-dimensional modeling in surgical planning, resident training, and patient education. J Laparoendosc Adv Surg Tech A. 2017;27:512-515.
18. Plantefève R, Peterlik I, Haouchine N, et al. Patient-specific biomechanical modeling for guidance during minimally-invasive hepatic surgery. Ann Biomed Eng. 2016;44:139-153.
19. Haouchine N, Dequidt J, Berger MO, et al. Monocular 3D reconstruction and augmentation of elastic surfaces with self-occlusion handling. IEEE Trans Vis Comput Graph. 2015;21:1363-1376.
20. Soler L, Nicolau S, Pessaux P, et al. Real-time 3D image reconstruction guidance in liver resection surgery. Hepatobiliary Surg Nutr. 2014;3:73-81.
21. Marzano E, Piardi T, Soler L, et al. Augmented reality-guided arteryfirst pancreatico-duodenectomy. J Gastrointest Surg. 2013;17:1980-1983.
22. Mahmoud N, GrasaO G, Nicolau SA, et al. On-patient see-through augmented reality based on visual SLAM. Int J CARS. 2017;12:1-11.
23. Bernhardt S, Nicolau SA, Soler L, et al. The status of augmented reality in laparoscopic surgery as of 2016. Med Image Anal. 2017;37:66-90.
24. Khor WS, Baker B, Amin K, et al. Augmented and virtual reality in surgery-the digital surgical environment: Applications, limitations and legal pitfalls. Ann Transl Med. 2016;4:444-454.
25. Ninja Theory. Hellblade: Diary 21: Making a Virtual Human j Real-time Performance Capture [Youtube web site]. Available at: https://www. youtube. com/watch?v=CmrXK4fNOEo. Accessed March 16, 2017.
26. Cubic Motion: Realtime Live [Cubic Motion web site]. Available at: https:// www. cubicmotion. com/realtime-live. Accessed July 16th, 2017.
27. Thomas DJ. Augmented reality in surgery: The computer-aided medicine revolution. Int J Surg. 2016;36:25.