Development of a surgical navigation system based on augmented reality using an optical see-through head-mounted display

Journal of Biomedical Informatics

Volumn 55, Issue , 2015, Pages 124-131

  Chen, Xiaojun ^a   Xu, Lu ^a   Wang, Yiping ^a   Wang, Huixiang ^b   Wang, Fang ^b   Zeng, Xiangsen ^b   Wang, Qiugen ^b   Egger, Jan ^c  

^a SHANGHAI JIAO TONG UNIVERSITY   (China)

^b SHANGHAI FIRST PEOPLE S HOSPITAL   (China)

^c GRAZ UNIVERSITY OF TECHNOLOGY   (Austria)

Author keywords

Augmented reality; Intra operative motion tracking; Optical see through HMD; Surgical navigation

Indexed keywords

AUGMENTED REALITY; BLOOD VESSELS; CALIBRATION; MOTION TRACKING; NAVIGATION SYSTEMS; SURGICAL EQUIPMENT; TRANSPLANTATION (SURGICAL);

ANATOMICAL STRUCTURES; CLINICAL APPLICATION; HEAD MOUNTED DISPLAYS; INTRA-OPERATIVE; OPTICAL SEE-THROUGH; OPTICAL SEE-THROUGH HEAD-MOUNTED DISPLAYS; SURGICAL NAVIGATION; SURGICAL NAVIGATION SYSTEMS;

HELMET MOUNTED DISPLAYS;

ARTICLE; CALIBRATION; HUMAN; IMAGE PROCESSING; IMAGE QUALITY; IMAGE RECONSTRUCTION; IMAGE SEGMENTATION; IMAGING AND DISPLAY; IMAGING SYSTEM; OPTICAL SEE THROUGH HEAD MOUNTED DISPLAY; PATIENT POSITIONING; PRIORITY JOURNAL; REAL TIME TRACKING SYSTEM; REGISTRATION; RELIABILITY; SAFETY; SURGICAL NAVIGATION SYSTEM; SYSTEMATIC ERROR; THREE DIMENSIONAL IMAGING; VALIDATION PROCESS; VIRTUAL REALITY; COMPUTER ASSISTED SURGERY; COMPUTER GRAPHICS; COMPUTER INTERFACE; DEVICE FAILURE ANALYSIS; DEVICES; EQUIPMENT DESIGN; HEAD; HELMET; IMAGE ENHANCEMENT; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY;

COMPUTER GRAPHICS; EQUIPMENT DESIGN; EQUIPMENT FAILURE ANALYSIS; HEAD; HEAD PROTECTIVE DEVICES; HUMANS; IMAGE ENHANCEMENT; IMAGING, THREE-DIMENSIONAL; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY; SURGERY, COMPUTER-ASSISTED; USER-COMPUTER INTERFACE;

EID: 84930699188     PISSN: 15320464     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jbi.2015.04.003     Document Type: Article

References (31)

1. Moussa G., Radwan E., Hussain K. Augmented reality vehicle system: left-turn maneuver study. Transp. Res. Part C 2012, 21:1-16.
2. Chen X.J., Ye M., Lin Y.P., Wu Y.Q., Wang C.T. Image guided oral implantology and its application in the placement of zygoma implants. Comput. Methods Programs Biomed. 2009, 93:162-173.
3. Kreissl M.E., Heydecke G., Metzger M.C., Schoen R. Zygoma implant-supported prosthetic rehabilitation after partial maxillectomy using surgical navigation: a clinical report. J. Prosthet. Dent. 2007, 97:121-128.
4. Ewers R., Schicho K., Undt G., Wanschitz F., Truppe M., Seemann R., et al. Basic research and 12 years of clinical experience in computer-assisted navigation technology: a review. Int. J. Oral Maxillofac. Surg. 2005, 34:1-8.
5. Grunert P., Darabi K., Espinosa J., Filippi R. Computer-aided navigation in neurosurgery. Neurosurg. Rev. 2003, 26:73-99.
6. Meyer U., Wiesmann H.P., Runte C., Fillies T., Meier N., Lueth T., et al. Evaluation of accuracy of insertion of dental implants and prosthetic treatment by computer-aided navigation in minipigs. Br. J. Oral Maxillofac. Surg. 2003, 41:102-108.
7. Watzinger F., Birkfellner W., Wanschitz F., Ziya F., Wagner A., Kremser J., et al. Placement of endosteal implants in the zygoma after maxillectomy: a cadaver study using surgical navigation. Plast. Reconstr. Surg. 2001, 107:659-667.
8. <>, (2014, June 10). http://www.skullysystems.com/#home.
9. Azuma R., Baillot Y., Behringer R., Feiner S., Julier S., MacIntyre B. Recent advances in augmented reality. IEEE Comput. Graphics Appl. 2001, 21:34-47.
10. Yang M.D., Chao C.F., Huang K.S., Lu L.Y., Chen Y.P. Image-based 3D scene reconstruction and exploration in augmented reality. Automat. Constr. 2013, 33:48-60.
11. Navab N., Traub J., Sielhorst T., Feuerstein M., Bichlmeier C. Action- and workflow-driven augmented reality for computer-aided medical procedures. IEEE Comput. Soc. 2007, 27:10-14.
12. Liao H., Dohi T., Iwahara M. Improved viewing resolution of integral videography by use of rotated prism sheets. Opt. Express 2007, 15:4814-4822.
13. Liao H., Inomata T., Sakuma I., Dohi T. 3-D augmented reality for MRI-Guided surgery using integral videography autostereoscopic image overlay. IEEE Trans. Biomed. Eng. 2010, 57:1476-1486.
14. Navab N., Heining S.M., Traub J. Camera augmented mobile C-arm (CAMC): calibration, accuracy study and clinical applications. IEEE Trans. Med. Imaging 2010, 29:1412-1423.
15. Fitzpatrick J.M., West J.B., Maurer C.R. Predicting error in rigid-body point-based registration. IEEE Trans. Med. Imag. 1998, 17:694-702.
16. West J.B., Fitzpatrick J.M., Toms S.A., Maurer C.R., Maciunas R.J. Fiducial point placement and the accuracy of point-based rigid body registration. Neurosurgery 2001, 48:810-816.
17. Claes J., Koekelkoren E., Wuyts F.L., Claes G.M.E., Van Den Hauwe L., Van de Heyning P.H. Accuracy of computer navigation in ear, nose, throat surgery - the influence of matching strategy. Otolaryngol. Head Neck Surg. 2000, 126:1462-1466.
18. Schicho K., Figl M., Seemann R., Donat M., Pretterklieber M.L., Birkfellner W., et al. Comparison of laser surface scanning and fiducial marker-based registration in frameless stereotaxy. Neurosurgery 2007, 106:704-709.
19. Caversaccio M., Zulliger D., Bachler R., Nolte L.P., Hausler R. Practical aspects for optimal registration (matching) on the lateral skull base with an optical frameless computer-aided pointer system. Am. J. Otol. 2000, 21:863-870.
20. Lorensen W.E., Cline H.E. Marching cubes: a high resolution 3D surface construction algorithm. ACM Comput. Graph. 1987, 21:38-44.
21. Chen X.J., Lin Y.P., Wu Y.Q., Wang C.T. Real-time motion tracking in image-guided oral implantology. Int. J. Med. Robot. Comput. Assist Surg. 2008, 4:339-347.
22. Cleary K., Cheng P., Enquobahrie A., Yaniv Z. IGSTK: The Book 2009, 225-229. Signature Book Printing, Gaithersburg, Maryland.
23. Cleary K., Peters T.M. Image-guided interventions: technology review and clinical applications. Annu. Rev. Biomed. Eng. 2010, 12:119-142.
24. Kellner F., Bolte B., Bruder G., Rautenberg U., Steinicke F., Lappe M., et al. Geometric calibration of head-mounted displays and its effects on distance estimation. IEEE Trans. Visual. Comput. Graph. 2012, 18:589-596.
25. Y. Genc, F. Sauer, F. Wenzel, M. Tuceryan, N. Navab, Optical see-through HMD calibration: a stereo method validated with a video see-through system, in: IEEE and ACM Int. Symposium on Augmented Reality, 2000, pp. 165-174.
26. Gilson S.J., Fitzgibbon A.W., Glennerster A. Spatial calibration of an optical see-through head mounted display. J. Neurosci. Methods 2008, 173:140-146.
27. Vigh B., Muller S., Ristow O., Deppe H., Holdstock S., Hollander J.D., et al. The use of a head-mounted display in oral implantology: a feasibility study. Int. J. CARS 2014, 9:71-78.
28. <>, 2015. https://www.davincisurgerycommunity.com/Home?tab1=HO.
29. Zhang X.Y. Microsoft Kinect sensor and its effect. IEEE Multimedia 2012, 19:4-10.
30. <>, (2013, November 5). http://www.slicer.org/slicerWiki/index.php/Documentation/4.3/Modules/DicomRtExport.
31. Chen X.J., Egger J. Development of an open source software module for enhanced visualization during MR-guided interstitial gynecologic brachytherapy. SpringerPlus 2014, 3:167-176.