Stereoscopic integrated imaging goggles for multimodal intraoperative image guidance

PLoS ONE

Volumn 10, Issue 11, 2015, Pages

  Mela, Christopher A ^a   Patterson, Carrie ^a   Thompson, William K ^b   Papay, Francis ^c   Liu, Yang ^a  

^a University of Akron   (United States)

^b NASA GLENN RESEARCH CENTER   (United States)

^c LERNER RESEARCH INSTITUTE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

INDOCYANINE GREEN;

ARTICLE; CHICKEN; CONTROLLED STUDY; ECHOGRAPHY; EQUIPMENT DESIGN; EX VIVO STUDY; FILTER; FLUORESCENCE IMAGING; FLUORESCENCE IMAGING SYSTEM; IMAGE PROCESSING; INTRAVITAL MICROSCOPY; NONHUMAN; PROCESS OPTIMIZATION; QUALITY CONTROL; SEMICONDUCTOR; SENSOR; SIMULATION; STEREOMICROSCOPY; STEREOSCOPIC INTEGRATED IMAGING GOGGLE; TELEMEDICINE; ANIMAL; COMPUTER ASSISTED SURGERY; DEPTH PERCEPTION; DEVICES; HUMAN; NEOPLASMS; POULTRY DISEASES; PROCEDURES; VETERINARY;

ANIMALS; CHICKENS; DEPTH PERCEPTION; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; NEOPLASMS; POULTRY DISEASES; SURGERY, COMPUTER-ASSISTED; TELEMEDICINE;

EID: 84951865815     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0141956     Document Type: Article

References (43)

1. Pamir MN, Seifert V, Kiris T, editors. Intraoperative Imaging. 1st ed. Vienna: Springer-Verlag Wien; 2011.
2. Kubben PL, ter Meulen KJ, Schijns OEMG, ter Laak-Poort MP, van Overbeeke JJ, van Santbrink H. Intraoperative MRI-guided resection of glioblastoma multiforme: a systematic review. The Lancet Oncol. 2011; 12(11):1062-70. doi: 10.1016/S1470-2045(11)70130-9 PMID: 21868286
3. Pallone MJ, Poplack SP, Avutu HBR, Paulsen KD, Barth RJ Jr. Supine breast MRI and 3D optical scanning: A novel approach to improve tumor localization for breast conserving surgery. Ann Surg Oncol. 2014; 21(7):2203-8. doi: 10.1245/s10434-014-3598-5 PMID: 24619494
4. Lam DL, Mitsumori LM, Neligan PC, Warren BH, Shuman WP, Dubinsky TJ. Pre-operative CT angiography and three-dimensional image post processing for deep inferior epigastric perforator flap breast reconstructive surgery. BJR. 2012; 85(1020):1293-7.
5. Nam WH, Kang DG, Lee D, Lee JY and Ra JB. Automatic registration between 3D intra-operative ultrasound and pre-operative CT images of the liver based on robust edge matching. Phys Med Biol. 2012;57(1):69-91. doi: 10.1088/0031-9155/57/1/69 PMID: 22126813
6. Kingham TP, Jayaraman S, Clements LW, Scherer MA, Stefansic JD, Jarnagin WR. Evolution of image-guided liver surgery: Transition from open to laparoscopic procedures. J Gastrointest Surg. 2013; 17(7):1274-82. doi: 10.1007/s11605-013-2214-5 PMID: 23645420
7. Kingham TP, Scherer MA, Neese BW, Clements LW, Stefansic JD, Jarnagin WR. Image-guided liver surgery: intraoperative projection of computed tomography images utilizing tracked ultrasound. HPB. 2012; 14(9): 594-603. doi: 10.1111/j.1477-2574.2012.00487.x PMID: 22882196
8. Kelderhouse LE, Chelvam V, Wayua C, Mahalingam S, Poh S, Kularatne SA, et al. Development of tumor-targeted near infrared probes for fluorescence guided surgery. Bioconjug Chem. 2013; 24(6):1075-80. doi: 10.1021/bc400131a PMID: 23642154
9. Hughes OR, Stone N, Kraft M, Arens C, Birchall MA. Optical and molecular techniques to identify tumor margins within the larynx. Head Neck. 2010; 32(11):1544-53. doi: 10.1002/hed.21321 PMID: 20091681
10. Nguyen QT, Olson ES, Aguilera TA, Jiang T, Scadeng M, Ellies LG, et al. Surgery with molecular fluorescence imaging using activatable cell-penetrating peptides decreases residual cancer and improves survival. PNAS. 2010; 107(9):4317-22. doi: 10.1073/pnas.0910261107 PMID: 20160097
11. Keller MD, Majumder SK, Kelley MC, Meszoely IM, Boulos FI, Olivares GM, et al. Autofluorescence and diffuse reflectance spectroscopy and spectral imaging for breast surgical margin analysis. Lasers Surg Med. 2010; 42(1):15-23. doi: 10.1002/lsm.20865 PMID: 20077490
12. Wilke LG, Brown JQ, Bydlon TM, Kennedy SA, Richards LM, Junker MK, et al. Rapid noninvasive optical imaging of tissue composition in breast tumor margins. Am J Surg. 2009; 198(4):566-74. doi: 10.1016/j.amjsurg.2009.06.018 PMID: 19800470
13. Cinotti E, Perrot JL, Labeille B, Campolmi N, Espinasse M, Grivet D, et al. Handheld reflectance confocal microscopy for the diagnosis of conjunctival tumors. Am J Ophthalmol. 2015; 159(2):324-33. doi: 10.1016/j.ajo.2014.10.031 PMID: 25447117
14. Hiroshima Y, Maawy A, Sato S, Murakami T, Uehara F, Miwa S, et al. Hand-held high-resolution fluorescence imaging system for fluorescence-guided surgery of patient and cell-line pancreatic tumors growing orthotopically in nude mice. J Surg Res. 2014; 187(2):510-7. doi: 10.1016/j.jss.2013.11.1083 PMID: 24373959
15. Martirosyan NL, Georges J, Eschbacher JM, Cavalcanti DD, Elhadi AM, Abdelwahab MG, et al. Potential application of a handheld confocal endomicroscope imaging system using a variety of fluorophores in experimental gliomas and normal brain. Neurosurg Focus. 2014; 36(2):E16. PMID: 24484254. doi: 10.3171/2013.11.FOCUS13486
16. Wang X, Bhaumik S, Li Q, Staudinger VP, Yazdanfar S. Compact instrument for fluorescence image-guided surgery. J Biomed Opt. 2010; 15(2):020509. PMID: 20459220. doi: 10.1117/1.3378128
17. Mieog JSD, Vahrmeijer AL, Hutteman M, van der Vorst JR, Drijfhout van Hooff M, Dijkstra J, et al. Novel intraoperative near-infrared fluorescence camera system for optical image-guided cancer surgery. Mol Imaging. 2010; 9(4):223-31. PMID: 20643025
18. Troyan SL, Kianzad V, Gibbs-Strauss SL, Gioux S, Matsui A, Oketokoun R, et al. The FLARE™ intraoperative near-infrared fluorescence imaging system: A first-in-human clinical trial in breast cancer sentinel lymph node mapping. Ann Surg Oncol. 2009; 16(10):2943-52. doi: 10.1245/s10434-009-0594-2 PMID: 19582506
19. Schaafsma BE, Mieog JSD, Hutteman M, van der Vorst JR, Kuppen PJK, Löwik CWGM, et al. The clinical use of indocyanine green as a near-infrared fluorescent contrast agent for image-guided oncologic surgery. J Surg Onc. 2011; 104(3):323-32.
20. Vahrmeijer AL, Hutteman M, van der Vorst JR, van de Velde CJH, Frangioni JV. Image-guided cancer surgery using near-infrared fluorescence. Nat Rev Clin Oncol. 2013; 10(9):507-18. doi: 10.1038/nrclinonc.2013.123 PMID: 23881033
21. Sevick-Muraca EM. Translation of near-infrared fluorescence imaging technologies: Emerging clinical applications. Annu Rev Med. 2012; 63:217-31. doi: 10.1146/annurev-med-070910-083323 PMID: 22034868
22. Liu Y, Bauer AQ, Akers WJ, Sudlow G, Liang K, Shen D, et al. Hands-free, Wireless Goggles for Near-infrared Fluorescence and Real-time Image-guided Surgery. Surgery. 2011; 149(5):689-98. doi: 10.1016/j.surg.2011.02.007 PMID: 21496565
23. Liu Y, Njuguna R, Matthews T, Akers WJ, Sudlow GP, Mondal S, et al. Near-infrared fluorescence goggle system with complementary metal-oxide-semiconductor imaging sensor and see-through display. J Biomed Opt. 2013; 18(10):101303. PMID: 23728180. doi: 10.1117/1.JBO.18.10.101303
24. Liu Y, Zhao YM, Akers W, Tang ZY, Fan J, Sun HC, et al. First in-human intraoperative imaging of HCC using the fluorescence goggle system and transarterial delivery of near-infrared fluorescent imaging agent: a pilot study. Transl Res. 2013; 162(5):324-31. doi: 10.1016/j.trsl.2013.05.002 PMID: 23747795
25. Mela CA, Patterson CL, Liu Y. A Miniature Wearable Optical Imaging System for Guiding Surgeries. In: Pogue BW, Gioux S, editors. Molecular-Guided Surgery: Molecules, Devices, and Applications. SPIE Photonics West 2015; 2015 Feb 7-12; San Francisco, CA. Bellingham (WA): SPIE; c2015. (Proceedings of SPIE; vol. 93110).
26. Mela CA, Papay F, Liu Y. Intraoperative Multimodal Imaging Using Goggle System. In: Walker JM, editor. Methods in Molecular Biology. New York: Springer; 2015. in press.
27. Dumas D, Fendler M, Berger F, Cloix B, Pornin C, Baier N, et al. Infrared camera based on a curved retina. Opt Lett. 2012; 37(4):653-5. doi: 10.1364/OL.37.000653 PMID: 22344137
28. Buhr E, Günther-Kohfahlb S, Neitzelb U. Simple method for modulation transfer function determination of digital imaging detectors from edge images. In: Yaffe MJ, Antonuk LE, editors. Physics of Medical Imaging. Medical Imaging 2003; 2003 Feb 15; Sand Diego, CA. Bellingham (WA): SPIE; c2015. p. 877-84.
29. Stelzer EHK. Contrast, resolution, pixelation, dynamic range and signal-to-noise ratio: fundamental limits to resolution in fluorescence light microscopy. J Microscopy. 1998; 189(1):15-24.
30. van der Vorst JR, Schaafsma BE, Verbeek FPR, Keereweer S, Jansen JC, van der Velden LA, et al. Near-infrared fluorescence sentinel lymph node mapping of the oral cavity in head and neck cancer patients. Oral Oncol. 2013; 49(1):15-9. doi: 10.1016/j.oraloncology.2012.07.017 PMID: 22939692
31. Held RT, Hui TT. A guide to stereoscopic 3D displays in medicine. Acad Radiol. 2011; 18(8):1035-48. doi: 10.1016/j.acra.2011.04.005 PMID: 21652229
32. van Beurden MHPH, Ijsselsteijn WA, Juola JF. Effectiveness of stereoscopic displays in medicine: a review. 3D Res. 2012; 3(1): [13 p.].
33. Liao H. 3D medical imaging and augmented reality for image-guided surgery. In: Furht B, editor. Handbook of Augmented Reality. 1st ed. New York: Springer-Verlag; 2011.
34. Wang S, Chen JX, Dong Z, Ledley RS. SMIS - A real-time stereoscopic medical imaging system. In: IEEE, editor. Proceedings of the 17th IEEE Symposium on Computer-Based Medical Systems; 2004 24-25 Jun; Bethesda, MD. Piscataway (NJ): IEEE; c2004. p. 18-24.
35. Zhou SA, Brahme A. Development of high-resolution molecular phase-contrast stereoscopic x-ray imaging for accurate cancer diagnostics. Radiat Prot Dosimetry. 2010; 139(1-3):334-8. doi: 10.1093/rpd/ncq012 PMID: 20154019
36. Wang XH, Durick JE, Herbert DL, Lu A Golla SK, Shinde DD, Piracha S, et al. Compare display schemes for lung nodule CT screening. JDI. 2010; 24(3):478-84.
37. Getty DJ, Green PJ. Clinical applications for stereoscopic 3-D displays. SID. 2007; 15(6):377-84.
38. Peloso A, Franchi E, Canepa MC, Barbieri L, Briani L, Ferrario J, et al. Combined use of intraoperative ultrasound and indocyanine green fluorescence imaging to detect liver metastases from colorectal cancer. HPB. 2013; 15:928-34. doi: 10.1111/hpb.12057 PMID: 23458105
39. Verbeek FP, Troyan SL, Mieog JS, Liefers GJ, Moffitt LA, Rosenberg M, et al. Near-infrared fluorescence sentinel lymph node mapping in breast cancer: a multicenter experience. Breast Cancer Res Treat. 2014; 143(2):333-42. doi: 10.1007/s10549-013-2802-9 PMID: 24337507
40. Gill R. The Physics and Technology of Diagnostic Ultrasound: A Practitioner's Guide. Sydney: High Frequency Publishing; 2012.
41. Marshall MV, Rasmussen JC, Tan IC, Aldrich MB, Adams KE, Wang X, et al. Near-infrared fluorescence imaging in humans with indocyanine green: A review and update. Open Surg Oncol J. 2012; 2(2):12-25.
42. Gioux S, Choi HS, Frangioni JV. Image-guided surgery using invisible near-infrared light: fundamentals of clinical translation. Mol Imaging. 2010; 9(5):237-55. PMID: 20868625
43. Siemionow M, Papay F, Djohan R, Bernard S, Gordon CR, Alam D, et al. First U.S. near-total human face transplantation - a paradigm shift for massive facial injuries. The Lancet 2009; 374(9685):203-09.