Performance evaluation and clinical applications of 3D plenoptic cameras

Proceedings of SPIE - The International Society for Optical Engineering

Volumn 9494, Issue , 2015, Pages

  Decker, Ryan ^a   Shademan, Azad ^a   Opfermann, Justin ^a   Leonard, Simon ^a   Kim, Peter C W ^a   Krieger, Axel ^a  

^a CHILDREN'S NATIONAL MEDICAL CENTER   (United States)

Author keywords

calibration; Imaging systems; Medical and biological imaging; plenoptic camera; quantitative measurement; Three dimensional (3D) image acquisition

Indexed keywords

ARTIFICIAL INTELLIGENCE; CAMERAS; COMPUTATION THEORY; IMAGE ACQUISITION; IMAGING SYSTEMS; MEDICAL IMAGING; ROBOTICS; SURGERY;

CAMERA CALIBRATION; CLINICAL APPLICATION; MEDICAL AND BIOLOGICAL IMAGING; OPTICAL IMAGING SYSTEM; PLENOPTIC CAMERAS; QUANTITATIVE IMAGING; QUANTITATIVE MEASUREMENT; THREE-DIMENSIONAL (3D) IMAGE ACQUISITION;

CALIBRATION;

EID: 84938723216     PISSN: 0277786X     EISSN: 1996756X     Source Type: Conference Proceeding    
DOI: 10.1117/12.2179281     Document Type: Conference Paper

References (54)

1. N. Taffinder et al., "The effect of a second-generation 3D endoscope on the laparoscopic precision of novices and experienced surgeons," Surg. Endosc. 13 (11), 1087-1092 (1999) [doi:10.1007/s004649901179].
2. K. Khoshelham and S. O. Elberink, "Accuracy and Resolution of Kinect Depth Data for Indoor Mapping Applications," Sensors 12 (2), 1437-1454 (2012) [doi:10.3390/s120201437].
3. D. Holz, "Systems and methods for capturing motion in three-dimensional space," US20130182897 A1 (2013).
4. D. Millbourn, Y. Cengiz, and L. A. Israelsson, "Effect of stitch length on wound complications after closure of midline incisions: a randomized controlled trial," Arch. Surg. Chic. Ill 1960 144 (11), 1056-1059 (2009) [doi:10.1001/archsurg.2009.189].
5. T. Treasure et al., "Surgical Performance Measurement," Health Care Manag. Sci. 5 (4), 243-248 (2002) [doi:10.1023/A:1020373921395].
6. A. Karliczek et al., "Surgeons lack predictive accuracy for anastomotic leakage in gastrointestinal surgery," Int. J. Colorectal Dis. 24 (5), 569-576 (2009) [doi:10.1007/s00384-009-0658-6].
7. M. Waseda et al., "Precision in stitches: Radius Surgical System," Surg. Endosc. 21 (11), 2056-2062 (2007) [doi:10.1007/s00464-007-9289-6].
8. S. Seki, "Accuracy of suture placement," Br. J. Surg. 74 (3), 195-197 (1987).
9. R. E. Torsten Hain, "Indications for Optical Shape Measurements in Orthopaedics and Dermatology," Med. Laser Appl. 17 (1), 55-58 (2002) [doi:10.1078/1615-1615-00047].
10. O. Tymofiyeva et al., "High-resolution 3D magnetic resonance imaging and quantification of carious lesions and dental pulp in vivo," Magma N. Y. N 22 (6), 365-374 (2009) [doi:10.1007/s10334-009-0188-9].
11. M. Buzzi et al., "3D modelling and knowledge: tools to automate prosthesis development process," Int. J. Interact. Des. Manuf. IJIDeM 6 (1), 41-53 (2012) [doi:10.1007/s12008-011-0137-5].
12. O. L. Harrysson, Y. A. Hosni, and J. F. Nayfeh, "Custom-designed orthopedic implants evaluated using finite element analysis of patient-specific computed tomography data: femoral-component case study," BMC Musculoskelet. Disord. 8, 91 (2007) [doi:10.1186/1471-2474-8-91].
13. H. Jiang et al., "Near-infrared optical imaging of the breast with model-based reconstruction," Acad. Radiol. 9 (2), 186-194 (2002).
14. S. Leonard et al., "Smart Tissue Anastomosis Robot (STAR): A Vision-Guided Robotics System for Laparoscopic Suturing," IEEE Trans. Biomed. Eng. Early Access Online (2014) [doi:10.1109/TBME.2014.2302385].
15. D. Nain et al., "An Interactive Virtual Endoscopy Tool," September 2001, (accessed 5 February 2014).
16. I. Ogata et al., "CT evaluation of gastric lesions with three-dimensional display and interactive virtual endoscopy: comparison with conventional barium study and endoscopy.," Am. J. Roentgenol. 172 (5), 1263-1270 (1999) [doi:10.2214/ajr.172.5.10227500].
17. P. Poignet et al., "Robust 3D tracking for robotic-assisted beating heart surgery," Conf. Proc. Annu. Int. Conf. IEEE Eng. Med. Biol. Soc. IEEE Eng. Med. Biol. Soc. Conf. 2011, 6686 (2011) [doi:10.1109/IEMBS.2011.6091648].
18. W. W. Lau et al., "Stereo-Based Endoscopic Tracking of Cardiac Surface Deformation," in Medical Image Computing and Computer-Assisted Intervention-MICCAI 2004, C. Barillot, D. R. Haynor, and P. Hellier, Eds., pp. 494-501, Springer Berlin Heidelberg (2004).
19. D. Stoyanov, A. Darzi, and G. Z. Yang, "Dense 3D Depth Recovery for Soft Tissue Deformation During Robotic Assisted Laparoscopic Surgery," in In Medical Image Computing and Computer-Assisted Intervention-MICCAI 2004, volume 3217 of LNCS, pp. 41-48, Springer (2004).
20. Lippmann, Gabriel, "Épreuves réversibles. photographies intégrales," Comptes Rendus Académie Sci. (1908).
21. C. Perwass and L. Wietzke, "Single lens 3D-camera with extended depth-of-field," 2012, 829108-829108-15 [doi:10.1117/12.909882].
22. E. H. Adelson and J. Y. A. Wang, "Single lens stereo with a plenoptic camera," IEEE Trans. Pattern Anal. Mach. Intell. 14 (2), 99-106 (1992) [doi:10.1109/34.121783].
23. R. Ng et al., "Light field photography with a hand-held plenoptic camera."
24. M. Levoy and P. Hanrahan, "Light Field Rendering," in Proceedings of the 23rd Annual Conference on Computer Graphics and Interactive Techniques, pp. 31-42, ACM, New York, NY, USA (1996) [doi:10.1145/237170.237199].
25. T. Georgeiv et al., "Spatio-Angular Resolution Tradeoff in Integral Photography," in In Eurographics Symposium on Rendering, pp. 263-272 (2006).
26. T. Georgiev and A. Lumsdaine, "The multifocus plenoptic camera," 2012, 829908-829908-11 [doi:10.1117/12.908667].
27. F. Dong et al., "Plenoptic cameras in real-time robotics," Int. J. Robot. Res. 32 (2), 206-217 (2013) [doi:10.1177/0278364912469420].
28. A. Lumsdaine, G. Chunev, and T. Georgiev, "Plenoptic rendering with interactive performance using GPUs," presented at Society of Photo-Optical Instrumentation Engineers (SPIE) Conference Series, 1 February 2012, 32 [doi:10.1117/12.909683].
29. F. Vogt et al., "Light fields for minimal invasive surgery using an endoscope positioning robot," Methods Inf. Med. 43 (4), 403-408 (2004) [doi:10.1267/METH04040403].
30. J. D. H Niemann, "Image-Based Modeling and Its Application in Image Processing," Pattern Recognit. Image Anal. 14, 184-189 (2004).
31. J. J. Aguilar, F. Torres, and M. A. Lope, "Stereo vision for 3D measurement: accuracy analysis, calibration and industrial applications," Measurement 18 (4), 193-200 (1996) [doi:10.1016/S0263-2241 (96)00065-6].
32. F. Barrera Campo, F. Lumbreras Ruiz, and A. D. Sappa, "Multimodal Stereo Vision System: 3D Data Extraction and Algorithm Evaluation," IEEE J. Sel. Top. Signal Process. 6 (5), 437-446 (2012) [doi:10.1109/JSTSP.2012.2204036].
33. G. Kamberova and R. Bajcsy, "Precision in 3-D Points Reconstructed from Stereo" (1997).
34. A. D. Wiles, D. G. Thompson, and D. D. Frantz, "Accuracy assessment and interpretation for optical tracking systems," 2004, 421-432 [doi:10.1117/12.536128].
35. R. Khadem et al., "Comparative tracking error analysis of five different optical tracking systems," Comput. Aided Surg. 5 (2), 98-107 (2000) [doi:10.1002/1097-0150 (2000)5:23.0.CO;2-H].
36. J. Batlle, E. Mouaddib, and J. Salvi, "Recent progress in coded structured light as a technique to solve the correspondence problem: a survey," Pattern Recognit. 31 (7), 963-982 (1998) [doi:10.1016/S0031-3203 (97)00074-5].
37. C. Rocchini et al., "A low cost 3D scanner based on structured light," Comput. Graph. Forum 20 (3), 299-308 (2001) [doi:10.1111/1467-8659.00522].
38. C. Schmalz et al., "An endoscopic 3D scanner based on structured light," Med. Image Anal. 16 (5), 1063-1072 (2012) [doi:10.1016/j.media.2012.04.001].
39. R. J. Valkenburg and A. M. McIvor, "Accurate 3D measurement using a structured light system," Image Vis. Comput. 16 (2), 99-110 (1998) [doi:10.1016/S0262-8856 (97)00053-X].
40. L. Zhang, B. Curless, and S. M. Seitz, "Rapid shape acquisition using color structured light and multi-pass dynamic programming," in First International Symposium on 3D Data Processing Visualization and Transmission, 2002. Proceedings, pp. 24-36 (2002) [doi:10.1109/TDPVT.2002.1024035].
41. D. Fofi, T. Sliwa, and Y. Voisin, "A comparative survey on invisible structured light," 2004, 90-98 [doi:10.1117/12.525369].
42. V. Casta?eda, D. Mateus, and N. Navab, Stereo Time-of-Flight.
43. M. Hansard et al., "Characterization of Time-of-Flight Data," in Time-of-Flight Cameras, pp. 1-28, Springer London (2013).
44. J. A. Kolthammer et al., "Time-of-flight precision and PET image accuracy," in 2010 IEEE Nuclear Science Symposium Conference Record (NSS/MIC), pp. 3657-3660 (2010) [doi:10.1109/NSSMIC.2010.5874495].
45. A. Dorrington, A. Payne, and M. Cree, "An evaluation of time-of-flight range cameras for close range metrology applications," Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci. 38, 201-206 (2010).
46. S. Fuchs and S. May, Calibration and Registration for Precise Surface Reconstruction with TOF Cameras (2007).
47. J. Penne et al., "Time-of-flight 3-D endoscopy," in Medical Image Computing and Computer-Assisted Intervention-MICCAI 2009, pp. 467-474, Springer (2009).
48. O. Johannsen et al., "On the Calibration of Focused Plenoptic Cameras," in Time-of-Flight and Depth Imaging. Sensors, Algorithms, and Applications, M. Grzegorzek et al., Eds., pp. 302-317, Springer Berlin Heidelberg (2013).
49. J. Zhu et al., "Fusion of time-of-flight depth and stereo for high accuracy depth maps," in IEEE Conference on Computer Vision and Pattern Recognition, 2008. CVPR 2008, pp. 1-8 (2008) [doi:10.1109/CVPR.2008.4587761].
50. M. Jie et al., "High Accuracy and Low Cost 3D Surface Acquisition Using Structured Light," Int. J. Adv. Comput. Technol. 5 (9), 1191-1201 (2013).
51. "Free High Resolution Textures-Lost and Taken-13 High Contrast B&W Textures," (accessed 27 February 2014).
52. M. A. Fischler and R. C. Bolles, "Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography," Commun ACM 24 (6), 381-395 (1981) [doi:10.1145/358669.358692].
53. F. Peral-Gutierrez, A. L. Liao, and C. N. Riviere, "Static and dynamic accuracy of vitreoretinal surgeons," Conf. Proc. Annu. Int. Conf. IEEE Eng. Med. Biol. Soc. IEEE Eng. Med. Biol. Soc. Conf. 4, 2734-2737 (2004) [doi:10.1109/IEMBS.2004.1403783].
54. A. Shademan et al., "Feasibility of near-infrared markers for guiding surgical robots," in SPIE Proceedings Vol. 8840 Optical Modeling and Performance Predictions VI 8840 (2013).