Stereoscopic visualization of laparoscope image using depth information from 3D model

Computer Methods and Programs in Biomedicine

Volumn 113, Issue 3, 2014, Pages 862-868

  Kumar, Atul ^a,b   Wang, Yen Yu ^a,b   Wu, Ching Jen ^a,b   Liu, Kai Che ^a,b   Wu, Hurng Sheng ^a,b  

^a IRCAD   (Taiwan)

^b CHANG BING SHOW CHWAN MEMORIAL HOSPITAL   (Taiwan)

Author keywords

2D 3D conversion; Endoscope; Feature based camera tracking; Laparoscopy; Stereo endoscope

Indexed keywords

3D MODELING; CAMERAS; COMPUTERIZED TOMOGRAPHY; DEPTH PERCEPTION; ENDOSCOPY; LAPAROSCOPY; LIGHT SOURCES; STEREO IMAGE PROCESSING; SURGICAL EQUIPMENT; TRANSPLANTATION (SURGICAL);

2D-3D CONVERSIONS; CAMERA TRACKING; CORRELATION COEFFICIENT; LAPAROSCOPIC SURGERY; SHAPE FROM SHADING ALGORITHMS; STEREOSCOPIC VISUALIZATION; SURGICAL INSTRUMENT; SURGICAL PROCEDURES; 3-D MODELING; DEPTH INFORMATION;

THREE DIMENSIONAL COMPUTER GRAPHICS; ENDOSCOPY;

ADULT; AGED; ALGORITHM; ARTICLE; BRONCHOSCOPY; CASE REPORT; COMPUTER; COMPUTER ASSISTED TOMOGRAPHY; DEPTH PERCEPTION; HUMAN; IMAGE QUALITY; LAPAROSCOPE; LAPAROSCOPIC SURGERY; MIDDLE AGED; PATIENT CARE; STEREOSCOPIC VISION; THREE DIMENSIONAL IMAGING; IMAGE ANALYSIS; NUCLEAR MAGNETIC RESONANCE IMAGING;

2D-3D CONVERSION; ENDOSCOPE; FEATURE BASED CAMERA TRACKING; LAPAROSCOPY; STEREO-ENDOSCOPE;

ALGORITHMS; COMPUTATIONAL BIOLOGY; DEPTH PERCEPTION; FOUR-DIMENSIONAL COMPUTED TOMOGRAPHY; HUMANS; IMAGE INTERPRETATION, COMPUTER-ASSISTED; IMAGING, THREE-DIMENSIONAL; LAPAROSCOPY; VIDEO-ASSISTED SURGERY;

EID: 84894243287     PISSN: 01692607     EISSN: 18727565     Source Type: Journal    
DOI: 10.1016/j.cmpb.2013.12.013     Document Type: Article

References (39)

1. Satava R.M. 3-D vision technology applied to advanced minimally invasive surgery systems. Surg. Endosc. 1993, 7:429-431.
2. Blavier A., Gaudissart Q., Cadière G.-B., Nyssen A.-S. Perceptual and instrumental impacts of robotic laparoscopy on surgical performance. Surg. Endosc. 2007, 21(October (10)):1875-1882.
3. Chan A.C., Chung S.C., Yim A.P., Lau J.Y., Ng E.K., Li A.K. Comparison of two-dimensional vs three-dimensional camera systems in laparoscopic surgery. Surg. Endosc. 1997, 11(May (5)):438-440.
4. Jourdan I.C., Dutson E., Garcia A., Vleugels T., Leroy J., Mutter D., Marescaux J. Stereoscopic vision provides a significant advantage for precision robotic laparoscopy. Br. J. Surg. 2004, 91(7):879-885.
5. Votanopoulos K., Brunicardi F.C., Thornby J., Bellows C.F. Impact of three-dimensional vision in laparoscopic training. World J. Surg. 2008, 32(January (1)):110-118.
6. Charisis V.S., Hadjileontiadis L.J., Liatsos C.N., Mavrogiannis C.C., Sergiadis G.D. Capsule endoscopy image analysis using texture information from various colour models. Comput. Methods Programs Biomed. 2012, 107(1):61-74.
7. Ciaccio E.J., Tennyson C.A., Bhagat G., Lewis S.K., Green P.H.R. Use of shape-from-shading to estimate three-dimensional architecture in the small intestinal lumen of celiac and control patients. Comput. Methods Programs Biomed. 2013, 111(3):676-684.
8. Kuo C.-F.J., Chu Y.-H., Wang P.-C., Lai C.-Y., Chu W.-L., Leu Y.-S., Wang H.-W. Using image processing technology and mathematical algorithm in the automatic selection of vocal cord opening and closing images from the larynx endoscopy video. Comput. Methods Programs Biomed. 2013, 112(3):455-465.
9. Szczypi'nski P., Klepaczko A., Pazurek M., Daniel P. Texture and color based image segmentation and pathology detection in capsule endoscopy videos. Comput. Methods Programs Biomed. 2012, 113(1):396-411.
10. Jeffrey Kuo C.-F., Wang P.-C., Chu Y.-H., Wang H.-W., Lai C.-Y. Using image processing technology combined with decision tree algorithm in laryngeal video stroboscope automatic identification of common vocal fold diseases. Comput. Methods Programs Biomed. 2013, 112(1):228-236.
11. Visentini-Scarzanella M., Stoyanov D., Yang G.-Z. Metric depth recovery from monocular images using Shape-from-Shading and specularities. Proceedings of the 2012 IEEE International Conference on Image Processing (ICIP 2012) 2012.
12. Mueller-Richter U.D.A., Limberger A., Weber P., Ruprecht K.W., Spitzer W., Schilling M. Possibilities and limitations of current stereo-endoscopy. Surg. Endosc. 2004, 18(June (6)):942-947.
13. Devernay F., Mourgues F., Coste-Manière E. Towards endoscopic augmented reality for robotically assisted minimally invasive cardiac surgery. Medical Imaging and Augmented Reality, 2001 Proceedings 2001, 16-20.
14. Grainger A., Allison R.G., Adam D.J., Dixon A. Diagnostic Radiology: A Textbook of Medical Imaging 2008, 3. Churchill Livingstone, New York, NY, (chapter 4). 5th ed.
15. Durou J.-D., Falcone M., Sagona M. Numerical methods for shape-from-shading: a new survey with benchmarks. Comput. Vis. Image Underst. 2008, 109(1):22-43.
16. Zhang M., Tsai R., Cryer P.S., Shah J.E. Shape-from-shading: a survey. IEEE Trans. Pattern Anal. Mach. Intell. 1999, 21(8):690-706.
17. Wu C., Chen Y., Liu C., Chang C., Sun Y. Automatic extraction and visualization of human inner structures from endoscopic image sequences. Med. Imaging. Proceedings of the SPIE, vol. 5369 2004, 464-473.
18. Wu C.C., Sun C.H., Chang Y.N. Three-dimensional modeling from endoscopic video using geometric constraints via feature positioning. Biomed. Eng. IEEE Trans. 2007, 54(7):1199-1211.
19. Thormahlen P.N., Broszio T., Meier H. Three-dimensional endoscopy. Falk Symposium 2002, 199-214. Kluwer Academic Publishers, Hannover, Germany.
20. Zhang G., Hua W., Qin X., Wong T.-T., Bao H. Stereoscopic video synthesis from a monocular video. IEEE Trans. Vis. Comput. Graph. 2007, 13(4):686-696.
21. Rotem E., Wolowelsky K., Pelz D. Automatic video to stereoscopic video conversion. Stereoscopic Displays and Virtual Reality Systems XII, June. Proceedings of the SPIE, vol. 5664 2005, pp. 198.
22. Liu Q., Sclabassi R.J., Yao N., Sun M. 3D construction of endoscopic images based on computational stereo. Bioengineering Conference, 2006. Proceedings of the IEEE 32nd Annual Northeast 2006, 69-70.
23. Harman P., Flack J., Fox S., Dowley M. Rapid 2D to 3D conversion. Proc. SPIE, vol. 4660, no. 78 2002.
24. Tomazevic D., Likar B., Pernus F. 3-D/2-D registration by integrating 2-D information in 3-D. Med. Imaging. IEEE Trans. 2006, 25(1):17-27.
25. Helferty J.P., Higgins W.E. Combined endoscopic video tracking and virtual 3D CT registration for surgical guidance. Image Processing. 2002. Proceedings. 2002 International Conference, vol. 2 2002, pp. II-961.
26. Burschka D., Li M., Ishii M., Taylor R.H., Hager G.D. Scale-invariant registration of monocular endoscopic images to CT-scans for sinus surgery. Med. Image Anal. 2005, 9(5):413-426.
27. Zinßer T., Schmidt J., Niemann H. Point set registration with integrated scale estimation. Eighth International Conference on Pattern Recognition and Image Processing 2005, 116-119.
28. Bay H., Tuytelaars T., Van Gool L. Surf: speeded up robust features. Computer Vision - ECCV 2006 2006, 404-417.
29. Calonder M., Lepetit V., Strecha C., Fua P. BRIEF: Binary Robust Independent Elementary Features. Computer Vision - ECCV 2010 2010, 778-792.
30. Moreno-Noguer F., Lepetit V., Fua P. Accurate non-iterative O(n) solution to the PnP problem. 2007 IEEE 11th Int. Conf. Comput. Vis. 2007, 1-8.
31. Schroeder W., Ken M., Bill L. VTK - The Visualization Toolkit 2003, 61-62.
32. Bradski G. The OpenCV Library. Dr. Dobb's J. Softw. Tools 2000.
33. R Core Team R: A Language and Environment for Statistical Computing 2013, R Foundation for Statistical Computing, Vienna, Austria, http://www.R-project.org.
34. Vemuri A.S., Liu K.-C., Ho Y., Wu H.-S., Ku M.-C. Endoscopic video mosaicing: application to surgery and diagnostics. Living Imaging Workshop, December 2011, 1-2.
35. Mirota D., Wang H., Taylor R., Ishii M., Hager G. Toward video-based navigation for endoscopic endonasal skull base surgery. Med. Image Comput. Comput. Interv. 2009, 2009:91-99.
36. Berretty R.-P., Peters F.J., Volleberg G.T.G. Real-time rendering for multiview autostereoscopic displays. Stereoscopic Displays and Virtual Reality Systems XIII, no 60550N, January. Proceedings of the SPIE, vol. 6055 2006.
37. Meier U., Lopez O., Monserrat C., Juan M.C., Alcaniz M. Real-time deformable models for surgery simulation: a survey. Comput. Methods Programs Biomed. 2005, 77(3):183-197.
38. Doignon C., Nageotte F., de Mathelin M. Segmentation and guidance of multiple rigid objects for intra-operative endoscopic vision. Dyn. Vis. Lect. Notes Comput. Sc. 2007, 4358:314-327.
39. Massoptier L., Casciaro S. A new fully automatic and robust algorithm for fast segmentation of liver tissue and tumors from CT scans. Eur. Radiol. 2008, 18(8):1658-1665.