Three-dimensional reconstruction of the digestive wall in capsule endoscopy videos using elastic video interpolation

IEEE Transactions on Medical Imaging

Volumn 30, Issue 4, 2011, Pages 957-971

  Karargyris, Alexandros ^a   Bourbakis, Nikolaos ^a,b  

^a Wright State University   (United States)

^b AIIS Inc   (United States)

Author keywords

3 D imaging; Capsule; endoscopy; interpolation

Indexed keywords

3D IMAGING; CAPSULE; CAPSULE ENDOSCOPY; CROHN'S DISEASE; CURRENT TECHNOLOGY; DIGESTIVE TRACT; FRAME RATE; HUMAN BODIES; INTERPOLATED IMAGES; MODERN TIME; REVOLUTIONARY TECHNOLOGY; THREE-DIMENSIONAL RECONSTRUCTION; VIDEO INTERPOLATION; WIRELESS CAPSULE ENDOSCOPY;

DIGESTIVE SYSTEM; ENDOSCOPY; INTERPOLATION;

THREE DIMENSIONAL;

ALGORITHM; ARTICLE; CAPSULE ENDOSCOPY; GASTROINTESTINAL TRACT; HISTOLOGY; HUMAN; IMAGE PROCESSING; METHODOLOGY; PATHOLOGY; PERISTALSIS; PHYSIOLOGY;

ALGORITHMS; CAPSULE ENDOSCOPY; GASTROINTESTINAL TRACT; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; PERISTALSIS;

EID: 79953736234     PISSN: 02780062     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMI.2010.2098882     Document Type: Article

References (59)

1. U. Mueller-Richter, A. Limberger, P. Weber, K. Ruprecht, W. Spitzer, and M. Schilling, "Possibilities and limitations of current stereo-endoscopy," Surg. Endosc., vol. 18, no. 6, pp. 942-947, Jun. 2004. (Pubitemid 38716007)
2. J. R. Zekta, Jr., Surgeons and the Scope. Ithaca, NY: Cornell Univ. Press, 2003.
3. F. Mourgues, F. Devemay, and E. Coste-Maniere, "3-D reconstruction of the operating field for image overlay in 3-D-endoscopic surgery," in Proc. IEEE ACM Int. Symp. Augmented Reality, 2001, pp. 191-192.
4. T. Thormahlen, H. Broszio, and P. Meier, "Three dimensional endoscopy," in Falk Symp., 2002, no. 124.
5. C. Wu, Y. Chen, C. Liu, C. Chang, and Y. Sun, "Automatic extraction and visualization of human inner structures from endoscopic image sequences," in Proc. SPIE, 2004, vol. 5369, pp. 464-473.
6. Q. Liu, R. J. Sclabassi, N. Yao, and M. Sun, "3-D construction of endoscopic images based on computational stereo," in Bioeng. Conf., 2006, pp. 69-70. (Pubitemid 44761559)
7. C. Wu, Y. Sun, and C. Chang, "Three-dimensional modeling from endoscopic video using geometric constraints via feature positioning," IEEE Trans. Biomed. Eng., vol. 54, no. 7, pp. 1199-1211, Jul. 2007. (Pubitemid 46956976)
8. J. Zhou, A. Das, F. Li, and B. Li, "Circular generalized cylinder fitting for 3-D reconstruction in endoscopic imaging based on MRF," in IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. Workshops (CVPRW08), Jun. 23-28, 2008, pp. 1-8.
9. R. I. Hartley and A. Zisserman, Multiple View Geometry in Computer Vision. Cambridge, U.K.: Cambridge Univ. Press, 2003.
10. M. Pollefeys, L. J. V. Gool, M. Vergauwen, F. Verbiest, K. Cornelis, J. Tops, and R. Koch, "Visual modeling with a hand-held camera," Int. J. Comput. Vis., vol. 59, no. 3, pp. 207-232, 2004.
11. A. Kaufman and J.Wang, "3-D surface reconstruction from endoscopic videos," Visualizat. Med. Life Sci. Math. Visualizat., vol. I, pp. 61-74, 2008, 10.1007/978-3-540-72630-24.
12. J. P. Helferty and W. E. Higgins, "Combined endoscopic video tracking and virtual 3-D CT registration for surgical guidance," in ICIP, 2002, vol. 2, pp. 961-964.
13. D. Burschka, M. Li, M. Ishii, R. H. Tylor, and G. D. Hager, "Scaleinvariant registration of monocular endoscopic images to CT-scans for sinus surgery," Med. Image Anal., vol. 9, no. 5, pp. 413-426, Oct. 2005. (Pubitemid 41179339)
14. H. Mitsuhiro, S. Naoki, and N. Yoshihiko, "Laser-scan endoscope system for intraoperative geometry acquisition and surgical robot safety management," Med. Image Anal., vol. 10, no. 4, pp. 509-519, Aug. 2006.
15. D. Tomazevic, B. Likar, and F. Pernus, "3-D/2-D registration by integrating 2-D information in 3-D," IEEE Trans. Biomed. Eng., vol. 25, no. 1, pp. 17-27, Jan. 2006. (Pubitemid 43172581)
16. A.Kolar, O. Romain, and J. Ayoub et al., "A system for an accurate 3-D reconstruction in video endoscopy capsule," EURASIP J. Embedded Syst., vol. 2009.
17. R. Zhang, P. Tsai, J. E. Cryer, and M. Shah, "Shape from shading: A survey," IEEE Trans. Pattern Anal. Mach. Intell., vol. 21, no. 8, pp. 690-706, Aug. 1999.
18. B. K. P. Horn, "Shape from shading: A method for obtaining the shape of a smooth opaque object from one view," Ph.D. dissertation, Massachusetts Inst. Technol., Cambridge, 1970.
19. E. Prados and O. Faugeras, A rigorous and realistic shape from shading method and some of Its applications INRIA Res. Rep. RR-5133, Mar. 2004.
20. J. Oliensis, "Shape from shading as a partially well-constrained problem," Comput. Vis., Graphics, Image Process.: Image Understand., vol. 54, pp. 163-183, 1991. (Pubitemid 21707400)
21. P. S. Tsai and M. Shah, "Shape from shading using linear approximation," Image Vis. Comput. J., vol. 12, no. 8, pp. 487-498, 1994.
22. J. H. Lambert, PhotometriaSive de Mensura de GratibusLuminis, Colorumet Umbrae. Augsberg, Germany: EberhardKlett, 1760.
23. R. T. Tan and K. Ikeuchi, "Separating reflection components of textured surfaces using a single image," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 2, pp. 178-193, Feb. 2005. (Pubitemid 40377312)
24. D. R. Hougen and N. Ahuja, "Estimation of the light source distribution and its use in integrated shape recovery from stereo and shading," in Proc. 4th Int. Conf. Comput. Vis., May 11-14, 1993, pp. 148-155. (Pubitemid 23667858)
25. M. J. Black and P. Anandan, "A framework for the robust estimation of optical flow," in IEEE Int. Conf. Comput. Vis., 1993, pp. 231-236. (Pubitemid 23667848)
26. H. Nagel and W. Enkelmann, "An investigation of smoothness constraints for the estimation of displacement vector fields from image sequences," IEEE Trans. Pattern Anal. Mach. Intell., vol. 8, no. 5, pp. 565-593, Sep. 1986.
27. T. Brox, A. Bruhn, N. Papenberg, and J.Weickert, "High accuracy optical flow estimation based on a theory for warping," in Proc. ECCV, 2004, vol. 3024, pp. 25-36.
28. L. Alvarez, J. Weickert, and J. Sánchez, "Reliable estimation of dense optical flow fields with large displacements," Int. J. Comput. Vis., vol. 39, no. 1, pp. 41-56, Aug. 2000.
29. E. Memin and P. Perez, "Hierarchical estimation and segmentation of dense motion fields," Int. J. Comput. Vis., vol. 46, no. 2, pp. 129-155, 2002. (Pubitemid 34143941)
30. S. Baker, D. Scharstein, J. Lewis, S. Roth, M. Black, and R. Szeliski, "A database and evaluation methodology for optical flow," in IEEE Int. Conf. Comput. Vis., 2007, pp. 1-.
31. F. Steinbrucker, T. Pock, and D. Cremers, "Large displacement optical flow computation without warping," in IEEE Int. Conf. Comput. Vis. (ICCV), Kyoto, Japan, 2009, p. 1609.
32. T. Brox, C. Bregler, and J. Malik, "Large displacement optical flow," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR'09), 2009, p. 1609.
33. R. Basri and D. W. Jacobs, "Lambertian reflectance and linear subspaces," IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 2, pp. 218-233, Feb. 2003.
34. A. Karargyris, O. Karargyris, and N. G. Bourbakis, "3-D representation of the digestive tract surface in wireless capsule endoscopy videos," in Proc. BIBE, 2010, pp. 279-280.
35. L. D. Lathauwer, B. D. Moor, and J. Vandewalle, "A multillinear singular value decomposition," SIAM J. Matrix Anal. Appl., vol. 21, no. 4, pp. 1253-1278, 2000.
36. L. Nyugen, Y. Xu, and A. Roy-Chowdhury, "An illumination invariant 3-D model based tracking algorithm, with Application in Video Compression," in EEE Int. Conf. Image Process., Oct. 8-11, 2006, pp. 1213-1216.
37. J. M. Buenaposada, A. Del Bue, E. Muñoz, and L. Baumela, "A model of brightness variations due to illumination changes and non-rigid motion using spherical harmonics," presented at the 19th Br. Mach. Vis. Conf. (BMVC 2008), Leeds, U.K., 2008, Univ. Leeds.
38. M. Ferrant, S. K. Warfield, C. R. G. Guttmann, R. V. Mulkern, F. A. Jolesz, and R. Kikinis, "3-D matching using a finite element based elastic deformation model," in Proc. MICCAI'98, 1999, pp. 202-209.
39. H. Wang, R. Raskar, and N. Ahuja, "Seamless video editing," in IEEE Int. Conf. Pattern Recognit. (ICPR), 2004, p. 858.
40. P. Pèrez, M. Gangnet, and A. Blake, "Poisson image editing," Siggraph, pp. 313-318, 2003.
41. A. Karargyris and N. Bourbakis, "Wireless capsule endoscopy and endoscopic imaging: A survey on various methodologies presented," IEEE Eng. Med. Biol. Mag., vol. 29, no. 1, pp. 72-83, Jan.-Feb. 2010.
42. Shape from shading source code [Online]. Available: http://server.cs. ucf.edu/∼vision/shadsrc.html
43. A. Moghaddamzadeh and N. Bourbakis, "A fuzzy-like region growing approach for segmentation of colored images," PR Soc. J. Pattern Recognit., vol. 30, no. 6, pp. 867-881, 1997. (Pubitemid 127417875)
44. A. Karargyris and N. Bourbakis, "A video-frame based registration using segmentation and graph connectivity for Wireless Capsule Endoscopy," in IEEE/NIH Life Sci. Syst. Appl. Workshop (LiSSA 2009), Apr. 9-10, 2009, pp. 74-79.
45. N. Bourbakis et al., "Object recognition using Local-Global graphs," in Int. IEEE Conf. TAI-03, CA, Nov. 2003, pp. 616-627.
46. G. Iddan, G. Meron, A. Glukhovsky, and P. Swain, "Wireless capsule endoscopy," Nature, vol. 405, no. 6785, p. 417, May 25, 2000, (2000).
47. Wireless capsule endoscopy, given Imaging Inc. [Online]. Available: http://www.givenimaging.com/
48. 510(K) summary given diagnostic system with PillCam TM ESO Capsule 510(k) Number K042960 [Online]. Available: http://www.accessdata. fda.gov/cdrh-docs/ pdf4/K042960.pdf
49. P. Van der Zee, "Measurement and modelling of the optical properties of human tissue in the near infrared," Ph.D. dissertation, Univ. London, London, U.K.
50. B. K. P. Horn and B. G. Schunck, "Determining optical flow," Artif. Intell., vol. 17, pp. 185-203, 1981.
51. U.S. Nat. Library Med.-Medline Plus, Peristalsis [Online]. Available: http://www.nlm.nih.gov/medlineplus/ency/article/002282.htm
52. SUNY Downstate Medical Center, Digestive Syst. [Online]. Available: http://ect.downstate.edu/courseware/histomanual/digestive.html
53. L. D. Cohen and I. Cohen, Finite-Element Methods for Active Contour Models and Balloons From 2-D to 3-D Ceremade, Tech. Rep. 9124, Dec. 1991.
54. P. K. Banerjee, The Boundary Element Methods in Engineering. New York: McGraw-Hill, 1994.
55. M. Unser, A. Aldroubi, and M. Eden, "Fast B-spline transforms for continuous image representation and interpolation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 13, no. 3, pp. 277-285, Mar. 1991.
56. A. Karargyris and N. Bourbakis, "Identification of Polyps in WCE using log Gabor filters," in IEEE-NIH Symp. LISSA, Bethesda, MD, Apr. 2009, pp. 143-147.
57. B. J. Wood and P. Razavi, "Virtual endoscopy: A promising new technology," AmFam Physician, vol. 66, no. 1, pp. 107-112, Jul. 1, 2002. (Pubitemid 34753368)
58. Tutorvista.com [Online]. Available: http://www.tutorvista.com/content/ biology/biology-iv/animal-nutrition/pharynx.php
59. A. Ali and J. M. SantisiJ. Vargo, "Video capsule endoscopy; A voyage beyond the end of the scope," Cleveland Clin. J. Med., vol. 71, pp. 415-425, 2004. (Pubitemid 38821200)