Endoscopic video texture mapping on pre-built 3-D anatomical objects without camera tracking

IEEE Transactions on Medical Imaging

Volumn 29, Issue 6, 2010, Pages 1213-1223

  Wang, Xianwang ^a   Zhang, Qing ^a   Han, Qiong ^a   Yang, Ruigang ^a   Carswell, Melody ^a   Seales, Brent ^a   Sutton, Erica ^b  

^a UNIVERSITY OF KENTUCKY   (United States)

^b UNIVERSITY OF MARYLAND   (United States)

Author keywords

3 D reconstruction; 3 D to 2 D registration; Computer augmented reality; Minimally invasive surgery (MIS)

Indexed keywords

3-D RECONSTRUCTION; 3-D TO 2-D REGISTRATION; ANATOMICAL OBJECTS; CAMERA TRACKING; COMPUTED TOMOGRAPHY; DEPTH INFORMATION; FIELD OF VIEWS; GROUND TRUTH; MINIMALLY INVASIVE SURGERY; NOVEL METHODS; REGISTRATION PERFORMANCE; SURFACE MODELS; TECHNICAL CHALLENGES; TEXTURE IMAGE; TRACKING METHOD; VIDEO FRAME; VIDEO SEQUENCES; VIDEO TEXTURES;

AUGMENTED REALITY; COMPUTERIZED TOMOGRAPHY; RESONANCE; SURGERY; TEXTURES; TEXTURING; TWO DIMENSIONAL; VIDEO RECORDING; VIRTUAL REALITY;

THREE DIMENSIONAL;

ALGORITHM; ARTICLE; AUTOMATED PATTERN RECOGNITION; CAPSULE ENDOSCOPY; COMPUTER ASSISTED DIAGNOSIS; HUMAN; IMAGE ENHANCEMENT; IMAGE SUBTRACTION; METHODOLOGY; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; THREE DIMENSIONAL IMAGING;

ALGORITHMS; CAPSULE ENDOSCOPY; HUMANS; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; IMAGING, THREE-DIMENSIONAL; PATTERN RECOGNITION, AUTOMATED; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY; SUBTRACTION TECHNIQUE;

EID: 77953149585     PISSN: 02780062     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMI.2009.2028341     Document Type: Article

References (43)

1. A. Park, M. Marcaccio, M. Sternbach, D. Witzke, and P. Fitzgerald, "Laparoscopic vs. open splenectomy, " Arch. Surg., vol.134, no.11, pp. 1263-1269, 1999.
2. M. M. Reza, J. A. Blasco, E. Andradas, R. Cantero, and J. Mayol, "Systematic review of laparoscopic versus open surgery for colorectal cancer, " Br. J. Surg., vol.93, no.8, pp. 921-928, 2006.
3. R. Berguer, W. Smith, and Y. Chung, "Performing laparoscopic surgery is significantly more stressful for the surgeon than open surgery, " Surg. Endoscopy, vol.15, no.10, pp. 1204-1207, 2001.
4. M. I. Klein, M. A. Riley, J. S. Warm, and G. Matthews, "Perceived mental workload in an endocopic surgery simulator, " in Proc. Human Factors Ergonomics Soc. 49th Annu. Meeting, 2005, pp. 1014-1018.
5. K. Subramonian, S. DeSylva, P. Bishai, P. Thompson, and G. Muir, "Acquiring surgical skills: A comparative study of open versus laparo-scopic surgery, " Eur. Urol., vol.45, no.3, pp. 346-351, 2004.
6. H. Fuchs, M. A.Livingston, R. Raskar, D. Colucci, K.Keller, A.State1, J. R. Crawford, P. Rademacher, S. H. Drake, and A. A. Meyer, "Augmented reality visualization for laparoscopic surgery, " in Proc. 1st Int. Conf. Med. Image Computing Computer-Assisted Intervention, 1998, pp. 934-943.
7. P. Paul, O. Fleig, and P. Jannin, "Augmented virtuality based on stereoscopic reconstruction in multimodal image-guided neuro-surgery: Methods and performance evaluation, " IEEE Trans. Med. Imag., vol.24, no.11, pp. 1500-1511, Nov. 2005.
8. K. Pulli, M. Cohen, T. Duchamp, H. Hoppe, L. Shapiro, and W. Stuetzle, "View-based rendering: Visualizing real objects from scanned range and color data, " in Proc. Eurographics Rendering Workshop, Jun. 1997, pp. 23-34.
9. Y. Sako and K. Fujimura, "Shape similarity by homotropic deformation, " Vis. Comput., vol.16, no.1, pp. 47-61, 2000.
10. D. Dey, D. G. Gobbi, P. J. Slomka, K. J. M. Surry, and T. M. Peters, "Automatic fusion of freehand endoscopic brain images to three-dimensional surfaces: Creating stereoscopic panoramas, " IEEE Trans. Med. Imag., vol.21, no.1, pp. 23-30, Jan. 2002.
11. M. J.Clarkson, D. Rueckert, D. L. Hill, and D. J. Hawkes, "Registration of multiple video images to preoperative ct for image-guided surgery, " Med. Imag., pp. 14-23, 1999.
12. B. Levy, "Constrained texture mapping for polygonal meshes, " in Proc. SIGGRAPH, 2001, pp. 417-424.
13. M. Desbrun, M. Meyer, and P. Alliez, "Intrinsic parameterizations of surface meshes, " in Proc. Eurographics, 2002.
14. V. Kraevoy, A. Sheffer, and C. Gotsman, "Matchmaker: Constructing constrained texture maps, " in Proc. SIGGRAPH, 2003, pp. 326-333.
15. F. Devernay, F. Mourgues, and E. Coste-Manière, "Towards endo-scopic augmented reality for robotically assisted minimally invasive cardiac surgery, " in Proc. Int. Workshop Med. Imag. Augmented Reality, 2001, pp. 16-20.
16. O. Shibolet and D. Cohen-Or, "Coloring voxel-based objects for virtual endoscopy, " in Proc. 1998 IEEE Symp. Volume Visualizat., 1998, pp. 15-22.
17. J. Fischer, M. Neff, D. Freudenstein, andD. Bartz, "Medical augmented reality based on commercial image guided surgery, " in Proc. Eurographics Symp. Virtual Environ. (EGVE), 2004.
18. F. Mourgues, T. Vieville, V. Falk, and E. Coste-Maniere, "Interactive guidance by image overlay in robot assisted coronary artery bypass, " in Proc. Med. Image Computing Computer-Assisted Intervention (MICCAI), 2003, pp. 173-181.
19. M. I. Miga, T. K. Sinha, D. M. Cash, R. L. Galloway, and R. J. Weil, "Cortical surface registration for image-guided neurosurgery using laser-range scanning, " IEEE Trans. Med. Imag., vol.22, no.8, pp. 973-985, Aug. 2003.
20. T. K. Sinha, B. M. Dawant, V. Duay, D. M. Cash, R. J. Weil, R. C. Thompson, K. D. Weaver, and M. I. Miga, "A method to track cortical surface deformations using a laser range scanner, " IEEE Trans. Med. Imag., vol.24, no.6, pp. 767-781, Jun. 2005.
21. S. Szpala, M. Wierzbicki, G. Guiraudon, and T. M. Peters, "Real-time fusion of endoscopic views with dynamic 3-D cardiac images: A phantom study, " IEEE Trans. Med. Imag., vol.24, no.9, pp. 1207-1215, Sep. 2005.
22. M. D. Elstrom and P. W. Smith, "Stereo-based registration of multi-sensor imagery for enhanced visualization of remote environments, " in Proc. IEEE Int. Conf. Robot. Autom., 1999, pp. 1948-1953.
23. R. Kurazume, K. Nishino, Z. Zhang, and K. Ikeuchi, "Simultaneous 2d images and 3d geometric model registration for texture mapping utilizing reflectance attribute, " in Proc. 5th Asian Conf. Comput. Vis., 2002, pp. 23-25.
24. K. Umeda, G. Godin, and M. Rioux, "Registration of range and color images using gradient constraints and range intensity images, " in Proc. 17th Int. Conf. Pattern Recognit., 2004, pp. 12-15.
25. L. Brunie, S. Lavallee, and R. Szeliski, "Using force fields derived from 3d distance maps for inferring the attitude of a 3d rigid object, " in Proc. 2nd Eur. Conf. Comput. Vis., 1992, pp. 670-675.
26. S. Lavallee and R. Szeliski, "Recovering the position and orientation of free-form objects from image contours using 3D distance maps, " IEEE Trans. Pattern Anal. Mach. Intell., vol.17, no.4, pp. 378-390, Apr. 1995.
27. K. Matsushita and T. Kaneko, "Efficient and handy texture mapping on 3D surfaces, " Comput. Graph. Forum, vol.18, pp. 349-358, 1999.
28. P. J. Neugebauer and K. Klein, "Texturing 3d models of real world objects from multiple unregistered photographic views, " in Comput. Graph. Forum, 1999, vol.18, pp. 245-256.
29. B. D. Lucas and T. Kanade, "An iterative image registration technique with an application to stereo vision, " in Proc. 7th Int. Joint Conf. Artif. Intell., 1981, pp. 674-679.
30. C. Tomasi and T. Kanade, Detection and tracking of point features Carnegie Mellon Univ., Pittsburgh, PA, Rep. CMU-CS-91-132, 1991.
31. D. G. Lowe, "Distinctive image features from scale-invariant key-points, " Int. J. Comput. Vis., vol.20, pp. 91-110, 2003.
32. D. Lowe, "Object recognition from local scale-invariant features, " in Proc. Int. Conf. Comput. Vis., 1999, pp. 1150-1157.
33. I. Eckstein, V. Surazhsky, and C. Gotsman, "Texture mapping with hard constraints, " Comput. Graph. Forum, vol.20, no.3, pp. 95-104, 2001.
34. V. Kraevoy and A. Sheffer, "Cross-parameterization and compatible remeshing of 3d models, " in Proc. SIGGRAPH, 2004, pp. 861-869.
35. J. Schreiner, A. Asirvatham, E. Praun, and H. Hoppe, "Inter-surface mapping, " in Proc. SIGGRAPH, 2004, pp. 870-877.
36. K. Zhou, X. Wang, Y. Tong, M. Desbrun, B. Guo, and H.-Y. Shum, "Texturemontage, " in Proc. SIGGRAPH, 2005, pp. 1148-1155.
37. B. Levy, S. Petitjean, N. Ray, and J. Maillot, "Least squares conformal maps for automatic texture atlas generation, " in Proc. SIGGRAPH, 2002, pp. 362-371.
38. A. Khodakovsky, N. Litke, and P. Schröder, "Globally smooth parame-terizations with low distortion, " in Proc. SIGGRAPH, 2003, vol.1, pp. 350-357.
39. M. Brown and D. G. Lowe, "Recognising panoramas, " in Proc. 9th IEEE Int. Conf. Comput. Vis., 2003, pp. 1218-1225.
40. R. Szeliski and H.-Y. Shum, "Creating full view panoramic image mosaics and environment maps, " in Proc. SIGGRAPH, 1997, pp. 251-258.
41. M. A. Fischler and R. C. Bolles, "Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography, " in Readings Comput. Vis.: Issues, Problems, Principles, Paradigms, 1987, pp. 726-740.
42. R. Hartley and A. Zisserman, Multiple View Geometry in Computer Vision, 2 ed. New York: Cambridge Univ. Press, 2004.
43. N. Metropolis andS. Ulam, "The monte carlo method, "J. Amer. Statist. Assoc., vol.44, no.247, pp. 335-341, 1949.