Current issues of photorealistic rendering for virtual and augmented reality in minimally invasive surgery

Proceedings of the International Conference on Information Visualisation

Volumn 2003-January, Issue , 2003, Pages 350-358

  Stoyanov, Danail ^a   ElHelw, Mohamed ^a   Lo, Benny P ^a   Chung, Adrian ^a   Bello, Fernando ^b   Yang, Guang Zhong ^a,b  

^a IMPERIAL COLLEGE LONDON   (United Kingdom)

^b ST MARY S HOSPITAL   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

AUGMENTED REALITY; COMPUTER GRAPHICS; COMPUTER VISION; DIAGNOSIS; INFORMATION ANALYSIS; INFORMATION SCIENCE; INFORMATION SYSTEMS; SURGERY; TRANSPLANTATION (SURGICAL); VISUALIZATION;

GEOMETRIC INFORMATION; IMAGE-BASED MODELING AND RENDERING; MINIMALLY INVASIVE SURGERY; PATIENT SPECIFIC MODEL; PHOTOREALISTIC RENDERING; PRE-OPERATIVE PLANNING; SURGICAL NAVIGATION; VIRTUAL AND AUGMENTED REALITY;

RENDERING (COMPUTER GRAPHICS);

EID: 20344373621     PISSN: 10939547     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IV.2003.1218010     Document Type: Conference Paper

References (53)

1. Virtual Reality in Medicine: A Survey of State of the Art, http://www.informatik.umu.se/∼jwworth/
2. D. Dey, P. J. Slomka, D. G. Gobbi and T. M. Peters. Mixed reality merging of endoscopic images and 3-d surfaces. Medical Image Computing and Computer-Assisted Intervention 2000. MICCAI, 2000.
3. M. de Waal. Image-guided surgery of the spine. Medica Mundi, vol. 42, 1998.
4. M. J. Mack. Minimally Invasive and Robotic Surgery. The Journal of the American Medical Association. vol. 285, pp. 568-572, 2001.
5. R. M. Satava, and S. B. Jones. Current and future applications of virtual reality for medicine. In Proceedings of the IEEE. vol. 86, pp. 484-489, 1998.
6. Xavier Provot. Deformation Constraints in a Mass-Spring Model to Describe Rigid Cloth Behavior. Wayne A.Davis and Przemyslaw Prusinkiewicz. In Proceedings of Graphics Interface 1995, pp. 147-154. 1995.
7. U.Kühnapfel, H.K.Çakmak, and H.Maaß. 3D Modeling for Endoscopic Surgery. Oct. 1999.
8. S.Roth, M.Gross, S.Turello, and F.Carls. A bernstein-bézier based approach to soft tissue simulation. In Proceedings of the Eurographics 1998. Sept., 1998.
9. M.Bro-Nielsen and S.Cotin. Real-time volumetric deformable models for surgery simulation using finite elements and condensation. Computer Graphics Forum, vol. 15, pp. 57-66, Sept. 1996.
10. D.Bielser and M.Gross. Open surgery simulation. In Proceedings of Medicine Meets Virtual Reality. 2002.
11. Cignoni P., Ganovelli F., and Scopigno R. Introducing Multiresolution Represen-tation in Deformable Modeling. In SCCG, pp. 149-158, Apr. 1999.
12. Debunne G., Desbrun M., Cani M.P, and Barr A.H. Adaptive Simulation of Soft Bodies in Real-Time. In CA, pp. 15-20, 2000.
13. Wu X.M. Adaptive Nonlinear Finite Elements for Deformable Body Simulation Using Dynamic Progressive Meshes. In Proceedings of the Eurographics 2001, pp. 439-448, 2001.
14. Paloc C., Bello F., Kitney R.I, and Darzi A. Online multiresolution volumetric mass spring model for real time soft tissue deformation. In MICCAI 2002, pp. 219-226, 2002.
15. T. Okatani, and K. Deguchi. Shape Reconstruction from an Endoscope Image by Shape from Shading Technique for a Point Light Source at the Projection Centre. Computer Vision and Image Understanding, vol. 66, pp. 119-131, 1997.
16. I. Serlie, F. M. Vos, R. E. van Gelder, J. Stoker, R. Truyen, Y. Nio and F. H. Post. Improved visualization in virtual colonoscopy using image based rendering. In Proceedings of the Joint Eurographics - IEEE TCVG Symposium on Visualizatation (VisSym-01), 2001.
17. E. Coste-Maniere, L. Adhami, R. Severac-Bastide, A. Lobontiu, J. K. Salisbury, J.-D. Boissonnat, N. Swarup, G. Guthart, E. Mousseaux, and A. Carpentier. Optimized Port Placement for the Totally Endoscopic Corinary Artery Bypass Grafting using the da Vinci Robotic System. Proceedings of ISER, 2000.
18. D. Dey, D. Gobbi, P. Slomka, K. Surry and T. Peters, Automatic fusion of freehand endoscopic brain images to three-dimensional surfaces: Creating stereoscopic panoramas, In IEEE Transactions on Medical Imaging, vol. 21, pp. 23-30, 2000.
19. F. Gerritsen, M. Breeuwer, H. de Bliek, J. Buurman, and P. Desmedt, Image-guided surgery - the easi project, presented at The Surgery Room of the 21st Century, Moat House hotel, Glasgow, Scotland, 1999.
20. A. P. King, P. J. E. M. R. Pike, G. L. G. Hill, and D. J. Hawkes. An analysis of calibration and registration errors in an augmented reality system for microscope-assisted guided interventions. Medical Image Understanding and Analysis, 1999.
21. A. Tei. Multi-modality image fusion by real-time tracking of volumetric brain deformation during image guided neurosurgery. MIT, 2002.
22. D. Rueckert, C. Hayes, C. Studholme, P. Summers, M. Leach and D. J. Hawkes . Non-rigid registration of breast MR images using mutual information. In Lecture Notes in Computer Science, vol. 2208, 1998.
23. T. Gaens, F. Maes, D. Vandermeulen and P. Suetens. Non-rigid multimodal image registration using mutual information. In Lecture Notes in Computer Science, vol. 1496, pp. 1099-, 1998.
24. J. Feldmar, N. Ayache, and F. Betting. 3D-2D projective registration of free-form curves and surfaces. Inria, Institut National de Recherche en Informatique et en Automatique Technical Report RR-2434.
25. A. Liu, E. Bullitt and S. M. Pizer. Registration via skeletal near projective invariance in tubular objects. In Lecture Notes in Computer Science, vol. 1496, pp. 952-, 1998.
26. C. M. Cyr, T. Sebastian and B. B. Kimia. 2d-3d registration based on shape matching. In IEEE Workshop on Mathematical Methods in Biomedical Image Analysis, 2000.
27. J. B. A. Maintz. An overview of medical image registration methods. In Symposium of the Belgian hospital physicists association (SBPH-BVZF). vol. 12, pp. 1-22, 1997.
28. J. F. Blinn, and M. E. Newell . Texture and Reflection in Computer Generated Images. CACM, vol. 19, pp. 542-547, 1976.
29. A. Watt. 3D Computer Graphics. 2000.
30. N. Greene. Environment mapping and other applications of world projections. Computer Graphics and Applications. IEEE. vol. 6, pp. 21-29, 1986.
31. D. Wagner, R. Wegenkittl and E. Gröller. Endoview: A phantom study of a tracked virtual bronchoscopy. Journal of WSCG, vol. 10, 2002.
32. I. W. O. Serlie, F.M. Vos, R. van Gelder et al. Improved visualization in virtual colonoscopy using image-based rendering. Accepted for publication in Proceedings of ACM/Eurographics.VisSym, 2001.
33. M. Oliveira, G. Bishop, and D. McAllister. Relief Texture Mapping. In Proceedings of SIGGRAPH 2000, pp. 231-242, 2000.
34. M. ElHelw and G-Z. Yang. Cylindrical Relief Texture Mapping. Journal of WSCG, vol. 11, 2003.
35. W. Mark. Post-Rendering 3D Image Warping: Visibility, Reconstruction, and Performance for Depth-Image Warping. University of North Carolina at Chapel Hill, 1999.
36. O. Faugeras. Multiple View Geometry. 1993.
37. R. Hartley and A. Zisserman. Multiple View Geometry in Computer Vision. 2000.
38. U. Dhond, and J. Aggarwal. Structure from stereo - a review. IEEE Transactions on Systems, Manufacture and Cybernetics, vol. 19, pp. 1489-1510, 1989
39. D. Scharstein, and R. Sziliski. A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms. Internation Journal of Computer Vision, vol. 47, pp. 7-42, 2002.
40. R. Y. Tsai. A versatile Camera Calibration Technique for High-Accuracy 3D Machine Vision Metrology Using Off-the-Shelf TV Cameras and Lenses. IEEE Journal of Robotics and Automation, vol. RA-3, pp. 323-344, 1987.
41. Z. Zhang. A flexible new technique for camera calibration. IEEE Transactions on Pattern Analysis and Machine Intelligence. vol. 22, pp.1330-1334, 2000.
42. A. Fusiello. Uncalibrated Eucledian reconstruction: a review. Image and Vision Computing. vol. 18, pp. 555-563, 2000.
43. R. Hartley and P. Sturm. Triangulation. In Proceedings of ARPA IUW, 1994.
44. B. K. Horn, and M. J. Brooks, Shape from Shading. 1989.
45. R. Zhang, PS. Tsai, J.E. Cryer, M. Shah. Shape from Shading: A Survey. IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 21, 1999.
46. C. H. Q. Forster, and C. Tozzi. Towards 3D Reconstruction of Endoscope Images Using Shape from Shading. In Proceedings of the XIII Brizilian Symposium on Computer Graphics and Image Processing, 2000.
47. J. L. Marr. Vision: A Computational Investigation into the Human Representation and Processing of Visual Information. 1982.
48. A. Blake, A. Zisserman, and G. Knowles, Surface descriptions from stereo and shading. Image Vision and Computing. vol. 3, pp. 183-191, 1985.
49. S. Pankanti, and A. K. Jain. A uniform Bayesian framework for integration. In International Symposium on Computer Vision. 1995.
50. J. J. Little, Integrating Vision Modules at Discontinuities, In 12th Canadian Symposium on Remote Sensing. 1989 International. IGARSS 189. vol. 3, pp. 1260-1263, 1989.
51. H. I. Bozma, and J. S. Duncan. Integration of Vision Modules: A Game-Theoretic Framework. In Conference on Computer Vision and Pattern Recognition. IEEE. 1991.
52. A. Jepson, and W. Richards. A Lattice Framework for Integrating Vision Modules, IEEE Transactions on Systems, Man and Cybernetics. vol. 22, 1992.
53. J. Shah, H. H. Pien, and J. M. Gauch. Recovery of Surfaces with Discontinuities by Fusing Shading and Range Data Within a Variational Framework. IEEE Transactions on Image Processing. vol. 5, pp. 1243-1251, 1996.