Single view augmentation of 3D elastic objects

ISMAR 2014 - IEEE International Symposium on Mixed and Augmented Reality - Science and Technology 2014, Proceedings

Volumn , Issue , 2014, Pages 229-236

  Haouchine, Nazim ^a   Dequidt, Jeremie ^a   Berger, Marie Odile ^b   Cotin, Stephane ^a  

^a UNIV LILLE   (France)

^b UNIVERSITÉ DE LORRAINE   (France)

Author keywords

augmented; Computational Geometry and Object Modeling Physically based modeling; H.5.1 Information Interfaces and Presentation : Multimedia Information Systems Artificial; I.3.5 Computer Graphics ; virtual realities

Indexed keywords

AUGMENTED REALITY; COMPUTATIONAL GEOMETRY; COMPUTER GRAPHICS; DEFORMATION; SHAPE OPTIMIZATION; VIRTUAL REALITY;

AUGMENTED; DEFORMATION PROPERTIES; ENERGY MINIMIZATION PROBLEM; GEOMETRIC CONSTRAINT; H.5.1 [INFORMATION INTERFACES AND PRESENTATION]: MULTIMEDIA INFORMATION SYSTEMS - ARTIFICIAL; I.3.5 [COMPUTER GRAPHICS]; MONOCULAR VIDEO SEQUENCES; PHYSICALLY BASED MODELING;

ELASTIC MODULI;

EID: 84945156343     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ISMAR.2014.6948432     Document Type: Conference Paper

References (34)

1. A. Agudo, B. Calvo, and J. M. M. Montiel. Finite element based sequential bayesian non-rigid structure from motion. In Computer Vision and Pattern Recognition, 2012. CVPR'12. IEEE Conference on, pages 1418-1425, 2012.
2. J. Barbi?c and D. L. James. Real-time subspace integration for st. venant-kirchhoff deformable models. In ACM Transactions on Graphics (TOG), volume 24(3), pages 982-990. ACM, 2005.
3. A. Bartoli, Y. Gerard, F. Chadebecq, and T. Collins. On templatebased reconstruction from a single view: Analytical solutions and proofs of well-posedness for developable, isometric and conformal surfaces. In Computer Vision and Pattern Recognition (CVPR), 2012 IEEE Conference on, pages 2026-2033, June 2012.
4. A. Bartoli and A. Zisserman. Direct estimation of non-rigid registration. In In British Machine Vision Conference, 2004.
5. H. Bay, A. Ess, T. Tuytelaars, and L. Van Gool. Speeded-up robust features (SURF). Comput. Vis. Image Underst., 110(3):346-359, June 2008.
6. S. Cotin, H. Delingette, and N. Ayache. Real-time elastic deformations of soft tissues for surgery simulation. Visualization and Computer Graphics, IEEE Transactions on, 5(1):62-73, Jan 1999.
7. F. Faure, C. Duriez, H. Delingette, J. Allard, B. Gilles, S. Marchesseau, H. Talbot, H. Courtecuisse, G. Bousquet, I. Peterlik, and S. Cotin. SOFA: A Multi-Model Framework for Interactive Physical Simulation. In Y. Payan, editor, Soft Tissue Biomechanical Modeling for Computer Assisted Surgery. Springer, June 2012.
8. V. Gay-Bellile, A. Bartoli, and P. Sayd. Direct estimation of nonrigid registrations with image-based self-occlusion reasoning. IEEE Trans. Pattern Anal. Mach. Intell., 32(1):87-104, Jan. 2010.
9. S. F. Gibson and B. Mirtich. A survey of deformable modeling in computer graphics. Technical report, Mitsubishi Electronic Research Laboratory, 1997.
10. C. Gúebert, C. Duriez, and L. Grisoni. Unified processing of constraints for interactive simulation. In M. T. François Faure, editor, Workshop in Virtual Reality Interactions and Physical Simulation VRIPHYS' 2008, pages-, Grenoble, France, 2008. Eurographics association.
11. N. Haouchine, J. Dequidt, I. Peterlik, E. Kerrien, M.-O. Berger, and S. Cotin. Image-guided simulation of heterogeneous tissue deformation for augmented reality during hepatic surgery. In Mixed and Augmented Reality (ISMAR), 2013 IEEE International Symposium on, pages 199-208, Oct 2013.
12. A. Hilsmann, D. C. Schneider, and P. Eisert. Realistic cloth augmentation in single view video under occlusions. Comput. Graph., 34(5):567-574, Oct. 2010.
13. R. Kikuuwe, H. Tabuchi, and M. Yamamoto. An edge-based computationally efficient formulation of saint venant-kirchhoff tetrahedral finite elements. ACM Transactions on Graphics (TOG), 28(1):8, 2009.
14. A. Malti, R. Hartley, A. Bartoli, and J.-H. Kim. Monocular templatebased 3D reconstruction of extensible surfaces with local linear elasticity. In Computer Vision and Pattern Recognition (CVPR), 2013 IEEE Conference on, pages 1522-1529, 2013.
15. K. Miller and J. Lu. On the prospect of patient-specific biomechanics without patient-specific properties of tissues. Journal of the Mechanical Behavior of Biomedical Materials, 27(0):154-166, 2013.
16. F. Moreno-Noguer, M. Salzmann, V. Lepetit, and P. Fua. Capturing 3D stretchable surfaces from single images in closed form. In Computer Vision and Pattern Recognition, 2009. CVPR 2009. IEEE Conference on, pages 1842-1849, June 2009.
17. A. Nealen, M. Müller, R. Keiser, E. Boxerman, and M. Carlson. Physically based deformable models in computer graphics. In Computer Graphics Forum, volume 25 (4), pages 809-836, 2006.
18. S. Nicolau, L. Soler, D. Mutter, and J. Marescaux. Augmented reality in laparoscopic surgical oncology. Surgical Oncology, 20(3):189-201, 2011.
19. M. Perriollat, R. Hartley, and A. Bartoli. Monocular template-based reconstruction of inextensible surfaces. International Journal of Computer Vision, 95(2):124-137, 2011.
20. I. Peterlk, C. Duriez, and S. Cotin. Modeling and real-time simulation of a vascularized liver tissue. In Medical Image Computing and Computer-Assisted Intervention, pages 50-57. Springer-Verlag, 2012.
21. J. Pilet, V. Lepetit, and P. Fua. Fast non-rigid surface detection, registration and realistic augmentation. Int. J. Comput. Vision, 76(2):109-122, Feb. 2008.
22. D. Pizarro and A. Bartoli. Feature-based deformable surface detection with self-occlusion reasoning. International Journal of Computer Vision, 97(1):54-70, 2012.
23. P. Pratt, D. Stoyanov, M. Visentini-Scarzanella, and G.-Z. Yang. Dynamic guidance for robotic surgery using image-constrained biomechanical models. In Medical Image Computing and Computer-Assisted Intervention, volume 6361, pages 77-85. 2010.
24. M. Salzmann and P. Fua. Linear local models for monocular reconstruction of deformable surfaces. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 33(5):931-944, May 2011.
25. M. Salzmann, R. Hartley, and P. Fua. Convex optimization for deformable surface 3-d tracking. In Computer Vision, 2007. ICCV 2007. IEEE 11th International Conference on, pages 1-8, Oct 2007.
26. M. Salzmann, J. Pilet, S. Ilic, and P. Fua. Surface deformation models for nonrigid 3D shape recovery. IEEE Trans. Pattern Anal. Mach. Intell., 29(8):1481-1487, Aug. 2007.
27. S. Shen, W. Shi, and Y. Liu. Monocular 3-d tracking of inextensible deformable surfaces under l2-norm. Trans. Img. Proc., 19(2):512-521, Feb. 2010.
28. E. Sifakis and J. Barbic. Fem simulation of 3D deformable solids: A practitioner's guide to theory, discretization and model reduction. In ACM SIGGRAPH 2012 Courses, SIGGRAPH'12, pages 20:1-20:50, New York, NY, USA, 2012. ACM.
29. M. Silcowitz-Hansen, S. Niebe, and K. Erleben. A nonsmooth nonlinear conjugate gradient method for & interactive contact force problems. Vis. Comput., 26(6-8):893-901, June 2010.
30. N. Snavely, S. M. Seitz, and R. Szeliski. Photo tourism: Exploring photo collections in 3d. In ACM SIGGRAPH 2006 Papers, SIGGRAPH'06, pages 835-846, New York, NY, USA, 2006. ACM.
31. S. Wuhrer, J. Lang, and C. Shu. Tracking complete deformable objects with finite elements. In 3DIMPVT, pages 1-8. IEEE, 2012.
32. M. C. Yip, D. G. Lowe, S. E. Salcudean, R. N. Rohling, and C. Y. Nguan. Tissue tracking and registration for image-guided surgery. Medical Imaging, IEEE Transactions on, 31(11):2169-2182, Nov 2012.
33. H. Zhong, M. P. Wachowiak, and T. M. Peters. A real time finite element based tissue simulation method incorporating nonlinear elastic behavior. Computer Methods in Biomechanics and Biomedical Engineering, 8(3):177-189, 2005.
34. J. Zhu and M. R. Lyu. Progressive finite newton approach to real-time nonrigid surface detection. In Computer Vision and Pattern Recognition, 2007. CVPR'07. IEEE Conference on, pages 1-8. IEEE, 2007.