Using specular highlights as pose invariant features for 2D-3D pose estimation

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn , Issue , 2011, Pages 721-728

  Netz, Aaron ^a   Osadchy, Margarita ^a  

^a UNIVERSITY OF HAIFA   (Israel)

Author keywords

[No Author keywords available]

Indexed keywords

LIGHT SOURCES;

2D-3D POSE ESTIMATION; CLUTTERED BACKGROUNDS; LOW ILLUMINATIONS; MONOCULAR IMAGE; POSE ESTIMATION; SPECULAR HIGHLIGHT; SYNTHETIC IMAGES; VIEWING CONDITIONS;

PATTERN RECOGNITION;

EID: 80052877830     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2011.5995673     Document Type: Conference Paper

References (37)

1. Alter. 3d pose from 3 corresponding points under weakperspective projection. Massachusetts Institute of Technology, Artificial Intelligence Laboratory, 1992.
2. A. Ansar and K. Daniilidis. Linear pose estimation from points or lines. IEEE Transactions on Pattern Analysis and Machine Intelligence, 25(5):578-589, 2003.
3. B. Barrois and C. Wohler. 3d pose estimation based on multiple monocular cues. In Ben COS07, pages 1-8, 2007.
4. P. J. Besl and H. D. Mckay. A method for registration of 3-d shapes. IEEE Transactions on Pattern Analysis and Machine Intelligence, 14(2):239-256, 1992.
5. A. Blake and G. Brelstaff. Geometry from specularities. In Second International Conference on Computer Vision, pages 394-403, 1988.
6. A. Blake and H. Bulthoff. Shape from specularities: Computation and psychophysics. Philosophical Transactions of the Royal Society B: Biological Sciences, 331(1260):237-252, 1991.
7. C. Bregler and J. Malik. Tracking people with twists and exponential maps. IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pages 8-15, 1998.
8. J. Y. Chang, R. Raskar, and A. K. Agrawal. 3d pose estimation and segmentation using specular cues. In CVPR, pages 1706-1713, 2009.
9. J. Chen and G. Stockman. Matching curved 3D object models to 2D images. In CAD-Based Vision Workshop, 1994., Proceedings of the 1994 Second, pages 210-218, 1994.
10. R. L. Cook and K. E. Torrance. A reflectance model for computer graphics. In SIGGRAPH, pages 307-316, 1981.
11. S. Dambreville, R. Sandhu, A. J. Yezzi, and A. Tannenbaum. Robust 3d pose estimation and efficient 2d region-based segmentation from a 3d shape prior. In ECCV (2), pages 169-182, 2008.
12. A. DelPozo and S. Savarese. Detecting specular surfaces on natural images. In Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Volume 2), 2007.
13. J. Flusser and T. Suk. Pattern recognition by affine moment invariants. Pattern recognition, 26(1):167-174, 1993.
14. M. Germann, M. D. Breitenstein, I. K. Park, and H. Pfister. Automatic pose estimation for range images on the gpu. In 3DIM'07: Proceedings of the Sixth International Conference on 3-D Digital Imaging and Modeling, pages 81-90, 2007.
15. K. Gremban and K. Ikeuchi. Planning multiple observations for object recognition. International Journal of Computer Vision, 12(2):137-172, 1994.
16. D. Huttenlocher and S. Ullman. Object recognition using alignment. In Proc. ICCV, pages 102-111, 1987.
17. D. Jacobs and R. Basri. 3-d to 2-d pose determination with regions. International Journal of Computer Vision, 34(2):123-145, 1999.
18. H. W. Kuhn. The Hungarian method for the assignment problem. Naval Research Logistic Quarterly, 2:83-97, 1955.
19. P. Lagger, M. Salzmann, V. Lepetit, and P. Fua. 3d pose refinement from reflections. In CVPR, 2008.
20. D. Lowe. Fitting parameterized three-dimensional models to images. IEEE Transactions on Pattern Analysis and Machine Intelligence, 13(5):441-450, 1991.
21. K. McHenry, J. Ponce, and D. Forsyth. Finding glass. In Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Volume 2), pages 973-979, 2005.
22. S. Nayar, K. Ikeuchi, and T. Kanade. Surface reflection: Physical and geometrical perspectives. IEEE Transactions on Pattern Analysis and Machine Intelligence, 13(7):611-634, Jul. 1991.
23. Y. Nomura, D. Zhang, Y. Sakaida, and S. Fujii. 3-d object pose estimation base on iterative image matching: Shading and edge data fusion. International Conference on Pattern Recognition, 1:513, 1996.
24. J. Norman, J. Todd, and G. Orban. Perception of three-dimensional shape from specular highlights, deformations of shading, and other types of visual information. Psychological Science, 15(8):565-570, 2004.
25. M. Oren and S. Nayar. A theory of specular surface geometry. International Journal of Computer Vision, 24(2):105-124, 1997.
26. M. Osadchy, D. Jacobs, R. Ramamoorthi, and D. Tucker. Using specularities in comparing 3D models and 2D images. Computer Vision and Image Understanding, 111(3):275-294, 2008.
27. B. Phong. Illumination for computer generated pictures. Communications of the ACM, 18(6):311-317, 1975.
28. T. Q. Phong, R. Horaud, A. Yassine, and P. D. Tao. Object pose from 2-d to 3-d point and line correspondences. Int. J. Comput. Vision, 15(3):225-243, 1995.
29. M. Powell. A fast algorithm for nonlinearly constrained optimization calculations. Numerical Analysis, G. A. Watson ed., Lecture Notes in Mathematics, 630, 1978.
30. B. Rosenhahn, T. Brox, and J. Weickert. Three-dimensional shape knowledge for joint image segmentation and pose tracking. Int. J. Comput. Vision, 73(3):243-262, 2007.
31. B. Rosenhahn, C. Perwass, and G. Sommer. Pose estimation of 3d free-form contours. Int. J. Comput. Vision, 62(3):267-289, 2005.
32. K. Sato, K. Ikeuchi, and T. Kanade. Model based recognition of specular objects using sensor models. In Automated CAD-Based Vision, 1991., Workshop on Directions in, pages 2-10, 1991.
33. H. Schultz. Retrieving shape information from multiple images of a specular surface. IEEE Transactions on Pattern Analysis and Machine Intelligence, 16(2):195-201, 1994.
34. D. Sim, O. Kwon, and R. Park. Object matching algorithms using robust Hausdorff distance measures. Image Processing, IEEE Transactions on, 8(3):425-429, 2002.
35. T. Suk and J. Flusser. Graph method for generating affine moment invariants. In Proceedings of the 17th International Conference on Pattern Recognition, volume 2, 2004.
36. J. Wang and K. J. Dana. A novel approach for texture shape recovery. In Proceedings of the Ninth International Conference on Computer Vision, page 1374, 2003.
37. G. J. Ward. Measuring and modeling anisotropic reflection. SIGGRAPH, 26(2):265-272, 1992.