Using specularities in comparing 3D models and 2D images

Computer Vision and Image Understanding

Volumn 111, Issue 3, 2008, Pages 275-294

  Osadchy, Margarita ^a   Jacobs, David ^b   Ramamoorthi, Ravi ^c   Tucker, David ^b  

^a UNIVERSITY OF HAIFA   (Israel)

^b UNIVERSITY OF MARYLAND   (United States)

^c Columbia University ^*  (United States)

Author keywords

Illumination; Object Recognition; Specularity

Indexed keywords

FACE RECOGNITION; IMAGE ENHANCEMENT; REFLECTION; TURBULENT FLOW;

2-D IMAGES; 3-D MODELING; 3-D SHAPE; DATA SETS; HYBRID METHODS; ILLUMINATION; IMAGE EFFECTS; INTENSITY IMAGES; LAMBERTIAN; LAMBERTIAN REFLECTANCE; NOVEL METHODS; OBJECT IDENTITY; OBJECT RECOGNITION; P RIOR WORK; REFERENCE IMAGES; SOURCE OF NOISE; SPECIFIC KNOWLEDGE; SPECULAR HIGHLIGHTS; SPECULAR REFLECTANCE; SPECULAR REFLECTIONS; SPECULARITIES; SPECULARITY; TRANSPARENT OBJECTS; VERIFICATION METHODS;

THREE DIMENSIONAL;

EID: 50249162470     PISSN: 10773142     EISSN: 1090235X     Source Type: Journal    
DOI: 10.1016/j.cviu.2007.12.004     Document Type: Article

References (46)

1. R. Basri, D. Jacobs, Lambertian reflectance and linear subspaces, in: Proceedings of ICCV, vol. II, 2001, pp. 283-390.
2. Belhumeur P.N., and Kriegman D.J. What is the set of images of an object under all possible lighting conditions?. IJCV 28 3 (1998) 245-260
3. Beckmann P., and Spizzichino A. The Scattering of Electromagnetic Waves from Rough Surfaces (1963), Pergamon, New York
4. Birk J.W., Kelly R.B., and Martines H.A.S. An orienting robot for feeding workpieces stored in bins. IEEE Trans. Syst. Man Cybernet. SMC 11 2 (1981) 151-160
5. Blanz V., and Vetter T. Face recognition based on fitting a 3D Morphable Model. IEEE Trans. PAMI 25 9 (2003) 1063-1073
6. Blinn J.F., and Newell M. Texture and reflection in computer generated images. Commun. ACM 19 10 (1976) 542-547
7. T. Bonfort, P. Sturm, Voxel carving for specular surfaces, in: Proceedings of International Conference of Computer Vision, 2003, pp. 394-403.
8. G. Brelstaff, A. Blake, Detecting specular reflections using Lambertian constraints, in: Proceedings of ICCV, 1988, pp. 297-302.
9. H.F. Chen, P.N. Belhumeur, D.W. Jacobs, In search of illumination invariants, in: IEEE Conference on CVPR, June 2000, pp. 254-261.
10. Cook R.L., and Torrance K.E. A reflectance model for computer graphics. ACM Trans. Graph. 1 1 (1982) 7-24
11. Criminisi A., Kang S.B., Swaminathan R., Szeliski R., and Anandan P. Extracting layers and analyzing their specular properties using epipolar-plane-image analysis. Comput. Vis. Image Understanding 1 (2005) 51-85
12. A. DelPozo, S. Savarese, Detecting specular surfaces on natural images, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, June 2007.
13. R. Epstein, P. Hallinan, A. Yuille, 5 ± 2 eigen images suffice: an empirical investigation of low-dimensional lighting models, in: IEEE Workshop on Physics-Based Vision, 1995, pp. 108-116.
14. Fukada Y., Doi H., Nagamine k., and Inari T. Relationships-based recognition of structural industrial parts stacked in bin. Robotoca 2 (1984) 47-154
15. Funt B., and Finlayson G. Color constant color indexing. IEEE Trans. PAMI 17 5 (1995) 522-529
16. A.S. Georghiades, Incorporating the Torrance and Sparrow Model of reflectance in uncalibrated photometric stereo, in: International Conference on Computer Vision, 2003, pp. 816-823.
17. Georghiades A.S., Belhumeur P.N., and Kriegman D.J. From few to many: generative models for recognition under variable pose and illumination. IEEE Trans. PAMI 23 6 (2001) 643-660
18. A.S. Georghiades, D.J. Kriegman, P.N. Belhumeur, Illumination cones for recognition under variable lighting: faces, in: Proceedings of IEEE Conference on CVPR, 1998.
19. Gonzalez R.C., and Woods R.E. Digital Image Processing (1992), Addison-Wesley, Reading, MA
20. K.D. Gremban, K. Ikeuchi, Planning multiple observations for specular object recognition, in: IEEE Conference on Robotics and Automation, vol. 2, 1993, pp. 599-604.
21. P. Hallinan, A low-dimensional representation of human faces for arbitrary lighting conditions, in: IEEE Conference on CVPR, 1994, pp. 995-999.
22. Ikeuchi K., and Sato K. Determining reflectance properties of an object using range and brightness images. IEEE Trans. PAMI 13 11 (1991) 1139-1153
23. Koshikawa K., and Shirai Y. A 3-D modeler for vision research. Proceedings of International Conference on Advanced Robotics (1985), Robotics Society of Japan 185-190
24. Lades M., Vortbruggen J.C., Buhmann J., Lange J., von der Malsburg C., Wurtz R.P., and Konen W. Distortion invariant object recognition in the dynamic link architecture. IEEE Trans. Comput. 42 (1993) 300-311
25. Land E., and McCann J. Lightness and retinex theory. J. Opt. Soc. Am. 61 1 (1971) 1-11
26. K. McHenry, J. Ponce, D. Forsyth, Finding glass, in: IEEE Conference on CVPR, 2005, pp. 973-979.
27. T. MacRobert, Spherical harmonics; an elementary treatise on harmonic functions, with applications, Dover Publications, 1948.
28. Y. Moses, Face recognition: generalization to novel images, Ph.D. Thesis, Weizmann Institute of Science, 1993.
29. Motoyoshi I., Nishida S., Sharan L., and Adelson E.H. Image statistics and the perception of surface qualities. Nature (2007)
30. Murase H., and Nayar S.K. Visual learning and recognition of 3d objects from appearance. IJCV 14 1 (1995) 5-24
31. Nayar S.K., and Bolle R. Reflectance based object recognition. IJCV 17 3 (1996) 219-240
32. Nayar S.K., Ikeuchi K., and Kanade T. Surface reflection: physical and geometrical perspectives. IEEE Trans. PAMI 13 7 (1991) 611-634
33. Nayar S.K., Ikeuchi K., and Kanade T. Determining shape and reflectance of hybrid surfaces by photometric sampling. IEEE Trans. Robotics Automat. 6 4 (1990) 418-431
34. Nishino K., Zhang Z., and Ikeuchi K. Determining reflectance parameters and illumination distribution from a sparse set of images for view-dependent image synthesis. ICCV01 I (2001) 599-606
35. Oren M., and Nayar S.K. A theory of specular surface geometry. IJCV 24 2 (1997) 105-124
36. M. Osadchy, D. Jacobs, R. Ravamoorthi, Using specularities for recognition, in: IEEE International Conference on Computer Vision, vol. II, 2003, pp. 1512-1519.
37. M. Osadchy, D. Jacobs, M. Lindenbaum, On the equivalence of common approaches to lighting insensitive recognition, in: IEEE International Conference on Computer Vision, vol. 2, 2005, 1721-1726.
38. Phong B. Illumination for computer generated images. Commun. ACM 18 6 (1975) 311-317
39. Ramamoorthi R. Analytic PCA construction for theoretical analysis of lighting variability in images of a Lambertian object. IEEE Trans. PAMI 24 10 (2002) 1322-1333
40. Ramamoorthi R., and Hanrahan P. On the relationship between radiance and irradiance: determining the illumination from images of a convex Lambertian object. JOSA A 18 10 (2001) 2448-2459
41. K. Sato, K. Ikeuchi, T. Kanade, Model-based recognition of specular objects using sensor models, in: Proceedings of IEEE Workshop on Directions in Automated CAD-Based Vision, June, 1991, pp. 2-10.
42. Savarese S., Chen M., and Perona P. Local shape from mirror reflections. Int. J. Comput. Vis. 64 1 (2005) 31-67
43. A. Shashua, Geometry and photometry in 3D visual recognition, Ph.D. Thesis, MIT, 1992.
44. S. Shirdhonkar, D.W. Jacobs, Non-negative lighting and specular object recognition, in: IEEE International Conference on Computer Vision, 2005, pp. 1323-1330.
45. K.K. Thornber, D.W. Jacobs, Broadened, specular reflection and linear subspaces, NEC TR#2001-033, 2001.
46. Ward G.J. Measuring and modeling anisotropic reflection. SIGGRAPH 92 26 2 (1992) 265-272