Point light source estimation from two images and its limits

International Journal of Computer Vision

Volumn 36, Issue 3, 2000, Pages 195-220

  Stauder, Jürgen ^a  

^a FCA UNESP   (Brazil)

Author keywords

[No Author keywords available]

Indexed keywords

ERROR ANALYSIS; IMAGE ANALYSIS; MAXIMUM LIKELIHOOD ESTIMATION; PARAMETER ESTIMATION; RANDOM PROCESSES;

CRAMER-RAO LOWER BOUND; ILLUMINATION ESTIMATION; POINT LIGHT SOURCE;

COMPUTER VISION;

EID: 0033729882     PISSN: 09205691     EISSN: None     Source Type: Journal    
DOI: 10.1023/A:1008177019313     Document Type: Article

References (90)

1. Arnspang, J. 1991. On the use of time varying shading and surface rim radiance. Pattern Recognition Letters, 12(4):203-210.
2. Becker, S. and Bove, V.M. 1994. Formulating a scene probability equation to differentiate the effects of shape and albedo on image brightness. TVOT Technical Report, MIT Media Laboratory, ftp://ftp.media.mit.edu/pub/Scene_ Prob_ Equation. ps.Z.
3. Bejanin, M., Huertas, A., Mediani, G., and Nevatia, R. 1994. Model validation for change detection. In 2nd Int'l IEEE Workshop on Applications of Computer Vision, Los Alamitos, USA, pp. 160-167.
4. Blohm, W. 1997. Lightness determination at curved surfaces with applications to dynamic range compression and model-based coding of facial images. IEEE Trans, on Image Processing, 6(8): 1129-1138.
5. Blondé, L., Buck, M., Galli, R., Niem, W., Paker, Y. Schmidt, W., and Thomas, G. 1996. A virtual studio for live broadcasting: The MONA LISA project. IEEE Multi Media, 3(2).
6. Bronstein, I.N. and Semendjajew, K.A. 1996. Teubner-Taschenbuch der Mathematik, Teubner, Leipzig.
7. Brunelli, R. 1997. Estimation of pose and illuminant direction for face processing. Image and Vision Computing, 15:741-748.
8. Chojnacki, W. and Brooks, M.J. 1994. Revisiting Pentland's estimator of light source direction. Journal of the Optical Society of America, Series A, 11(1): 118.
9. Daimler-Benz AG: 1992. Some results on modeling illumination effects in a videophone sequence. COST 211ter Simulation Subgroup, Turin, 30. September-1. October.
10. Deshpande, S.G. 1996. On tracking illuminant motion. Diploma Thesis, Indian Institute of Technology, Bombay, India.
11. Deshpande, S.G. and Chaudhuri, S. 1996. Recursive estimation of illuminant motion from flow field. In ICIP '96, Intl. Conference on Image Processing, Lausanne, Schwitzerland.
12. Deshpande, S.G. and Chaudhuri, S. 1998. Recursive estimation of illuminant motion from flow field and simultaneous recovery of shape. Computer Vision and Image Understanding, 72(1):10-20.
13. Drew, M.S. and Funt, B.V. 1990. Calculating surface reflectance using a single-bounce model of mutual reflection. In IEEE Conf. on Computer Vision, pp. 394-399.
14. Eisert, P. and Girod, B. 1996. Illumination compensated motion estimation for analysis synthesis coding. In B. Girod, H. Niemann, and H.-P. Seidel. 3D Image Analysis and Synthesis '96, Proceedings, 18-19. November Erlangen, Germany, pp. 61-66.
15. Forsyth, D. and Zissermann, A. 1989. Shape from shading in the light of mutual illumination. In Alvey Vision Conference, pp. 193-198.
16. Gilge, M. 1990. Motion estimation by scene adaptive block matching and illumination correction. Image Processing Algorithms and Techniques, SPIE Vol. 1224, pp. 355-366.
17. Grimsehl, E. 1988. Lehrbuch der Physik, Vol. 3: Optik. Teubner: Leipzig, Germany.
18. Hampson, F.J., Franich, R.E.H., Pesquet, J.C., and Biemond, J. 1996. Pel-recursive motion estimation in the presence of illumination variations. In Int'l Conf. of Image Processing, Lausanne, Switzerland, Vol. 1. pp. 101-104.
19. Haralick, R.M. and Shapiro, L.G. 1993. Computer and Robot Vision, Vol. II. Addison-Wesley.
20. Hashimoto, T., Kato, H., Sato, K., and Inokuchi, S. 1992. Recognition of material types and interreflection using color images. Systems and Computers in Japan, 23(12):1-12.
21. Ikeuchi, K., et al. 1999. Photometric modelling for mixed reality. In Mixed Reality, Merging Real and Virtual Worlds, Y. Otha and H. Tamura (Eds.). Springer Verlag: Berlin. ISBN 3-540-65623-5.
22. Irani, M., Rousso, B., and Peleg, A. 1994. Computing occluding and transparent motions. Int'l Journal of Computer Vision, 12(1): 5-16.
23. Iwahori, Y., Sugie, H., and Ishii, N. 1991. Photometric stereo under illumination from unknown zenith angles. Systems and Computers in Japan, 22(12):99-108.
24. Kanatani, K. 1996. Statistical Optimization for Geometric Computation. Elsevier Science: Amstersam, The Netherlands. ISBN 0-444-82427-8.
25. Klinker, G.J., Shafer, S.A., and Kanade, T. 1988. The measurement of highlights in color images. International Journal of Computer Vision, 2(7):7-32.
26. Klinker, G.J., Shafer, S.A., and Kanade, T. 1990. A Physical approach to color image understanding. International Journal of Computer Vision, 4(7):7-38.
27. Koch, R. 1993. Dynamic 3-D scene analysis through synthesis feedback control. IEEE Transactions on Pattern Recognition, 16(6):556-568.
28. Koller, D., Danilidis, K., and Nagel, H.-H. 1993. Model-Based object tracking in monocular image sequences of road traffic scenes. Int'l Journal of Computer Vision, 10(3):257-281.
29. Lambert, J.H. 1892. Lambert's Photometrie (Photometria sive de mensura de gratibus luminis, colorum et umbrae). Wilhelm Engelmann: Leipzig.
30. Langer, M.S. and Zucker, S.W. 1994. Shape from shading on a cloudy day. Journal of the Optical Society of America, 11(2):467-478.
31. Lee, K.M. and Kuo, C.-C.J. 1994. Shape from shading with perspective projection. CVGIP: Image Understanding, 59(2):202-212.
32. Lee, K.Y. and Pearson, D.E. 1991. Luminance compensation in model-based-prediction. In Picture Coding Symposium, Tokyo, Japan, pp. 275-276.
33. Lee, C.H. and Rosenfeld, A. 1989. Improved methods of estimating shape from shading using the light coordinate system. In Shape from Shading, B.K.P. Horn and M.J. Brooks (Eds.). MIT Press: Cambridge, pp. 323-347.
34. Manabe, Y., Sato, K., and Inokuchi, S. 1995. Detecting interreflection by using moving light. Trans. Inst. Electron. Inf. Commun. Eng. D-II, J78D-II(1):86-93.
35. Melsa, J.L. and Cohn, D.L. 1978. Decision and Estimation Theory, international student ed. McGraw-Hill: Tokyo.
36. Mendel, J.M. 1995. Lessons in Estimation Theory for Signal Processing, Communications and Control. Prentice Hall: Englewood Cliffs, New Jersey.
37. Meyberg, K. and Vachenhauer, P. 1993. Höhere Mathematik, Vol. 1. Springer: Berlin.
38. Moloney, C.R. and Dubois, E. 1991. Estimation of motion fields from image sequences with illumination variation. In ICASSP, Toronto, Canada, Vol. 4, pp. 2425-2428.
39. Mukawa, N. 1992a. Motion field estimation based on shading models. Systems and Computers in Japan, 23(12):66-74.
40. Mukawa, N. 1992b. Estimation of light source information from image sequence. Systems and Computers in Japan, 23(10):92-99.
41. Murase, H. 1991. Surface shape reconstruction of un undulating transparent object. In IEEE Int'l Conf. on Computer Vision and Pattern Recognition, pp. 313-317.
42. Murase, H. and Nayar, S.K. 1994. Illumination planning for object recognition using parametric eigenspaces. IEEE Trans. on Pattern Recognition and Machine Intelligence, 16(12):1219-1227.
43. Musmann, H.G., Hötter, M., and Ostermann, J. 1989. Object-oriented analysis-synthesis coding of moving images. Signal Processing: Image Communication, 1(2):117-137.
44. Nayar, S.K. and Bolle, R.M. 1996. Reflectance based object recognition. Int'l Journal of Computer Vision, 17(3):219-239.
45. Nayar, S.K., Ikeuchi, K., and Kanade, T. 1991. Surface reflection: Physical and geometrical perspectives. IEEE Transactions on Pattern Recognition and Machine Intelligence, 13(7):611-634.
46. Negahdaripour, S. and Yu, C.-H. 1993. A generalized brightness change model for computing optical flow. In Int'l Conf. on Computer Vision, Berlin, pp. 2-11.
47. Nicolas, H. and Labit, C. 1995. Motion and illumination variation estimation using a hierarchy of models: Application to image sequence coding. Journal of Visual Communication and Image Representation, 6(4):303-316.
48. Nicolas, H. and Motsch, J. 1997. Very low bitrate coding using hybrid synthetic/real images for multi-sites videoconference applications. In Proc. of Visual Communication and Image Processing Conference, San Jose, USA. SPIE Vol. 3024, pp. 1330-1341.
49. Nomura, A., Miike, H., and Koga, K. 1995. Determining motion fields under non-uniform illumination. Pattern Recognition Letters, 16(3):286-296.
50. Ono, E., Morishima, S., and Harashima, H. 1993. A model based shade estimation and reproduction schemes for rotational face. In Picture Coding Symposium, Lausanne, Switzerland, pp. 2.2.1-2.2.4.
51. Oppenheim, A.V. and Schafer, R.W. 1998. Discrete Time Signal Processing. Prentice-Hall.
52. Oren, M. and Nayar, S.K. 1995. Generalization of the Lambertian model and implications for machine vision. Int'l Journal of Computer Vision, 14(3):227-251.
53. Ostermann, J. 1994. Object-based analysis-synthesis coding (OBASC) based on the source model of moving rigid 3D objects. Signal Processing: Image Communication, 6(2): 143-161.
54. Papoulis, A. 1991. Probability, Random Variables, and Stochastic Processes. McGraw-Hill.
55. Pearson, D.E. 1990. Texture mapping in model-based image coding. Signal Processing: Image Communication, 2(4):377-395.
56. Pentland, A.P. 1982. Finding the illumination direction. Journal of the Optical Society of America, 72(4):448-455.
57. Pentland, A.P. 1990. Linear shape from shading. Int'l Journal of Computer Vision, 4(2):153-162.
58. Pentland, A.P. 1991. Photometric motion. IEEE Trans. on Pattern Analysis and Machine Intelligence, 13(9):879-890.
59. Phillips, P.J. and Vardi, Y. 1996. Efficient illumination normalization of facial images. Pattern Recognition Letters, 17(8):921-927.
60. Phong, B.-T. 1975. Illumination for computer generated pictures. Communications of the ACM, 18(6):311-317.
61. Pochec, P. and Wasson, W.D. 1991. On surface orientation detection in 3-D. Pattern Recognition Letters, 12(6):363-369.
62. Press, W.H., Teukolsky, S.A., Vetterling, W.T., and Flannery, B.P. 1992. Numerical Recipes in C. Cambridge University Press: Cambridge, USA.
63. Rashid, H.U. and Burger, P. 1992. Differential algorithm for the determination of shape from shading using a point light source. Image and Vision Computing, 10(2):119-127.
64. Scales, L.E. 1985. Introduction to Non-Linear Optimization. MacMillan: London.
65. Shafer, S.A. 1985. Shadows and Silhouettes in Computer Vision. Kluwer Academic Publishers: Dordrecht, Netherlands.
66. Sorenson, H.W. 1980. Parameter Estimation: Principles and Problems. Marcel Dekker: New York.
67. Stauder, J. 1995. Estimation of point light source parameters for object-based coding. Signal Processing: Image Communication, 7(4-6):355-379.
68. Stauder, J. 1999. Augmented reality with automatic illumination control incorporating ellipsoidal models. IEEE Trans, on Multi Media, 1(2):136-143.
69. Stauder, J. 1998. Illumination analysis for synthetic/natural hybrid image sequence generation. Int'l Conf. of Computer Graphics, Hannover, pp. 506-511.
70. Stauder, J. 1999. Schätzung der Szenenbeleuchtung aus Bewegtbildfolgen. Ph.D. Thesis, University of Hannover, Germany. Fortschritt-Berichte VDI, Series 10, No. 584. ISBN 3-18-358410-7.
71. Stewart, J. and Langer, M.S. 1997. Towards accurate recovery of shape from shading under diffuse lighting. IEEE Trans. on Pattern Analysis and Machine Intelligence, 19(9):1020-1025.
72. Torrance, K.E. and Sparrow, E.M. 1967. Theory for off-specular reflection from roughened surfaces. Journal of the Optical Society of America, 57(9):1105-1114.
73. Treves, P. and Konrad, J. 1994. Motion estimation and compensation under varying illumination. In IEEE International Conf. on Image Processing IPIC, Austin, Texas, USA, pp. 373-377.
74. Voinov, V.G. and Nikulin, M.S. 1989. Unbiased Estimators and their Applications. Kluwer Academic Publishers: Dordrecht, Netherlands.
75. Wang, K. and Kohno, R. 1996. Compression coding using an optical model for a pair of range and grey-scale images of 3D objects. IEICE Trans. on. Fundamentals, E79-A(9):1330-1337.
76. Watt, A. 1993. 3D Computer Graphics, 2nd ed. Addison-Wesley.
77. Wei, J. and Li, Z.-N. 1997. Motion compensation in color video with illumination variations. In Int'l Conf. on Image Processing (ICIP), Santa Barbara, USA, pp. 614-617.
78. Weng, J., Ahuja, N., and Huang, T.S. 1993. Optimal motion and structure estimation. IEEE Trans. on Pattern Recognition and Machine Intelligence, 15(9):864-884.
79. Wolff, L.B. and Boult, T.E. 1991. Constraint object features using a polarization reflectance model. IEEE Trans. on Pattern Recognition and Machine Intelligence, 13(7):635-657.
80. Wolff, L.B., Nayar, S.K., and Oren, M. 1988. Improved diffuse reflection models for computer vision. Int'l Journal of Computer Vision, 30(1):55-71.
81. Woodham, R.J. 1980. Photometric method for determining surface orientation from multiple images. Optical Engineering, 19(1):139-144.
82. Yang, Y. and Yuille, A. 1990. Sources from shading. In Int'l Conf. on Computer Vision, pp. 534-539.
83. Yi, S., Haralick, R.M., and Shapiro, L.G. 1995. Optimal sensor and light source positioning for machine vision. Computer Vision and Image Understanding (CVGIP), 61(1):122-137.
84. Young, G.-S. and Chellappa, R. 1992. Statistical analysis of inherent ambiguities in recovering 3-D motion from a noisy flow field. IEEE Transactions on Pattern Analysis and Machine Intelligence, 14(10):995-1013.
85. Yu, Y and Malik, J. 1998. Recovering photometric properties of architectural scenes from photographs. In SIGGRAPH'98 Conference Proceedings. Addison Wesley, pp. 207-218.
86. Zhang, R., Tsai, P.-S., and Shah, M. 1996. Photomotion. Computer Vision and Image Understanding, 63(2):221-231.
87. Zheng, Q. and Chellappa, R. 1991. Estimation of illuminant direction, albedo, and shape from shading. IEEE Trans. on Pattern Analysis and Machine Intelligence, 13(7):680-702.
88. Zheng, Q. and Chellappa, R. 1993. A computational vision approach to image registration. IEEE Trans. on Image Processing, 2(3):311-326.
89. Zheng, J.Y., Fukagawa, Y., and Abe, N. 1997. 3D surface estimation and model construction from specular motion in image sequences. IEEE Trans. on Pattern Analysis and Machine Intelligence, 19(5):513-520.
90. Zheng, J.Y., Kakinoki, H., Tanaka, K., and Abe, N. 1996. Computing 3D models of rotating objects from moving shading. In Int'l Conf. on Pattern Recognition ICPR'96, Wien, pp. 800-804.