Extracting layers and analyzing their specular properties using epipolar-plane-image analysis

Computer Vision and Image Understanding

Volumn 97, Issue 1, 2005, Pages 51-85

  Criminisi, Antonio ^a   Kang, Sing Bing ^a   Swaminathan, Rahul ^b   Szeliski, Richard ^a   Anandan, P ^a  

^a MICROSOFT   (United States)

^b Och Spine at New York Presbyterian Hospitals   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EPIPOLAR PLANE IMAGE (EPI); HYBRID ALGORITHMS; PARTIAL VISIBILITY;

ALGORITHMS; COMPUTER VISION; DATA ACQUISITION; IMAGE COMPRESSION; IMAGE RECONSTRUCTION; IMAGE SEGMENTATION; MATHEMATICAL MODELS;

IMAGE ANALYSIS;

EID: 11144234565     PISSN: 10773142     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.cviu.2004.06.001     Document Type: Article

References (33)

1. R.K. Bajcsy, S.W. Lee, and A. Leonardis Detection of diffuse and specular interface reflections and inter-reflections by color image segmentation Int. J. Comput. Vision 17 3 1996 241 272
2. S. Baker, R. Szeliski, P. Anandan, A layered approach to stereo reconstruction, in: IEEE Comput. Soc. Conf. on Computer Vision and Pattern Recognition (CVPR'98), Santa Barbara, June 1998, pp. 434-441
3. A.F. Bobick, and S.S. Intille Large occlusion stereo Int. J. Comput. Vision 33 3 1999 181 200
4. R.C. Bolles, H.H. Baker, and D.H. Marimont Epipolar-plane image analysis: an approach to determining structure from motion Int. J. Comput. Vision 1 1987 7 55
5. J.W. Bruce, and P.J. Giblin Curves and Singularities 1984 Cambridge University Press Cambridge
6. D.G. Burkhard, and D.L. Shealy Flux density for ray propagation in geometrical optics J. Opt. Soc. Am. 63 3 1973 299 304
7. R.T. Collins, A space-sweep approach to true multi-image matching, in: IEEE Comput. Soc. Conf. on Computer Vision and Pattern Recognition (CVPR'96), San Francisco, California, June 1996, pp. 358-363
8. P. Dev, Segmentation processes in visual perception: A cooperative neural model. COINS Technical Report 74C-5, University of Massachusetts at Amherst, June 1974
9. S.J. Gortler, R. Grzeszczuk, R. Szeliski, M.F. Cohen, The Lumigraph, in: Computer Graphics Proceedings, Annual Conference Series, Proc. SIGGRAPH'96 (New Orleans), August 1996, ACM SIGGRAPH, pp. 43-54
10. W.R. Hamilton Theory of systems of rays Trans. Royal Irish Acad. 15 1828 69 174
11. R.I. Hartley, and A. Zisserman Multiple View Geometry 2000 Cambridge University Press Cambridge, UK
12. G.J. Klinker, S.A. Shafer, and T. Kanade The measurement of highlights in color images Int. J. Comput. Vision 2 1 1988 7 32
13. J.J. Koenderink, and A.J. van Doorn Geometrical modes as a general method to treat diffuse interreflections in radiometry J. Opt. Soc. Am. 73 6 1983 843 850
14. K.N. Kutulakos, S.M. Seitz, A theory of shape by space carving, in: Seventh Internat. Conf. on Computer Vision (ICCV'99), Kerkyra, Greece, September 1999, pp. 307-314
15. J. Lengyel, J. Snyder, Rendering with coherent layers, in: Computer Graphics Proceedings, Annual Conference Series, Proc. SIGGRAPH'97 (Los Angeles), August 1997, ACM SIGGRAPH, pp. 233-242
16. M. Levoy, P. Hanrahan, Light field rendering, in: Computer Graphics Proceedings, Annual Conference Series, Proc. SIGGRAPH'96 (New Orleans), August 1996. ACM SIGGRAPH, pp. 31-42
17. S. Lin, Y. Li, S.B. Kang, X. Tong, H.-Y. Shum, Simultaneous separation and depth recovery of specular reflections, in: Seventh Eur. Conf. on Computer Vision, Copenhagen, Denmark, 2002, part 3, pp. 210-224
18. D. Marr Vision: A Computational Investigation into the Human Representation and Processing of Visual Information 1982 W.H. Freeman San Francisco, CA
19. S.K. Nayar, K. Ikeuchi, and T. Kanade Surface reflection: physical and geometrical perspectives IEEE Trans. Pattern Anal. Mach. Intell. 13 7 1991 611 634
20. M. Okutomi, and T. Kanade A multiple baseline stereo IEEE Trans. Pattern Anal. Mach. Intell. 15 4 1993 353 363
21. M. Oren, and S. Nayar A theory of specular surface geometry Int. J. Comput. Vision 24 2 1997 105 124
22. S.M. Seitz, C.M. Dyer, Photorealistic scene reconstrcution by voxel coloring, in: IEEE Comput. Soc. Conf. on Computer Vision and Pattern Recognition (CVPR'97), San Juan, Puerto Rico, June 1997, pp. 1067-1073
23. J. Shade, S. Gortler, L.-W. He, R. Szeliski, Layered depth images, in: Computer Graphics (SIGGRAPH'98) Proceedings, Orlando, July 1998, ACM SIGGRAPH, pp. 231-242
24. J. Shade, D. Lischinski, D. Salesin, T. DeRose, J. Snyder, Hierarchical images caching for accelerated walkthroughs of complex environments, in: Computer Graphics (SIGGRAPH'96) Proceedings, Proc. SIGGRAPH'96 (New Orleans), August 1996, ACM SIGGRAPH, pp. 75-82
25. P.P. Sloan, M.F. Cohen, S.J. Gortler, Time critical Lumigraph rendering, in: Symposium on Interactive 3D Graphics, Providence, RI, USA, 1997, pp. 17-23
26. R. Swaminathan, M.D. Grossberg, S.K. Nayar, Caustics of catadioptric cameras, in: Proc. Internat. Conf. on Computer Vision, July 2001, pp. II: 2-9
27. R. Szeliski, S. Avidan, P. Anandan, Layer extraction from multiple images containing reflections and transparency, in: IEEE Comput. Soc. Conf. on Computer Vision and Pattern Recognition (CVPR'2000), volume 1, Hilton Head Island, June 2000, pp. 246-253
28. R. Szeliski, P. Golland, Stereo matching with transparency and matting, Int. J. Comput. Vision, 32(1) (1999) 45-61, Special Issue for Marr Prize papers
29. J. Torborg, J.T. Kajiya, Talisman: Commodity realtime 3D graphics for the PC, in: Computer Graphics Proceedings, Annual Conference Series, Proc. SIGGRAPH'96 (New Orleans), August 1996, ACM SIGGRAPH, pp. 353-363
30. P.H.S. Torr, R. Szeliski, P. Anandan, An integrated Bayesian approach to layer extraction from image sequences, in: Seventh Internat. Conf. on Computer Vision (ICCV'98), Kerkyra, Greece, September 1999, pp. 983-990
31. J.Y.A. Wang, and E.H. Adelson Representing moving images with layers IEEE Trans. Image Process. 3 5 1994 625 638
32. Y. Weiss, Deriving intrinsic images from image sequences, in: Proc. Intl. Conf. on Computer Vision, 2001, pp. II: 68-75
33. Y. Yang, A. Yuille, J. Lu, Local, global, and multilevel stereo matching, in: IEEE Comput. Soc. Conf. on Computer Vision and Pattern Recognition (CVPR'93), New York, June 1993, IEEE Computer Society, pp. 274-279