Stereo matching with transparency and matting

International Journal of Computer Vision

Volumn 32, Issue 1, 1999, Pages 54-61

  Szeliski, Richard ^a   Golland, Polina ^b  

^a MICROSOFT RESEARCH   (United States)

^b MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

IMAGE RECONSTRUCTION; ITERATIVE METHODS; MATHEMATICAL MODELS; OPACITY; OPTIMIZATION; PATTERN MATCHING; PROBLEM SOLVING; STEREO VISION; TRANSPARENCY;

ITERATIVE ENERGY MINIMIZATION; MATTING; MIXED PIXELS; STEREO MATCHING;

COMPUTER VISION;

EID: 0032597864     PISSN: 09205691     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (61)

1. Adelson, E.H. and Anandan, P. 1990. Ordinal characteristics of transparency. In AAAI-90 Workshop on Qualitative Vision, AAAI: Boston, MA, pp. 77-81.
2. Adelson, E.H. and Anandan, P. 1993. Perceptual organization and the judgement of brightness. Science, 262:2042-2044.
3. Arnold, R.D. 1983. Automated stereo perception. Technical Report AIM-351, Artificial Intelligence Laboratory, Stanford University.
4. Baker, H.H. 1980. Edge based stereo correlation. In Image Understanding Workshop, L.S. Baumann (Ed.), Science Applications International Corporation, pp. 168-175.
5. Baker, S., Szeliski, R., and Anandan, P. 1998. A layered approach to stereo reconstruction. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'98), Santa Barbara.
6. Barnard, S.T. 1989. Stochastic stereo matching over scale. International Journal of Computer Vision, 3(1): 17-32.
7. Barnard, S.T. and Fischler, M.A. 1982. Computational stereo. Computing Surveys, 14(4):553-572.
8. Belhumeur, P.N. and Mumford, D. 1992. A Bayesian treatment of the stereo correspondence problem using half-occluded regions. In Computer Vision and Pattern Recognition, Champaign-Urbana, Illinois, pp. 506-512.
9. Bergen, J.R., Burt, P.J., Hingorani, R., and Peleg, S. 1992. A three-frame algorithm for estimating two-component image motion. IEEE Transactions on Pattern Analysis and Machine Intelligence, 14(9):886-896.
10. Blinn, J.F. 1994a. Jim Blinn's corner: Compositing, part 1: Theory. IEEE Computer Graphics and Applications, 14(5):83-87.
11. Blinn, J.F. 1994b. Jim Blinn's corner: Compositing, part2: Practice. IEEE Computer Graphics and Applications, 14(6):78-82.
12. Blonde, L. et al. 1996. A virtual studio for live broadcasting: The Mona Lisa project. IEEE Multimedia, 3(2): 18-29.
13. Bolles, R.C., Baker, H.H., and Marimont, D.H. 1987. Epipolar-plane image analysis: An approach to determining structure from motion. International Journal of Computer Vision, 1:7-55.
14. Collins, R.T. 1996. A space-sweep approach to true multi-image matching. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'96), San Francisco, California, pp. 358-363.
15. Cox, I.J. 1994. A maximum likelihood n-camera stereo algorithm. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'94), IEEE Computer Society: Seattle, Washington, pp. 733-739.
16. Darrell, T. and Pentland, A. 1991. Robust estimation of a multi-layered motion representation. In IEEE Workshop on Visual Motion, IEEE Computer Society Press: Princeton, New Jersey, pp. 173-178.
17. Dhond, U.R. and Aggarwal, J.K. 1989. Structure from stereo - A review. IEEE Transactions on Systems, Man, and Cybernetics, 19(6):1489-1510.
18. Fua, P. 1993. A parallel stereo algorithm that produces dense depth maps and preserves image features. Machine Vision and Applications, 6:35-49.
19. Geiger, D., Ladendorf, B., and Yuille, A. 1992. Occlusions and binocular stereo. In Second European Conference on Computer Vision (ECCV'92), Springer-Verlag: Santa Margherita Liguere, Italy, pp. 425-433.
20. Golland, P. and Bruckstein, A. 1995. Motion from color. Technical Report 9513, IS Lab, CS Department, Technion, Haifa, Israel.
21. Gortler, S.J., Grzeszczuk, R., Szeliski, R., and Cohen, M.F. 1996. The lumigraph. In Computer Graphics Proceedings, Annual Conference Series, ACM SIGGRAPH, Proc. SIGGRAPH'96 (New Orleans), pp. 43-54.
22. Huber, P.J. 1981. Robust Statistics. John Wiley & Sons: New York.
23. Intille, S.S. and Bobick, A.F. 1994. Disparity-space images and large occlusion stereo. In Proc. Third European Conference on Computer Vision (ECCV'94), Springer-Verlag: Stockholm, Sweden.
24. Jenkin, M.R.M., Jepson, A.D., and Tsotsos, J.K. 1991. Techniques for disparity measurement. CVGIP: Image Understanding, 53(1):14-30.
25. Jones, D.G. and Malik, J. 1992. A computational framework for determining stereo correspondence from a set of linear spatial filters. In Second European Conference on Computer Vision (ECCV'92), Springer-Verlag: Santa Margherita Liguere, Italy, pp. 397-410.
26. Ju, S.X., Black, M.J., and Jepson, A.D. 1996. Skin and bones: Multi-layer, locally affine, optical flow and regularization with transparency. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'96), San Francisco, California, pp. 307-314.
27. Kanade, T. and Okutomi, M. 1994. A stereo matching algorithm with an adaptive window: Theory and experiment. IEEE Transactions on Pattern Analysis and Machine Intelligence, 16(9):920-932.
28. Kanade, T., Yoshida, A., Oda, K., Kano, H., and Tanaka, M. 1996. A stereo machine for video-rate dense depth mapping and its new applications. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'96), San Francisco, California, pp. 196-202.
29. Kang, S.B., Webb, J., Zitnick, L., and Kanade, T. 1995. A multi-baseline stereo system with active illumination and real-time image acquisition. In Fifth International Conference on Computer Vision (ICCV'95), Cambridge, Massachusetts, pp. 88-93.
30. Lacroute, P. and Levoy, M. 1994. Fast volume rendering using a shear-warp factorization of the viewing transformation. Computer Graphics (SIGGRAPH'94), 451-457.
31. Levoy, M. 1990. Efficient ray tracing of volume data. ACM Transactions on Graphics, 9(3):245-261.
32. Lucas, B.D. and Kanade, T. 1981. An iterative image registration technique with an application in stereo vision. In Seventh International Joint Conference on Artificial Intelligence (IJCAI-81), Vancouver, pp. 674-679.
33. Marr, D. and Poggio, T. 1976. Cooperative computation of stereo disparity. Science, 194:283-287.
34. Matthies, L.H., Szeliski, R., and Kanade, T. 1989. Kalman filter-based algorithms for estimating depth from image sequences. International Journal of Computer Vision, 3:209-236.
35. McMillan, L. and Bishop, G. 1995. Plenoptic modeling: An image-based rendering system. Computer Graphics (SIGGRAPH'95), 39-46.
36. Mitsunaga, T., Yokoyama, T., and Totsuka, T. 1995. Autokey: Human assisted key extraction. In Computer Graphics Proceedings, Annual Conference Series, ACM SIGGRAPH, Proc. SIGGRAPH'95 (Los Angeles), pp. 265-272.
37. Ohta, Y. and Kanade, T. 1985. Stereo by intra- and inter-scanline search using dynamic programming. IEEE Transactions on Pattern Analysis and Machine Intelligence, PAMI-7(2):139-154.
38. Okutomi, M. and Kanade, T. 1993. A multiple baseline stereo. IEEE Transactions on Pattern Analysis and Machine Intelligence, 15(4):353-363.
39. Paker, Y. and Wilbur, S. (Eds.) 1994. Image Processing for Broadcast and Video Production, Hamburg, 1994, Springer, Hamburg. Proceedings of the European Workshop on Combined Real and Synthetic Image Processing for Broadcast and Video Production, Hamburg, 23-24 November, 1994.
40. Pollard, S.B., Mayhew, J.E.W., and Frisby, J.P. 1985. PMF: A stereo correspondence algorithm using a disparity gradient limit. Perception, 14:449-470.
41. Porter, T. and Duff, T. 1984. Compositing digital images. Computer Graphics (SIGGRAPH'84), 18(3):253-259.
42. Prazdny, K. 1985. Detection of binocular disparities. Biological Cybernetics, 52:93-99.
43. Press, W.H., Flannery, B.P., Teukolsky, S.A., and Vetterling, W.T. 1992. Numerical Recipes in C: The Art of Scientific Computing, Cambridge University Press: Cambridge, England.
44. Ryan, T.W., Gray, R.T., and Hunt, B.R. 1980. Prediction of correlation errors in stereo-pair images. Optical Engineering, 19(3):312-322.
45. Sawhney, H.S. and Ayer, S. 1996. Compact representation of videos through dominant multiple motion estimation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 18(8):814-830.
46. Scharstein, D. and Szeliski, R. 1996. Stereo matching with non-linear diffusion. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'96), San Francisco, California, pp. 343-350.
47. Seitz, S.M. and Dyer, C.M. 1997. Photorealistic scene reconstrcution by space coloring. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'97), San Juan, Puerto Rico, pp. 1067-1073.
48. Shade, J., Gortler, S., He, L.-W., and Szeliski, R. 1998. Layered depth images. In Computer Graphics (SIGGRAPH'98) Proceedings, ACM SIGGRAPH, Orlando.
49. Shizawa, M. and Mase, K. 1991a. Principle of superposition: A common computational framework for analysis of multiple motion. In IEEE Workshop on Visual Motion, IEEE Computer Society Press: Princeton, New Jersey, pp. 164-172.
50. Shizawa, M. and Mase, K. 1991b. A unified computational theory of motion transparency and motion boundaries based on eigenenergy analysis. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'91), IEEE Computer Society Press: Maui, Hawaii, pp. 289-295.
51. Smith, A.R. and Blinn, J.F. 1996. Blue screen matting. In Computer Graphics Proceedings, Annual Conference Series, ACM SIGGRAPH, Proc. SIGGRAPH'96 (New Orleans), pp. 259-268.
52. Szeliski, R. and Hinton, G. 1985. Solving random-dot stereograms using the heat equation. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'85), IEEE Computer Society Press: San Francisco, California, pp. 284-288.
53. Szeliski, R. and Kang, S.B. 1995. Direct methods for visual scene reconstruction. In IEEE Workshop on Representations of Visual Scenes, Cambridge, Massachusetts, pp. 26-33.
54. Tian, Q. and Huhns, M.N. 1986. Algorithms for subpixel registration. Computer Vision, Graphics, and Image Processing, 35:220-233.
55. Vlahos, P. and Taylor, B. 1993. Traveling matte composite photography. In American Cinematographer Manual, American Society of Cinematographers, Hollywood, pp. 430-445.
56. Wang, J.Y.A. and Adelson, E.H. 1993. Layered representation for motion analysis. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'93), New York, pp. 361-366.
57. Weinshall, D. 1989. Perception of multiple transparent planes in stereo vision. Nature, 341:737-739.
58. Weiss, Y. and Adelson, E.H. 1996. A unified mixture framework for motion segmentation: Incorporating spatial coherence and estimating the number of models. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'96), San Francisco, California, pp. 321-326.
59. Wood, G.A. 1983. Realities of automatic correlation problems. Photogrammetric Engineering and Remote Sensing, 49(4):537-538.
60. Yang, Y, Yuille, A., and Lu, J. 1993. Local, global, and multilevel stereo matching. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'93), IEEE Computer Society: New York, pp. 274-279.
61. Yuille, A.L. and Poggio, T. 1984. A generalized ordering constraint for stereo correspondence. A.I. Memo 777, Artificial Intelligence Laboratory, Massachusetts Institute of Technology.