LAMP: 3D layered, adaptive-resolution, and multi-perspective panorama - A new scene representation

Computer Vision and Image Understanding

Volumn 96, Issue 3 SPEC. ISS., 2004, Pages 294-326

  Zhu, Zhigang ^a   Hanson, Allen R ^b  

^a City University of New York   (United States)

^b Biologically Inspired Neural and Dynamical Systems Laboratory   (United States)

Author keywords

Epipolar plane image; Image based modeling and rendering; Layered representation; Multi image processing; Multi resolution; Spatio temporal image

Indexed keywords

CAMERAS; COMPUTER VISION; LIGHT MODULATION; MATHEMATICAL MODELS; OPTICAL RESOLVING POWER; THREE DIMENSIONAL COMPUTER GRAPHICS;

EPIPOLAR PLANE IMAGE; IMAGE-BASED MODELING AND RENDERING; LAYERED REPRESENTATION; MULTI-IMAGE PROCESSING; MULTI-PERSPECTIVE PANORAMA (LAMP); MULTI-RESOLUTION; SPATIO-TEMPORAL IMAGE ANALYSIS;

IMAGE PROCESSING;

EID: 7444230480     PISSN: 10773142     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.cviu.2004.03.011     Document Type: Article

References (27)

1. S.E. Chen, QuickTime VR - an image based approach to virtual environment navigation, in: Proceedings of SIGGRAPH'95, 1995, pp. 29-38.
2. H.-Y. Shum, R. Szeliski, Construction of panoramic mosaics with global and local alignment, Int. J. Comput. Vision 36 (2) (2000) 101-130.
3. H.S. Sawhney, R. Kumar, G. Gendel, J. Bergen, D. Dixon, V. Paragano, VideoBrush™: experiences with consumer video mosaicing, in: Proceedings of Workshop on Applications of Computer Vision (WACV98), 1998, pp. 56-62.
4. H. Ishiguro, M. Yamamoto, S. Tsuji, Omni-directional stereo for making global map, in: Proceedings of Computer Vision and Patten Recognition (CVPR'90), 1990, pp. 540-547.
5. S. Peleg, M. Ben-Ezra, Y. Pritch, OmniStereo: panoramic stereo imaging, IEEE Trans. Pattern Anal. Mach. Intell. (2001) 279-290.
6. H.-Y. Shum, R. Szeliski, Stereo reconstruction from multiperspective panoramas, in: Proceedings of IEEE Conference on Computer Vision (ICCV'99), 1999, pp. 14-21.
7. J.Y. Zheng, S. Tsuji, S Panoramic representation for route recognition by a mobile robot, Int. J. Comput. Vision 9 (1) (1992) 55-76.
8. S. Peleg, B. Rousso, A. Rav-Akha, A. Zomet, Mosaicing on adaptive manifolds, IEEE Trans. Pattern Recogn. Mach. Anal. 22 (10) (2000) 1144-1154.
9. P. Rademacher, G. Bishop, Multiple-center-of-projection images, in: Proceedings of SIGGRAPH'98, 1998, pp. 199-206.
10. J. Wang, E.H. Adelson, Representation moving images with layers, IEEE Trans. Image Process. 3 (5) (1994) 625-638.
11. H.S. Sawhney, S. Ayer, Compact representation of videos through dominant and multiple motion estimation, IEEE Trans. Pattern Anal. Mach. Intell. 18 (8) (1996) 814-830.
12. S. Baker, R. Szeliski, P. Anandan, A layered approach to stereo reconstruction, in: Proceedings of Computer Vision and Patten Recognition (CVPR'98), 1998, pp. 434-441.
13. J. Shade, S. Gortler, L. He, R. Szeliski, Layered depth image, in: Proceedings of SIGGRAPH'98, 1998, pp. 231-242
14. R.C. Bolles, H.H. Baker, D.H. Marimont, Epipolar-plane image analysis: an approach to determining structure from motion, Int J. Comput. Vision 1 (1) (1987) 7-55.
15. Z. Zhu, G. Xu, X. Lin, Panoramic EPI generation and analysis of video from a moving platform with vibration, in: Proceedings of Computer Vision and Patten Recognition (CVPR'99), 1999, pp. 531-537.
16. Z. Zhu, E.M. Riseman, A.R. Hanson, Parallel-perspective stereo mosaics, in: Proceedings of the IEEE International Conference on Computer Vision, Vancouver, Canada, July 9-12, 2001, vol I, pp. 345-352.
17. N.L. Chang, A. Zakhor, View generation for three-dimensional scene from video sequence, IEEE Trans. Image Process. 6 (4) (1997) 584-598.
18. R. Szeliski, A multi-view approach to motion and stereo, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR'99), 1999, pp. 157-163.
19. Z. Zhu, A.R. Hanson, 3D LAMP: a new layered panoramic representation, in: Proceedings of the IEEE International Conference on Computer Vision, Vancouver, Canada, July 9-12, 2001, vol II, pp. 723-730.
20. Z. Zhu, 3D LAMP: Layered Representation for Image-based Rendering, URL for the project: http://www-cs.engr.ccny.cuny.edu/~zhu/panorama3D.html URL for a movie: http://www-cs.engr.ccny.cu-ny.edu/~zhu/fg3dLAMP4M.mpg.
21. Z. Zhu, Full View spatio-temporal Visual Navigation - Imaging, Modeling and Representation of Real Scenes, China Higher Education Press, December 2001, First Hundred National Excellent Doctorate Dissertations Series (Based on his Ph.D. Thesis), Department of Computer Science and Technology, Tsinghua University, 1997. English Version may be found at http://www-cs.engr.ccny.-cuny.edu/~zhu/PhD-Thesis.
22. Q. Ke, T. Kanade, A subspace approach to layer extraction, in: Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition (CVPR 2001), Hawaii, Dec. 2001.
23. P.H.S. Torr, R. Szeliski, P. Anandan, An integrated Bayesian approach to layer extraction from image sequences, IEEE Trans. Pattern Anal. Mach. Intell. 23 (3) (2001) 297-303.
24. B. Rousso, S. Peleg, I. Finci, A. Rav-Acha, Universal mosaicing using pipe projection, in: Proceedings of the IEEE International Conference on Computer Vision (ICCV'98), Bombay, January 1998, pp. 945-952.
25. M.J. Black, A.D. Jepson, Estimating optical flow in segmented images using variable-order parametric models with local deformations, IEEE Trans. Pattern Anal. Mach. Intell. 18 (10) (1996) 972-986.
26. N.L. Chang, A. Zakhor, Constructing a multivalued representation for view synthesis, Int. J. Comput. Vision 45 (2) (2001) 157-190.
27. Z. Zhu, E.M. Riseman, A.R. Hanson, Generalized parallel-perspective stereo mosaics from airborne videos, IEEE Trans. Pattern Anal. Mach. Intell. 26 (2) (2004) 226-237.