Video stabilization based on a 3D perspective camera model

Visual Computer

Volumn 25, Issue 11, 2009, Pages 997-1008

  Zhang, Guofeng ^a   Hua, Wei ^a   Qin, Xueying ^a,b   Shao, Yuanlong ^a   Bao, Hujun ^a  

^a ZHEJIANG UNIVERSITY   (China)

^b SHANDONG UNIVERSITY   (China)

Author keywords

Optimization; Structure from motion; Video stabilization; View warping; Warping error

Indexed keywords

CAMERA MODEL; DEPTH VARIATION; GEOMETRY REPRESENTATION; OPTIMIZATION PROCESS; PLANAR STRUCTURE; QUADRATIC COST FUNCTIONS; SIMPLIFIED MODELS; SPARSE LINEAR SYSTEMS; STABILIZATION PROBLEMS; STABILIZATION SYSTEMS; STRUCTURE FROM MOTION; VIDEO SEQUENCES; VIDEO STABILIZATION; VIEW WARPING; WARPING ERROR;

CAMERAS; EQUATIONS OF MOTION; LINEAR SYSTEMS; STABILIZATION; STRUCTURAL OPTIMIZATION; VIDEO RECORDING; WEAVING;

THREE DIMENSIONAL;

EID: 70349847621     PISSN: 01782789     EISSN: None     Source Type: Journal    
DOI: 10.1007/s00371-009-0310-z     Document Type: Article

References (27)

1. 2d3: http://www.2d3.com
2. Barrett, R., Berry, M., Chan, T.F., Demmel, J., Donato, J., Dongarra, J., Eijkhout, V., Pozo, R., Romine, C., der Vorst, H.V.: Templates for the Solution of Linear Systems: Building Blocks for Iterative Methods, 2nd edn. SIAM, Philadelphia (1994)
3. Bhat, P., Zitnick, C.L., Snavely, N., Agarwala, A., Agrawala, M., Curless, B., Cohen, M., Kang, S.B.: Using photographs to enhance videos of a static scene. In: Kautz, J., Pattanaik, S. (eds.) Rendering Techniques 2007, Proceedings Eurographics Symposium on Rendering, pp. 327-338. Eurographics (2007)
4. Buehler, C., Bosse, M., McMillan, L.: Non-metric image-based rendering for video stabilization. In: CVPR, pp. 609-614 (2001)
5. Davis, L.S., Bajcsy, R., Herman, M.: RSTA on the move. In: Proceedings of the ARPA Image Understanding Workshop, pp. 435-456 (1994)
6. Fischler, M.A., Bolles, R.C.: Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography. In: CommACM, vol. 24, p. 381-395 (1981)
7. Fitzgibbon, A., Zisserman, A.: Automatic camera tracking. In: Shah, M., Kumar, R. (eds.) Video Registration, pp. 18-35. Kluwer, Dordrecht (2003)
8. Hansen, M., Anadan, P., Dana, K., van de Wal, G., Burt, P.: Realtime scene stabilization and mosaic construction. In: Proc. IEEE Image Understanding Workshop, pp. 457-463 (1994)
9. Hartley, R., Zisserman, A.: Multiple View Geometry in Computer Vision. Cambridge University Press, Cambridge (2000)
10. Litvin, A., Konrad, J., Karl, W.: Probabilistic video stabilization using Kalman filtering and mosaicking. In: IS&T/SPIE Symposium on Electronic Imaging, Image and Video Communications, pp. 663-674 (2003)
11. D.G. Lowe 2004 Distinctive image features from scale-invariant keypoints Int. J. Comput. Vis. 60 2 91 110 10.1023/B:VISI.0000029664.99615.94
12. Mark, W.R., McMillan, L., Bishop, G.: Post-rendering 3D warping. In: SI3D, pp. 7-16, 180 (1997)
13. Matsushita, Y., Ofek, E., Tang, X., Shum, H.Y.: Full-frame video stabilization. In: CVPR (1), pp. 50-57 (2005)
14. Morimoto, C., Chellappa, R.: Fast 3D stabilization and mosaic construction. In: CVPR, pp. 660-665 (1997)
15. Morimoto, C., Chellappa, R.: Evaluation of image stabilization algorithms. In: International Conference on Acoustics, Speech and Signal Processing, vol. 5, pp. 2789-2792 (1998)
16. D. Nistér 2005 Preemptive ransac for live structure and motion estimation Mach. Vis. Appl. 16 5 321 329 10.1007/s00138-005-0006-y
17. Pilu, M.: Video stabilization as a variational problem and numerical solution with the Viterbi method. In: CVPR (1), pp. 625-630 (2004)
18. M. Pollefeys L.J.V. Gool M. Vergauwen F. Verbiest K. Cornelis J. Tops R. Koch 2004 Visual modeling with a hand-held camera Int. J. Comput. Vis. 59 3 207 232 10.1023/B:VISI.0000025798.50602.3a
19. REALVIZ: http://www.realviz.com
20. Shade, J., Gortler, S.J., wei He, L., Szeliski, R.: Layered depth images. In: SIGGRAPH, pp. 231-242 (1998)
21. N. Snavely S.M. Seitz R. Szeliski 2006 Photo-tourism: exploring photo-collections in 3D ACM Trans. Graph. 25 3 835 846 10.1145/1141911.1141964 (Pubitemid 44481045)
22. TAUCS: http://www.tau.ac.il/~stoledo/taucs/
23. Triggs, B., McLauchlan, P.F., Hartley, R.I., Fitzgibbon, A.W.: Bundle adjustment-a modern synthesis. In: Workshop on Vision Algorithms, pp. 298-372 (1999)
24. Yao, Y., Burlina, P., Chellappa, R., Wu, T.: Electronic image stabilization using multiple visual cues. In: Proceedings of International Conference on Image Processing, pp. 191-194 (1995)
25. Zhang, G., Qin, X., Hua, W., Wong, T.T., Heng, P.A., Bao, H.: Robust metric reconstruction from challenging video sequences. In: CVPR (2007)
26. Z. Zhang 1998 Determining the epipolar geometry and its uncertainty: A review Int. J. Comput. Vis. 27 2 161 195 10.1023/A:1007941100561
27. Zhu, Z., Xu, G., Yang, Y., Jin, J.S.: Camera stabilization based on 2.5D motion model estimation and inertial motion filtering. In: IEEE Conference on Intelligent Vehicles, pp. 329-334 (1998)