A robust image alignment algorithm for video stabilization purposes

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 21, Issue 10, 2011, Pages 1390-1400

  Puglisi, Giovanni ^a   Battiato, Sebastiano ^a  

^a UNIVERSITY OF CATANIA   (Italy)

Author keywords

Block matching; image alignment; video stabilization

Indexed keywords

ALIGNMENT ALGORITHMS; BLOCK MATCHING; EMBEDDED DEVICE; GLOBAL MOTION; ILLUMINATION CHANGES; IMAGE ALIGNMENT; IMAGE ALIGNMENT ALGORITHM; LOCAL MOTIONS; MOVING OBJECTS; VIDEO STABILIZATION;

ALGORITHMS; ALIGNMENT; CELLULAR TELEPHONE SYSTEMS; DIGITAL DEVICES; IMAGE MATCHING; IMAGE RECORDING; MOBILE DEVICES; MOTION ESTIMATION; PERSONAL DIGITAL ASSISTANTS; STABILIZATION; VIDEO RECORDING;

COMPUTER GRAPHICS;

EID: 80053489828     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2011.2162689     Document Type: Article

References (41)

1. P.-M. Jodoin, J. Konrad, V. Saligrama, and V. Veilleux-Gaboury, "Motion detection with an unstable camera," in Proc. ICIP, Oct. 2008, pp. 229-232.
2. L. Mercenaro, G. Vernazza, and C. Regazzoni, "Image stabilization algorithms for video-surveillance application," in Proc. ICIP, 2001, pp. 349-352. (Pubitemid 33057433)
3. K.-Y. Lee, Y.-Y. Chuang, B.-Y. Chen, and M. Ouhyoung, "Video stabilization using robust feature trajectories," in Proc. IEEE Int. Conf. Comput. Vision, Sep.-Oct. 2009, pp. 1397-1404.
4. S. Battiato and R. Lukac, "Video stabilization techniques," in Encyclopedia of Multimedia. New York: Springer-Verlag, Oct. 2008, pp. 941-945.
5. S. Battiato, A. R. Bruna, and G. Puglisi, "A robust block based image/video registration approach for mobile imaging devices," IEEE Trans. Multimedia, vol. 12, no. 7, pp. 622-635, Nov. 2010.
6. S. W. Jang, M. Pomplun, G. Kim, and H. I. Choi, "Adaptive robust estimation of affine parameters from block motion vectors," Image Vision Comput., vol. 23, no. 14, pp. 1250-1263, Dec. 2005. (Pubitemid 41751077)
7. Y. Matsushita, E. Ofek, W. Ge, X. Tang, and H.-Y. Shum, "Full-frame video stabilization with motion inpainting," IEEE Trans. Patt. Anal. Mach. Intell., vol. 28, no. 7, pp. 1150-1163, Jul. 2006.
8. H. Chen, C.-K. Liang, Y.-C. Peng, and H.-A. Chang, "Integration of digital stabilizer with video codec for digital video cameras," IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 7, pp. 801-813, Jul. 2007. (Pubitemid 47159707)
9. S.-J. Ko, S.-H. Lee, and K.-H. Lee, "Digital image stabilizing algorithms based on bit-plane matching," IEEE Trans. Consum. Electron., vol. 44, no. 3, pp. 617-622, Aug. 1998. (Pubitemid 128743424)
10. S.-J. Ko, S.-H. Lee, S.-W. Jeon, and E.-S. Kang, "Fast digital image stabilizer based on gray-coded bit-plane matching," IEEE Trans. Consum. Electron., vol. 45, no. 3, pp. 598-603, Aug. 1999.
11. A. A. Yeni and S. Erturk, "Fast digital image stabilization using one bit transform based sub-image motion estimation," IEEE Trans. Consum. Electron., vol. 51, no. 3, pp. 917-921, Aug. 2005. (Pubitemid 41489930)
12. O. Urhan and S. Erturk, "Single sub-image matching based low complexity motion estimation for digital image stabilization using constrained one-bit transform," IEEE Trans. Consum. Electron., vol. 52, no. 4, pp. 1275-1279, Nov. 2006. (Pubitemid 46231639)
13. N.-J. Kim, H.-J. Lee, and J.-B. Lee, "Probabilistic global motion estimation based on Laplacian two-bit plane matching for fast digital image stabilization," EURASIP J. Adv. Signal Process., vol. 2008, no. 180582, pp. 1-10, 2008.
14. M. Hansen, P. Anandan, K. Dana, G. van der Wal, and P. Burt, "Realtime scene stabilization and mosaic construction," in Proc. IEEE WACV, Dec. 1994, pp. 54-62.
15. Z. Zhu, G. Xu, Y. Yang, and J. S. Jin, "Camera stabilization based on 2.5D motion estimation and inertial motion filtering," in Proc. IEEE Int. Conf. Intell. Vehicles, vol. 2. Oct. 1998, pp. 329-334.
16. A. Adams, N. Gelfand, and K. Pulli, "Viewfinder alignment," Comput. Graphics Forum, vol. 2, no. 27, pp. 597-606, 2008. (Pubitemid 351612873)
17. C. R. del Blanco, F. Jaureguizar, L. Salgado, and N. Garća, "Automatic feature-based stabilization of video with intentional motion through a particle filter," in Proc. ACIVS, LNCS 5259. 2008, pp. 356-367.
18. J. Yang, D. Schonfeld, and M. Mohamed, "Robust video stabilization based on particle filter tracking of projected camera motion," IEEE Trans. Circuits Syst. Video Technol., vol. 19, no. 7, pp. 945-954, Jul. 2009.
19. A. Bosco, A. Bruna, S. Battiato, G. Bella, and G. Puglisi, "Digital video stabilization through curve warping techniques," IEEE Trans. Consum. Electron., vol. 54, no. 2, pp. 220-224, May 2008.
20. S. Battiato, G. Gallo, G. Puglisi, and S. Scellato, "SIFT features tracking for video stabilization," in Proc. ICIAP, 2007, pp. 825-830.
21. S. Alliney and C. Morandi, "Digital image registration using projections," IEEE Trans. Patt. Anal. Mach. Intell., vol. 8, no. 2, pp. 222-233, Mar. 1986. (Pubitemid 16595424)
22. X. Q. Gao, C. J. Duanmu, and C. R. Zou, "A multilevel successive elimination algorithm for block matching motion estimation," IEEE Trans. Image Process., vol. 9, no. 3, pp. 501-504, Mar. 2000.
23. W. Li and E. Salari, "Successive elimination algorithm for motion estimation," IEEE Trans. Image Process., vol. 4, no. 1, pp. 105-107, Jan. 1995.
24. C. Zhu, W. S. Qi, and W. Ser, "Predictive fine granularity successive elimination for fast optimal blockmatching motion estimation," IEEE Trans. Image Process., vol. 14, no. 2, pp. 213-221, Feb. 2005. (Pubitemid 40181979)
25. T. Koga, K. Iinuma, A. Hirano, Y. Iijima, and T. Ishiguro, "Motion compensated interframe coding for video conferencing," in Proc. Nat. Telecommun. Conf., vol. 4. 1981, pp. G5.3.1-G5.3.5.
26. C. Zhu, X. Lin, and L. P. Chau, "Hexagon-based search pattern for fast block motion estimation," IEEE Trans. Circuits Syst. Video Technol., vol. 12, no. 5, pp. 349-355, May 2002. (Pubitemid 34725861)
27. S. Zhu and K.-K. Ma, "A new diamond search algorithm for fast blockmatching motion estimation," IEEE Trans. Image Process., vol. 9, no. 2, pp. 287-290, Feb. 2000. (Pubitemid 30557223)
28. Y. Koo and W. Kim, "An image resolution enhancing technique using adaptive sub-pixel interpolation for digital still camera system," IEEE Trans. Consum. Electron., vol. 45, no. 1, pp. 118-123, Feb. 1999.
29. A. J. Crawford, H. Denman, F. Kelly, F. Pitíe, and A. C. Kokaram, "Gradient based dominant motion estimation with integral projections for real time video stabilisation," in Proc. IEEE ICIP, Oct. 2004, pp. 3371-3374. (Pubitemid 40820797)
30. J. S. Kim and R. H. Park, "A fast feature-based block matching algorithm using integral projections," IEEE J. Select. Areas Commun., vol. 10, no. 5, pp. 968-971, Jun. 1992.
31. C. Tu, T. Tran, J. Prince, and P. Topiwala, "Projection-based block matching motion estimation," Proc. SPIE Applicat. Digital Image Process. XXIII, vol. 4115, pp. 374-384, Aug. 2000.
32. S. Tai and Y. Lin, "Fast full-search block-matching algorithm for motion-compensated video compression," in Proc. ICPR, 1996, pp. 914-918.
33. P. Viola and M. Jones, "Rapid object detection using a boosted cascade of simple features," in Proc. IEEE Comput. Soc. Conf. Comput. Vision Patt. Recog., Apr. 2001, pp. 511-518.
34. A. Oliva and A. Torralba, "Modeling the shape of the scene: A holistic representation of the spatial envelope," Int. J. Comput. Vision, vol. 42, no. 3, pp. 145-175, 2001. (Pubitemid 32680801)
35. W. H. Cho and K.-S. Hong, "Affine motion based CMOS distortion analysis and CMOS digital image stabilization," IEEE Trans. Consum. Electron., vol. 53, no. 3, pp. 833-841, Aug. 2007. (Pubitemid 47593346)
36. J. Lee, Y. Park, S. Lee, and J. Paik, "Statistical region selection for robust image stabilization using feature-histogram," in Proc. ICIP, Nov. 2009, pp. 1553-1556.
37. M. A. Fischler and R. C. Bolles, "Random sample consensus: A paradigm model fitting with applications to image analysis and automated cartography," Commun. ACM, vol. 24, no. 6, pp. 381-395, 1981.
38. P. J. Hube, Robust Statistical Procedures. New York: Society for Industrial and Applied Mathematics, 1996.
39. Y. Shen, P. Guturu, T. Damarla, B. Buckles, and K. Namuduri, "Video stabilization using principal component analysis and scale invariant feature transform in particle filter framework," IEEE Trans. Consum. Electron., vol. 55, no. 3, pp. 1714-1721, Aug. 2009.
40. M. Soto, S. Maludrottu, and C. S. Regazzoni, "Fast and correspondenceless camera motion estimation based on voting mechanism and morton codes," in Proc. IEEE ICIP, Sep. 2010, pp. 745-748.
41. S. Battiato, G. Puglisi, and A. R. Bruna, "Regular texture removal for video stabilization," in Proc. ICPR, Dec. 2008, pp. 1-4.