Integration of digital stabilizer with video codec for digital video cameras

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 17, Issue 7, 2007, Pages 801-813

  Liang, Chia Kai ^a,b   Peng, Yu Chun ^b,c   Chang, Hung An ^d  

^a IEEE   (Taiwan)

^b NATIONAL TAIWAN UNIVERSITY   (Taiwan)

^c Novatek Microelectronics Corp Ltd   (Taiwan)

^d MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

Digital video camera; Digital video stabilization; Global motion estimation (ME); ME; Video coding

Indexed keywords

DIGITAL STABILIZATION; DIGITAL STABILIZERS; GLOBAL MOTION ESTIMATION (ME); MOTION VECTORS (MVS);

COMPUTATIONAL EFFICIENCY; IMAGE CODING; MOTION ESTIMATION; VIDEO CAMERAS;

DIGITAL CAMERAS;

EID: 34547450232     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2007.897113     Document Type: Article

References (36)

1. M. Oshima, T. Hayashi, S. Fujioka, T. Inaji, H. Mitani, J. Kajino, K. Ikeda, and K. Komoda, "VHS camcorder with electronic image stabilizer," IEEE Trans. Consum. Electron., vol. 35, no. 4, pp. 749-758, Nov. 1989.
2. K. Sato, S. Ishizuka, A. Nikami, and M. Sato, "Control techniques for optical image stabilizing system," IEEE Trans. Consum. Election., vol. 39, no. 3, pp. 461-466, Aug. 1993.
3. K. Uomori, A. Morimura, H. Ishii, T. Sakaguchi, and Y. Kitamura, "Automatic image stabilizing system by full-digital signal processing," IEEE Trans. Consum. Electron., vol. 36, no. 3, pp. 510-519, Aug. 1990.
4. J.-K. Paik, Y.-C. Park, and S.-W. Park, "An edge detection approach to digital image stabilization based on tri-state adaptive linear neurons," IEEE Trans. Consum. Election., vol. 37, no. 3, pp. 521-530, Aug. 1991.
5. J.-K. Paik, Y.-C. Park, and D.-W. Kim, "An adaptive motion decision system for digital image stabilizer based on edge pattern matching," IEEE Trans. Consum. Electron., vol. 38, no. 3, pp. 607-616, Aug. 1992.
6. Y. Egusa, H. Akahori, A. Morimura, and N. Wakami, "An application of fuzzy set theory for an electronic video camera image stabilizer," IEEE Trans. Fuzzy Syst., vol. 3, no. 3, pp. 351-356, Aug. 1995.
7. S.-J. Ko, S.-H. Lee, and K.-H. Lee, "Digital image stabilizing algorithms based on bit plane matching," IEEE Trans. Consum. Electron., vol. 44, no. 3, pp. 544-549, Aug. 1998.
8. S.-J. Ko, S.-H. Lee, and S.-W. Jeon, "Fast digital image stabilizer based on gray-coded bit plane matching," in Proc. Int. Conf. Consum. Electron., Los Angeles, CA, Jun. 1999, pp. 90-91.
9. G.-R. Chen, Y.-M. Yeh, S.-J. Wang, and H.-C. Chiang, "A novel structure for digital image stabilizer," in Proc. Asia-Pacific Conf. Circuits Syst., Dec. 2000, pp. 101-104.
10. H. R. Pourreza, M. Rahmati, and F. Behazin, "Weighted mutiple bit plane matching, a simple and efficient matching crierion for electronic digital image stabilizer application," in Proc. Int. Conf. Signal Process., Aug. 2002, vol. 2, pp. 957-960.
11. S. Ertürk, "Image sequence stabilisation by lowpass filtering of interframe motion," in Proc. SPIE, Vis. Commun. Image Process., 2001, vol. 4310, pp. 434-442.
12. S. Ertürk and T. J. Dennis, "Image sequence stabilisation based on DFT filtering," IEE Proc. Image Vis. Signal Process., vol. 127, pp. 95-102, 2000.
13. S. Ertürk and M. K. Gullu, "Membership function adaptive fuzzy filter for image sequence stabilization," IEEE Trans. Consum. Electron., vol. 50, no. 1, pp. 1-7, Feb. 2004.
14. S. Ertrük, "Real-time digital image stabilization using Kalman filters," Real-Time Imaging, vol. 8, pp. 317-328, 2002.
15. S.-C. Hsu, S.-F. Liang, and C.-T. Lin, "A robust digital image stabilization technique based on inverse triangle method and background detection," IEEE Trans. Comsum. Electron., vol. 51, no. 2, pp. 335-345, May 2005.
16. H. R. Pourreza, M. Rahmati, and F. Behazin, "An electronic digital image stabilizer based on stationary wavelet transform (SWT)," in Proc. Int. Conf. Image Process., Barceleon, Spain, Sep. 2003, vol. 2, pp. 383-386.
17. C. Morimoto and R. Chellappa, "Evaluation of image stabilization algorithms," in Proc. Int. Conf. Acoust., Speech, Signal Process., Seattle, WA, May 1998, vol. 5, pp. 2789-2792.
18. S. B. Balakirsky and R. Chellappa, "Performance characterization of image stabilization algorithms," in Proc. Int. Conf. Image Process., Sep. 1996, vol. 1, pp. 413-416.
19. A. Engelsberg and G. Schmidt, "A comparative review of digital image stabilising algorithms for mobile video communications," IEEE Trans. Consum. Electron., vol. 45, no. 3, pp. 591-597, Aug. 1999.
20. S. Ertürk, "Digital image stabilization with subimage phase correlation based global motion estimation," IEEE Trans. Consum. Electron., vol. 49, no. 4, pp. 1320-1325, Nov. 2003.
21. J.-Y. Chang, W.-F. Hu, M.-H. Cheng, and B.-S Chang, "Digital image translational and rotational motion stabilization using optical flow technique," IEEE Trans. Consum. Electron., vol. 48, no. 1, pp. 108-115, Feb. 2002.
22. A. Censi, A. Fusiello, and V. Roberto, "Image stabilization by feature tracking," in Proc. Int. Conf. Image Anal. Process., Venice, Italy, Sep. 1999, pp. 665-667.
23. A. J. Crawford, H. Denman, F. Kelly, F. Pitie, and A. C. Kokaram, "Gradient based dominant motion estimation with integral projections for real time video stabilization," in Proc. Int. Conf. Image Process., Singapore, Oct. 2004, vol. 5, pp. 3371-3374.
24. A. T. Erdem and C. Erdem, "Effect of image stabilization on the performance of the MPEG-2 video coding algorithm," in Proc. SPIE, Vis. Commun. Image. Process., 1998, vol. 3309, pp. 272-277.
25. Generic Coding of Audio-Visual Objects - Part 2 Visual, ISO/IEC 14496-2, 2001.
26. Advanced Video Coding, Draft ITU-T Recommendation H.264 and Final Draft International Standard of Joint Video Specification, 14496-10, May 2003.
27. S. Zhu and K.-K. Ma, "A new diamond search algorithm for fast block-matching motion estimation," IEEE Trans. Image Processing, vol. 9, no. 2, pp. 287-290, Feb. 2000.
28. A. Litvin, J. Konrad, and W. C. Karl, "Probabilistic video stabilization using Kalman filtering and mosaicing," in Proc. IS&T/SPIE Symp. Electron. Imaging, Image. Video Commun., 2003, pp. 663-674.
29. Y. Matsushita, E. Ofek, X. Tang, and H. Y. Shum, "Full-frame video stabilization," in Proc. Int. Conf. Comp. Vis. Pattern Recognit., San Diego, CA, Jun. 2005, vol. 1, pp. 50-57.
30. R. Coudray and B. Besserer, "Global motion estimation for MPEG-encoded streams," in Proc. Int. Conf. Image Process., Singapore, Oct. 2004. pp. 3411-3414.
31. Y. Su, M.-T. Sun, and V. Hsu, "Global motion estimation from coarsely sampled motion vector field and the applications," IEEE Trans. Circuits Syst. Video Technol., vol. 15, no. 2, pp. 232-242, Feb. 2005.
32. Y. Su, M.-T. Sun, and V. Hsu, "Global motion estimation from coarsely sampled motion vector field and the applications," in Proc. Int. Symp. Circuits Syst., May 2003, vol. 2, pp. 628-631.
33. Y.-C. Peng, H.-A. Chang, H. H. Chen, and C.-J. Kao, "Digital image stabilization and its integration with video encoder," in Proc. Consum. Commun. Netw. Conf., Las Vegas, NV, Jan. 2005, pp. 617-622.
34. C.-K. Liang, Y.-C. Peng, H.-A. Chang, C.-C. Su, and H. H. Chen, "The effect of digital image stabilization on coding performance," in Proc. Int. Symp. Intell. Multimedia, Video Speech Process., Hong Kong, Oct. 2004. pp. 402-405.
35. Y.-C. Peng, C.-K. Liang, H.-A. Chang, H. H. Chen, and C.-J Kao, "Integration of image stabilizer with video codec for digital video cameras," in Proc. Int. Symp. Circuits Syst., Kobe, Japan, May 2005, pp. 4781-4784.
36. Y.-C. Peng, M.-T. Lu, and H. H. Chen, "DSP implementation of digital image stabilizer," in Proc. Int. Conf. Multimedia Expo, Amsterdam, The Netherlands, Jul. 2005, pp. 808-811.