Matching-area-based seam carving for video retargeting

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 23, Issue 2, 2013, Pages 302-310

  Yan, Bo ^a   Sun, Kairan ^a   Liu, Liu ^a  

^a FUDAN UNIVERSITY   (China)

Author keywords

Energy adjustment; matching area; seam carving; video retargeting

Indexed keywords

ENERGY ADJUSTMENT; MATCHING AREA; SEAM CARVING; SPATIAL AND TEMPORAL COHERENCE; USER STUDY; VIDEO RETARGETING;

MEDIA STREAMING;

NETWORKS (CIRCUITS);

EID: 84873381623     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2012.2203740     Document Type: Article

References (32)

1. A. Shamir and O. Sorkine, "Visual media retargeting," in Proc. ACM SIGGRAPH ASIA 2009 Courses, 2009, p. 11.
2. L. Wolf, M. Guttmann, and D. Cohen-Or, "Non-homogeneous contentdriven video-retargeting," in Proc. IEEE 11th ICCV, Oct. 2007, pp. 1-6.
3. Y. Zhang, S. Hu, and R. Martin, "Shrinkability maps for content-aware video resizing," in Proc. Comput. Graph. Forum, vol. 27, no. 7, 2008, pp. 1797-1804.
4. T.-C. Yen, C.-M. Tsai, and C.-W. Lin, "Maintaining temporal coherence in video retargeting using mosaic-guided scaling," IEEE Trans. Image Process., vol. 20, no. 8, pp. 2339-2351, Aug. 2011.
5. Y. Wang, H. Fu, O. Sorkine, T. Lee, and H. Seidel, "Motion-aware temporal coherence for video resizing," ACM Trans. Graph. (TOG), vol. 28, no. 5, 2009, p. 127.
6. P. Kr̈ahenb̈uhl, M. Lang, A. Hornung, and M. Gross, "A system for retargeting of streaming video," ACM Trans. Graph. (TOG), vol. 28, no. 5, 2009, p. 126.
7. J.-S. Kim, J.-H. Kim, and C.-S. Kim, "Adaptive image and video retargeting technique based on fourier analysis," in Proc. IEEE Conf. Comput. Vision Pattern Recognit. (CVPR), Jun. 2009, pp. 1730-1737.
8. S.-F. Wang and S.-H. Lai, "Compressibility-aware media retargeting with structure preserving," IEEE Trans. Image Process., vol. 20, no. 3, pp. 855-865, Mar. 2011.
9. L. Shi, J. Wang, L. Duan, and H. Lu, "Consumer video retargeting: Context assisted spatial-temporal grid optimization," in Proc. 17th ACM Int. Conf. Multimedia, 2009, pp. 301-310.
10. M. Rubinstein, A. Shamir, and S. Avidan, "Improved seam carving for video retargeting," ACM Trans.Graph. (TOG), vol. 27, no. 3, pp. 1-9, 2008.
11. M. Grundmann, V. Kwatra, M. Han, and I. Essa, "Discontinuous seamcarving for video retargeting," in Proc. IEEE Conf. Comput. Vision Pattern Recognit. (CVPR), Jun. 2010, pp. 569-576.
12. C.-K. Chiang, S.-F. Wang, Y.-L. Chen, and S.-H. Lai, "Fast JND based video carving with GPU acceleration for real-time video retargeting," IEEE Trans. Circuits Syst. Video Technol., vol. 19, no. 11, pp. 1588-1597, Nov. 2009.
13. W.-L. Chao, H.-H. Su, S.-Y. Chien, W. Hsu, and J.-J. Ding, "Coarsetofine temporal optimization for video retargeting based on seam carving," in Proc. IEEE Int. Conf. Multimedia Expo (ICME), Jul. 2011, pp. 1-6.
14. T. Deselaers, P. Dreuw, and H. Ney, "Pan, zoom, scan-time-coherent, trained automatic video cropping," in Proc. IEEE Conf. CVPR, Jun. 2008, pp. 1-8.
15. X. Fan, X. Xie, H. Zhou, and W. Ma, "Looking into video frames on small displays," in Proc. 11th ACM Int. Conf. Multimedia, 2003, pp. 247-250.
16. F. Liu and M. Gleicher, "Video retargeting: Automating pan and scan," in Proc. 14th Ann. ACM Int. Conf. Multimedia, 2006, pp. 241-250.
17. S. Kopf, T. Haenselmann, D. Farin, and W. Effelsberg, "Automatic generation of summaries for the web," Storage Retrieval Image Video Databases, 2004, pp. 417-428.
18. S. Avidan and A. Shamir, "Seam carving for content-aware image resizing," ACM Trans. Graph. (TOG), vol. 26, no. 3, 2007, p. 10.
19. P. Felzenszwalb and D. Huttenlocher, "Efficient graph-based image segmentation," Int. J. Computer Vision, vol. 59, no. 2, pp. 167-181, 2004.
20. S. Khan and M. Shah, "Object based segmentation of video using color, motion and spatial information," in Proc. IEEE Conf. CVPR, vol. 2 Dec. 2001, pp. II-746-II-751.
21. S. Paris, "Edge-preserving smoothing and mean-shift segmentation of video streams," in Proc. Eur. Conf. Computer Vision (ECCV), 2008, pp. 460-473.
22. J. Wang, B. Thiesson, Y. Xu, and M. Cohen, "Image and video segmentation by anisotropic kernel mean shift," in Proc. Eur. Conf. Computer Vision (ECCV), 2004, pp. 238-249.
23. M. Rubinstein, A. Shamir, and S. Avidan, "Multi-operator media retargeting," ACM Trans. Graph. (TOG), vol. 28, no. 3, pp. 1-11, 2009.
24. B. Yan and M. Wang, "Adaptive distortion-based intra-rate estimation for H.264/AVC rate control," IEEE Signal Process. Lett., vol. 16, no. 3, pp. 145-148, Mar. 2009.
25. L. Itti, C. Koch, and E. Niebur, "A model of saliency-based visual attention for rapid scene analysis," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 11, pp. 1254-1259, Nov. 1998.
26. J. Li, Y. Tian, T. Huang, and W. Gao, "Multi-task rank learning for visual saliency estimation," IEEE Trans. Circuits Syst. Video Technol., vol. 21, no. 5, pp. 623-636, May 2011.
27. W. Kim, C. Jung, and C. Kim, "Spatiotemporal saliency detection and its applications in static and dynamic scenes," IEEE Trans. Circuits Syst. Video Technol., vol. 21, no. 4, pp. 446-456, Apr. 2011.
28. Y. Luo, J. Yuan, P. Xue, and Q. Tian, "Saliency density maximization for efficient visual objects discovery," IEEE Trans. Circuits Syst. Video Technol., vol. PP, no. 99, p. 1, Dec. 2011.
29. T. Liu, Z. Yuan, J. Sun, J. Wang, N. Zheng, X. Tang, and H.-Y. Shum, "Learning to detect a salient object," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 2, pp. 353-367, Feb. 2011.
30. Y. Ma and H. Zhang, "Contrast-based image attention analysis by using fuzzy growing," in Proc. 11th ACM Int. Conf. Multimedia, 2003, pp. 374-381.
31. Y. Wang, H. Lin, O. Sorkine, and T. Lee, "Motion-based video retargeting with optimized crop-and-warp," ACM Trans. Graph. (TOG), vol. 29, no. 4, p. 90, 2010.
32. H. David, The Method of Paired Comparisons, London: Griffin, 1963.