Motion-based video retargeting with optimized crop-and-warp

ACM SIGGRAPH 2010 Papers, SIGGRAPH 2010

Volumn , Issue , 2010, Pages

  Wang, Yu Shuen ^a,b   Lin, Hui Chih ^a   Sorkine, Olga ^b   Lee, Tong Yee ^a  

^a NATIONAL CHENG KUNG UNIVERSITY   (Taiwan)

^b NEW YORK UNIVERSITY   (United States)

Author keywords

Cropping; Optimization; Spatial and temporal coherence; Video retargeting; Warping

Indexed keywords

ASPECT RATIO; COMPUTER GRAPHICS; OPTIMIZATION; VIDEO SIGNAL PROCESSING;

ARBITRARY ASPECT RATIO; CROPPING; SPATIAL AND TEMPORAL COHERENCE; SPATIAL CONSIDERATIONS; TEMPORAL DIMENSIONS; VARIATIONAL OPTIMIZATION; VIDEO RETARGETING; WARPING;

INTERACTIVE COMPUTER GRAPHICS;

EID: 85026926010     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1778765.1778827     Document Type: Conference Paper

References (30)

1. AVIDAN, S., AND SHAMIR, A. 2007. Seam carving for contentaware image resizing. ACM Trans. Graph. 26, 3, 10.
2. BARNES, C., SHECHTMAN, E., FINKELSTEIN, A., AND GOLDMAN, D. B. 2009. PatchMatch: A randomized correspondence algorithm for structural image editing. ACM Trans. Graph. 28, 3.
3. BUATOIS, L., CAUMON, G., AND LÉVY, B. 2009. Concurrent number cruncher: a GPU implementation of a general sparse linear solver. Int. J. Parallel Emerg. Distrib. Syst. 24, 3, 205-223.
4. CHEN, L. Q., XIE, X., FAN, X., MA, W. Y., ZHANG, H. J., AND ZHOU, H. Q. 2003. A visual attention model for adapting images on small displays. ACM Multimedia Systems Journal 9, 4, 353-364.
5. CHO, T. S., BUTMAN, M., AVIDAN, S., AND FREEMAN, W. T. 2008. The patch transform and its applications to image editing. In CVPR'08.
6. DAVID, H. A. 1963. The Method of Paired Comparisons. Charles Griffin & Company.
7. DESELAERS, T., DREUW, P., AND NEY, H. 2008. Pan, zoom, scan: Time-coherent, trained automatic video cropping. In CVPR.
8. DONG, W., ZHOU, N., PAUL, J.-C., AND ZHANG, X. 2009. Optimized image resizing using seam carving and scaling. ACM Trans. Graph. 28, 5, 1-10.
9. FAN, X., XIE, X., ZHOU, H.-Q., AND MA, W.-Y. 2003. Looking into video frames on small displays. In Multimedia'03, 247-250.
10. GAL, R., SORKINE, O., AND COHEN-OR, D. 2006. Featureaware texturing. In EGSR'06, 297-303.
11. ITTI, L., KOCH, C., AND NIEBUR, E. 1998. A model of saliencybased visual attention for rapid scene analysis. IEEE Trans. Pattern Anal. Mach. Intell. 20, 11, 1254-1259.
12. KARNI, Z., FREEDMAN, D., AND GOTSMAN, C. 2009. Energybased image deformation. Comput. Graph. Forum 28, 5, 1257-1268.
13. KRÄHENBÜHL, P., LANG, M., HORNUNG, A., AND GROSS, M. 2009. A system for retargeting of streaming video. ACM Trans. Graph. 28, 5.
14. LIU, F., AND GLEICHER, M. 2006. Video retargeting: automating pan and scan. In Multimedia'06, 241-250.
15. LIU, H., XIE, X., MA, W.-Y., AND ZHANG, H.-J. 2003. Automatic browsing of large pictures on mobile devices. In Proceedings of ACM International Conference on Multimedia, 148-155.
16. PRITCH, Y., KAV-VENAKI, E., AND PELEG, S. 2009. Shift-map image editing. In ICCV'09.
17. RASHEED, Z., AND SHAH, M. 2003. Scene detection in Hollywood movies and TV shows. In CVPR'03, vol. 2, II-343-8.
18. RUBINSTEIN, M., SHAMIR, A., AND AVIDAN, S. 2008. Improved seam carving for video retargeting. ACM Trans. Graph. 27, 3.
19. RUBINSTEIN, M., SHAMIR, A., AND AVIDAN, S. 2009. Multioperator media retargeting. ACM Trans. Graph. 28, 3, 23.
20. SANTELLA, A., AGRAWALA, M., DECARLO, D., SALESIN, D., AND COHEN, M. 2006. Gaze-based interaction for semiautomatic photo cropping. In Proceedings of CHI, 771-780.
21. SHAMIR, A., AND SORKINE, O. 2009. Visual media retargeting. In ACM SIGGRAPH Asia Courses.
22. SIMAKOV, D., CASPI, Y., SHECHTMAN, E., AND IRANI, M. 2008. Summarizing visual data using bidirectional similarity. In CVPR'08.
23. SUH, B., LING, H., BEDERSON, B. B., AND JACOBS, D. W. 2003. Automatic thumbnail cropping and its effectiveness. In Proceedings of UIST, 95-104.
24. VIOLA, P., AND JONES, M. J. 2004. Robust real-time face detection. Int. J. Comput. Vision 57, 2, 137-154.
25. WANG, Y.-S., TAI, C.-L., SORKINE, O., AND LEE, T.-Y. 2008. Optimized scale-and-stretch for image resizing. ACM Trans. Graph. 27, 5, 118.
26. WANG, Y.-S., FU, H., SORKINE, O., LEE, T.-Y., AND SEIDEL, H.-P. 2009. Motion-aware temporal coherence for video resizing. ACM Trans. Graph. 28, 5.
27. WERLBERGER, M., TROBIN, W., POCK, T., WEDEL, A., CREMERS, D., AND BISCHOF, H. 2009. Anisotropic Huber-L1 optical flow. In Proceedings of the British Machine Vision Conference (BMVC).
28. WOLF, L., GUTTMANN, M., AND COHEN-OR, D. 2007. Nonhomogeneous content-driven video-retargeting. In ICCV'07.
29. ZHANG, Y.-F., HU, S.-M., AND MARTIN, R. R. 2008. Shrinkability maps for content-aware video resizing. In PG'08.
30. ZHANG, G.-X., CHENG, M.-M., HU, S.-M., AND MARTIN, R. R. 2009. A shape-preserving approach to image resizing. Computer Graphics Forum 28, 7, 1897-1906.