Video adaptation for small display based on content recomposition

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 17, Issue 1, 2007, Pages 43-58

  Cheng, Wen Huang ^a,b   Wang, Chia Wei ^b   Wu, Ja Ling ^a,b  

^a IEEE   (Taiwan)

^b NATIONAL TAIWAN UNIVERSITY   (Taiwan)

Author keywords

Content recomposition; Media aesthetics; Region of interest; Video adaptation; Visual attention model

Indexed keywords

CONTENT RECOMPOSITION; MEDIA AESTHETICS; REGION OF INTEREST; VIDEO ADAPTATION; VISUAL ATTENTION MODEL;

MATHEMATICAL MODELS; VIDEO ON DEMAND;

DISPLAY DEVICES;

EID: 33846321817     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2006.885717     Document Type: Article

References (52)

1. F. Pereira and I. Burnett, "Universal multimedia experience for tomorrow," IEEE Signal Process. Mag., vol. 20, no. 2, pp. 63-73, Mar. 2003.
2. R. Mohan, J. R. Smith, and C.-S Li, "Adapting multimedia internet content for universal access," IEEE Trans. Multimedia, vol. 1, no. 1, pp. 104-114, Mar. 1999.
3. J. Bormans, J. Gelissen, and A. Perkis, "MPEG-21: The 21st century multimedia framework," IEEE Signal Process. Mag., vol. 20, no. 2, pp. 53-62, Mar. 2003.
4. S.-F. Chang and A. Vetro, "Video adaptation: Concepts, technologies, and open issues," Proc. IEEE, vol. 93, no. 1, pp. 148-158, Jan. 2005.
5. K. Lee, H.-S. Chang, S.-S. Chun, H. Choi, and S. Sull, "Perception-based image transcoding for universal multimedia access," in Proc. 8th Int. Conf. Image Process. (ICIP'01), 2001, vol. 2, pp. 475-478.
6. L.-Q. Chen, X. Xie, X. Fan, W.-Y. Ma, H.-J. Zhang, and H.-Q. Zhou, "A visual attention model for adapting images on small displays," Multimedia Syst., vol. 9, no. 4, pp. 353-364, Oct. 2003.
7. I. Ahmad, X. Wei, Y. Sun, and Y.-Q. Zhang, "Video transcoding: an overview of various techniques and research issues," IEEE Trans. Multimedia, vol. 7, no. 5, pp. 793-804, Oct 2005.
8. J. Xin, C.-W. Lin, and M.-T. Sun, "Digital video transcoding," Proc. IEEE, vol. 93, no. 1, pp. 84-97, Jan. 2005.
9. H. Knoche,J.D. McCarthy, and M. A. Sasse, "Can small be beautiful? Assessing image resolution requirements for mobile TV," in Proc. 13th ACM Int. Conf. Multimedia (MM'05), 2005, pp. 829-838.
10. V. Setlur, S. Takagi, M. Gleicher, R. Ramesh, and B. Gooch, Automatic Image Retargeting Comp. Sci. Dept., Northwestern Univ., Evanston, IL, 2004, Tech. Rep. NWU-CS-04-41.
11. F. Liu and M. Gleicher, "Automatic image retargeting with flsheye-view warping," in Proc. 18th ACM Symp. User Interface Technol. (UIST'05), 2005, pp. 153-162.
12. D.Bordwell and K.Thompson, Film Art: An Introduction. New York: McGraw-Hill, 2001.
13. H. Zettl, Sight, Sound, Motion: Applied Media Aesthetics, 3rd ed. Belmont, CA: Wadsworth, 1998.
14. C. Dorai and S. Venkatesh, "Computational media aesthetics: Finding meaning beautiful," IEEE Multimedia, vol. 8, no. 4, pp. 10-12, Oct./ Dec. 2001.
15. Y. Wang, J. Ostermann, and Y.-Q. Zhang, Video Processing and Communications. Upper Saddle River, NJ: Prentice Hall, 2001.
16. Y.-S. Tung, "The design and implementation of an MPEG-4 based universal scalable video codec in layered path-tree structure," Ph.D. dissertation, Dept. Comp. Sci. Inf. Eng., National Taiwan University, Taipei, Taiwan, R.O.C., 2002.
17. J. Nam, Y.-M. Ro, Y. Huh, and M. Kim, "Visual content adaptation according to user perception characterstics," IEEE Trans. Multimedia, vol. 7, no. 3, pp. 435-445, Jun. 2005.
18. A. Cavallaro, O. Steiger, and T. Ebrahimi, "Semantic video analysis for adaptive content delivery and automatic description," IEEE Trans. Circuits Syst. Video Technol., vol. 15, no. 10, pp. 1200-1209, Oct. 2005.
19. L. Itti, C. Koch, and E. Niebur,"A model of saliency-based visual attention for rapid scene analysis," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 11, pp. 1254-1259, Nov. 1998.
20. C. M. Privitera and L. W. Stark, "Algorithms for defining visual regions-of-interest: Comparison with eye fixations," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 9, pp. 970-982, Sep. 2000.
21. W.-H. Cheng, W.-T. Chu, and J.-L. Wu, "A visual attention based region-of-interest determination framework for video sequences," IEICE Trans. Info Syst., vol. E-88D, no. 7, pp. 1578-1586, Jul. 2005.
22. C.-W. Lin, Y.-C. Chen, and M.-T. Sun, "Dynamic region of interest transcoding for multipoint video conferencing," IEEE Trans. Circuits Syst. Video Technol., vol. 13, no. 10, pp. 982-992, Oct. 2003.
23. C.-C. Ho, J.-L. Wu, and W.-H. Cheng, "A practical foveation-based rate-shaping mechanism for MPEG videos," IEEE Trans. Circuits Syst. Video Technol., vol. 15, no. 11, pp. 1365-1372, Nov. 2005.
24. M M. Hannuksela, Y.-K. Wang, and M Gabbouj, "Isolated regions in video coding," IEEE Trans. Multimedia, vol. 6, no. 2, pp. 259-267, Apr. 2004.
25. H. Liu, X. Xie, W.-Y. Ma, and H.-J. Zhang, "Automatic browsing of large pictures on mobile devices," in Proc. 11th ACM Int. Conf. Multimedia (MM'03), 2003, pp. 148-155.
26. Digital Recomposition System, FlikFX Pty GmbH Ltd, (1999) [Online]. Available: http://www.widescreenmuseum.com/flikfx/
27. Y.-F. Ma, L. Lu, H.-J. Zhang, and M-J. Li, "A user attention model for video summarization," in Proc. 10th ACM Int. Conf. Multimedia (MM'02), 2002, pp. 533-542.
28. C.-C. Ho, W.-H. Cheng, T.-J. Pan, and J.-L. Wu, "A user-attention based focus detection framework and its applications," in Proc. 4th Pacific-Rim Conf. Multimedia (PCM'03), 2003, pp. 1341-1345.
29. S. Engel, X. Zhang, and B. Wandell, "Colour tuning in human visual cortex measured with functional magnetic resonance imaging," Nature, vol. 388, no. 6637, pp. 68-71, 1997.
30. C.-W. Ngo, T.-C. Pong, and H.-J. Zhang, "Motion analysis and segmentation through spatio-temporal slices processing," IEEE Trans. Image Process., vol. 12, no. 3, pp. 341-355, Mar. 2003.
31. B. Jahne, Spatio-Temporal Image Processing: Theory and Scientific Applications. New York: Springer-Verlag, 1991.
32. L. Itti and C. Koch, "A comparison of feature combination strategies for saliency-based visual attention systems," in Proc. SPIE Human Vision and Electronic Imaging IV(HVEI'99), 1999, pp. 473-482.
33. X.-S. Hua and H.-J. Zhang, "An attention-based decision fusion scheme for multimedia information retrieval," in Proc. 5th Pacific-Rim Conf. Multimedia (PCM'04), 2004, pp. 1001-1010.
34. R. Paramesan, P. Ramaswamy, and S. Omatu, "Regular moments for symmetric images," Electron. Lett.,vol. 34, no. 15, pp. 1481-1482, Jul. 1998.
35. P. S. Maybeck, Stochastic Models, Estimation, and Control. New York: Academic, 1979, vol. 1.
36. G. Welch and G. Bishop, An introduction to the Kalman filter Dept. Comp. Sci., Univ. North Carolina at Chapel Hill, 2004, Tech. Rep. 95-041.
37. S.T.Bow, Pattern Recognition and Image Preprocessing. New York: Marcel Dekker, 2002.
38. A. K. Jain, M. N. Murty, and P. J. Flynn, "Data clustering: A review," ACM Comput. Surveys, vol. 31, no. 3, pp. 264-323, Sep. 1999.
39. C.-H. Chang, C.-H. Wu, J.-C. Chen, J.-H. Kuo, and J.-L. Wu, "A real-time semi-automatic video segmentation system based on mathematical morphology," in Proc. Vis. Comm. Image Process. (VCIP'05), 2005, pp. 2152-2162.
40. H.-Y. Lee, H.-K. Lee, and Y.-H. Ha, "Spatial color descriptor for image retrieval and video segmentation," IEEE Trans. Multimedia, vol. 5, no. 3, pp. 358-367, Sep. 2003.
41. A. Criminisi, P. Perez, and K. Toyama, "Region filling and object removal by exemplar-based image inpainting," IEEE Trans. Image Process., vol. 13, no. 9, pp. 1200-1212, Sep. 2004.
42. W.-H. Cheng, C.-W. Hsieh, S.-K. Lin, C.-W. Wang, and J.-L. Wu, "Robust algorithm for exemplar-based image inpainting," in Proc. Int. Conf. Comput. Graphics, Imaging Vis. (CGIV'05), 2005, pp. 64-69.
43. K. A. Patwardhan, G. Sapiro, and M. Bertalmio, "Video inpainting of occluding and occluded objects," in Proc. 12th Int. Conf. Image Process. (ICIP'05), 2005, vol. 2, pp. 69-72.
44. V. Cheung, B. J. Frey, and N. Jojic, "Video epitomes," in Proc. CVPR'05, 2005, vol. 1, pp. 42-49.
45. T. G. Cormen, C. E. Leiserson, and R. L. Rivest, Introduction to Algorithms, 2nd ed. Cambridge, MA: MIT Press, 2001.
46. J. L. Devore, Probability and Statistics for Engineering and the Sciences, 4th ed. Belmont, CA: Wadsworth, 1995.
47. A. K. Gupta, S. Nooshabadi, D. Taubman, and M. Dyer, "Realizing low-cost highthroughput general-purpose block encoder for JPEG2000," IEEE Trans. Circuits Syst. Video Technol., vol. 16, no. 7, pp. 843-858, Jul. 2006.
48. J. Diaz, E. Ros, F. Pelayo, E. M. Ortigosa, and S. Mota, "FPGA-based real-time optical-flow system," IEEE Trans. Circuits Syst. Video Technol., vol. 16, no. 2, pp. 274-279, Feb. 2006.
49. V. Navalpakkam and L. Itti, "A goal oriented attention guidance model," Lecture Notes Comput. Sci., vol. 2525, pp. 453-161, Nov. 2002.
50. R. R. Sarukkai, "Video search: Opportunities and challenges," in Keynote Speech at ACM MIR Workshop, 2005 ACM Multimedia Conf. (MM'05) [Online]. Available: http://www.cs.utsa.edu/~mir/ MIR2005_files/keynote/MIR- Keynote-2005-Sarukkai-Final.ppt
51. H. Zhong, L. Wenyin, and S. Li, "Interactive tracker - A semi-automatic video object tracking and segmentation system," in Proc. 2001 IEEE Int. Conf. Multimedia Expo (ICME'01), 2001, pp. 1167-1170.
52. I. Burnett, R. V. Walle, K. Hill, J. Bormans, and F. Pereira, "MPEG-21: Goals and achievements," IEEE Multimedia, vol. 10, no. 4, pp. 60-70, Oct./Dec. 2003.