Saliency detection in the compressed domain for adaptive image retargeting

IEEE Transactions on Image Processing

Volumn 21, Issue 9, 2012, Pages 3888-3901

  Fang, Yuming ^a   Chen, Zhenzhong ^b   Lin, Weisi ^a   Lin, Chia Wen ^c  

^a NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

^b NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

^c NATIONAL TSING HUA UNIVERSITY   (Taiwan)

Author keywords

Compressed domain; image retargeting; joint photographic experts group (JPEG); saliency detection; texture homogeneity

Indexed keywords

ADAPTIVE IMAGES; COMPRESSED DOMAIN; DISCRETE COSINE TRANSFORM COEFFICIENTS; FEATURE MAP; HAUSDORFF DISTANCE; IMAGE PROCESSING APPLICATIONS; IMAGE RESIZING; IMAGE RETARGETING; IMAGE SCALING; IN-DEPTH ANALYSIS; JOINT PHOTOGRAPHIC EXPERTS GROUP; REGIONS OF INTEREST; SALIENCY DETECTION; SEAM CARVING; STATE-OF-THE-ART ALGORITHMS; TEXTURE FEATURES;

ADAPTIVE ALGORITHMS; DISCRETE COSINE TRANSFORMS; TEXTURES;

IMAGE TEXTURE;

EID: 84865408339     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2012.2199126     Document Type: Article

References (45)

1. A. Treisman and G. Gelade, "A feature-integration theory of attention," Cognit. Psychol., vol. 12, no. 1, pp. 97-136, 1980.
2. J. Wolfe, K. R. Cave, and S. L. Franzel, "Guided search: An alternative to the feature integration model for visual search," J. Experim. Psychol.: Human Percept. Perform., vol. 15, no. 3, pp. 419-433, 1989.
3. L. Itti, C. Koch, and E. Niebur, "A model of saliency-based visual attention for rapid scene analysis," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 11, pp. 1254-1259, Nov. 1998. (Pubitemid 128742001)
4. T. Liu, J. Sun, N. Zheng, X. Tang, and H. Y. Shum, "Learning to detect a salient object," in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit., Jul. 2007, pp. 1-8.
5. X. Hou and L. Zhang, "Saliency detection: A spectral residual approach," in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit., Jun. 2007, pp. 1-8.
6. R. Achanta, S. Hemami, F. Estrada, and S. Susstrunk, "Frequency- tuned salient region detection," in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit., Jun. 2009, pp. 1597-1604.
7. C. Guo and L. Zhang, "A novel multi-resolution spatiotemporal saliency detection model and its applications in image and video compression," IEEE Trans. Image Process., vol. 19, no. 1, pp. 185-198, Jan. 2010.
8. D. Walther and C. Koch, "Modeling attention to salient proto-objects," Neural Netw., vol. 19, no. 9, pp. 1395-1407, 2006. (Pubitemid 44708603)
9. J. Harel, C. Koch, and P. Perona, "Graph-based visual saliency," in Proc. Adv. Neural Inf. Process. Syst., vol. 19. 2007, pp. 545-552.
10. Y. Ma and H. Zhang, "Contrast-based image attention analysis by using fuzzy growing," in Proc. ACM Int. Conf. Multimedia, 2003, pp. 228-241.
11. Z. Lu, W. Lin, X. Yang, E. Ong, and S. Yao, "Modeling visual attention's modulatory aftereffects on visual sensitivity and quality evaluation," IEEE Trans. Image Process., vol. 14, no. 11, pp. 1928-1942, Nov. 2005. (Pubitemid 41655695)
12. R. Achanta and S. Susstrunk, "Saliency detection for content-aware image resizing," in Proc. IEEE Int. Conf. Image Process., Nov. 2009, pp. 1005-1008.
13. L. Wolf, M. Guttmann, and D. Cohen-Or, "Non-homogeneous content-driven video retargeting," in Proc. IEEE 11th Int. Conf. Comput. Vis., Oct. 2007, pp. 1-6.
14. T. Ren, Y. Liu, and G. Wu, "Image retargeting based on global energy optimization," in Proc. IEEE Int. Conf. Multimedia Expo, Jun.-Jul. 2009, pp. 406-409.
15. Y. Guo, F. Liu, J. Shi, Z. Zhou, and M. Gleicher, "Image retargeting using mesh parametrization," IEEE Trans. Multimedia, vol. 11, no. 5, pp. 856-867, Aug. 2009.
16. S. Goferman, L. Zelnik-Manor, and A. Tal, "Context-aware saliency detection," in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit., Jun. 2010, pp. 2376-2383.
17. S. Avidan and A. Shamir, "Seam carving for content-aware image resizing," ACM Trans. Graph., vol. 26, no. 3, pp. 1-9, 2007.
18. M. Rubinstein, A. Shamir, and S. Avidan, "Improved seam carving for video retargeting," ACM Trans. Graph., vol. 27, no. 3, pp. 1-9, 2008.
19. Y. Jin, L. Liu, and Q. Wu, "Nonhomogeneous scaling optimization for realtime image resizing," Visual Comput., vol. 26, nos. 6-8, pp. 769-778, 2010.
20. M. Grundmann, V. Kwatra, M. Han, and I. Essa, "Discontinuous seam-carving for video retargeting," in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit., Jun. 2010, pp. 569-576.
21. M. Rubinstein, A. Shamir, and S. Avidan, "Multi-operator media retargeting," ACM Trans. Graph., vol. 28, no. 3, pp. 1-11, 2009.
22. W. Dong, N. Zhou, J. C. Paul, and X. Zhang, "Optimized image resizing using seam carving and scaling," ACM Trans. Graph., vol. 28, no. 5, pp. 1-10, 2009.
23. G. K. Wallace, "The JPEG still picture compression standard," Commun. ACM, vol. 34, no. 4, pp. 30-44, Apr. 1991.
24. Y. Zhong and A. K. Jain, "Object localization using color, texture and shape," Pattern Recognit., vol. 33, no. 4, pp. 671-684, 2000. (Pubitemid 30553116)
25. J. Wei, "Color object indexing and retrieval in digital libraries," IEEE Trans. Image Process., vol. 11, no. 8, pp. 912-922, Aug. 2002. (Pubitemid 34974175)
26. C. Theoharatos, V. K. Pothos, N. A. Laskaris, G. Economou, and S. Fotopoulos, "Multivariate image similarity in the compressed domain using statistical graph matching," Pattern Recognit., vol. 39, no. 10, pp. 1892-1904, 2006. (Pubitemid 43947097)
27. 10918-1: Information Technology-Digital Compression and Coding of Continuous-Tone Still Images-Requirements and Guidlines, ISO/IEC Standard JTC1/SC29/WG1, 1994.
28. N. D. Bruce and J. K. Tsotsos, "Saliency based on information maximization," Adv. Neural Inf. Process. Syst., vol. 18, pp. 155-162, Jun. 2006.
29. O. Le Meur, P. Le Callet, D. Barba, and D. Thoreau, "A coherent computational approach to model the bottom-up visual attention," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 5, pp. 802-817, May 2006.
30. M. Rubinstein, D. Gutierrez, O. Sorkine, and A. Shamir, "A comparative study of image retargeting," ACM SIGGRAPH Asia, vol. 29, no. 6, pp. 1-9, 2010.
31. D. Vaquero, M. Turk, K. Pulli, M. Tico, and N. Gelfand, "A survey of image retargeting techniques," Proc. SPIE, vol. 7798, pp. 779814-1-779814-15, Sep. 2010.
32. Y. Fang, Z. Chen, W. Lin, and C. Lin, "Saliency-based image retargeting in the compressed domain," in Proc. 19th ACM Int. Conf. Multimedia, 2011, pp. 1049-1052.
33. S. Engel, X. Zhang, and B. Wandell, "Colour tuning in human visual cortex measured with functional magnetic resonance imaging," Nature, vol. 388, no. 6, pp. 68-71, 1997. (Pubitemid 27283889)
34. Y. L. Huang and R. F. Chang, "Texture features for DCT-coded image retrieval and classification," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., vol. 6. Mar. 1999, pp. 3013-3016.
35. Y. Li, X. Chen, X. Fu, and S. Belkasim, "Multi-level discrete cosine transform for content-based image retrieval by support vector machines," in Proc. IEEE Int. Conf. Image Process., Sep.-Oct. 2007, pp. 21-24.
36. H. Li, G. Liu, and Z. Zhang, "A new texture generation method based on pseudo-DCT coefficients," IEEE Trans. Image Process., vol. 15, no. 5, pp. 1300-1312, May 2006.
37. H. Y. Tong and A. N. Venetsanopoulos, "A perceptual model for JPEG applications based on block classification, texture masking, and luminance masking," in Proc. IEEE Int. Conf. Image Process., Oct. 1998, pp. 428-432.
38. Y. Jia, W. Lin, and A. A. Kassim, "Estimating just-noticeable distortion for video," IEEE Trans. Circuits Syst. Video Technol., vol. 16, no. 7, pp. 820-829, Jul. 2006. (Pubitemid 44192197)
39. R. T. Rockafellar and R. J.-B. Wets, Variational Analysis. New York: Springer-Verlag, 2005.
40. L. Macaire, N. Vandenbroucke, and J. G. Postaire, "Color image segmentation by analysis of subset connectedness and color homogeneity properties," Comput. Vis. Image Understand., vol. 102, no. 1, pp. 105-116, 2006. (Pubitemid 43344455)
41. K. Hirakawa and T. W. Parks, "Adaptive homogeneity-directed demosaicing algorithm," IEEE Trans. Image Process., vol. 14, no. 3, pp. 360-369, Mar. 2005. (Pubitemid 40351913)
42. H.-D. Cheng and Y. Sun, "A hierarchical approach to color image segmentation using homogeneity," IEEE Trans. Image Process., vol. 9, no. 12, pp. 2071-2082, Dec. 2000.
43. N. Otsu, "A threshold selection method from gray level histograms," IEEE Trans. Syst., Man Cybern., vol. 9, no. 1, pp. 62-66, Jan. 1979. (Pubitemid 9413341)
44. O. Le Meur, A. Ninassi, P. Le Callet, and D. Barba, "Do video coding impairments disturb the visual attention deployment?" Signal Process.: Image Commun., vol. 25, no. 8, pp. 597-609, Sep. 2010.
45. Y. Pritch, E. Kav-Venaki, and S. Peleg, "Shift-map image editing," in Proc. IEEE 12th Int. Conf. Comput. Vis., 2009, pp. 151-158.