Fusion of multichannel local and global structural cues for photo aesthetics evaluation

IEEE Transactions on Image Processing

Volumn 23, Issue 3, 2014, Pages 1419-1429

  Zhang, Luming ^a   Gao, Yue ^b   Zimmermann, Roger ^a   Tian, Qi ^c   Li, Xuelong ^d  

^a NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

^b TSINGHUA UNIVERSITY   (China)

^c One UTSA Circle   (United States)

^d XI AN INSTITUTE OF OPTICS AND PRECISION MECHANICS   (China)

Author keywords

aesthetic evaluation; Multi channel; probabilistic model; structural cues

Indexed keywords

AESTHETIC EVALUATION; CONVENTIONAL APPROACH; EMBEDDING ALGORITHMS; MULTI-CHANNEL; PROBABILISTIC MODELING; SPATIAL ARRANGEMENTS; STATE-OF-THE-ART ALGORITHMS; STRUCTURAL CUES;

ALGORITHMS; IMAGE PROCESSING;

QUALITY CONTROL;

ALGORITHM; ARTICLE; ASSOCIATION; AUTOMATED PATTERN RECOGNITION; BIOMIMETICS; COMPUTER ASSISTED DIAGNOSIS; ESTHETICS; IMAGE ENHANCEMENT; METHODOLOGY; PHOTOGRAPHY;

ALGORITHMS; BIOMIMETICS; CUES; ESTHETICS; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; PATTERN RECOGNITION, AUTOMATED; PHOTOGRAPHY;

EID: 84897696597     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2014.2303650     Document Type: Article

References (45)

1. S. Bhattacharya, R. Sukthankar, and M. Shah, "A framework for photoquality assessment and enhancement based on visual aesthetics," in Proc. Int. Conf. Multimedia, 2010, pp. 271-280.
2. B. Cheng, B. Ni, S. Yan, and Q. Tian, "Learning to photograph," in Proc. Int. Conf. Multimedia, 2010, pp. 291-300.
3. R. Datta, D. Joshi, J. Li, and J. Z. Wang, "Studying aesthetics in photographic images using a computational approach," in Proc. ECCV, 2006, pp. 288-301. (Pubitemid 44029685)
4. S. Dhar, V. Ordonez, and T. L. Berg, "High level describable attributes for predicting aesthetics and interestingness," in Proc. CVPR, 2011, pp. 1657-1664.
5. N. Dalal and B. Triggs, "Histograms of oriented gradients for human detection," in Proc. CVPR, 2005, pp. 886-893. (Pubitemid 43897286)
6. T. Grill and M. Scanlon, Photographic Cmposition. New York, NY, USA: Amphoto Books, 1990.
7. N. Guan, D. Tao, Z. Luo, and B. Yuan, "Manifold regularized discriminative nonnegative matrix factorization with fast gradient descent," IEEE Trans. Image Process., vol. 20, no. 7, pp. 2030-2048, Jul. 2011.
8. P. Gehler and S. Nowozin, "On feature combination for multiclass object classification," in Proc. 12th ICCV, 2009, pp. 221-228.
9. J. Harel, C. Koch, and P. Perona, "Graph-based visual saliency," in Proc. NIPS, 2007, pp. 545-552.
10. Z. Harchaoui and F. Bach, "Image classification with segmentation graph kernels," in Proc. CVPR, 2007, pp. 1-8.
11. Y. Ke, X. Tang, and F. Jing, "The design of high-level features for photo quality assessment," in Proc. CVPR, 2006, pp. 419-426. (Pubitemid 44931359)
12. L.-J. Li, H. Su, E. P. Xing, and L. Fei-Fei, "Object bank: A highlevel image representation for scene classification and semantic feature sparsification," in Proc. NIPS, 2010, pp. 1378-1386.
13. W. Luo, X. Wang, and X. Tang, "Content-based photo quality assessment," in Proc. ICCV, 2011, pp. 2206-2213.
14. Y. Li, S. Gong, and H. Liddell, "Kernel discriminant analysis," ACM Trans. Program. Lang. Syst., vol. 15, no. 5, pp. 745-770, 1998.
15. F.-F. Li and P. Perona, "A Bayesian hierarchical model for learning natural scene categories," in Proc. CVPR, 2005, pp. 524-531.
16. Y. Luo, D. Tao, B. Geng, C. Xu, and S. J. Maybank, "Manifold regularized multitask learning for semi-supervised multilabel image classification," IEEE Trans. Image Process., vol. 32, no. 9, pp. 523-536, Feb. 2013.
17. M. Veringham, L. Van Gool, C. K. I. Williams, J. Winn, and A. Zisserman, "The PASCAL visual object classes (VOC) challenge," IJCV, vol. 2, no. 88, pp. 303-338, 2010.
18. M. Everingham, L. Van Gool, C. K. I. Williams, J. Winn, and A. Zisserman, The PASCAL Visual Object Classes Challenge(VOC2009), Oct. 2009.
19. N. Murray, L. Marchesotti, and F. Perronnin, "AVA: A largescale database for aesthetic visual analysis," in Proc. CVPR, 2012, pp. 2408-2415.
20. M. Nishiyama, T. Okabe, Y. Sato, and I. Sato, "Sensation-based photo cropping," ACM Multimedia, 2009, pp. 669-672s.
21. M. Nishiyama, T. Okabe1, I. Sato, and Y. Sato, "Aesthetic quality classification of photographs based on color harmony," in Proc. CVPR, 2011, pp. 33-40.
22. M. Stricker and M. Orengo, "Similarity of color images," in Proc. Storage Retr. Image Video Databases, 1995, pp. 381-392.
23. D. Song and D. Tao, "Biologically inspired feature manifold for scene classification," IEEE Trans. Image Process., vol. 19, no. 1, pp. 174-184, Jan. 2010.
24. M. Werman and D. Weinshall, "Similarity and affine invariant distances between 2D point sets," IEEE Trans. Pattern Anal. Mach. Intell., vol. 17, no. 8, pp. 810-814, Aug. 1995.
25. X. Wang and E. Grimson, "Spatial latent Dirichlet allocation," in Proc. NIPS, 2007, pp. 1577-1584.
26. X. Xiong and K. L. Chan, "Towards an unsupervised optimal fuzzy clustering algorithm for image database organization," in Proc. 15th ICPR, 2000, pp. 897-900.
27. C.-H. Yeh, Y.-C. Ho, B. A. Barsky, and M. Ouhyoung, "Personalized photograph ranking and selection system," in Proc. ACM Multimedia, 2010, pp. 211-220.
28. T. Zhang, D. Tao, X. Li, and J. Yang, "Patch alignment for dimensionality reduction," IEEE Trans. Knowl. Data Eng., vol. 21, no. 9, pp. 1299-1313, Sep. 2009.
29. L. Zhang, M. Song, Q. Zhao, X. Liu, J. Bu, and C. Chen, "Probabilistic graphlet transfer for photo cropping," IEEE Trans. Image Process., vol. 21, no. 5, pp. 2887-2897, Feb. 2013.
30. L. Zhang, M. Song, Z. Liu, X. Liu, J. Bu, and C. Chen, "Probabilistic graphlet cut, exploiting spatial structure cue for weakly supervied image segmentation," IEEE Trans. Image Process., vol. 21, no. 5, pp. 1908-1915, Jun. 2013.
31. R. Ji, L.-Y. Duan, J. Chen, H. Yao, Y. Rui, S.-F. Chang, et al., "Towards low bit rate mobile visual search with multiple channel coding," in Proc. 19th ACM Int. Conf. Multimedia, 2011, pp. 573-582.
32. Y. Gao, M. Wang, Z. J. Zha, Q. Tian, Q. Dai, and N. Zhang, "Less is more: Efficient 3-D object retrieval with query view selection," IEEE Trans. Multimedia, vol. 13, no. 5, pp. 1071-1018, Oct. 2011.
33. Y. Gao, M. Wang, Z. Zha, J. Shen, X. Li, and X. Wu, "Visual-textual joint relevance learning for tag-based social image search," IEEE Trans. Image Process., vol. 22, no. 1, pp. 363-376, Jan. 2013.
34. L. Zhang, Y. Han, Y. Yang, M. Song, S. Yan, and Q. Tian, "Discovering discriminative graphlets for aerial image categories recognition," IEEE Trans. Image Process., vol. 22, no. 12, pp. 5071-5084, Dec. 2013.
35. M. Juneja, A. Vedaldi, C. V. Jawahar, and A. Zisserman, "Blocks that shout: Distinctive parts for scene classification," in Proc. CVPR, Jun. 2013, pp. 923-930.
36. A. Quattoni and A. Torralba, "Recognizing indoor scenes," in Proc. CVPR, 2009, pp. 1-8.
37. M. Nishiyama, T. Okabe, Y. Sato, and I. Sato, "Sensation-based photo cropping," in Proc. 17th ACM Int. Conf. Multimedia, 2009, pp. 669-672.
38. C.-H. Yeh, Y.-C. Ho, B. A. Barsky, and M. Ouhyoung, "Personalized photograph ranking and selection system," in Proc. Int. Conf. Multimedia, 2010, pp. 211-220.
39. S. Dhar, V. Ordonez, and T. L. Berg, "High level describable attributes for predicting aesthetics and interestingness," in Proc. CVPR, 2011, pp. 1657-1664.
40. W. Luo, X. Wang, and X. Tang, "Content-based photo quality assessment," in Proc. ICCV, 2011, pp. 2206-2213.
41. T. Xia, D. Tao, T. Mei, and Y. Zhang, "Multiview spectral embedding," IEEE Trans. Syst., Man, Cybern., B, Cybern., vol. 40, no. 6, pp. 1438-1446, Dec. 2010.
42. R. Ji, H. Yao, W. Liu, X. Sun, and Q. Tian, "Task dependent visual codebook compression," IEEE Trans. Image Process., vol. 21, no. 4, pp. 2282-2293, Apr. 2012.
43. R. Ji, L.-Y. Duan, H. Yao, L. Xie, Y. Rui, and W. Gao, "Learning to distribute vocabulary indexing for scalable visual search," IEEE Trans. Multimedia, vol. 15, no. 1, pp. 153-166, Jan. 2013.
44. K. Chatfield, V. S. Lempitsky, A. Vedaldi, and A. Zisserman, "The devil is in the details: An evaluation of recent feature encoding methods," in Proc. BMVC, 2011, pp. 1-12.
45. J. Yang, K. Yu, Y. Gong, and T. S. Huang, "Linear spatial pyramid matching using sparse coding for image classification," in Proc. CVPR, 2009, pp. 1794-1801.