Spatial-aware object-level saliency prediction by learning graphlet hierarchies

IEEE Transactions on Industrial Electronics

Volumn 62, Issue 2, 2015, Pages 1301-1308

  Zhang, Luming ^a   Xia, Yingjie ^a,b   Ji, Rongrong ^c   Li, Xuelong ^d  

^a ZHEJIANG UNIVERSITY   (China)

^b HANGZHOU NORMAL UNIVERSITY   (China)

^c XIAMEN UNIVERSITY   (China)

^d XI AN INSTITUTE OF OPTICS AND PRECISION MECHANICS   (China)

Author keywords

Eye tracking; graphlet; object level; saliency; spatial

Indexed keywords

BEHAVIORAL RESEARCH; SEMANTICS;

EYE-TRACKING; GRAPHLET; OBJECT-LEVEL; SALIENCY; SPATIAL;

FORECASTING;

EID: 84920929329     PISSN: 02780046     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIE.2014.2336602     Document Type: Article

References (55)

1. R. Achanta et al., "SLIC superpixels compared with state-of-the-art superpixel methods," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 11, pp. 2274-2282, Nov. 2012.
2. T. Avraham and M. Lindenbaum, "Esaliency (extended saliency): Meaningful attention using stochastic image modeling," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 4, pp. 693-708, Apr. 2010.
3. Y. Gao, M. Wang, D. Tao, R. Ji, and Q. Dai, "3D object retrieval and recognition with hypergraph analysis," IEEE Trans. Image Process., vol. 21, no. 9, pp. 4290-4303, Sep. 2011.
4. A. Borji and L. Itti, "State-of-the-art in visual attention modeling," IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 1, pp. 185-207, Jan. 2013.
5. A. Borji, D. N. Sihite, and L. Itti, "Probabilstic learning of task-specific visual attention," in Proc. IEEE CVPR, Jun. 2012, pp. 470-477.
6. A. Borji, D. N. Sihite, and L. Itti, "Computational modeling of top-down visual attention in interative environments," in Proc. BMVC, Sep. 2011, pp. 85.1-85.12.
7. Y. Bengio, "Learning deep architectures for AI," Found. Trends Mach. Learn., vol. 2, no. 1, pp. 1-127, Jan. 2009.
8. D. Bi, Y. F. Li, S. K. Tso, and G. L. Wang, "Friction modeling and compensation for haptic display based on support vector machine," IEEE Trans. Ind. Electron., vol. 51, no. 2, pp. 491-500, Apr. 2004.
9. C.-Y. Chang and H. W. Lie, "Real-time visual tracking and measurement to control fast dynamics of overhead cranes," IEEE Trans. Ind. Electron., vol. 59, no. 3, pp. 1640-1649, Mar. 2012.
10. Y.-L. Chen, B.-F. Wu, H.-Y. Huang, and C.-J. Fan, "A real-time vision system for nighttime vehicle detection and traffic surveillance," IEEE Trans. Ind. Electron., vol. 58, no. 5, pp. 2030-2044, May 2011.
11. N. Dalal and B. Triggs, "Histograms of oriented gradients for human detection," in Proc. IEEE CVPR, Jun. 2005, pp. 886-893.
12. W. Einhäser, M. Spain, and P. Perona, "Objects predict fixations better than early saliency," J. Vis., vol. 8, no. 14, pp. 1-26, Nov. 2008.
13. S. Goferman, L. Z.-Minor, and A. Tal, "Context-aware saliency detection," in Proc. IEEE CVPR, 2010, pp. 2376-2383.
14. C. Gao, L. Jian, and S. Luo, "Modeling of the thermal state change of blast furnace hearth with support vector machines," IEEE Trans. Ind. Electron., vol. 59, no. 2, pp. 1134-1145, Feb. 2012.
15. M. I. Chacon-Murguia and S. Gonzalez-Duarte, "An adaptive neuralfuzzy approach for object detection in dynamic backgrounds for surveillance systems," IEEE Trans. Ind. Electron., vol. 59, no. 8, pp. 3286-3298, Aug. 2012.
16. J. Harel, C. Koch, and P. Perona, "Graph-based visual saliency," in Proc. NIPS, 2007, pp. 545-552.
17. X. Hou, J. Harel, and C. Koch, "Image signature: Highlighting sparse salient regions," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 1, pp. 194-201, Jan. 2012.
18. D. H. Hubel, Eye, brain, vision. San Francisco, CA, USA: Freeman, 1988.
19. S. Hu, H. Wang, S. Kwong, and C.-C. J. Kuo, "Novel rate-quantization model-based rate control with adaptive initialization for spatial scalable video coding," IEEE Trans. Ind. Electron., vol. 59, no. 3, pp. 1673-1684, Mar. 2012.
20. P.-Y. Hsiao, C.-L. Lu, and L.-C. Fu, "Multilayered image processing for multiscale harris corner detection in digital realization," IEEE Trans. Ind. Electron., vol. 57, no. 5, pp. 1799-1805, May 2010.
21. T. Judd, K. Ehinger, F. Durand, and A. Torralba, "Learning to predict where humans look," in Proc. IEEE ICCV, 2009, pp. 2106-2113.
22. Y. Gao et al., "Less is more: Efficient 3D object retrieval with query view selection," IEEE Trans. Multimedia, vol. 11, no. 5, pp. 1007-1018, Oct. 2011.
23. C.-F. Juang and G.-C. Chen, "A TS fuzzy system learned through a support vector machine in principal component space for real-time object detection," IEEE Trans. Ind. Electron., vol. 59, no. 8, pp. 3309-3320, Aug. 2012.
24. G. Kim and A. Torralba, "Unsupervised detection of regions of interest using iterative link analysis," in Proc. NIPS, 2009, pp. 961-969.
25. J. Li, Y. Tian, T. Huang, and W. Gao, "Probabilistic multitask learning for visual saliency estimation in video," Int. J. Comput. Vis., vol. 90, no. 2, pp. 150-165, Nov. 2010.
26. J. Lafferty, A. McCallum, and F. Pereira, "Conditional random fields: Probabilistic models for segmenting and labeling sequence data," in Proc. ICML, 2001, pp. 282-289.
27. F. Lin, X. Dong, B. M. Chen, K.-Y. Lum, and T. H. Lee, "A robust realtime embedded vision system on an unmanned rotorcraft for ground target following," IEEE Trans. Ind. Electron., vol. 59, no. 2, pp. 1038-1049, Feb. 2012.
28. S. Lazebnik, C. Schmid, and J. Ponce, "Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories," in Proc. IEEE CVPR, 2006, pp. 2169-2178.
29. T. Liu et al., "Learning to detect a salient object," in Proc. IEEE CVPR, 2007, pp. 1-8.
30. N. Rasiwasia and N. Vasconcelos, "Holistic context models for visual recognition," IEEE Trans. Pattern Anal. Mach. Intell, vol. 34, no. 5, pp. 902-917, May 2012.
31. S. Ramanathan, H. Katti, N. Sebe, M. Kankanhalli, and T.-S. Chua, "An eye fixation database for saliency detection in images," in Proc. ECCV, 2010, pp. 30-43.
32. J. M. Reed and S. Hutchinson, "Image fusion and subpixel parameter estimation for automated optical inspection of electronic components," IEEE Trans. Ind. Electron., vol. 43, no. 3, pp. 346-354, Jun. 1996.
33. N. Sudha and A. R.Mohan, "Hardware-efficient image-based robotic path planning in a dynamic environment and its FPGA implementation," IEEE Trans. Ind. Electron., vol. 58, no. 5, pp. 1907-1920, May 2011.
34. M. Stricker and M. Orengo, "Similarity of color images," Storage Retrieval Image Video Databases, pp. 381-392, Mar. 1995.
35. Y. Gao et al., "Visual-textual joint relevance learning for tag-based social image search," IEEE Trans. Image Process., vol. 21, no. 1, pp. 363-376, Jan. 2013.
36. Z. Stejic, Y. Takama, and K. Hirota, "Relevance feedback-based image retrieval interface incorporating region and feature saliency patterns as visualizable image similarity criteria," IEEE Trans. Ind. Electron., vol. 50, no. 5, pp. 839-852, Oct. 2003.
37. R. Ji, H. Yao, W. Liu, X. Sun, and Q. Tian, "Task dependent visual codebook compression," IEEE Trans Image Process., vol. 21, no. 4, pp. 2282-2293, Apr. 2012.
38. R. Ji et al., "Learning to distribute vocabulary indexing for scalable visual search," IEEE Trans. Multimedia, vol. 15, no. 1, pp. 153-166, Jan. 2013.
39. E. Vazquez-Sanchez, J. Gomez-Gil, J. C. Gamazo-Real, and J. F. Diez-Higuera, "A new method for sensorless estimation of the speed and position in brushed dc motors using support vector machines," IEEE Trans. Ind. Electron., vol. 59, no. 3, pp. 1397-1408, Mar. 2012.
40. H. Wang, C. H. Q. Ding, and H. Huang, "Multi-label linear discriminant analysis," in Proc. ECCV, 2010, pp. 126-139.
41. J. Yang and M.-H. Yang, "Top-down visual saliency via joint CRF and dictionary learning," in Proc. IEEE CVPR, 2012, pp. 2296-2303.
42. J. Yang, K. Yu, and T. S. Huang, "Supervised translation-invariant sparse coding," in Proc. IEEE CVPR, 2010, pp. 3517-3524.
43. R. Zunino and S. Rovetta, "Vector quantization for license-plate location and image coding," IEEE Trans. Ind. Electron., vol. 47, no. 1, pp. 159-167, Feb. 2000.
44. H. Zhuang, K.-S. Low, and W.-Y. Yau, "Multichannel pulse-coupledneural-network-based color image segmentation for object detection," IEEE Trans. Ind. Electron., vol. 59, no. 8, pp. 3299-3308, Aug. 2012.
45. L. Zhang et al., "Probabilistic graphlet transfer for photo cropping," IEEE Trans. Image Process., vol. 21, no. 5, pp. 2887-2897, Feb. 2013.
46. L. Zhang et al., "Discovering discrminative graphlets for aerial image categories recognition," IEEE Trans. Image Process., vol. 22, no. 12, pp. 5071-5084, Dec. 2013.
47. Y. Gao et al., "Camera constraint-free view-based 3D object retrieval," IEEE Trans. Image Process., vol. 21, no. 4, pp. 2269-2281, Apr. 2012.
48. L. Zhang et al., "Probabilistic graphlet cut: Exploring spatial structure cue for weakly supervised image segmentation," in Proc. IEEE CVPR, 2013.
49. Y. Jia and M. Han, "Category-independent object-level saliency detection," in Proc. IEEE ICCV, 2013, pp. 1761-1768.
50. R. Ji et al., "Location discriminative vocabulary coding for mobile landmark search," Int. J. Comput. Vis., vol. 96, no. 3, pp. 290-314, Feb. 2012.
51. C. Zhang and W. Wang, "Object-level saliency detection based on spatial compactness assumption," in Proc. IEEE ICIP, 2013, pp. 2475-2479.
52. J. Go. Norniella et al., "Improving the dynamics of virtual-flux-based control of three-phase active rectifiers," IEEE Trans. Ind. Electron., vol. 61, no. 1, pp. 177-187, Jan. 2014.
53. M. E. Kiziroglou et al., "Design and fabrication of heat storage thermoelectric harvesting devices," IEEE Trans. Ind. Electron., vol. 61, no. 1, pp. 302-309, Jan. 2014.
54. S. Chuangpishit, A. Tabesh, Z. Moradi-Sharbabk, and M. Saeedifard, "Topology design for collector systems of offshore wind farms with pure DC power systems," IEEE Trans. Ind. Electron., vol. 61, no. 1, pp. 320-328, Jan. 2014.
55. J. Li, M. D. Levine, X. An, X. Xu, and H. He, "Visual saliency based on scale-space analysis in the frequency domain," IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 4, pp. 996-1010, Apr. 2013.