Multi-Camera Saliency

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 37, Issue 10, 2015, Pages 2057-2070

  Luo, Yan ^a   Jiang, Ming ^a   Wong, Yongkang ^a   Zhao, Qi ^a  

^a NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

Author keywords

Global Saliency; High Level Feature Saliency; Label Consistent K SVD; Multi Camera Eye Tracking Dataset; Multi Camera Saliency; Region Competition

Indexed keywords

FACE RECOGNITION;

EYE-TRACKING; GLOBAL SALIENCY; HIGH-LEVEL FEATURES; MULTI-CAMERAS; REGION COMPETITION;

CAMERAS;

ALGORITHM; AUTOMATED PATTERN RECOGNITION; BEHAVIOR; HUMAN; IMAGE PROCESSING; MACHINE LEARNING; PHYSIOLOGY; PROCEDURES;

ALGORITHMS; BEHAVIOR; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MACHINE LEARNING; PATTERN RECOGNITION, AUTOMATED;

EID: 84941110546     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2015.2392783     Document Type: Article

References (75)

1. C. Koch and S. Ullman, "Shifts in selective visual attention: Towards the underlying neural circuitry," Matters Intell., vol. 188, pp. 115-141, 1987.
2. L. Itti, C. Koch, and E. Niebur, "A model of saliency-based visual attention for rapid scene analysis," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 11, pp. 1254-1259, Nov. 1998.
3. M. Cerf, E. P. Frady, and C. Koch, "Faces and text attract gaze independent of the task: Experimental data and computer model," J. Vis., vol. 9, no. 12, pp. 1-15, 2009.
4. Q. Zhao and C. Koch, "Learning a saliency map using fixated locations in natural scenes," J. Vis., vol. 11, no. 3, pp. 1-15, 2011.
5. Q. Zhao and C. Koch, "Learning visual saliency by combining feature maps in a nonlinear manner using adaboost," J. Vis., vol. 12, no. 6, pp. 1-15, 2012.
6. T. Judd, K. A. Ehinger, F. Durand, and A. Torralba, "Learning to predict where humans look," in Proc. IEEE Int. Conf. Comput. Vis., 2009, pp. 2106-2113.
7. P. A. Viola and M. J. Jones, "Robust real-time face detection," Int. J. Comput. Vis., vol. 57, no. 2, pp. 137-154, 2004.
8. M. Jiang, M. Song, and Q. Zhao, "Leveraging human fixations in sparse coding: Learning a discriminative dictionary for saliency prediction," in Proc. IEEE Int. Conf. Syst., Man, Cybern., 2013, pp. 2126-2133.
9. A. M. Treisman and G. Gelade, "A feature-integration theory of attention," Cogn. Psychol., vol. 12, no. 1, pp. 97-136, 1980.
10. A. Torralba, "Contextual modulation of target saliency," in Proc. Adv. Neural Inform. Process. Syst., 2001, pp. 1303-1310.
11. D. Parkhurst, K. Law, and E. Niebur, "Modeling the role of salience in the allocation of overt visual attention," Vis. Res., vol. 42, no. 1, pp. 107-123, 2002.
12. O. Le Meur, P. Le Callet, D. Barba, and D. Thoreau, "A coherent computational approach to model bottom-up visual attention," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 5, pp. 802-817, May 2006.
13. D. Gao, S. Han, and N. Vasconcelos, "Discriminant saliency, the detection of suspicious coincidences, and applications to visual recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 6, pp. 989-1005, Jun. 2009.
14. V. Mahadevan and N. Vasconcelos, "Spatiotemporal saliency in dynamic scenes," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 1, pp. 171-177, Jan. 2010.
15. J. Fan and Y. Wu, "Contextual saliency," IEEE Vis. Commun. Image Process., pp. 1-4, Nov. 2011.
16. T. Avraham and M. Lindenbaum, "Esaliency (extended saliency): Meaningful attention using stochastic image modeling," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 4, pp. 693-708, Apr. 2010.
17. T. Liu, Z. Yuan, J. Sun, J. Wang, N. Zheng, X. Tang, and H.-Y. Shum, "Learning to detect a salient object," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 2, pp. 353-367, Feb. 2011.
18. Y. Luo, J. Yuan, P. Xue, and Q. Tian, "Saliency density maximization for efficient visual objects discovery," IEEE Trans. Circuits Syst. Video Technol., vol. 21, no. 12, pp. 1822-1834, Dec. 2011.
19. T. Judd, F. Durand, and A. Torralba, "Fixations on low-resolution images," J. Vis., vol. 11, no. 4, pp. 1-20, 2011.
20. A. Toet, "Computational versus psychophysical bottom-up image saliency: A comparative evaluation study," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 11, pp. 2131-2146, Nov. 2011.
21. X. Shen and Y. Wu, "A unified approach to salient object detection via low rank matrix recovery," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2012, pp. 853-860.
22. X. Hou, J. Harel, and C. Koch, "Image signature: Highlighting sparse salient regions," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 1, pp. 194-201, Jan. 2012.
23. S. Ramenahalli and E. Niebur, "Computing 3D saliency from a 2D image," in Proc. Conf. Inform. Sci. Syst., 2013, pp. 1-5.
24. L. Itti, N. Dhavale, and F. Pighin, "Realistic avatar eye and head animation using a neurobiological model of visual attention," in Proc. SPIE 48th Annu. Int. Symp. Optical Sci. Technol., 2004, vol. 5200, pp. 64-78.
25. A. Torralba, "Modeling global scene factors in attention," J. Opt. Soc. Am. A, vol. 20, no. 7, pp. 1407-1418, 2003.
26. A. Oliva and A. Torralba, "Modeling the shape of the scene: A holistic representation of the spatial envelope," Int. J. Comput. Vis., vol. 42, no. 3, pp. 145-175, 2001.
27. L. Zhang, M. H. Tong, T. K. Marks, H. Shan, and G. W. Cottrell, "SUN: A Bayesian framework for saliency using natural statistics," J. Vis., vol. 8, no. 7, pp. 1-20, 2008.
28. N. D. B. Bruce and J. K. Tsotsos, "Saliency based on information maximization," in Proc. Adv. Neural Inform. Process. Syst., 2005, pp. 155-162.
29. X. Hou and L. Zhang, "Dynamic visual attention: Searching for coding length increments," in Proc. Adv. Neural Inform. Process. Syst., 2008, pp. 681-688.
30. A. Borji, D. N. Sihite, and L. Itti, "Computational modeling of topdown visual attention in interactive environments." in Proc. Brit. Mach. Vis. Conf., 2011, pp. 1-12.
31. A. Borji, M. N. Ahmadabadi, and B. N. Araabi, "Cost-sensitive learning of top-down modulation for attentional control," Mach. Vis. Appl., vol. 22, no. 1, pp. 61-76, 2011.
32. L. Elazary and L. Itti, "A Bayesian model for efficient visual search and recognition," Vis. Res., vol. 50, no. 14, pp. 1338-1352, 2010.
33. N. J. Butko and J. R. Movellan, "Optimal scanning for faster object detection," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2009, pp. 2751-2758.
34. R. J. Peters and L. Itti, "Beyond bottom-up: Incorporating taskdependent influences into a computational model of spatial attention," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2007, pp. 1-8.
35. J. Li, Y. Tian, T. Huang, and W. Gao, "Probabilistic multi-task learning for visual saliency estimation in video," Int. J. Comput. Vis., vol. 90, no. 2, pp. 150-165, 2010.
36. D. Pang, A. Kimura, T. Takeuchi, J. Yamato, and K. Kashino, "A stochastic model of selective visual attention with a dynamic Bayesian network," in Proc. IEEE Int. Conf. Multimedia Expo, 2008, pp. 1073-1076.
37. J. M. Wolfe and T. S. Horowitz, "What attributes guide the deployment of visual attention and how do they do it?" Nature Rev. Neurosci., vol. 5, no. 6, pp. 495-501, 2004.
38. J. M. Wolfe, "Guided search 4.0: Current progress with a model of visual search," Int. Models Cognit. Syst., pp. 99-119, 2007.
39. J. Harel, C. Koch, and P. Perona, "Graph-based visual saliency," in Proc. Adv. Neural Inform. Process. Syst., 2006, pp. 545-552.
40. L. W. Renninger, J. M. Coughlan, P. Verghese, and J. Malik, "An information maximization model of eye movements," in Proc. Adv. Neural Inform. Process. Syst., 2004, pp. 1121-1128.
41. N. D. Bruce and J. K. Tsotsos, "Saliency, attention, and visual search: An information theoretic approach," J. Vis., vol. 9, no. 3, pp. 1-24, 2009.
42. J. Li, M. D. Levine, X. An, X. Xu, and H. He, "Visual saliency based on scale-space analysis in the frequency domain," IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 4, pp. 996-1010, Apr. 2013.
43. W. Einhäuser, M. Spain, and P. Perona, "Objects predict fixations better than early saliency," J. Vis., vol. 8, no. 14, pp. 1-26, 2008.
44. A. Nuthmann and J. M. Henderson, "Object-based attentional selection in scene viewing," J. Vis., vol. 10, no. 8, pp. 1-19, 2010.
45. J. Xu, M. Jiang, S. Wang, M. S. Kankanhalli, and Q. Zhao, "Predicting human gaze beyond pixels," J. Vis., vol. 14, no. 1, pp. 1-20, 2014.
46. M. Jiang, J. Xu, and Q. Zhao, "Saliency in crowd," in Proc. 13th Eur. Conf. Comput. Vis., vol. 8695, 2014, pp. 17-32.
47. A. Maki, P. Nordlund, and J.-O. Eklundh, "Attentional scene segmentation: Integrating depth and motion," Comput. Vis. Image Understanding, vol. 78, no. 3, pp. 351-373, 2000.
48. S. Frintrop, E. Rome, A. Nüchter, and H. Surmann, "A bimodal laser-based attention system," Comput. Vis. Image Understanding, vol. 100, no. 1-2, pp. 124-151, 2005.
49. N. D. B. Bruce and J. K. Tsotsos, "An attentional framework for stereo vision," in Proc. 2nd Canadian Conf. Comput. Robot Vis., 2005, pp. 88-95.
50. S. Jeong, S.-W. Ban, and M. Lee, "Stereo saliency map considering affective factors and selective motion analysis in a dynamic environment," Neural Netw., vol. 21, no. 10, pp. 1420-1430, 2008.
51. Y. Zhang, G. Jiang, M. Yu, and K. Chen, "Stereoscopic visual attention model for 3D video," in Proc. 16th Int. Conf. Adv. Multimedia Model., 2010, pp. 314-324.
52. Y. Niu, Y. Geng, X. Li, and F. Liu, "Leveraging stereopsis for saliency analysis," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2012, pp. 454-461.
53. C. Lang, T. V. Nguyen, H. Katti, K. Yadati, M. S. Kankanhalli, and S. Yan, "Depth matters: Influence of depth cues on visual saliency," in Proc. 12th Eur. Conf. Comput. Vis., vol. 7573, 2012, pp. 101-115.
54. E. Ekmekcioglu, H. K. Arachchi, A. Kondoz, C. G. Gurler, and S. Sedef Savas, "Content aware delivery of visual attention based scalable multi-view video over P2P," in Proc. Int. Packet Video Workshop, 2012, pp. 71-76.
55. R. Horaud, D. Knossow, and M. Michaelis, "Camera cooperation for achieving visual attention," Mach. Vis. Appl., vol. 16, no. 6, pp. 331-342, 2006.
56. U. Rashid, M. A. Nacenta, and A. J. Quigley, "Factors influencing visual attention switch in multi-display user interfaces: A survey," in Proc. Int. Symp. Pervasive Displays, 2012.
57. J. Yuan, G. Zhao, Y. Fu, Z. Li, A. K. Katsaggelos, and Y. Wu, "Discovering thematic objects in image collections and videos," IEEE Trans. Image Process., vol. 21, no. 4, pp. 2207-2219, Apr. 2012.
58. C. W. H. Ngau, L.-M. Ang, and K. P. Seng, "Multi camera visual saliency using image stitching," in Proc. Int. Conf. Telecommun. Technol. Appl., 2011, pp. 93-98.
59. F. Urban, B. Follet, C. Chamaret, O. L. Meur, and T. Baccino, "Medium spatial frequencies, a strong predictor of salience," Cogn. Comput., vol. 3, no. 1, pp. 37-47, 2011.
60. Z. Jiang, Z. Lin, and L. S. Davis, "Learning a discriminative dictionary for sparse coding via label consistent K-SVD," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2011, pp. 1697-1704.
61. N. Dalal and B. Triggs, "Histograms of oriented gradients for human detection," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2005, pp. 886-893.
62. P. F. Felzenszwalb, R. B. Girshick, D. A. McAllester, and D. Ramanan, "Object detection with discriminatively trained part-based models," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 9, pp. 1627-1645, Sep. 2010.
63. H. Lee, C. Ekanadham, and A. Y. Ng, "Sparse deep belief net model for visual area V2," in Proc. Adv. Neural Inform. Process. Syst., 2007, pp. 873-880.
64. M. Aharon, M. Elad, and A. Bruckstein, "K-SVD: An algorithm for designing overcomplete dictionaries for sparse representation," IEEE Trans. Signal Process., vol. 54, no. 11, pp. 4311-4322, Nov. 2006.
65. A. Torralba, A. Oliva, M. S. Castelhano, and J. M. Henderson, "Contextual guidance of eye movements and attention in realworld scenes: The role of global features in object search," Psychol. Rev., vol. 113, no. 4, pp. 766-786, 2006.
66. X. Hou and L. Zhang, "Saliency detection: A spectral residual approach," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2007, pp. 1-8.
67. X. Hou and L. Zhang, "Dynamic visual attention: Searching for coding length increments," in Proc. Adv. Neural Inform. Process. Syst., 2009, pp. 681-688.
68. R. Hartley and A. Zisserman, Multiple View Geometry in Computer Vision, 2nd ed. Cambridge, U.K: Cambridge Univ. Press, 2004.
69. B. W. Tatler, R. J. Baddeley, and I. D. Gilchrist, "Visual correlates of fixation selection: Effects of scale and time," Vis. Res., vol. 45, no. 5, pp. 643-659, 2005.
70. B. W. Tatler, "The central fixation bias in scene viewing: Selecting an optimal viewing position independently of motor biases and image feature distributions," J. Vis., vol. 7, no. 14, pp. 1-17, 2007.
71. N. Ouerhani, R. von Wartburg, H. Hugli, and R. Muri, "Empirical validation of the saliency-based model of visual attention," Electron. Lett. Comput. Vis. Image Anal., vol. 3, no. 1, pp. 13-24, 2004.
72. R. J. Peters, A. Iyer, L. Itti, and C. Koch, "Components of bottomup gaze allocation in natural images," Vis. Res., vol. 45, no. 18, pp. 2397-2416, 2005.
73. D. Thirde, L. Li, and F. Ferryman, "Overview of the pets2006 challenge," in Proc. IEEE Int. Workshop Perform. Eval. Tracking Surveill., 2006, pp. 47-50.
74. S. Yu, D. Tan, and T. Tan, "A framework for evaluating the effect of view angle, clothing and carrying condition on gait recognition," in Proc. Int. Conf. Pattern Recognit., 2006, pp. 441-444.
75. A. Bialkowski, S. Denman, S. Sridharan, C. Fookes, and P. Lucey, "A database for person re-identification in multi-camera surveillance networks," in Proc. Int. Conf. Dig. Image Comput. Tech. Appl., 2012, pp. 1-8.