Multimodal saliency-based attention for object-based scene analysis

IEEE International Conference on Intelligent Robots and Systems

Volumn , Issue , 2011, Pages 1173-1179

  Schauerte, Boris ^a   Kühn, Benjamin ^a   Kroschel, Kristian ^b   Stiefelhagen, Rainer ^a,b  

^a KARLSRUHE INSTITUTE OF TECHNOLOGY   (Germany)

^b FRAUNHOFER IOSB   (Germany)

Author keywords

active perception; audio visual saliency; auditory surprise; hierarchical object analysis; isophote based visual proto objects; multimodal attention; object based inhibition of return; overt attention; parametric 3 D saliency model; scene exploration

Indexed keywords

AUDIO-VISUAL; AUDITORY SURPRISE; HIERARCHICAL OBJECT ANALYSIS; ISOPHOTE-BASED VISUAL PROTO-OBJECTS; MULTIMODAL ATTENTION; OBJECT BASED; OVERT ATTENTION;

ANTHROPOMORPHIC ROBOTS; COGNITIVE SYSTEMS; IMAGE SEGMENTATION; OBJECT RECOGNITION; ROBOTICS; THREE DIMENSIONAL; VISUALIZATION;

INTELLIGENT ROBOTS;

EID: 84455202806     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IROS.2011.6048857     Document Type: Conference Paper

References (41)

1. T. Asfour, K. Welke, P. Azad, et al., "The Karlsruhe Humanoid Head,"in Humanoids, 2008.
2. N. Butko, L. Zhang, et al., "Visual saliency model for robot cameras,"in Proc. Int. Conf. Robot. Autom., 2008.
3. D. Meger, P.-E. Forssén, K. Lai, et al., "Curious George: An attentive semantic robot," in IROS Workshop: From sensors to human spatial concepts, 2007.
4. F. Orabona, G. Metta, and G. Sandini, "Object-based visual attention: a model for a behaving robot," in CVPR Workshop: Attention and Performance in Computational Vision, 2005.
5. J. Ruesch, M. Lopes, A. Bernardino, et al., "Multimodal saliencybased bottom-up attention: A framework for the humanoid robot iCub," in Proc. Int. Conf. Robot. Autom., 2008.
6. D. Figueira, M. Lopes, R. Ventura, and J. Ruesch, "From pixels to objects: Enabling a spatial model for humanoid social robots," in Proc. Int. Conf. Robot. Autom., 2009.
7. T. Xu, N. Chenkov, K. Kühnlenz, and M. Buss, "Autonomous switching of top-down and bottom-up attention selection for vision guided mobile robots," in Proc. Int. Conf. Intell. Robots Syst., 2009.
8. B. Schauerte and G. A. Fink, "Focusing computational visual attention in multi-modal human-robot interaction," in Proc. Int. Conf. Multimodal Interfaces, 2010.
9. M. Begum, F. Karray, G. K. I. Mann, and R. G. Gosine, "A probabilistic model of overt visual attention for cognitive robots," IEEE Trans. Syst., Man, Cybern. B, vol. 40, pp. 1305-1318, 2010.
10. B. Schauerte, J. Richarz, T. Plötz, et al., "Multi-modal and multicamera attention in smart environments," in Proc. Int. Conf. Multimodal Interfaces, 2009.
11. S. Frintrop, E. Rome, and H. I. Christensen, "Computational visual attention systems and their cognitive foundation: A survey," ACM Trans. Applied Perception, vol. 7, 2010.
12. C. Kayser, C. I. Petkov, M. Lippert, and N. K. Logothetis, "Mechanisms for allocating auditory attention: an auditory saliency map,"Current Biology, vol. 15, pp. 1943-1947, 2005. (Pubitemid 41566142)
13. O. Kalinli and S. Narayanan, "Prominence detection using auditory attention cues and task-dependent high level information," IEEE Trans. on Audio, Speech, and Language Proc., vol. 17, pp. 1009-1024, 2009.
14. M. Heracles, U. Körner, T. Michalke, et al., "A dynamic attention system that reorients to unexpected motion in real-world traffic environments,"in Proc. Int. Conf. Intell. Robots Syst., 2009.
15. L. Itti, C. Koch, and E. Niebur, "A model of saliency-based visual attention for rapid scene analysis," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, pp. 1254-1259, 1998. (Pubitemid 128742001)
16. L. Itti and P. F. Baldi, "Bayesian surprise attracts human attention," in Advances in Neural Information Processing Systems, 2006.
17. F. Shic and B. Scassellati, "A behavioral analysis of computational models of visual attention," Int. J. Comp. Vis., vol. 73, pp. 159-177, 2007. (Pubitemid 46181622)
18. B. Schauerte, J. Richarz, and G. A. Fink, "Saliency-based identification and recognition of pointed-at objects," in Proc. Int. Conf. Intell. Robots Syst., 2010.
19. X. Hou and L. Zhang, "Saliency detection: A spectral residual approach,"in Proc. Int. Conf. Comp. Vis. Pat. Rec., 2007.
20. C. Guo, Q. Ma, and L. Zhang, "Spatio-temporal saliency detection using phase spectrum of quaternion fourier transform," in Proc. Int. Conf. Comp. Vis. Pat. Rec., 2008.
21. A. Oppenheim and J. Lim, "The importance of phase in signals,"Proceedings of the IEEE, vol. 69, pp. 529-541, 1981.
22. D. Walther and C. Koch, "Modeling attention to salient proto-objects,"Neural Networks, vol. 19, pp. 1395-1407, 2006.
23. Y. Yu, G. K. I. Mann, and R. G. Gosine, "An object-based visual attention model for robotic applications," IEEE Trans. Syst., Man, Cybern. B, vol. 40, pp. 1398-1412, 2010.
24. J. Schmuedderich, H. Brandl, B. Bolder, et al., "Organizing multimodal perception for autonomous learning and interactive systems,"in Humanoids, 2008.
25. F. Orabona, G. Metta, and G. Sandini, "Attention in cognitive systems. theories and systems from an interdisciplinary viewpoint," L. Paletta and E. Rome, Eds., 2008, ch. A Proto-object Based Visual Attention Model, pp. 198-215.
26. J. Lichtenauer, E. Hendriks, and M. Reinders, "Isophote properties as features for object detection," in Proc. Int. Conf. Comp. Vis. Pat. Rec., 2005.
27. S. Vijayakumar, J. Conradt, T. Shibata, and S. Schaal, "Overt visual attention for a humanoid robot," in Proc. Int. Conf. Intell. Robots Syst., 2001.
28. K. A. Fleming, R. A. Peters II, and R. E. Bodenheimer, "Image mapping and visual attention on a sensory ego-sphere," in Proc. Int. Conf. Intell. Robots Syst., 2006.
29. A. Dankers, N. Barnes, and A. Zelinsky, "A reactive vision system: Active-dynamic saliency," in Proc. Int. Conf. Vis. Syst., 2007.
30. T. Machmer, A. Swerdlow, B. Kühn, and K. Kroschel, "Hierarchical, knowledge-oriented opto-acoustic scene analysis for humanoid robots and man-machine interaction," in Proc. Int. Conf. Robot. Autom., 2010.
31. B. Kühn, A. Belkin, A. Swerdlow, et al., "Knowledge-driven optoacoustic scene analysis based on an object-oriented world modelling approach for humanoid robots," in Proc. 41st Int. Symp. Robotics and 6th German Conf. Robotics (ISR/ROBOTIK), 2010.
32. I. Essa, "Ubiquitous sensing for smart and aware environments," IEEE Personal Communications, vol. 7, pp. 47-49, 2000. (Pubitemid 32031787)
33. J. Holsopple and S. Yang, "Designing a data fusion system using a top-down approach," in Proc. Int. Conf. Military Comm., 2009.
34. D. Hall and J. Linas, Handbook of Multisensor Data Fusion: Theory and Practice. CRC Press, 2008.
35. M. Baum, I. Gheta, A. Belkin, et al., "Data association in a world model for autonomous systems," in Proc. Int. Conf. Multisensor Fusion and Integration for Intelligent Systems, 2010.
36. D. Comaniciu and P. Meer, "Mean shift: A robust approach toward feature space analysis," IEEE Trans. Pattern Anal. Mach. Intell., pp. 603-619, 2002. (Pubitemid 34550429)
37. J. Hershey and P. Olsen, "Approximating the kullback leibler divergence between gaussian mixture models," in Int. Conf. Acoustics, Speech and Signal Processing, 2007.
38. T. Machmer, J. Moragues, A. Swerdlow, et al., "Robust impulsive sound source localization by means of an energy detector for temporal alignment and pre-classification," in Proc. Europ. Sig. Proc. Conf., 2009.
39. V. J. Hodge and J. Austin, "A survey of outlier detection methodologies,"Artificial Intelligence Review, vol. 22, pp. 85-126, 2004.
40. W.-L. Chou and S.-L. Yeh, "Location- and object-based inhibition of return are affected by different kinds of working memory," The Quarterly Journal of Experimental Psychology, vol. 61, pp. 1761-1768, 2008.
41. S. Onat, K. Libertus, and P. König, "Integrating audiovisual information for the control of overt attention," Journal of Vision, vol. 7, 2007.