A probabilistic model of overt visual attention for cognitive robots

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 40, Issue 5, 2010, Pages 1305-1318

  Begum, Momotaz ^a   Karray, Fakhri ^a   Mann, George K I ^b   Gosine, Raymond G ^b  

^a UNIVERSITY OF WATERLOO   (Canada)

^b MEMORIAL UNIVERSITY OF NEWFOUNDLAND   (Canada)

Author keywords

Bayes filter; biased competition (BC); overt visual attention; probabilistic modeling; scale invariant feature transform (SIFT)

Indexed keywords

BAYES FILTER; BIASED COMPETITION; PROBABILISTIC MODELING; SCALE INVARIANT FEATURE TRANSFORMS; VISUAL ATTENTION;

BAYESIAN NETWORKS; CAMERAS; COMPETITION; MAMMALS; ROBOTS;

EYE MOVEMENTS;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; COGNITION; COMPUTER SIMULATION; DECISION SUPPORT SYSTEM; METHODOLOGY; ROBOTICS; STATISTICAL MODEL;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; COGNITION; COMPUTER SIMULATION; DECISION SUPPORT TECHNIQUES; MODELS, STATISTICAL; PATTERN RECOGNITION, AUTOMATED; ROBOTICS;

EID: 77956689729     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2009.2037511     Document Type: Article

References (51)

1. C. Koch and S. Ullman, "Shifts in selective visual attention: Toward the underlying neural circuitry," Human Neurobiol., vol.4, no.4, pp. 219-227, 1985.
2. L. Itti, C. Koch, and E. Niebur, "Amodel of saliency-based visual attention for rapid scene analysis," IEEE Trans. Pattern Anal. Mach. Intell., vol.20, no.11, pp. 1254-1259, Nov. 1998.
3. L. Itti and C. Koch, "A saliency based search mechanism for overt and covert shift of visual attention," Vis. Res., vol.40, no.10-12, pp. 1489-1506, Jun. 2000.
4. R. Milanese, "Detecting salient regions in an image: From biological evidence to computer implementation," Ph.D. dissertation, Univ. Geneva, Geneva, Switzerland, 1993.
5. V. Navalpakkam and L. Itti, "Top-down attention selection is finegrained," J. Vis., vol.6, no.11, pp. 1180-1193, Oct. 2006.
6. J. K. Tsotsos, S. Culhane, Y. Winky, L. Yuzhong, N. Davis, and F. Nuflo, "Modeling visual attention via selective tuning," Artif. Intell., vol. 78, no. 1/2, pp. 507-545, Oct. 1995.
7. K. R. Cave, "The FeatureGate model of visual selection," Psychol. Res., vol. 62, no. 2/3, pp. 182-194, 1999.
8. Y. Sun and R. Fisher, "Object-based visual attention for computer vision," Artif. Intell., vol.146, no.1, pp. 77-123, May 2003.
9. S. Frintrop, VOCUS: A visual attention system for object detection and goal-directed search, vol.3899, Lecture Notes in Artificial Intelligence (LNAI). Berlin, Germany: Springer-Verlag, 2006.
10. D. A. Chernyak and L. W. Stark, "Top-down guided eye movements," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol.31, no.4, pp. 514-522, Aug. 2001.
11. F. Orabona, G. Metta, and G. Sandini, "Object-based visual attention: A model for a behaving robot," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2005, pp. 88-89.
12. C. Breazeal, A. Edsinger, P. Fitzpatrick, and B. Scassellati, "Active vision for sociable robots," IEEE Trans. Syst., Man, Cybern. A, Syst., Humans, vol.31, no.5, pp. 443-453, Sep. 2001.
13. A. Ude, V. Wyart, L.-H. Lin, and G. Cheng, "Distributed visual attention on a humanoid robot," in Proc. IEEE-RAS Int. Conf. Humanoid Robots, 2005, pp. 381-386.
14. J. A. Driscoll, R. A. Peters, and K. R. Cave, "A visual attention network for a humanoid robot," in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst., 1998, pp. 1968-1974.
15. S. Vijayakumar, J. Conrad, T. Shibata, and S. Schaal, "Overt visual attention for a humanoid robot," in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst., 2001, pp. 2332-2337.
16. A. Dankers, N. Barnes, and A. Zelinsky, "A reactive vision system: Active-dynamic saliency," in Proc. Int. Conf. Comput. Vis. Syst., 2007, 10.2390/biecoll-icvs2007-91.
17. J. J. Clark, "Spatial attention and saccadic camera motion," in Proc. IEEE Int. Conf. Robot. Autom., 1998, pp. 3247-3252.
18. L. Manfredi, E. S. Maini, P. Dario, C. Laschi, B. Girard, N. Tabareau, and A. Berthoz, "Implementation of neurophysiological model of saccadic eye movements on an anthropomorphic robotic head," in Proc. IEEE/RSJ Int. Conf. Humanoid Robot., 2006, pp. 438-443.
19. K. Hasoda, H. Sumioh, A. Morita, and M. Asada, "Acquisition of humanrobot joint attention through real-time natural interaction," in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst., 2004, pp. 2867-2872.
20. S. Frintrop and P. Jensfelt, "Active gaze control for attentional visual slam," in Proc. IEEE Int. Conf. Robot. Autom., 2008, pp. 3690-3697.
21. S. May, M. Klodt, E. Rome, and R. Breithaupt, "GPU-accelerated affordance cueing based on visual attention," in Proc. IEEE Int. Conf. Intell. Robots Syst., 2007, pp. 3385-3390.
22. R. Sim and J. J. Little, "Autonomous vision based exploration and mapping using hybrid maps and Rao-Blackwellised particle filters," in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst., 2006, pp. 2082-2089.
23. A. Davison and D. Murray, "Simultaneous localization and map-building using active vision," IEEE Trans. Pattern Anal. Mach. Intell., vol.24, no.7, pp. 865-880, Jul. 2002.
24. M. Bollmann, R. Hoischen, M. Jesikiewicz, C. Justkowski, and B. Mertsching, "Playing domino: A case study for an active vision system," in Proc. 1st Int. Conf. Comput. Vis. Syst., vol.1542, LNCS, 1999, pp. 392-411.
25. J. C. Baccon, L. Hafemeister, and P. Gaussier, "A context and task dependent visual attention system to control a mobile robot," in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst., 2002, pp. 238-243.
26. S. J. Dickinson, H. I. Christensen, J. K. Tsotsos, and G. Olofsson, "Active object recognition integrating attention and viewpoint control," Comput. Vis. Image Underst., vol.67, no.3, pp. 239-260, Sep. 1997.
27. G. Heidemann, R. Rae, H. Bekel, I. Bax, and H. Ritter, "Integrating context-free and context-dependent attentional mechanisms for gestural object reference," Mach. Vis. Appl., vol.16, no.1, pp. 64-73, Dec. 2002. (Pubitemid 40003028)
28. A. Belardinelli, F. Pirri, and A. Carbone, "Bottom-up gaze shifts and fixations learning by imitation," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol.37, no.2, pp. 256-271, Apr. 2007.
29. M. Oginoa, H. Toichia, Y. Yoshikawaa, and M. Asadaa, "Interaction rule learning with a human partner based on an imitation faculty with a simple visuo-motor mapping," Robot. Auton. Syst., vol.54, no.5, pp. 414-418, May 2006.
30. M. Lopes and J. S. Victor, "A developmental roadmap for learning by imitation in robots," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol.37, no.2, pp. 308-321, Apr. 2007.
31. R. Desimone and J. Duncan, "Neural mechanisms of selective visual attention," Annu. Rev. Neurosci., vol.18, pp. 193-222, 1995.
32. S. Kastner and L. G. Ungerleider, "The neural basis of biased competition in human visual cortex," Neuropsychologia, vol.39, no.12, pp. 1263-1276, 2001.
33. J. H. Reynolds, L. Chelazzi, and R. Desimone, "Competitive mechanisms subserve attention in macaque areas V2 and V4," J. Neurosci., vol.19, no.5, pp. 1736-1753, Mar. 1999.
34. L. Chelazzi, E. K. Miller, J. Duncan, and R. Desimone, "A neural basis for visual search in inferior temporal cortex," Nature, vol.363, no.6427, pp. 345-347, May 1993.
35. sL. J. Lanyon and S. L. Denham, "A model of active visual search with object-based attention guiding scan paths," Neural Netw., vol. 17, no. 5/6, pp. 873-897, Jun./Jul. 2004.
36. E. T. Rolls and G. Deco, Computational Neuroscience of Vision. London, U.K.: Oxford Univ. Press, 2002.
37. M. S. Peterson, A. F. Kramer, R. F.Wang, D. E. Irwin, and J. S. McCarley, "Visual search has memory," Psychol. Sci., vol.12, no.4, pp. 287-292, Jul. 2002.
38. M. I. Posner and Y. Cohen, Components of Visual Orienting. Hillsdale, NJ: Erlbaum, 1984, pp. 531-556.
39. J. Vitay, N. P. Rougier, and F. Alexandre, A Distributed Model of Spatial Visual Attention. New York: Springer-Verlag, 2005, pp. 54-72.
40. P. F. Dominey and M. A. Arbib, "A cortico-subcortical model for generation of spatially accurate sequential saccades," Cereb. Cortex, vol.2, no.2, pp. 153-175, Mar./Apr. 1992.
41. J. J. Clark and N. J. Ferrier, "Modal control of an attentive vision system," in Proc. IEEE Int. Conf. Comput. Vis., 1988, pp. 514-523.
42. J. Ruesch, M. Lopes, A. Bernardino, J. Hornstein, J. S. Victor, and R. Pfeifer, "Multi modal saliency-based bottom-up attention: A framework for the humanoid robot iCub," in Proc. IEEE Int. Conf. Robot. Autom., 2008, pp. 962-967.
43. J. L. Crespo, A. Faina, and R. J. Duro, "An adaptive detection/attention mechanism for real time robot operation," Neurocomputing, vol.72, no.4-6, pp. 850-860, Jan. 2009.
44. J. M. Canas, M. M. Casa, and T. Gonzalez, "An overt visual attention mechanism based on saliency dynamics," Int. J. Intell. Comput. Med. Sci. Image Process., vol.2, pp. 93-100, 2008.
45. A. Elfes, "Sonar-based real-world mapping and navigation," IEEE J. Robot. Autom., vol.3, no.3, pp. 249-265, Jun. 1987.
46. D. J. Felleman and D. C. V. Essen, "Distributed hierarchical processing in the primate cerebral cortex," Cereb. Cortex, vol.1, no.1, pp. 1-47, Jan./Feb. 1991.
47. D. G. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vis., vol.60, no.2, pp. 91-110, Nov. 2004.
48. D. G. Lowe, "Local feature view clustering for 3d object recognition," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2001, pp. 682-688.
49. M. A. Tanner, Tools for Statistical Inference: Methods for the Exploration of Posterior Distributions and Likelihood Functions. NewYork: Springer-Verlag, 1996.
50. F. Shic and B. Scassellati, "A behavioral analysis of computational models of visual attention," Int. J. Comput. Vis., vol.73, no.2, pp. 159-177, Jun. 2007.
51. L. Itti and P. Baldi, "A principled approach to detecting surprising events in video," in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recog., 2005, pp. 631-637.