An object-based visual attention model for robotic applications

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 40, Issue 5, 2010, Pages 1398-1412

  Yu, Yuanlong ^a   Mann, George K I ^a   Gosine, Raymond G ^a  

^a MEMORIAL UNIVERSITY OF NEWFOUNDLAND   (Canada)

Author keywords

Integrated competition (IC) hypothesis; mobile robotics; object based visual attention; topdown biasing

Indexed keywords

ATTENTION MODEL; CONTOUR FEATURES; INTEGRATED COMPETITION (IC) HYPOTHESIS; LEARNING PHASE; LOCATION BASED; LONG TERM MEMORY; MOBILE ROBOTIC; MOVING OBJECTS; OBJECT BASED; OBJECT OF INTERESTS; OBJECT REGION; OBJECT REPRESENTATIONS; ORIENTATION FEATURES; PROCESSING MODULES; ROBOTIC APPLICATIONS; SALIENCY MAP; SELECTION PROCEDURES; TOPDOWN; VISUAL ATTENTION MODEL; VISUAL FIELDS; VISUAL PERCEPTION;

COMPETITION; IMAGE SEGMENTATION; ROBOTICS; ROBOTS; VISION;

FEATURE EXTRACTION;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; ATTENTION; AUTOMATED PATTERN RECOGNITION; BIOMIMETICS; COMPUTER SIMULATION; METHODOLOGY; ROBOTICS; THEORETICAL MODEL; VISION;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; ATTENTION; BIOMIMETICS; COMPUTER SIMULATION; MODELS, THEORETICAL; PATTERN RECOGNITION, AUTOMATED; ROBOTICS; VISUAL PERCEPTION;

EID: 77956700008     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2009.2038895     Document Type: Article

References (58)

1. D. G. Lowe, "Object recognition from local scale-invariant features," in Proc. IEEE ICCV, 1999, pp. 1150-1157.
2. C. Harris and M. J. Stephens, "A combined corner and edge detector," in Proc. 4th Alvey Vis. Conf., 1988, pp. 147-151.
3. K. Sohn, J. H. Kim, and W. E. Alexander, "A mean field annealing approach to robust corner detection," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol.28, no.1, pp. 82-90, Feb. 1998.
4. J.Wang, H. Zha, and R. Cipolla, "Coarse-to-fine vision-based localization by indexing scale-invariant features," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol.36, no.2, pp. 413-422, Apr. 2006.
5. A. A. Argyros, K. E. Bekris, and S. C. Orphanoudakis, "Robot homing based on corner tracking in a sequence of a panoramic images," in Proc. IEEE Int. Conf. CVPR, 2001, pp. 3-10.
6. I. Ulrich and I. Nourbakhsh, "Appearance-based place recognition for topological localization," in Proc. IEEE ICRA, 2000, pp. 1023-1029.
7. A. Remazeilles and F. Chaumette, "Image-based robot navigation from an image memory," Robot. Auton. Syst., vol.55, no.4, pp. 345-356, Apr. 2007.
8. J. Duncan, "Selective attention and the organization of visual information," J. Exp. Psychol.: Gen., vol.113, no.4, pp. 501-517, Dec. 1984.
9. J. M. Henderson, J. R. Brockmole, M. S. Castelhano, and M. Mack, "Visual saliency does not account for eye movements during visual search in real-world scenes," in Eye Movements: A Window on Mind and Brain, R. V. Gompel, M. Fischer, W. Murray, and R. Hill, Eds. Oxford, U.K.: Elsevier, 2007, pp. 537-562.
10. L. Itti, C. Koch, and E. Niebur, "Amodel of saliency-based visual attention for rapid scene analysis," IEEE Trans. Pattern Anal. Mach. Intell., vol.20, no.11, pp. 1254-1259, Nov. 1998.
11. B. J. Scholl, "Objects and attention: The state of art," Cognition, vol. 80, no. 1/2, pp. 1-46, Jun. 2001.
12. M. I. Posner, C. R. R. Snyder, and B. J. Davidson, "Attention and the detection of signals," J. Exp. Psychol.: Gen., vol.109, no.2, pp. 160-174, Jun. 1980.
13. J. M. Wolfe, "Preattentive object files: Shapeless bundles of basic features," Vis. Res., vol.37, no.1, pp. 25-43, Jan. 1997.
14. C. R. Olson, "Object-based vision and attention in primates," Curr. Opin. Neurobiol., vol.11, no.2, pp. 171-179, Apr. 2001.
15. M. Bravo and R. Blake, "Preattentive vision and perceptual groups," Perception, vol.19, no.4, pp. 515-522, 1990.
16. K. M. O'Craven, P. E. Downing, and N. Kanwisher, "FMRI evidence for objects as the units of attentional selection," Nature, vol.401, no.6753, pp. 584-587, Oct. 1999.
17. J. Duncan, G. Humphreys, and R. Ward, "Competitive brain activity in visual attention," Curr. Opin. Neurobiol., vol.7, no.2, pp. 255-261, Apr. 1997.
18. P. R. Roelfsema, V. A. F. Lamme, and H. Spekreijse, "Object-based attention in the primary visual cortex of the macaque monkey," Nature, vol.395, no.6700, pp. 376-381, Sep. 1998.
19. C. M. Moore, S. Yantis, and B. Vaughan, "Object-based visual selection: Evidence from perceptual completion," Psychol. Sci., vol.9, no.2, pp. 104-110, Mar. 1998.
20. A. M. Treisman and G. Gelade, "A feature-integration theory of attention," Cogn. Psychol., vol.12, no.1, pp. 97-136, Jan. 1980.
21. J. M. Wolfe, "Guided search 2.0: A revised model of visual search," Psychon. Bull. Rev., vol.1, no.2, pp. 202-238, 1994.
22. J. Duncan, "Converging levels of analysis in the cognitive neuroscience of visual attention," Philos. Trans. R. Soc. Lond. B: Biol. Sci., vol.353, no.1373, pp. 1307-1317, Aug. 1998.
23. V. Navalpakkam and L. Itti, "Modeling the influence of task on attention," Vis. Res., vol.45, no.2, pp. 205-231, Jan. 2005.
24. T. Hoya, "Notions of intuition and attention modeled by a hierarchically arranged generalized regression neural network," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol.34, no.1, pp. 200-209, Feb. 2004.
25. A. Carbone, D. Ciacelli, A. Finzi, and F. Pirri, "Autonomous attentive exploration in search and rescue scenarios," in Proc. 4th Int. WAPCV, 2007, pp. 431-446.
26. C. Breazeal, A. Edsinger, P. Fitzpatrick, and B. Scassellati, "Active vision for sociable robots," IEEE Trans. Syst., Man, Cybern. A, Syst., Humans, vol.31, no.5, pp. 443-453, Sep. 2001.
27. A. Belardinelli, F. Pirri, and A. Carbone, "Bottom-up gaze shifts and fixations learning by imitation," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol.37, no.2, pp. 256-271, Apr. 2007.
28. Y. Sun and R. Fisher, "Object-based visual attention for computer vision," Artif. Intell., vol.146, no.1, pp. 77-123, May 2003.
29. M. Z. Aziz, B. Mertsching, M. Salah, E.-N. Shafik, and R. Stemmer, "Evaluation of visual attention models for robots," in Proc. IEEE ICVS, 2006, p. 20.
30. F. Orabona, G. Metta, and G. Sandini, "Object-based visual attention: A model for a behaving robot," in Proc. IEEE Int. Conf. CVPR, 2005, p. 89.
31. R. W. Hill, "Perceptual attention in virtual humans: Towards realistic and believable gaze behaviors," in Proc. AAAI Fall Symp. Simulating Human Agents, 2000, pp. 46-52.
32. Y. Kim, M. van Velsen, and R. W. Hill, "Modeling dynamic perceptual attention in complex virtual environments," in Proc. 5th Int. Work. Conf. IVA, 2005, pp. 266-277.
33. M. R. Endsley, "Designing for situation awareness in complex systems," in Proc. 2nd Int. Workshop Symbiosis Humans, Artifacts Environ., 2001, pp. 1-14.
34. Y. Yu, G. K. I. Mann, and R. G. Gosine, "An object-based visual attention model for robots," in Proc. IEEE ICRA, 2008, pp. 943-948.
35. H.-C. Nothdurft, "The role of features in preattentive vision: Comparison of orientation, motion and color cues," Vis. Res., vol.33, no.14, pp. 1937-1958, Sep. 1993.
36. P. J. Burt and E. H. Adelson, "The Laplacian pyramid as a compact image code," IEEE Trans. Commun., vol.COM-31, no.4, pp. 532-540, Apr. 1983.
37. J. G. Daugman, "Uncertainty relation for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cortical filters," J. Opt. Soc. Amer. A, Opt. Image Sci., vol.2, no.7, pp. 1160-1169, Jul. 1985.
38. D. J. Heeger, "Model for the extraction of image flow," J. Opt. Soc. Amer. A, Opt. Image Sci., vol.4, no.8, pp. 1455-1471, Aug. 1987.
39. E. H. Adelson and J. R. Bergen, "Spatiotemporal energy models for the perception of motion," J. Opt. Soc. Amer. A, Opt. Image Sci., vol.2, no.2, pp. 284-299, Feb. 1985.
40. E. P. Simoncelli and E. H. Adelson, "Computing optical flow distributions using spatio-temporal filters," MIT Press, Cambridge, MA, 1991.
41. E. P. Simoncelli, "Distributed representation and analysis of visual motion," Ph.D. dissertation, Dept. Elect. Eng. Comput. Sci., MIT, Cambridge, MA, 1993.
42. B. Jahne, Spatio-Temporal Image Processing: Theory and Scientific Applications. Secaucus, NJ: Springer-Verlag, 1993.
43. R. Eckhorn, "Neural principles of preattentive scene segmentation: Hints from cortical recordings, related models and perception," in Models of Neural Networks IV: Early Vision and Attention, J. L. V. Hemmen, J. D. Cowan, and E. Domany, Eds. Secaucus, NJ: Springer-Verlag, 2002, pp. 183-216.
44. S. E. Palmer, Vision Science: Photons to Phenomenology. Cambridge, MA: MIT Press, 1999.
45. T. Leung and J. Malik, "Contour continuity in region based image segmentation," in Proc. Eur. Conf. Comput. Vis., 1998, pp. 544-559.
46. S. C. Zhu and A. Yuille, "Region competition: Unifying snakes, region growing, and Bayes/MDL for multiband image segmentation," IEEE Trans. Pattern Anal. Mach. Intell., vol.18, no.9, pp. 884-900, Sep. 1996.
47. J. Shi and J. Malik, "Normalized cuts and image segmentation," IEEE Trans. Pattern Anal. Mach. Intell., vol.22, no.8, pp. 888-905, Aug. 2000.
48. J. Malik, S. Belongie, T. Leung, and J. Shi, "Contour and texture analysis for image segmentation," Int. J. Comput. Vis., vol.43, no.1, pp. 7-27, Jun. 2001.
49. G. W. Humphreys, "Neural representation of objects in space: A dual coding account," Philos. Trans. R. Soc. Lond. B: Biol. Sci., vol.353, no.1373, pp. 1341-1351, Aug. 1998.
50. A. N. Redlich, "Redundancy reduction as a strategy for unsupervised learning," Neural Comput., vol.5, no.2, pp. 289-304, Mar. 1993.
51. A. Blake and M. Isard, Active Contours: The Application of Techniques From Graphics, Vision, Control Theory and Statistics to Visual Tracking of Shapes in Motion. Secaucus, NJ: Springer-Verlag, 1998.
52. A. Dobbins, S. W. Zucker, and M. S. Cynader, "Endstopping and curvature," Vis. Res., vol.29, no.10, pp. 1371-1387, 1989.
53. J. Duncan and G.W. Humphreys, "Visual search and stimulus similarity," Psychol. Rev., vol.96, no.3, pp. 433-458, Jul. 1989.
54. J. MacCormick, "Probabilistic modelling and stochastic algorithms for visual localisation and tracking," Ph.D. dissertation, Dept. Eng. Sci., Univ. Oxford, Oxford, U.K., 2000.
55. E. K. Miller and J. D. Cohen, "An integrative theory of prefrontal cortex function," Annu. Rev. Neurosci., vol.24, no.1, pp. 167-202, 2001.
56. J. D. Cohen, G. Aston-Jones, and M. S. Gilzenrat, "A systems-level perspective on attention and cognitive control: Guided activation, adaptive gating, conflict monitoring, and exploitation versus exploration," in Cognitive Neuroscience of Attention, M. I. Posner, Ed. New York: Guilford Press, 2004, pp. 71-90.
57. S. Araki, T. Matsuoka, H. Takemura, and N. Yokoya, "Real-time tracking of multiple moving objects in moving camera image sequences using robust statistics," in Proc. ICPR, 1998, vol.2, pp. 1433-1436.
58. T. S. Lee and M. Nguyen, "Dynamics of subjective contour formation in the early visual cortex," Proc. Nat. Acad. Sci. U.S.A., vol.98, no.4, pp. 1907-1911, Feb. 2001.