Foveated visual search for corners

IEEE Transactions on Image Processing

Volumn 16, Issue 3, 2007, Pages 813-823

  Arnow, Thomas L ^a   Bovik, Alan Conrad ^a  

^a UNIVERSITY OF TEXAS AT AUSTIN   (United States)

Author keywords

Corner detection; Feature detection; Foveated vision; Machine vision

Indexed keywords

ALGORITHMS; FEATURE EXTRACTION; IMAGE RECOGNITION;

CORNER DETECTION; FEATURE DETECTION; FOVEATED VISION; FOVEATED VISUAL FIXATIONS;

COMPUTER VISION;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; COMPUTER ASSISTED DIAGNOSIS; EVALUATION; IMAGE ENHANCEMENT; METHODOLOGY; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; PATTERN RECOGNITION, AUTOMATED; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY;

EID: 33947278317     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2006.891335     Document Type: Article

References (77)

1. A. Srivastava, M. I. Miller, and U. Grenader, "Statistical odels for Bayesian object recognition," in The Handbook of Image and Video Processing. New York: Elsevier, 2005, pp. 1341-1354.
2. J. Clark and N. Ferrier, "Modal control of an attentive vision system," in Proc. 2nd Int. Conf. Computer Vision, 1988, pp. 514-523.
3. L. Wixson and D. Ballard, "Using intermediate objects to improve the efficiency of visual search," Int. J. Comput. Vis., vol. 12, no. 2, pp. 209-230, 1994.
4. W. Klarquist and A. Bovik, "Fovea: A foveated vergent active stereo vision system for dynamic three-dimensional scene recovery," IEEE Trans. Robotics Autom., vol. 14, no. 5, pp. 755-770, Oct. 1998.
5. C. Privitera and L. Stark, "Algorithms for defining visual regions-of-interest: Comparison with eye fixations," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 9, pp. 970-982, Sep. 2000.
6. R. Rao and D. Ballard, "A multiscale filter bank approach to camera movement control in active vision systems," Proc. SPIE, vol. 2345, pp. 105-116, 1994.
7. R. Rao, D. Ballard, G. Tesauro, D. Touretzky, and T. Leen, "Learning saccadic eye movements using multiscale spatial filters," in Proc. Conf. Advances in Neural Information Processing Systems, G. Tesauro, D. Touretzky, and T. Leen, Eds., New York, 1995, vol. 7, pp. 893-900.
8. R. Rao, G. Zelinsky, M. Hayhoe, D. Ballard, D. Touretzky, M. Mozer, and M. Hasselmo, "Modeling saccadic targeting in visual search," in Proc. Conf. Advances in Neural Information Processing, D. Touretzky, M. Mozer, and M. Hasselmo, Eds., New York, 1996, vol. 8, pp. 830-836.
9. B. Moghaddam and A. Pentland, "Probabilistic visual learning for object detection," in Proc. 5th Int. Conf. Computer Vision, Cambridge, MA, 1995, pp. 786-793.
10. W. Gribble, "Slow visual search in a fast-changing world," in Proc. Int. Symp. Computer Vision, Austin, TX, 1995, pp. 515-520.
11. J. Tsotsos, "On the relative complexity of active vs. passive visual search," Int. J. Comput. Vis., vol. 7, no. 2, pp. 127-141, 1992.
12. D. Mart, Vision. New York: Freeman, 1982.
13. E. Kowler, "The role of visual and cootive processes in the control of eye movement," in Eye Movements and Their Role in Visual and Cognitive Processes. Amsterdam, The Netherlands: Elsevier, 1990, pp. 1-63.
14. G. Sperling, "Comparison of perception in the moving and stationary eye," in Eye Movements and Their Role in Visual and Cognitive Processes. Amsterdam, The Netherlands: Elsevier, 1990, pp. 307-352.
15. W. S. Geisler and D. B. Hamilton, "Sampling-theory analysis of spatial vision," J. Opt. Soc. Amer. A, vol. 8, pp. 62-70, 1986.
16. W. S. Geisler and M. S. Banks, "Visual performance," in Handbook of Optics: Fundamentals, Techniques and Design, 2nd ed. New York: McGraw-Hill, 1995, vol. 1.
17. K. J. Wiebe and A. Basu, "Modelling ecologically specialized biological visual systems," Pattern Recognit., vol. 30, no. 10, pp. 1687-1703, Oct. 1997.
18. R. W. Rodieck, The First Steps in Seeing. Sunderland, MA: Sinauer, 1998.
19. A. L. Yarbus, Eye Movements and Vision. New York: Plenum, 1967.
20. S. Lee and A. Bovik, "Fast algorithms for foveated video processing," IEEE Trans. Circuits Syst. Video Technol., vol. 13, no. 2, pp. 149-162, Feb. 2003.
21. P. Kortum and W. S. Geisler, "Implementation of a foveated image coding system for image bandwidth reduction," Proc. SPIE, vol. 2657, no. 1, pp. 350-360, Apr. 1996.
22. A. M. Treisman and G. Gelade, "A feature-integration theory of attention," Cogn. Psych., vol. 12, no. 1, pp. 97-136, Jan. 1980.
23. J. M. Wolfe, K. R. Cave, and S. L. Franzel, "Guided search: An alternative to the feature integration model for visual search," J. Exp. Psych.: Human Percept. Perform., vol. 15, no. 3, pp. 419-433, Aug. 1989.
24. W. S. Geisler and K. L. Chou, "Separation of low-level and high-level factors in complex tasks: Visual search," Psychol. Rev., vol. 102, no. 2, pp. 356-378, Apr. 1995.
25. J. McGowan, E. Kowler, A. Sharma, and C. Chubb, "Saccadic localization of random dot targets," Vis. Res., vol. 38, no. 6, pp. 895-909, 1998.
26. J. Jonides, D. E. Irwin, and S. Yantis, "Integrating visual information from successive fixations," Science, vol. 215, no. 4529, pp. 192-194, Jan. 1982.
27. D. E. Irwin, S. Yantis, and J. Jonides, "Evidence against visual integration across saccadic eye movements," Percept. Psychophys., vol. 34, pp. 49-57, 1983.
28. D. E. Irwin, "Lexical processing during saccadic eye movements," Cogn. Psych., vol. 36, no. 1, pp. 1-27, Jun. 1998.
29. D. Irwin and R. Gordon, "Eye movements, attention and trans-saccadic memory," Vis. Cogn., vol. 5, no. 1, pp. 127-155, 1998.
30. H. Deubel, D. Irwin, and W. X. Schneider, "The subjective direction of gaze shifts long before the saccade," in Current Oculomotor Research: Physiological and Psychological Aspects. New York: Plenum, 1999, pp. 65-70.
31. R. M. Klein and E. Hansen, "On the relationship between shifts of attention and shifts of gaze," presented at the Psychonomics Society Meeting, Phoenix, AZ, Nov. 1979.
32. R. M. Klein and E. Hansen, "Shifts of attention & gaze: Evidence for independence," in Proc. Association for Research in Vision and Ophthalmology Annual Meeting, Sarasota, FL, Apr. 1979.
33. J. M. Wolfe, "Visual memory: What do you know about what you saw?," Curr. Biol., vol. 8, no. 9, pp. R303-R304, Apr. 1998.
34. T. Horowitz and J. M. Wolfe, "Visual search has no memory," Nature, vol. 394, no. 6693, pp. 575-577, 1998.
35. J. M. Wolfe and K. R. Cave, "The psychophysical evidence for a binding problem in human vision," Neuron, vol. 24, no. 1, pp. 11-17, Sep. 1999.
36. J. Epelboim, R. Steinman, E. Kowler, M. Edwards, Z. Pizlo, C. Erkelens, and H. Collewijn, "The function of visual search and memory in sequential looking tasks," Vis. Res., vol. 35, no. 23, pp. 3401-3422, 1995.
37. G. J. Zelinsky, R. P. Rao, M. M. Hayhoe, and D. H. Ballard, "Eye movements during a realistic search task," Investig. Opthal. Vis. Sci. Suppl., vol. 37, no. 3, p. S15, 1996.
38. Z. Wang, L. Lu, and A. Bovik, "Foveation scalable video coding with automatic fixation selection," IEEE Trans. Image Process., vol. 12, no. 2, pp. 243-254, Feb. 2003.
39. J. F. Canny, "Finding edges and lines in images," Tech. Rep. AD-A130824, Artif. Intell. Lab., Mass. Inst. Technol., Cambridge, 1983.
40. R. G. Raj, W. S. Geisler, R. A. Frazor, and A. C. Bovik, "Contrast statistics for foveated visual systems: Fixation selection by minimizing contrast entropy," J. Opt. Soc. Amer. A.
41. A. Najemnik and W. Geisler, "Optimal eye movement strategies in visual search," Nature, vol. 434, no. 7031, pp. 387-391, 2005.
42. U. Rajashekar, L. Cormack, and A. Bovik, "Point-of-gaze analysis reveals visual search strategies," Proc. SPIE, vol. 5292, no. 1, pp. 296-306.
43. U. Rajashekar, A. C. Bovik, and L. K. Cormack, "Visual search in noise: revealing the influence of structural cues by gaze-contingent classification image analysis," J. Vis., vol. 6, no. 4, pp. 379-386, 2006.
44. J. A. Noble, "Finding corners," Image Vis. Comput., vol. 6, no. 2, pp. 121-128, 1988.
45. P. Flynn and A. Jain, "On reliable curvature estimation," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 1989, pp. 110-116.
46. R. Mehrotra, S. Nichani, and N. Ranganathan, "Corner detection," Pattern Recognit., vol. 23, pp. 1223-1233, 1990.
47. J. Basak and D. Mahata, "A connectionist model for corner detection in binary and gray images," IEEE Trans. Neural Netw., vol. 11, no. 5, pp. 1124-1132, Oct. 2000.
48. L. Kitchen and A. Rosenfeld, "Gray-level corner detection," Pattern Recognit. Lett., vol. 1, no. 2, pp. 95-102, Dec. 1982.
49. C. Harris and M. Stephens, "A combined corner and edge detector," in Proc. 4th Alvey Vision Conf., 1988, pp. 147-151.
50. F. Mokhtarian and R. Suomela, "Robust image corner detection through curvature scale space," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 12, pp. 1376-1381, Dec. 1998.
51. H. Sossa and A. Palomino, "Model-based recognition of planar objects using geometric invariants," in Proc. Int. Conf. Image Processing, Mexico City, Mexico, 1996, vol. 3, pp. 603-606.
52. J. Qiang and R. Haralick, "Corner detection with covariance propagation," in Proc. IEEE Computer Society Conf., Seattle, WA, 1997, pp. 362-367.
53. Y.-H. Gu and T. Tjahjadi, "Corner-based feature extraction for object retrieval," in Proc. Int. Conf. Image Processing, Goteborg, Sweden, 1999, vol. 1, pp. 119-123.
54. A. Rattarangsi and R. Chin, "Scale-based detection of corners of planar curves," IEEE Trans. Pattern Anal. Mach. Intell., vol. 14, no. 4, pp. 430-449, Apr. 1992.
55. Y. H. Liu and X. Cai, "An efficient and robust corner detection algorithm," in Proc. 5th World Congr. Intelligent Contral and Automation, Hangzhou, China, Jun. 15-19, 2004.
56. D. Marr and E. Hildreth, "Theory of edge detection," Proc. Roy. Soc. Lond. B, vol. 207, no. 1167, pp. 187-217, Feb. 1980.
57. J. Shi and C. Tomasi, "Good features to track," in Proc. IEEE Computer Society Conf. Computer Vision and Pattern Recognition, Ithaca, NY, 1994, pp. 593-600.
58. T. Tommasini, A. Fusiello, E. Trucco, and V. Roberto, "Making good features track better," in Proc. IEEE Computer Soc. Conf. Computer Vision and Pattern Recognition, 1998, pp. 178-183.
59. C. Schmid, R. Mohr, and C. Bauckhage, "Evaluation of interest point detectors," Int. J. Comput. Vis., vol. 37, no. 2, pp. 151-172, 2000.
60. C. Kenney, B. Manjunath, M. Zuliani, G. Hewer, and A. Van Nevel, "A condition number for point matching with application to registration and postregistration error estimation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 11, pp. 1437-1454, Nov. 2003.
61. I. Gordon and D. G. Lowe, "Scene modelling, recognition and tracking with invariant image features," in Proc. Int. Symp. Mixed Augmented Reality, Arlington, VA, Nov. 2004, pp. 110-119.
62. D. Lowe, "Object recognition from local scale-invariant features," in Proc. 7th IEEE Int. Conf. Computer Vision, Vancouver, BC, Canada, 1999, vol. 2, pp. 1150-1157.
63. I. Reid and D. Murray, "Tracking foveated corner clusters using affine structure," in Proc. 4th Int. Conf. Computer Vision, 1993, pp. 76-83.
64. D. Murray, P. McLauchlan, I. Reid, and P. Sharkey, "Reactions to peripheral image motion using a head/eye platform," in Proc. 4th Int. Conf. Computer Vision, 1993, pp. 403-411.
65. Z. Wang and A. Bovik, "Embedded foveation image coding," IEEE Trans. Image Process., vol. 10, no. 10, pp. 1397-1410, Oct. 2001.
66. W. Geisler and J. Perry, "A real-time foveated multiresolution system for low-bandwidth video communication," Proc. SPIE, vol. 3299, pp. 294-305.
67. A. C. Bovik, Ed., The Handbook of Image and Video Processing, 2nd ed. New York: Elsevier, 2005.
68. A. P. Witkin, "Scale-space filtering," presented at the 8th Int. Joint Conf. Artificial Intelligence, Karlsruhe, Germany, Aug. 8-12, 1983.
69. T. Lindeberg, "Edge detection and ridge detection with automatic scale selection," in Proc. IEEE Computer Society Conf. Computer Vision and Pattern Recognition, Stockholm, Sweden, 1996, pp. 465-470.
70. S. M. Smith and J. M. Brady, "SUSAN - a new approach to low level image processing," Int. J. Comput. Vis., vol. 23, no. 1, pp. 45-78, 1997.
71. E. W. Weisstein, Relative Entropy. [Online]. Available: http://www.mathworld.wolfram.com/RelativeEntropy
72. Symmetrizing the Kullback-Leibler Distance. [Online]. Available: http://www.cmc.rice.edu/docs/docs/Joh2001Mar1Symmetrizi
73. K. Siddiqi, A. Shokoufandeh, S. Dickenson, and S. Zucker, "Shock graphs and shape matching," in Proc. 6th Int. Conf. Computer Vision, New Haven, CT, 1998, pp. 222-229.
74. J. H. van Hateren and A. van der Schaaf, "Independent component filters of natural images compared with simple cells in primary visual cortex," Proc. Biol. Sci., vol. 265, no. 1394, pp. 359-366, Mar. 1998.
75. J. M. Wolfe, S. J. Butcher, C. Lee, and M. Hyle, "Changing your mind: On the contributions of top-down and bottom-up guidance in visual search for feature singletons," J. Exp. Psych.: Human Percept. Perform., vol. 29, pp. 483-502, 2003.
76. J. M. Wolfe, "Moving towards solutions to some enduring controversies in visual research," Trends Cogn. Sci., vol. 7, no. 2, pp. 70-76, 2003.
77. P. J. Burt, "Smart sensing with a pyramid vision machine," Proc. IEEE, vol. 76, no. 8, pp. 1006-1015, Aug. 1988.