Vision-model-based image foveation and motion estimation

Optical Engineering

Volumn 44, Issue 10, 2005, Pages

  Yitzhaky, Yitzhak ^a   Peli, Eli ^b  

^a BEN GURION UNIVERSITY OF THE NEGEV   (Israel)

^b SCHEPENS EYE RESEARCH INSTITUTE   (United States)

Author keywords

Foveated imaging; Head mounted displays; Image registration; Motion estimation; Multiresolution; Vision model

Indexed keywords

EDGE DETECTION; FEATURE EXTRACTION; IMAGE COMPRESSION; IMAGING SYSTEMS; MATHEMATICAL MODELS; MOTION ESTIMATION;

FOVEATED IMAGING; HEAD-MOUNTED DISPLAYS; IMAGE REGISTRATION; MULTIRESOLUTION; VISION MODEL;

COMPUTER VISION;

EID: 33747610941     PISSN: 00913286     EISSN: 15602303     Source Type: Journal    
DOI: 10.1117/1.2084667     Document Type: Article

References (43)

1. W. S. Geisler and J. S. Perry, "A real-time foveated multi-resolution system for low-bandwidth video communication," Proc. SPIE 3299, 294-305 (1998).
2. S. Lee, M. S. Pattichis, and A. C. Bovik, "Foveated video quality assessment," IEEE Trans. Multimedia 4(1), 129-132 (2002).
3. E. L. Schwartz, "Computational anatomy and functional architecture of striate cortex: A spatial mapping approach to perceptual coding," Vision Res. 20(8), 645-669 (1980).
4. R. Wallace, P. W. Ong, B. Bederson, and E. Schwartz, "Space variant image processing," Int. J. Comput. Vis. 13(1), 71-90 (1994).
5. E. C. Chang and C. K. Yap, "A wavelet approach to foveating images," in 13th ACM Symp. Computational Geometry, pp. 397-399 (1997).
6. W. S. Geisler and J. S. Perry, "Variable-resolution displays for visual communication and simulation," Soc. Info. Display 30, 420-423 (1999).
7. S. Lee, M. S. Pattichis, and A. C. Bovik, "Foveated video compression with optimal rate control," IEEE Trans. Image Process. 10, 977-992 (2001).
8. D. F. Wilson and J. P. Siebert, "Foveated stereo for an active robot vision system," European Conf. Visual Perception (ECVP), Perception 22 Supplement, 114-115, Pion Ltd, London (1993).
9. A. Basu and K. J. Wiebe, "Enhancing videoconferencing using spatially varying sensing," IEEE Trans. Syst. Man Cybern. - Part A: Systems and Humans 28(2), 137-148 (1998).
10. M. L. Thomas, R. Robinson, W. P. Siegmund, and S. E. Antos, "Fiberoptic development for use on the fiber optic helmet-mounted display," Opt. Eng. 29, 855-862 (1990).
11. P. T. Kortum and W. S. Geisler, "Implementation of a foveated image-coding system for bandwidth reduction of video images," Proc. SPIE 2657, 350-360 (1996).
12. H. D. Warner, G. L. Serfoss, and D. C. Hubbard, "Effects of area-of-interest display characteristics on visual search performance and head movements in simulated low-level flight," Armstrong Laboratory, Human Resources Directorate, Aircrew Training Division, Williams AFB, AZ (1993).
13. C. Stiller and J. Konrad, "Estimating motions in image sequences - a tutorial on modeling and computation of 2D motion," IEEE Signal Process. Mag. 16, 70-91 (1999).
14. B. Bridgeman, A. H. C. van der Heijden, and B. Velichkovsky, "Visual stability and saccadic eye movements," Behav. Brain Sci. 17(2), 247-258 (1994).
15. D. Heiner, B. Bridgman, and W. X. Schneider, "Immediate post-saccadic information mediates space constancy," Vision Res. 38, 3147-3159 (1998).
16. D. O. Bahcall and E. Kowler, "Illusory shifts in visual direction accompany adaptation of saccadic eye movement," Nature (London) 400, 864-866 (1999).
17. D. Marr, Vision: A Computational Investigation into the Human Representation and Processing of Visual Information, W. H. Freeman and Company, New York (1982).
18. H. Spitzer, M. Almon, and I. Sherman, "A model for the early stages of motion processing based on spatial and temporal edge detection by X-cells," Spatial Vis. 8, 341-368 (1994).
19. D. C. Burr, M. C. Morrone, and D. Spinelli, "Evidence for edge and bar detectors in human vision," Vision Res. 29, 419-431 (1989).
20. E. Peli, R. A. Augliere, and G. T. Timberlake, "Feature-based registration of retinal images," IEEE Trans. Med. Imaging 6(3), 272-278 (1987).
21. H. Li, B. S. Manjunath, and S. K. Mitra, "A contour-based approach to multisensor image registration," IEEE Trans. Image Process. 4(3), 320-334 (1995).
22. N. S. Kopeika, A System Engineering Approach to Imaging, SPIE Optical Engineering Press, Bellingham, WA (1998).
23. H. R. Wilson and J. R. Bergen, "A four mechanism model for threshold in spatial vision," Vision Res. 19, 19-32 (1979).
24. A. B. Watson, "Summation of grating patches indicates many types of detector at one retinal location," Vision Res. 22, 17-25 (1982).
25. N. Graham, J G. Robson, and J. Nachmias, "Grating summation in fovea and periphery," Vision Res. 18(7), 815-825 (1978).
26. M. A. Garcia-Perez and V. Sierra-Vazquez, "Do channels shift their tuning towards lower spatial frequencies in the periphery?" Vision Res. 36(20), 3339-3372 (1996).
27. C. J. van den Branden Lambrecht, "A working spatio-temporal model of the human visual system for image restoration and quality assessment applications," in the Proc. Intl. Conf. Acoustics, Speech, Signal Process., pp. 2293-2296, (1996).
28. E. Peli, "Feature detection algorithm based on a visual system model," Proc. IEEE 90, 78-93 (2002).
29. J. Daugman, "Uncertainty relation for resolution in space, spatial frequency, and orientation optimized two-dimensional visual cortical filters," J. Opt. Soc. Am. A 2(7), 1160-1168 (1985).
30. E. Peli, "Contrast in complex images," J. Opt. Soc. Am. A 7(10), 2032-2040 (1990).
31. D. J. Field, "Relations between the statistics of natural images and the response properties of cortical cells," J. Opt. Soc. Am. A 4, 2379-2394 (1987).
32. E. Peli, J. Yang, and R. B. Goldstein, "Image invariance with changes in size: The role of peripheral contrast thresholds," J. Opt. Soc. Am. A 8(11), 1762-1774 (1991).
33. M. A. Georgeson and G. D. Sullivan, "Contrast constancy: Deblurring in human vision by spatial frequency channels," J. Physiol. (London) 252(3), 627-656 (1975).
34. J. G. Robson and N. Graham, "Probability summation and regional variation in contrast sensitivity across the visual field," Vision Res. 21, 409-418 (1981).
35. M. W. Cannon Jr., "Perceived contrast in the fovea and periphery," J. Opt. Soc. Am. A 2, 1760-1768 (1985).
36. J. S. Pointer and R. F. Hess, "The contrast sensitivity gradient across the human visual field: With emphasis on the low spatial frequency range," Vision Res. 29, 1133-1151 (1989).
37. E. Peli and G. A. Geri, "Discrimination of wide-field images as a test of a peripheral-vision model," J. Opt. Soc. Am. A 18, 294-301 (2001).
38. G. J. P. Barten, Contrast Sensitivity of the Human Eye and Its Effects on Image Quality, SPIE Optical Engineering Press, Bellingham, WA (1999).
39. G. J. Burton and R. Moorhead, "Color and spatial structure in natural scenes," Appl. Opt. 26(1), 157-170 (1987).
40. E. Peli, L. Arend, G. Young, and R. Goldstein, "Contrast sensitivity to patch stimuli: Effects of spatial bandwidth and temporal presentation," Spatial Vis. 7(1), 1-14 (1993).
41. L. G. Brown, "A survey of image registration techniques," ACM Comput. Surv. 24(4), 325-376 (1992).
42. C. D. Kuglin and D. C. Hines, "The phase correlation image alignment method," IEEE Conf. Cybernetics Soc., pp. 163-165 (1975).
43. D. I. Barnea and H. F. Silverman, "A class of algorithms for fast digital image registration," IEEE Trans. Comput. C-21, 179-186 (1972).