Three-systems theory of human visual motion perception: Review and update

Journal of the Optical Society of America A: Optics and Image Science, and Vision

Volumn 18, Issue 9, 2001, Pages 2331-2370

  Lu, Zhong Lin ^a   Sperling, George ^b  

^a UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BIOLOGICAL MODEL; CONTRAST SENSITIVITY; HUMAN; LIGHT; MOVEMENT PERCEPTION; PHYSIOLOGY; PSYCHOLOGICAL MODEL; REVIEW; VISION;

CONTRAST SENSITIVITY; HUMANS; LIGHT; MODELS, NEUROLOGICAL; MODELS, PSYCHOLOGICAL; MOTION PERCEPTION; VISUAL PERCEPTION;

COMPUTATION THEORY; MATHEMATICAL MODELS; MATHEMATICAL TRANSFORMATIONS; VISION;

THREE-SYSTEMS THEORY;

MOTION ESTIMATION;

EID: 0035459688     PISSN: 10847529     EISSN: 15208532     Source Type: Journal    
DOI: 10.1364/JOSAA.18.002331     Document Type: Article

References (124)

1. E. G. Boring, Sensation and Perception in the History of Experimental Psychology: A History of Experimental Psychology, 2nd ed. (Appleton-Century-Crofts, New York, 1942).
2. F. Kenkel, “Untersuchungen ueber Zusammenhang zwischen Erscheinungsgross und Erscheinungsbewegung beim einigen sogenannten optischen Täuschungen,” Z. Psychol. 61, 358-449 (1913).
3. A. Korte, “Kinematoskopische Untersuchungen,” Z. Psychol. 72, 193-206 (1915).
4. M. Wertheimer, “Ueber das Sehen von Scheinbewegunen und Scheinkorpern,”Z. Psychol. 61, 161-265 (1912).
5. O. Braddick, “A short-range process in apparent motion,” Vision Res. 14, 519-529 (1974).
6. A. Pantle and L. Picciano, “A multistable movement display: Evidence for two separate motion systems in human vision,” Science 193, 500-502 (1976).
7. G. Mather, P. Cavanagh, and A. M. Anstis, “A moving display which opposes short-range and long-range signals,” Perception 14, 163-166 (1985).
8. M. A. Georgeson and T. M. Shackleton, “Monocular motion sensing, binocular motion perception,” Vision Res. 29, 1511-1523 (1989).
9. P. Cavanagh and G. Mather, “Motion: The long and the short of it,” Spatial Vision 4, 103-129 (1989).
10. P. Cavanagh, “Short-range vs long-range motion: Not a valid distinction,” Spatial Vision 5, 303-309 (1991).
11. C. Chubb and G. Sperling, “Two motion perception mechanisms revealed by distance driven reversal of apparent motion,” Proc. Natl. Acad. Sci. USA 86, 2985-2989 (1989).
12. W. Reichardt, “Autokorrelationsauswertung als funktionsprinzip des zentralnervensystems,” Z. Naturforsch. 12b, 447-457 (1957).
13. W. Reichardt, “Autocorrelation, a principle for the evaluation of sensory information by the central nervous system,” in Sensory Communication, W. A. Rosenblith, ed. (Wiley, New York, 1961).
14. J. P. H. van Santen and G. Sperling, “Temporal covariance model of human motion perception,” J. Opt. Soc. Am. A 1, 451 -473 (1984).
15. J. P. H. van Santen and G. Sperling, “Elaborated Rei-chardt detectors,” J. Opt. Soc. Am. A 2, 300-321 (1985).
16. E. H. Adelson and J. R. Bergen, “Spatio-temporal energy models for the perception of apparent motion,” J. Opt. Soc. Am. A 2, 284-299 (1985).
17. E. H. Adelson and J. R. Bergen, “The extraction of spatiotemporal energy in human and machine vision,” in Motion: Representation and Analysis (IEEE Workshop Proceedings), (IEEE Computer Society Press, Washington D.C., 1986) pp. 151-155.
18. D. Marr and S. Ullman, “Directional selectivity and its use in early visual processing,” Proc. R. Soc. London Ser. B 211, 151-180 (1981).
19. C. L. Fennema and W. B. Thompson, “Velocity determination in scenes containing several moving objects,” Comput. Graph. 9, 301-315 (1979).
20. A. Johnston, P. W. McOwan, and H. Buxton, “A computational model of the analysis of some first-order and second-order motion patterns by simple and complex cells,” Proc. R. Soc. London Ser. B 250, 297-306 (1992).
21. B. Hassenstein and W. Reichardt, “Systemtheoretische analyse der zeit-, reihenfolgen-and vorzeichenauswertung bei der bewegungsperzeption des russelkafers chlo-rophanus,” Z. Naturforsch. 11b, 513-524 (1956).
22. A. B. Watson and A. J. Ahumada, Jr., “A look at motion in the frequency domain,” in Motion: Perception and Representation, J. K. Tsotsos, ed. (Association for Computing Machinery, New York, 1983) pp. 1-10.
23. D. J. Heeger, “A model for the extraction of image flow,” J. Opt. Soc. Am. A 4, 1455-1471 (1987).
24. H. R. Wilson, V. P. Ferrera, and C. Yo, “A psychophysically motivated model for two-dimensional motion perception,” Visual Neurosci. 9, 79-97 (1992).
25. S. J. Nowlan and T. J. Sejnowski, “Filter selection model for motion segmentation and velocity integration,” J. Opt. Soc. Am. A 11, 3177-3200 (1994).
26. V. S. Ramachandran, M. V. Rau, and T. R. Vidyasagar, “Apparent movement with subjective contours,” Vision Res. 13, 1399-1401 (1973).
27. G. Sperling, “Movement perception in computer-driven visual displays,” Behav. Res. Methods Instrum. 8, 144-151 (1976).
28. A. M. M. Lelkens and J. J. Koenderink, “Illusory motion in visual displays,” Vision Res. 24, 293-300 (1984).
29. A. M. Derrington and D. R. Badcock, “Separate detectors for simple and complex grating patterns?” Vision Res. 25, 1869-1878 (1985).
30. C. Chubb and G. Sperling, “Drift-balanced random stimuli: A general basis for studying non-Fourier motion perception,” J. Opt. Soc. Am. A 5, 1986-2006 (1988).
31. K. Turano and A. Pantle, “On the mechanism that encodes the movement of contrast variations-I: Velocity discrimination,” Vision Res. 29, 207-221 (1989).
32. J. D. Victor and M. M. Conte, “Motion mechanisms have only limited access to form information,” Vision Res. 30, 289-301 (1989).
33. C. Chubb and G. Sperling, “Texture quilts: Basic tools for studying motion-from-texture,” J. Math. Psychol. 35, 411 -442 (1991).
34. G. Sperling, “Visual form and motion perception: Psychophysics, computation, and neural networks,”., March 5, 1988.
35. B. Julesz and R. Payne, “Difference between monocular and binocular stroboscopic motion perception,” Vision Res. 8, 433-444 (1968).
36. J. T. Petersik, K. I. Hicks, and A. J. Pantle, “Apparent movement of successively generated subjective figures,” Perception 7, 371-383 (1978).
37. M. Shadlen and T. Carney, “Mechanism of human motion revealed by new cyclopean illusion,” Science 232, 95-97 (1986).
38. P. Cavanagh, M. Arguin, and M. von Grunau, “Interattribute apparent motion,” Vision Res. 29, 1379-1386 (1989).
39. J. M. Zanker, “Theta motion: A paradoxical stimulus to explore higher order motion extraction,” Vision Res. 33, 553-569 (1993).
40. Z.-L. Lu and G. Sperling, “Attention-generated apparent motion,” Nature 377, 237-239 (1995).
41. Z.-L. Lu and G. Sperling, “The functional architecture of human visual motion perception,” Vision Res. 35, 2697-2722 (1995).
42. R. Patterson, “Stereoscopic (cyclopean) motion sensing,” Vision Res. 39, 3329-3345 (1999).
43. Z.-L. Lu and G. Sperling, “Three systems for visual motion perception,” Curr. Dir. Psychol. Sci. 5, 44-53 (1996).
44. G. Sperling and Z.-L. Lu, “A systems analysis of human visual motion perception,” in High-Level Motion Processing, T. Watanabe, ed. (MIT Press, Cambridge, Mass., 1998), pp. 153-183.
45. W. C. Shipley, F. A. Kenney, and M. E. King, “Beta apparent movement under binocular, monocular and interocular stimulation,” Am. J. Psychol. 58, 545-549 (1945).
46. O. Braddick, “Low-level and high-level processes in apparent motion,” Philos. Trans. R. Soc. London, Ser. B 290, 137-151 (1980).
47. Y.-X. Zhou and C. L. B. Baker, Jr, “A processing stream in mammalian visual cortex neurons for non-Fourier responses,” Science 261, 98-101 (1993).
48. T. D. Albright, “Form-cue invariant motion processing in primate visual cortex,” Science 255, 1141-1143 (1992).
49. T. Ledgeway and A. T. Smith, “Evidence for separate motion-detecting mechanisms for first-and second-order motion in human vision,” Vision Res. 34, 2727-2740 (1994).
50. Y.-X. Zhou and C. L. Baker, Jr, “Spatial properties of envelope-responsive cells in area 17 and 18 neurons of the cat,” J. Neurophysiol. 75, 1038-1050 (1996).
51. M. W. Greenlee and A. T. Smith, “Detection and discrimination of first-and second-order motion in patients with unilateral brain damage,” J. Neurosci. 17, 804-818 (1997).
52. S. Nishida, T. Ledgeway, and M. D. Edwards, “Multiple-scale processing for motion in the human visual system,” Vision Res. 37, 2685-2698 (1997).
53. C. E. Ho, “Letter recognition reveals pathways of second-order and third-order motion,” Proc. Natl. Acad. Sci. USA 95, 400-404 (1998).
54. L. P. O’Keefe and J. A. Movshon, “Processing of first-and second-order motion signals by neurons in area MT of the macaque monkey,” Visual Neurosci. 15, 305-317 (1998).
55. A. T. Smith, M. W. Greenlee, K. D. Singh, F. M. Kraemer, and J. Hennig, “The processing of first-and second-order motion in human visual cortex assessed by functional magnetic resonance imaging (fMRI),” J. Neurosci. 18, 3816-3830 (1998).
56. E. Blaser, G. Sperling, and Z.-L. Lu, “Measuring the amplification and the spatial resolution of visual attention,” Proc. Natl. Acad. Sci. USA 96, 11681-11686 (1999).
57. C. E. Ho and G. Sperling, “Selecting second and third-order motion pathways,” Invest. Ophthalmol. Visual Sci. ARVO Suppl. 40, S425 (1999).
58. Z.-L. Lu, L. Lesmes, and G. Sperling, “Mechanisms of isoluminant chromatic motion perception,” Proc. Natl. Acad. Sci. USA 96, 8289-8294 (1999).
59. Z.-L. Lu, L. Lesmes, and G. Sperling, “Perceptual motion standstill from rapidly moving chromatic displays,” Proc. Natl. Acad. Sci. USA 96, 15374-15379 (1999).
60. I. Mareschal and C. L. Baker, Jr., “Cortical processing of second-order motion,” Visual Neurosci. 16, 1-14 (1999).
61. N. E. Scott-Samuel and M. A. Georgeson, “Does early nonlinearity account for second-order motion?” Vision Res. 39, 2853-2865 (1999).
62. J. A. Solomon and M. J. Morgan, “Dichoptically canceled motion,” Vision Res. 39, 2293-2297 (1999).
63. S. Nishida and H. Ashida, “A hierarchical structure of motion system revealed by interocular transfer of flicker motion aftereffects,” Vision Res. 40, 265-278 (2000).
64. A. J. Schofield and M. A. Georgeson, “The temporal properties of first-and second-order vision,” Vision Res. 40, 2475-2487 (2000).
65. G. Sperling, T.-S. Kim, and Z.-L. Lu, “Direction-reversal VEP’s reveal signature of first-and second-order motion,” Invest. Ophthalmol. Visual Sci. ARVO Suppl. 41, S334 (2000).
66. G. Sperling and C. E. Ho, “Third-order versus first-order and second-order motion in ambiguous stimuli: Competition reveals temporal tuning functions, monocularity/ binocularity, and the role of attention,” Perception 29, 83 (2000).
67. E. Taub, J. D. Victor, and M. M. Conte, “Nonlinear preprocessing in short-range motion,” Vision Res. 37, 1459-1477 (1997).
68. N. M. Grzywacz, S. N. J. Watamaniuk, and S. P. McKee, “Temporal coherence theory for the detection and measurement of visual motion,” Vision Res. 35, 3183-3203 (1995).
69. A. E. Seiffert and P. Cavanagh, “Position displacement, not velocity, is the cue to motion detection of second-order stimuli,” Vision Res. 38, 3569-3582 (1998).
70. T. Carney, “Evidence for an early motion system which integrates information from the two eyes,” Vision Res. 37, 2361-2368 (1997).
71. L. Zemany, C. F. Stromeyer III, A. Chaparro, and R. E. Kronauer, “Motion detection on stationary, flashed pedestal gratings: Evidence for an opponent-motion mechanism,” Vision Res. 38, 795-812 (1998).
72. A. T. Smith and T. Ledgeway, “Separate detection of moving luminance and contrast modulations: Fact or arti-fact?” Vision Res. 37, 45-62 (1997).
73. J. A. Solomon and G. Sperling, “Full-wave and half-wave rectification in 2nd-order motion perception,” Vision Res. 34, 2239-2257 (1994).
74. C. Koch and S. Ullman, “Shifts in selective visual attention: Towards the underlying neural circuitry,” Hum. Neurobiol. 4, 219-227 (1985).
75. P. Burt, “Attention mechanisms for vision in a dynamic world,” in Proceedings of the Ninth International Conference on Pattern Recognition, Rome, Italy (IEEE Computer Society Press, Washington, D.C., 1988), pp. 977-987.
76. M. Mozer, The Perception of Multiple Objects: A Connectionist Approach, (MIT Press, Cambridge, Mass, 1991).
77. S. Ahmad and S. Omohundro, “Efficient visual search: A connectionist solution,” International Computer Science Institute Technical Report tr-91-040 (University of California, Berkeley, Calif., 1991).
78. J. K. Tsotsos, S. M. Culhane, W. Y. K. Wai, Y. Lai, N. Davis, and F. Nuflo, “Modeling visual attention via selective tuning,” Artif. Intell. 78, 507-545 (1995).
79. G. Sperling, A. Reeves, E. Blaser, Z.-L. Lu, and E. Weich-selgartner, “Two computational models of attention,” in Attention, C. Koch and J. Braun, eds. (MIT Press, Cambridge, Mass., 2001), pp. 177-214.
80. P. Werkhoven, G. Sperling, and C. Chubb, “Motion perception between dissimilar gratings: A single channel theory,” Vision Res. 33, 463-485 (1993).
81. G. Sperling and Z. L. Lu, “Update on the three-motion-systems theory,” Invest. Ophthalmol. Visual Sci. ARVO Suppl. 39, S461 (1998).
82. K. Nakayama and G. H. Silverman, “Detection and discrimination of sinusoidal grating displacements,” J. Opt. Soc. Am. A 2, 267-274 (1985).
83. Z.-L. Lu and G. Sperling, “Contrast gain control in first-and second-order motion perception,” J. Opt. Soc. Am. A 13, 2305-2318 (1996).
84. W. Prinzmetal, H. Amiri, K. Allen, and T. Edwards, “Phenomenology of attention: I. Color, location, orientation, and spatial frequency,” J. Exp. Psychol. Hum. Percep. Perform. 24, 261-282 (1998).
85. C. Tseng, J. L. Gobell, and G. Sperling, “Sensitization to color: Induced by search, measured by motion,” Invest. Ophthalmol. Visual Sci. ARVO Suppl. 41, S40, Abstr nr. 207 (2000).
86. S. M. Anstis, “Phi movement as a subtraction process,” Vision Res. 10, 1411-1430 (1970).
87. S. M. Anstis and B. J. Rogers, “Illusory reversal of visual depth and movement during changes of contrast,” Vision Res. 15, 957-961 (1975).
88. S. Nishida, “Spatiotemporal properties of motion perception for random-check contrast modulations,” Vision Res. 33, 633-645 (1993).
89. Z.-L. Lu and G. Sperling, “Second-order reversed phi,” Percept. Psychophys. 61, 1075-1088 (1999).
90. S. J. Anderson, D. C. Burr, and M. C. Morrone, “Twodimensional spatial and spatial-frequency selectivity of motion-sensitive mechanisms in human vision,” J. Opt. Soc. Am. A 8, 1340-1351 (1991).
91. Z.-L. Lu, G. Sperling, and J. Beck, “Selective adaptation of three motion systems,” Invest. Ophthalmol. Visual Sci. ARVO Suppl. 38, 237 (1997).
92. L. M. Vaina, N. Makris, D. Kennedy, and A. Cowey, “The selective impairment of the perception of first-order motion by unilateral cortical brain damage,” Visual Neurosci. 15, 333-348 (1998).
93. G. T. Plant, K. D. Laxer, N. M. Barbaro, J. S. Schiffman, and K. Nakayama, “Impaired visual motion perception in the contralateral hemifield following unilateral posterior cerebral lesions,” Brain 116, 1337-1353 (1993).
94. L. M. Vaina, M. Le May, and N. M. Grzywacz, “Deficits of non-Fourier motion perception in a patient with normal performance on short-range motion tasks,” Soc. Neurosci. Abstract 19, 1284 (1993).
95. L. M. Vaina and A. Cowey, “Impairment of the perception of second order motion but not first order motion in a patient with unilateral focal brain damage,” Proc. R. Soc. London Ser. B 263, 1225-1232 (1996).
96. J. Rademacher, A. M. Galaburda, D. N. Kennedy, P. A. Pilipek, and V. S. Caviness, “Human cerebral cortex: Localization, parcellation, and morphometry with magnetic resonance imaging,” J. Cog. Neurosci. 4, 352-374 (1992).
97. L. M. Vaina, A. Cowey, and D. Kennedy, “Perception of first-and second-order motion: Separable neurological mechanisms?” Hum. Brain Mapping 7, 67-77 (1999).
98. C. L. Baker, Jr., “Central neural mechanisms for detecting second-order motion,” Curr. Opin. Neurobiol. 9, 461-466 (1999).
99. C. Chubb and G. Sperling, “Second-order motion perception: Space-time separable mechanisms,” in Proceedings: Workshop on Visual Motion (IEEE Computer Society Press, Washington, D.C., 1989), pp. 126-138.
100. A. Johnston and C. W. G. Clifford, “A unified account of three apparent motion illusions,” Vision Res. 35, 11091123 (1995).
101. A. Johnston and C. W. G. Clifford, “Perceived motion of contrast-modulated gratings: Predictions of the multi channel gradient model and the role of full-wave rectifica-tion,” Vision Res. 35, 1771-1783 (1995).
102. A. Johnston, C. P. Benton, and P. W. McOwan, “Induced motion at texture-defined motion boundaries,” Proc. R. Soc. London Ser. B 266, 2441-2450 (1999).
103. K. Nakayama and C. W. Tyler, “Psychophysical isolation of movement sensitivity by removal of familiar position cues,” Vision Res. 21, 427-433 (1981).
104. D. H. Kelly, “Motion and vision: II. Stabilized spatio temporal threshold surface,” J. Opt. Soc. Am. 69, 1340-1349 (1979).
105. S. J. Anderson and D. C. Burr, “Spatial and temporal selectivity of the human motion detection system,” Vision Res. 25, 1147-1154 (1985).
106. G. Sperling, H.-J. Kim, and Z.-L. Lu. (2001). “Is there interocular first-order motion?” Talk at annual meeting of the Association for Research in Vision and Ophthalmology, Fort Lauderdale, Fla., May 2, 2001.
107. H. J. Kim, Z.-L. Lu, and G. Sperling, “Rivalry motion versus depth motion,” Invest. Ophthalmol. Visual Sci. ARVO Suppl. 42, S736 (2001).
108. C. Tseng, H. Kim, J. L. Gobell, Z.-L. Lu, and G. Sperling, “Motion standstill in rapidly moving stereoptic depth displays,” Invest. Ophthalmol. Visual Sci. ARVO Suppl. 42, S504, Abstract nr. 2720 (2001).
109. B. A. Dosher, M. S. Landy, and G. Sperling, “Kinetic depth effect and optic flow: 1. 3D shape from Fourier motion,” Vision Res. 29, 1789-1813 (1989).
110. A. T. Smith and T. Ledgeway, “Sensitivity to second-order motion as a function of temporal frequency and eccentric-ity,” Vision Res. 38, 403-410 (1998).
111. M. S. Landy, Y. Cohen, and G. Sperling, “HIPS: A Unix-based image processing system,” Comput. Vis. Graph. Image Process. 25, 331-347 (1984a).
112. M. S. Landy, Y. Cohen, and G. Sperling, “HIPS: Image processing under UNIX software and applications,” Behav. Res. Methods Instrum. 16, 199-216 (1984b).
113. R. S. Woodworth and H. Schlosberg, Experimental Psychology (Rev. ed.). (Holt, Rinehart & Winston, New York, 1954).
114. H. R. Wilson, “Spatiotemporal characterization of a transient mechanism in the human visual system,” Vision Res. 20, 443-452 (1980).
115. M. B. Mandler and W. Makous, “A three channel model of temporal frequency perception,” Vision Res. 24, 1881-1887 (1984).
116. Z.-L. Lu and G. Sperling, “Sensitive calibration and measurement procedures based on the amplification principle in motion perception,” Vision Res. 41, 2355-2374 (2001).
117. Z.-L. Lu and G. Sperling, “Black-white asymmetry in visual perception,” Mathematical Behavioral Sciences Rep. MBS 01-14 (University of California, Irvine, Calif., 2001).
118. D. G. Pelli and L. Zhang, “Accurate control of contrast on microcomputer displays,” Vision Res. 31, 1337-1350 (1991).
119. O. I. Ukkonen and A. M. Derrington, “Motion of contrast-modulated gratings is analyzed by different mechanisms at low and at high contrasts,” Vision Res. 40, 3359-3371 (2000).
120. F. C. Kolb and J. Braun, “Blindsight in normal observers,” Nature 377, 336-338 (1995).
121. P. Burt and G. Sperling, “Time, distance, and feature trade-offs in visual apparent motion,” Psychol. Rev. 88, 171-195 (1981).
122. A. Baloch, S. Grossberg, E. Mingolla, and C. A. M. Nogueira, “Neural model of first-order and second-order motion perception and magnocellular dynamics,” J. Opt. Soc. Am. A 16, 953-978 (1999).
123. M. J. Morgan and C. Chubb, “Contrast facilitation in motion detection: Evidence for a Reichardt detector in hu man vision,” Vision Res. 39, 4217-4231 (1999).
124. J. Krauskopf and X. Li, “Effect of contrast on detection of motion of chromatic and luminance targets: Retina relative and object-relative movement,” Vision Res. 39, 3346-3350 (1999).