Discerning nonrigid 3D shapes from motion cues

Proceedings of the National Academy of Sciences of the United States of America

Volumn 108, Issue 4, 2011, Pages 1663-1668

  Jain, Anshul ^a   Zaidi, Qasim ^a  

^a STATE UNIVERSITY OF NEW YORK   (United States)

Author keywords

Optic flow; Structure from motion

Indexed keywords

ARTICLE; ASSOCIATION; DEPTH PERCEPTION; HUMAN; HUMAN EXPERIMENT; MATHEMATICAL MODEL; MOTION; PRIORITY JOURNAL; PSYCHOMETRY; VELOCITY;

ALGORITHMS; COMPUTER SIMULATION; CUES; FORM PERCEPTION; HUMANS; MODELS, PSYCHOLOGICAL; MOTION; MOTION PERCEPTION; PSYCHOMOTOR PERFORMANCE; VISUAL PERCEPTION;

EID: 79952179426     PISSN: 00278424     EISSN: 10916490     Source Type: Journal    
DOI: 10.1073/pnas.1016211108     Document Type: Article

References (67)

1. Wallach H, O'Connell DN (1953) The kinetic depth effect. J Exp Psychol 45:205-217.
2. Sperling G, Dosher BA, Landy MS (1990) How to study the kinetic depth effect experimentally. J Exp Psychol Hum Percept Perform 16:445-450.
3. Sperling G, Landy MS (1989) Kinetic depth effect and identification of shape. J Exp Psychol Hum Percept Perform 15:826-840.
4. Domini F, Caudek C (1999) Perceiving surface slant from deformation of optic flow. J Exp Psychol Hum Percept Perform 25:426-444.
5. Rogers B, Graham M (1979) Motion parallax as an independent cue for depth perception. Perception 8:125-134. (Pubitemid 9166016)
6. Braunstein ML, Hoffman DD, Pollick FE (1990) Discriminating rigid from nonrigid motion: Minimum points and views. Percept Psychophys 47:205-214. (Pubitemid 20182504)
7. Todd JT (1984) The perception of three-dimensional structure from rigid and nonrigid motion. Percept Psychophys 36:97-103.
8. Hogervorst MA, Kappers AM, Koenderink JJ (1996) Structure from motion: A tolerance analysis. Percept Psychophys 58:449-459. (Pubitemid 126423059)
9. Ullman S (1979) The interpretation of structure from motion. Proc R Soc Lond B Biol Sci 203:405-426.
10. Grzywacz NM, Hildreth EC (1987) Incremental rigidity scheme for recovering structure from motion: Position-based versus velocity-based formulations. J Opt Soc Am A 4: 503-518.
11. Domini F, Caudek C, Richman S (1998) Distortions of depth-order relations and parallelism in structure from motion. Percept Psychophys 60:1164-1174. (Pubitemid 128460287)
12. Domini F, Braunstein ML (1998) Recovery of 3D structure from motion is neither euclidean nor affine. J Exp Psychol Human Percept Perform 24:1273-1295.
13. Helmholtz HV (1910) Treatise on Physiological Optics (Optical Society of America, New York), Vol 3.
14. Gibson JJ, Olum P, Rosenblatt F (1955) Parallax and perspective during aircraft landings. Am J Psychol 68:372-385.
15. Buracas GT, Albright TD (1996) Contribution of area MT to perception of three-dimensional shape: A computational study. Vision Res 36:869-887. (Pubitemid 26073848)
16. Graham M, Rogers B (1982) Simultaneous and successive contrast effects in the perception of depth from motion-parallax and stereoscopic information. Perception 11:247-262. (Pubitemid 13166049)
17. Rogers BJ, Graham ME (1983) Anisotropies in the perception of three-dimensional surfaces. Science 221:1409-1411.
18. Loomis JM, Nakayama K (1973) A velocity analogue of brightness contrast. Perception 2:425-427.
19. Hammond P, Smith AT (1982) On the sensitivity of complex cells in feline striate cortex to relative motion. Exp Brain Res 47:457-460. (Pubitemid 12019194)
20. Allman J, Miezin F, McGuinness E (1985) Stimulus specific responses from beyond the classical receptive field: Neurophysiological mechanisms for local-global comparisons in visual neurons. Annu Rev Neurosci 8:407-430. (Pubitemid 15137176)
21. Frost BJ, Nakayama K (1983) Single visual neurons code opposing motion independent of direction. Science 220:744-745. (Pubitemid 13081957)
22. Snowden RJ, Treue S, Erickson RG, Andersen RA (1991) The response of area MT and V1 neurons to transparent motion. J Neurosci 11:2768-2785.
23. Bradley DC, Chang GC, Andersen RA (1998) Encoding of three-dimensional structure from-motion by primate area MT neurons. Nature 392:714-717. (Pubitemid 28207791)
24. Nawrot M, Blake R (1991) A neural network model of kinetic depth. Vis Neurosci 6:219-227.
25. Fernández JM, Watson B, Qian N (2002) Computing relief structure from motion with a distributed velocity and disparity representation. Vision Res 42:883-898. (Pubitemid 34258525)
26. Grunewald A, Bradley DC, Andersen RA (2002) Neural correlates of structure-from-motion perception in macaque V1 and MT. J Neurosci 22:6195-6207. (Pubitemid 35387660)
27. Orban GA, Sunaert S, Todd JT, Van Hecke P, Marchal G (1999) Human cortical regions involved in extracting depth from motion. Neuron 24:929-940. (Pubitemid 30017672)
28. Caudek C, Proffitt DR (1993) Depth perception in motion parallax and stereokinesis. J Exp Psychol Hum Percept Perform 19:32-47.
29. Liter JC, Braunstein ML, Hoffman DD (1993) Inferring structure from motion in two-view and multiview displays. Perception 22:1441-1465.
30. Koenderink JJ, van Doorn AJ (1975) Invariant properties of the motion parallax field due to the movement of rigid bodies relative to an observer. Opt Acta (Lond) 22(9):773-791.
31. Longuet-Higgins HC, Prazdny K (1980) The interpretation of a moving retinal image. Proc R Soc Lond B Biol Sci 208:385-397. (Pubitemid 11234921)
32. Koenderink JJ (1986) Optic flow. Vision Res 26(1):161-179.
33. Koenderink JJ, van Doorn AJ (1976) Local structure of movement parallax of the plane. J Opt Soc Am 66(7):717-723.
34. Freeman TCA, Harris MG, Meese TS (1996) On the relationship between deformation and perceived surface slant. Vision Res 36:317-322.
35. Domini F, Caudek C (2003) 3-D structure perceived from dynamic information: A new theory. Trends Cogn Sci 7:444-449. (Pubitemid 37188787)
36. Fernandez JM, Farell B (2009) A new theory of structure-from-motion perception. J Vis 9:1-20.
37. Saito H, et al. (1986) Integration of direction signals of image motion in the superior temporal sulcus of the macaque monkey. J Neurosci 6:145-157. (Pubitemid 16149228)
38. Tanaka K, Saito H (1989) Analysis of motion of the visual field by direction, expansion/contraction, and rotation cells clustered in the dorsal part of the medial superior temporal area of the macaque monkey. J Neurophysiol 62:626-641. (Pubitemid 19236118)
39. Sugihara H, Murakami I, Shenoy KV, Andersen RA, Komatsu H (2002) Response of MSTd neurons to simulated 3D orientation of rotating planes. J Neurophysiol 87:273-285. (Pubitemid 34669949)
40. Anderson KC, Siegel RM (2005) Three-dimensional structure-from-motion selectivity in the anterior superior temporal polysensory area, STPa, of the behaving monkey. Cereb Cortex 15:1299-1307. (Pubitemid 41191538)
41. Anderson KC, Siegel RM (1999) Optic flow selectivity in the anterior superior temporal polysensory area, STPa, of the behaving monkey. J Neurosci 19:2681-2692. (Pubitemid 29162416)
42. Beer AL, Watanabe T, Ni R, Sasaki Y, Andersen GJ (2009) 3D surface perception from motion involves a temporal-parietal network. Eur J Neurosci 30:703-713.
43. Lagae L, Maes H, Raiguel S, Xiao DK, Orban GA (1994) Responses of macaque STS neurons to optic flow components: A comparison of areas MT and MST. J Neurophysiol 71:1597-1626. (Pubitemid 24153029)
44. Johansson G (1973) Visual perception of biological motion and a model for its analysis. Percept Psychophys 14(2):201-211.
45. Mather G, Murdoch L (1994) Gender discrimination in biological motion displays based on dynamic cues. Proc R Soc Lond B 258:273-279.
46. Dittrich WH, Troscianko T, Lea SE, Morgan D (1996) Perception of emotion from dynamic point-light displays represented in dance. Perception 25:727-738. (Pubitemid 126694959)
47. Giese MA, Poggio T (2003) Neural mechanisms for the recognition of biological movements. Nat Rev Neurosci 4:179-192. (Pubitemid 37280183)
48. Tomasi C, Kanade T (1992) Shape and motion from image streams under orthography: A factorization method. Int J Comput Vis 9(2):137-154. (Pubitemid 23621943)
49. Torresani L, Hertzmann A, Bregler C (2008) Nonrigid structure-from- motion: Estimating shape and motion with hierarchical Priors. IEEE Trans Pattern Anal Mach Intell 30: 878-892. (Pubitemid 351486755)
50. Akhter I, Sheikh YA, Khan S, Kanade T (2009) Nonrigid structure from motion in trajectory space. Adv Neural Inf Process Syst 21:41-48.
51. Bregler C, Hertzmann A, Biermann H (2000) Recovering non-rigid 3D shape from image streams. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (IEEE Computer Society Press, Washington, DC), Vol 2, pp 690-696.
52. Brand M (2005) A direct method for 3D factorization of nonrigid motion observed in 2D. Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition (IEEE Computer Society Press, Washington, DC), Vol 2, pp 122-128.
53. Regan D, Hamstra SJ (1992) Shape discrimination and the judgment of perfect symmetry: Dissociation of shape from size. Vision Res 32:1845-1864.
54. Cohen EH, Jain A, Zaidi Q (2010) The utility of shape attributes in deciphering movements of non-rigid objects. J Vis 10:29.
55. Watson AB, Pelli DG (1983) QUEST: A Bayesian adaptive psychometric method. Percept Psychophys 33:113-120.
56. Norman JF, Todd JT (1993) The perceptual analysis of structure from motion for rotating objects undergoing affine stretching transformations. Percept Psychophys 53:279-291.
57. Todd JT, Bressan P (1990) The perception of 3-dimensional affine structure from minimal apparent motion sequences. Percept Psychophys 48:419-430. (Pubitemid 20361679)
58. Hogervorst MA, Eagle RA (2000) The role of perspective effects and accelerations in perceived three-dimensional structure-from-motion. J Exp Psychol Hum Percept Perform 26:934-955.
59. Glennerster A, Tcheang L, Gilson SJ, Fitzgibbon AW, Parker AJ (2006) Humans ignore motion and stereo cues in favor of a fictional stable world. Curr Biol 16:428-432. (Pubitemid 43259355)
60. Hildreth EC (1984) Measurement of Visual Motion (MIT Press, Cambridge, MA).
61. Yuille AL, Grzywacz NM (1988) A computational theory for the perception of coherent visual motion. Nature 333:71-74.
62. Rokers B, Yuille A, Liu Z (2006) The perceived motion of a stereokinetic stimulus. Vision Res 46:2375-2387.
63. Meese TS, Harris MG (1997) Computation of surface slant from optic flow: Orthogonal components of speed gradient can be combined. Vision Res 37:2369-2379. (Pubitemid 27355038)
64. Meese TS, Harris MG, Freeman TCA (1995) Speed gradients and the perception of surface slant: Analysis is two-dimensional not one-dimensional. Vision Res 35:2879-2888.
65. Cipolla R, Okamoto Y, Kuno Y (1993) Robust structure from motion using motion parallax. Proceedings of the International Conference on Computer Vision (IEEE Computer Society Press, Washington, DC), pp 374-382.
66. Koenderink JJ, van Doorn AJ (1986) Depth and shape from differential perspective in the presence of bending deformations. J Opt Soc Am A 3:242-249.
67. Sinha P, Poggio T (1996) Role of learning in three-dimensional form perception. Nature 384:460-463. (Pubitemid 26414662)