Motion and shape from sequences of images under feature correspondences

IEICE Transactions on Information and Systems

Volumn E82-D, Issue 3, 1999, Pages 548-557

  Fujiki, Jun ^a  

^a ELECTROTECHNICAL LABORATORY   (Japan)

Author keywords

Epipolar geometry; Factorization method; Structure from motion

Indexed keywords

APPROXIMATION THEORY; COMPUTATIONAL GEOMETRY; COMPUTER VISION; FEATURE EXTRACTION; INVERSE PROBLEMS; MATHEMATICAL MODELS; MATHEMATICAL TRANSFORMATIONS; MATRIX ALGEBRA; MOTION COMPENSATION;

CAMERA MOTION; EPIPOLAR GEOMETRY; FACTORIZATION METHOD; FEATURE CORRESPONDENCE; OBJECT SHAPE;

IMAGE RECONSTRUCTION;

EID: 0033340101     PISSN: 09168532     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (88)

1. J.Y. Aloimonos,"Prospective approximations," Imago and Vision Computing, vol.8, no.3, pp.179-192, Aug.1990.
2. N. Ayache and F. Lustman, "Trinocular stereo vision for robotics," IEEE Trans. PAMI, vol.13, no.l, pp.73-85, 1991.
3. S. Christy and R. Horaud, "Eulidean reconstruction: From paraperspective to perspective," Proc. 4th ECCV, vol.2, pp.129-140, 1996.
4. J. Costeria and T. Kanade, "A multi-body factorization method for motion analysis," Proc. 5th ICCV, pp.10711076, May 1995.
5. J.P. Costeria and T. Kanade, "A multibody factorization method for independently moving objects," IJCV, vol.29, no.3, pp.159-179, 1998.
6. K. Deguchi, "Factorization method for structure from multiple perspective images," CVIM 106-6, pp.35-42, 7.24, 1997 (in Japanese).
7. K. Deguchi and B. Triggs, "Factorization method for structure from perspective images," IEICE Technical Report, PRMU 96-139, Jan. 1997 (in Japanese).
8. O.D. Faugeras, "What can be seen in three dimensions with an uncalibratcd stereo rig?" Proc. 2nd ECCV, Santa Margherita Ligure, pp.563-578, May 1992.
9. O.D. Faugeras, 'Three-dimensional computer vision: A geometric viewpoint," MIT Press, Cambridge, MA, 1993.
10. O. Faugeras and B. Mourrain, "On the geomerty and algebra of the point and line correspondences between Ar im-ages," Proc. 5th ICCV, pp.951-95G, 1995.
11. O. Faugcras and L. Robert, "What can two images tell us about a third one?," UCV, vol.18, pp.5-19, 1996.
12. J. Fujiki and T. Kurata, "An mathematical analysis of factorization method for affine model," IEICE Technical Report, PRMU 97-22, May 1997 (in Japanese).
13. J. Fujiki and T. Kurata, "The metric of affine shape and motion : The intuitive interpretation in terms of the factorization method," Proc. SPIE97, San Diego, Vision Geometry VI, vol.3168-22, pp.200-217, Aug. 1997.
14. J. Fujiki and T. Kurata, "An mathematical analysis of the factorization method for generalized affine projection model," IEICE Technical Report, PRMU 97-142, Nov. 1997 (in Japanese).
15. J. Fujiki, T. Kurata, and M. Tanaka, "Iterative factorization method for object recognition," Proc. SPIE98, San Diego, Vision Geometry VI, vol.3454-18, pp.192-201, July 1998.
16. J. Fujiki, T. Kurata, and M. Tanaka, "Iterative factorization method for the generalizad affine projection model," IEICE Technical Report, PRMU 98-118, Nov. 1998 (in Japanese).
17. C.W. Gear, "Multibody grouping from motion images," UCV, vol.29, no.2, pp.133-150, 1998.
18. R. Hartley, R. Gupta, and T. Chang, "Stereo from uncalibrated cameras," Proc. CVPR'92, Urvana Champaign, pp.761-764, June 1992.
19. R.I. Hartley, "In defence of the eight-point algorithm," IEEE Trans. PAMI, vol.19, no.G, pp.580-592, June 1997.
20. R.I. Hartley, "Lines and points in three views and the trifocal tensor," IJCV, vol.22, no.2, pp.125-140, 1997.
21. A. Heyden and F. Kahl, "Reconstruction from affine cameras using closure constraints," Proc. ICPR'98, Brisbane, pp.47-50, Aug. 1998.
22. X. Hu and N. Ahuja, "Mirror uncertainty and uniqueness condition for determining shape and motion from orthographic projection," IJCV, vol.13, no.3, pp.295-309, 1994.
23. T.S. Huang and C.H. Lee, "Motion and structure from orthographic projections," IEEE Trans. PAMI, vol.11, no.5, pp.536-540, May 1989.
24. Y.J. Huang and II. Nishida, "Reconstruction of measurement matrices for recovering shape and motion from long image sequences," Proc. IAPR Workshop on MVA98, Makuhari, Chiba, pp.463-466, Nov. 1998.
25. R. Horaud, F. Dornaika, B. Lamiroy, and S. Christy, "Object pose: The link between weak perspective, paraperspective, and full perspective," IJCV, vol.22, no.2, pp.173-189, 1997.
26. K. Hwang, N. Yokoya, H. Takemura, and K. Yamazawa, "A factorization method using 3-d linear combination for shape and motion recovery," Proc. ICPR'98, vol.2, pp.959-963, Aug. 1998.
27. N. Ichimura and F. Tomita, "Motion segmentation based of feature selection from shape matrix," IEICE Trans., vol.JSl-D-II, no.12, pp.2757-2766, Dec. 1998 (in Japanese).
28. D. Jacobs, "Linear fitting with missing data: Application to structure-from-motion and to characterizing intensity images," Proc. CVPR'97, pp.20G-212, 1997.
29. T. Kanade, C.J. Poelman, and T. Morita, "A factorization method for shape and motion recovery," IEICE Trans., vol.J76-D-II, no.8, pp.1497-1505, Aug. 1993 (in Japanese).
30. H. Kamada, M. Siohara, and Y. Hao, "Simultaneous recovering motion and shape of 3d moving," IEICE Trans., V01.J7G-D-II, no.8, pp.1554-1561, Aug. 1993 (in Japanese).
31. K. Kanatani, "Mathematical Analysis of three dimensional data," Asakura Publisher, Tokyo, 1995 (in Japanese).
32. K. Kanatani, "Factorization without factorization: From orthographie to perspective," IEICE Technical Report, PRMU98-2G, June 1998 (in Japanese).
33. K. Kanatani, "Factorization without factorization: Multibody segmentation," IEICE Technical Report, PRMU98117, Nov. 1998 (in Japanese).
34. J.J. Koenderink and A.J. van Doom, "Affine Structure from Motion," J. Opt. Soc. Am. A, vol.8, no.2, pp.377-395, 1991.
35. F. Kahl and A. Heyden, "Using conic correspondences in two images to estimate the epipolar geometry," Proc. Gth ICCV, Bombcy, pp.761-766, 1998.
36. K. Kinoshita and J. Sato, "Quasi-perspective camera model," MIRU98, pp.I-249-I-254, July 1998.
37. H. Kuo, K. Yamazawa, H. Iwasa, H. Takemura, and N. Yokoya, "A new factorization method based on 3d linear combination for shape and motion recovery," Proc. 55th General Conf. of IPSJ, pp.2-313-2-314, 1997 (in Japanese).
38. T. Kurata and J. Fujiki, "The interpretation of epipolar geometry and image-based rendering via factorization method for affine projection," IEICE Technical Report, PRMU 97143, Nov. 1997 (in Japanese).
39. T. Kurata, J. Fujiki, and K. Sakaue, "Affine epipolar geometry via factorization method and its application," Proc. SPIE, San Diego, vol.3457-13, July 1998.
40. T. Kurata, J. Fujiki, and K. Sakaue, "Affine epipolar geometry via factorization method," Proc. ICPR'98, Brisbane, PP-862-86G, Aug. 1998.
41. T. Kurata, J. Fujiki, and K. Sakaue, "A factorization method for generalized affine projection model using robust estimation," IEICE Technical Report, PRMU, 98-194, Jan. 1999 (in Japanese).
42. T. Matsuyama, Y. Kuno, and A. Imiya, eds., "Computer vision-Its technical comment and future prospect," ShinGijutsu Communications Publisher, Tokyo, 1998.
43. T. Morita and T. Kanade, "A sequential factorization method for recovering shape and motion from image streams," IEEE Trans. PAMI, vol.19, no.8, pp.858-8G7, 1997.
44. D.D. Morris and T. Kanade, "A unified factorization algorithm for points, line segments and plane with uncertanity models," Proc. ICCV98, pp.69G-702, 1998.
45. Y. Mukaigawa, Y. Nakamura, and Y. Ohta, "Synthesis of arbitrary oriented facial views from two images," IPSJ Trans., vol.37, no.4, pp.G35-644, April 199G (in Japanese).
46. Y. Mukaigawa, Y. Nakamura, and Y. Ohta, "synthesis of facial views with arbitrary poses and expressions using multiple facial images," IEICE Trans., vol.J80-D-II, no.6, pp.1555-1562, June 1997 (in Japanese).
47. J.L. Mundy and A. Zisserman, eds., "Geometric invariance in computer vision," MIT Press, 1992.
48. T. Nagasaki, T. Kawashima, and Y. Aoki, "Structure estimation of an articulated object from motion image analysis based on factorization method," IEICE Trans., vol.J81-DII, no.3, pp.483-492, March 1998 (in Japanese).
49. Y. Ohta, K. Maenobu, and T. Sakai, "Obtaining surface orientation from texels under perspective projection," Proc. 7th Internatioanl Joint Conf. AI, pp.746-751, 1981.
50. S.I. Olsen, "Epipolar line estimation," Proc. ECCV92', pp.307-311, 1992.
51. J. Ostuni and S. Dünn, "Motion from three weak perspective images using image rotation," IEEE Trans. PAMI, vol.18, no.l, PP-G4-G9, Jan. 199G.
52. C.J. Poelman and T. Kanade, "A paraperspective factorization method for shape and motion recovery," CMU-CS93-219, Dec. 1993.
53. C.J. Poelman, "The paraperspective and projective factorization method for recovering shape and motion," CMUCS-95-173, July 1995.
54. C.J. Poclman and T. Kanade, "A paraperspcctve factorization method for shape and motion recovery," IEEE Trans. PAMI, vol.19, no.3, pp.20G-218, March 1997.
55. L. Quan, "Invariants of six points and projective reconstruction from three uncalibrated images," IEEE Trans. PAMI, vol.17, no.l, pp.31-16, Jan. 1995.
56. L. Quan, "Invariant of a pair of non-coplanar conies in space: Definition, geometric interpretation and computation," Proc. 5th ICCV, pp.926-931, 1995.
57. L. Quan, "Self-calibration of an affine camera from multiple views," IJCV, vol.19, no.l, pp.93-105, 1996.
58. L. Quan, "Conic reconstruction and correspondence from two views," IEEE Trans. PAMI, vol.18, no.2, pp.151-160, Feb. 1996.
59. L. Quan and T. Kanade, "Affine structure from line correspondences with uncalibrated affine cameras," IEEE Trans. PAMI, vol.19, no.8, pp.831-845, Aug. 1997.
60. S.M. Seitz and C.R. Dyer, "Complete scene structure from four point correspondences," Proc. 5th ICCV, pp.330-337, 1995.
61. K. Sengupta, I. Poupyrev, T. Sakaguchi, and J. Ohya, "A new camera projection model and its application in reprojection," MIRU98, pp.I-2-13-I-2.18, July 1998.
62. L.S. Shapiro, A. Zisserman, and M. Brady, "3d motion recovery via affine epipopar geometry," IJCV, vol.16, pp.147182, 1995.
63. L.S. Shapiro, "Affine analysis of image sequences," Camblidge Univ. Press, 1995.
64. A. Shashua, "Algebraic functions for recognition," IEEE Trans. PAMI, vol.17, no.8, pp.779-789, Aug. 1995.
65. A. Shashua and M. Werman, "Trilinearity of three perspective views and its associated tensor," Proc. 5th ICCV, pp.920-925, 1995.
66. P. Sturm and B. Triggs, "A factorization based algorithm for multi-image projective structure and motion," Proc. 4th ECCV, vol.2, pp.709-720, 1996.
67. N. Sugimoto and G. Xu, "A simple linear algorithm for motion from three weak perspective images using Euler angles," IEICE Trans., vol.J81-D-II, no.4, pp.681-688, April 1998 (in Japanese).
68. H.Y. Shum, K. Ikeuchi, and R. Reddy, "Principal component analysis with missing data and its application to polyhedral object modeling," IEEE Trans. PAMI, vol.17, no.9, pp.851-867, Sept. 1995.
69. J.K. Tan, S. Ishikawa, II. Ikeuchi, I. Nohara, and S. Hâta, "Recovering human motion by factorization," Proc. 3rd Sympo. on Sensing via Image Inform., Yokohama, C-14, pp. 111-114, June 1997.
70. J.K. Tan, S. Kawabata, and S. Ishikawa, "An efficient technique for motion recovery based on multiple views," Proc. IAPR Workshop on MVA98, Makuhari, Chiba, pp.270-273, Nov. 1998.
71. C. Tomasi and T. Kanade, "The factorization method for the recovery of shape and motion from image streams," Proc. Image Understanding Workshop, pp.459-472, San Diego, Jan. 1992.
72. C. Tomasi and T. Kanade, "Shape and motion from image streams under orthography: A factorization method," IJCV, vol.9, no.2, pp.137-154, 1992.
73. B. Triggs, "Factorization method for projective structure and motion," Proc CVPR'96, San Fransisco, pp.845-851, 1996.
74. T. Ueshiba and F. Tomita, "A factorization method for multiple perspective views using affine projection as the initial camera model," CVIM 107-1, pp.1-8, Sept. 1997 (in Japanese).
75. T. Ueshiba and F. Tomita, "A factorization method for projcctivc and Euclidean reconstruction from multiple prospective views via iterative depth estimation," Proc. 5th ECCV, vol.1, pp.296-310, Freiburg, Germany, June 1998.
76. N. Ukita and T. Shakunaga, "3d reconstruction from wide-range image sequences using prospective factorization method," IEICE Technical Report, PRMU 97-27G, March 1998 (in Japanese).
77. S. Ullman, 'The interpretation of visual motion," MIT Press, Cambridge, Mass., 1979.
78. S. Ullman and R. Basri, "Recognition by linear combinations of models," IEEE Trans. PAMI, vol.13, no.10, pp.9921005, Oct. 1991.
79. D. Weinshall, "Model-based invariants for 3-d vision," IJCV, vol.10, no.l, pp.27-42, 1993.
80. D. Veinshall and C. Tomasi, "Linear and incremental acquisition of invariant shape models from image sequences," Proc. 4th ICCV, pp.G75-G82, 1993.
81. G. Xu and Z. Zhang, "Epipolar geometry in stereo, motion and object recognition-A unified approach," Kluwer Academic Publishers, 199G.
82. G. Xu and N. Sugimoto, "A linear algorithm for motion from three weak perspective images using Euler angles," Proc. ACCV98, Hong Kong, pp.513-550, Jan. 1998.
83. G. Xu and S. Tsuji, "3d vision," Kyoritsu Publishers, Tokyo, 1998 (in Japanese).
84. II. Yu, Q. Chen, G. Xu, and M. Yachida, "3d shape and motion by SVD under higher-order approximation of perspective projection," Proc. ICPR'9G, pp.45G-4GO, 199G.
85. Z. Zhang, "Estimating motion and structure from correspondences of line segments between two perspective images," IEEE Trans. PAMI, vol.17, no.12, pp.1129-1139, Dec. 1995.
86. Z. Zhang, R. Deriche, O. Faugeras, and Q.T. Luong, "A robust technique for matching two uncalibrated images through the recovery of the unknown epipolar geometry," Artificial Intellgence 78, pp.87-119, 1995.
87. Z. Zhang and G. Xu, "A general expression of the fundamental matrix for both perspective and affine cameras," Proc. IJCAI'98, pp. 1502-1507, 1998.
88. Z. Zhang, "Determining the epipolar geometry and its uncertainly: a review," IJCV, vol.27, no.2, pp.161-195, 1998.