Video orbits of the projective group: A simple approach to featureless estimation of parameters

IEEE Transactions on Image Processing

Volumn 6, Issue 9, 1997, Pages 1281-1295

  Mann, Steve ^a,b   Picard, Rosalind W ^a,b  

^a IEEE   (United States)

^b MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

Motion estimation; Personal imaging; Projective geometry; Video orbits

Indexed keywords

IMAGE QUALITY; IMAGING TECHNIQUES; PARAMETER ESTIMATION;

MOTION ESTIMATION; PROJECTIVE GEOMETRY; VIDEO ORBITS;

IMAGE PROCESSING;

EID: 0031237803     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/83.623191     Document Type: Article

References (49)

1. S. B. J. L. Barron and D. J. Fleet, "Systems and experiment performance of optical flow techniques," Int. J.Comput. Vis., pp. 43-77, 1994.
2. A. Tekalp, M. Ozkan, and M. Sezan, "High-resolution image reconstruction from lower-resolution image sequences and space-varying image restoration," in Proc. IEEE Int. Conf. on Acoustics, Speech, and Signal Processing, San Francisco, CA, Mar. 23-26, 1992, pp. III-169.
3. Q. Zheng and R. Chellappa, "A computational vision approach to image registration," IEEE Trans. Image Processing, vol. 2, pp. 311-325, July 1993.
4. M. Irani and S. Peleg, "Improving resolution by image registration," CVGIP, vol. 53, pp. 231-239, May 1991.
5. L. Teodosio and W. Bender, "Salient video still: Content and context preserved," in Proc. ACM Multimedia Conf., Aug. 1993.
6. S. Mann, "Compositing multiple pictures of the same scene," in Proc. 46th Ann. IS&T Conf., Cambridge, MA, May 9-14, 1993.
7. R. Szeliski and J. Coughlan, "Hierarchical spline-based image registration," in Proc. IEEE Computer Society Conf. Computer Vision and Pattern Recognition, Seattle, WA, June 1994, pp. 194-201.
8. G. Wolberg, Digital Image Warping, IEEE Comput. Soc. Press monograph 10662. Los Alamitos, CA: IEEE Computer Society Press, 1990.
9. G. Adiv, "Determining 3D motion and structure from optical flow generated by several moving objects," IEEE Trans. Pattern Anal. Machine Intell., vol. 7, pp. 384-401, July 1995.
10. N. Navab and S. Mann, "Recovery of relative affine structure using the motion flow field of a rigid planar patch," Tech. Rep. 310, Percept. Comput. Sect., MIT Media Lab., Cambridge, MA;
11. also in Proc. Mustererkennung 1994, Symp. der DAGM, Vienna, Austria, pp. 186-196.
12. R. Y. Tsai and T. S. Huang, "Estimating three-dimensional motion parameters of a rigid planar patch," Trans. Acoust., Speech, Signal Processing, vol. ASSP-29, pp. 1147-1152, 1981.
13. O. D. Faugeras and F. Lustman, "Motion and structure from motion in a piecewise planar environment," Int. J. Pattern Recognit. Artif. Intell., vol. 2, pp. 485-508, 1988.
14. A. Shashua and N. Navab, "Relative affine: Theory and application to 3D reconstruction from perspective views," in Proc. IEEE Conf. Vis. Pattern Recognit., June 1994.
15. H. Sawhney, "Simplifying motion and structure analysis using planar parallax and image warping," in Proc. ICPR, Oct. 1994, vol. 1, pp. 403-408.
16. R. Kumar, P. Anandan, and K. Hanna, "Shape recovery from multiple views: A parallax based approach," in Proc. ARPA Image Understanding Workshop, Nov. 10, 1994.
17. L. Campbell and A. Bobick, "Correcting for radial lens distortion: A simple implementation," Tech. Rep. 322, Mass. Inst. Technol. Media Lab. Percept. Comput. Sect., Cambridge, MA, Apr. 1995.
18. C. W. Wyckoff, "An experimental extended response film," SPIE Newslett., June-July 1962.
19. S. Mann and R. Picard, "Being 'undigital' with digital cameras: Extending dynamic range by combining differently exposed pictures," Tech. Rep. 323, Mass. Inst. Technol. Media Lab. Percept. Comput. Sect., Cambridge, MA, 1994.
20. Also in Proc. IS&T's 46th Ann Conf., May 1995, pp. 422-428.
21. M. Artin, Algebra. Englewood Cliffs, NJ: Prentice-Hall, 1991.
22. S. Mann, "Wavelets and chirplets: Time-frequency perspectives, with applications," in Advances in Machine Vision, Strategies and Applications, P. Archibald, Ed. Singapore: World Scientific, 1992.
23. S. Mann and R. W. Picard, "Virtual bellows: Constructing high-quality images from video," in Proc. IEEE First Int. Conf. Image Processing, Austin, TX, Nov. 13-16, 1994.
24. R. Y. Tsai and T. S. Huang, "Multiframe image restoration and registration," Trans. Journal ACM, vol. 31, 1984.
25. T. S. Huang and A. Netravali, "Motion and structure from feature correspondence: A review," Proc. IEEE, vol. 82, pp. 252-268, Feb. 1984.
26. N. Navab and A. Shashua, "Algebraic description of relative affine structure: Connections to Euclidean, affine and projective structure," Memo 270, Mass. Inst. Technol. Media Lab., 1994.
27. H. L. Van Trees, Detection, Estimation, and Modulation Theory (Part I). New York: Wiley, 1968.
28. S. Mann and S. Haykin, "The chirplet transform: Physical considerations," IEEE Trans. Signal Processing, vol. 43, pp. 2745-2761, Nov. 1995.
29. A. Berthon, "Operator groups and ambiguity functions in signal processing," Wavelets: Time-Frequency Methods and Phase Space, J. Combs, Ed. New York: Springer-Verlag, 1989.
30. A. Grossmann and T. Paul, "Wave functions on subgroups of the group of affine cannonical tranformations," Lecture Notes in Physics, no. 211: Resonances - Models and Phenomena. New York: Springer-Verlag, 1984, pp. 128-138.
31. R. K. Young, Wavelet Theory and Its Applications. Boston, MA: Kluwer, 1993.
32. L. G. Weiss, "Wavelets and wideband correlation processing," IEEE Signal Processing Mag., pp. 13-32, 1993.
33. S. Mann and S. Haykin, "Adaptive 'chirplet' transform: An adaptive generalization of the wavelet transform," Opt. Eng., vol. 31, pp. 1243-1256, June 1992.
34. B. Horn and B. Schunk, "Determining optical flow," Artif. Intell., vol. 17, pp. 185-203, 1981.
35. J. Y. Wang and E. H. Adelson, "Spatio-temporal segmentation of video data," in Proc. SPIE Image and Video Processing II, San Jose, CA, Feb. 7-9, 1994, pp. 120-128, .
36. J. Bergen, P. Burt, R. Hingorini, and S. Peleg, "Computing two motions from three frames," in Proc. Third Int. Conf. Computer Vision, Osaka, Japan, Dec. 1990, pp. 27-32.
37. B. D. Lucas and T. Kanade, "An iterative image-registration technique with an application to stereo vision," in Proc. Image Understanding Workshop, 1981, pp. 121-130.
38. J. Y. A. Wang and E. H. Adelson, "Representing moving images with layers," IEEE Trans. Image Processing, Spec. Issue Image Sequence Compress., vol. 3, pp. 625-638, Sept. 1994.
39. R. Wilson and G. H. Granlund, "The uncertainty principle in image processing," IEEE Trans. Pattern Anal. Machine Intell., Nov. 1984.
40. J. Segman, J. Rubinstein, and Y. Y. Zeevi, "The canonical coordinates method for pattern deformation: Theoretical and computational considerations," vol. 14, pp. 1171-1183, Dec. 1992.
41. J. Segman, "Fourier cross correlation and invariance transformations for an optimal recognition of functions deformed by affine groups," vol. 9, pp. 895-902, June 1992.
42. J. Segman and W. Schempp, "Two methods of incorporating scale in the Heisenberg group," JMIV Special Issue on Wavelets, 1993.
43. B. Girod and D. Kuo, "Direct estimation of displacement histograms," in Proc. OSA Meet. Image Understanding and Machine Vision, June 1989.
44. Y. Sheng, C. Lejeune, and H. H. Arsenault, "Frequency-domain Fourier-Mellin descriptors for invariant pattern recognition," Opt. Eng., vol. 28, pp. 494-500, May 1988.
45. P. J. Burt and P. Anandan, "Image stabilization by registration to a reference mosaic," in Proc. ARPA Image Understanding Workshop, Nov. 10, 1994.
46. M. Hansen, P. Anandan, K. Dana, G. van der Wal, and P. Burt, "Real-time scene stabilization and mosaic construction," in Proc. ARPA Image Understanding Workshop, Nov. 1994.
47. S. Intille, "Computers watching football," 1995, http://www-white.media.mit.edu/vismod/demos/football/football.html.
48. Additional technical notes, examples, computer code, and video sequences, some containing images in the same orbit of the projective group (contributions are also welcome), are available from: http://www.wearcam.org/pencigraphy, or http://www-white.media.mit.edu/\steve/pencigraphy.
49. S. Mann, "Wearable computing: A first step toward personal imaging," IEEE Comput. Mag., vol. 30, pp. 25-32, February 1997; also available from http://computer.org/pubs/computer/1997/0297toc.htm.