Compact representations of videos through dominant and multiple motion estimation

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 18, Issue 8, 1996, Pages 814-830

  Sawhney, Harpreet S ^a  

^a SARNOFF CORPORATION   (United States)

Author keywords

Compact video representations; Expectation maximization (em) algorithm; Layered motion representations; Mixture models; Motion segmentation; Robust estimation; Video indexing; Video mosaics; Video motion analysis

Indexed keywords

ALGORITHMS; IMAGE SEGMENTATION; IMAGE UNDERSTANDING; INDEXING (OF INFORMATION); MOTION PICTURES; VIDEO SIGNAL PROCESSING;

COMPACT VIDEO REPRESENTATIONS; EXPECTATION MAXIMIZATION ALGORITHM; LAYERED MOTION REPRESENTATIONS; VIDEO MOSAICS; VIDEO MOTION ANALYSIS;

IMAGE ANALYSIS;

EID: 0030216923     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/34.531801     Document Type: Article

References (43)

1. E.H. Adelson and P. Anandan, "Ordinal Characteristics of Transparency," Proc. AAAl Workshop Qualitative Vision, 1990.
2. G. Adiv, "Determining 3D Motion and Structure from Optical Flows Generated bv Several Moving Objects," IEEE Trans. Pattern Analysis and Machine intelligence, vol. 7, no. 4, pp. 384-401,1985.
3. J. Ashley, M. Flickncr, J. Hafner, et al., "Automatic and SemiAutomatic Methods for Image Annotation and Retrieval in QBIC," Image and Video Storage Retrieval 111, vol. 2,420. San Jose, Calif.: SP1E, 1995.
4. S. Ayer, "Sequential and Competitive Methods for the Estimation of Multiple Motions," PhD thesis, EPFL, Lausanne, 1995.
5. S. Ayer and H.S. Sawhncy, "Layered Representation of Motion Video Using Robust Maximum-Likelihood Estimation of Mixture Models and MDL Encoding," Proc. Int'l Conf. Computer Vision, pp. 777-784,1995.
6. S. Ayer, P. Schroetcr, and J. Bigün, "Segmentation of Moving Objects by Robusl Motion Parameter Estimation Over Multiple Frames," Proc. ECCV, Stockholm, May 1994.
7. J.R. Bergen, P. Anandan, K.J. Hanna, and R. Hingorani, "Hierarchical Model-Based Motion Estimation," Proc. Second ECCV, pp. 237-252,1992.
8. MJ. Black and P. Anandan, "The Robust Estimation of Multiple Motions: Affine and Piecewise-Smooth Flow Fields," Technical Report TR, Xerox PARC, CA, Dec. 1993.
9. M. Bober and J. Kittler, "Robust Motion Analysis," Proc. CVPR, pp. 947-952, Seattle, June 1994.
10. T. Darrell and A.P. Pcntland, "Cooperative Robust Estimation Using Layers of Support," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 17, no. 5, pp. 474-487, May 1995.
11. M. Flickner, H.S. Sawhney, W. Niblack, et al., "Query by Image Video Content: The QBIC System," Computer, pp. 23-32, Sept. 1995.
12. F.R. Hampel, E.M. Ronchetti, P.J. Rousseeuw, and W.A. Stahel, Robust Statistics: The Approach Based on Influence Function's. New York: J. Wiley & Sons, 1986.
13. K.J. Hanna, "Direct Multi-Resolution Estimation of Ego-Motion and Structure from Motion," Proc. IEEE Workshop Visual Motion, pp. 156-162,1991.
14. R.I. Hartley, "Euclidean Reconstruction from Uncalibrated Views," Proc. Joint European-US Workshop Applications of Invariance in Computer Vision, 1993.
15. H. Hashihara, J. Takahashi, and J.-K. Hong, "Scene Retrieval Method for Motion Image Databases," technical report, IBM Tokyo Research Laboratory, 1991.
16. V. Hasselblad, "Estimation of Parameters for a Mixture of Normal Distributions," Technometrics, vol. 8, no. 3, pp. 431-446, Aug. 1966.
17. K. llirata and T. Kato, "Though Sketch-Based Image Information Retrieval," NEC R&D, vol. 34, no. 2, pp. 263-273, Apr. 1993.
18. S. Hsu, P. Anandan, and S. Peleg, "Accurate Computation of Optical Flow by Using Layered Motion Representation," Proc. ICPR, pp. 743-746, Jerusalem, Oct. 1994.
19. M. Irani, P. Anandan, and S. Hsu, "Mosaic Based Representations of Video Sequences and Their Applications," Proc. Int'l ConJ. Computer Vision, pp. 605-611, 1995.
20. M. Irani, B. Rousso, and S. Peleg, "Detecting and Tracking Multiple Moving Objects Using Temporal Integration," Proc, ECCV, pp. 282-287, Santa Margherita, Italy, May 1992.
21. A. Jepson and M.J. Black, "Mixture Models for Optical Flow Computation," Proc. CVPR, pp. 760-761, New York, June 1993.
22. R. Kumar, P. Anandan, and K. Hanna, "Direct Recovery of Shape from Multiple Views: A Parallax Based Approach," Proc. ICPR, pp. 685-688,1994.
23. R. Kumar, P. Anandan, M. Irani, et al., "Representation of Scenes from Collection of Images," Proc. IEEE Workshop Représentation of Visual Scenes, 1995.
24. Y.G. Leclerc, "Constructing Simple Stable Descriptions for Image Partitioning," Int'l }. Computer Vision, vol. 3, no. 1, pp. 73-102, 1989.
25. G. Li, "Robust Regression," Exploring Dala Tables, Trends find Shapes, D.C. Hoaglin, F. Mosteller, and J.W. Tukey, eds., chap. 8. New York: John Wiley & Sons, 1985.
26. W.J. MacLean, A.D. Jepson, and R.C. Frecker, "Recovery of Egomotion and Segmentation of Independent Object Motion Using the EM Algorithm," Proc. BMVC, 1994.
27. S. Mann and R.W. Picard, "Virtual Bellows: Constructing High Quality Stills from Video," Proc. 1C1P, 1994.
28. G.J. McLachlan and K.E. Basford, Mixture Models Inference and Applications to Clustering. New York and Basel: Marcel Dekker, Inc., 1988.
29. W. Niblack, R. Barber, W. Equitz, et al... "1 he QB1C Project: Querying Images by Content Using Color, Texture, and Shape," SPIE 1980, Storage and Retrieval for Image and Video Databases, pp. 173-187, Feb. 1993.
30. J.M. Odobez and P. Bouthemy, "Detection of Multiple Moving Objects Using Multiscale mrf with Camera Motion Compensation," Proc. ICIP, pp. 257-261, Austin, Tex., Nov. 1994.
31. J.M. Odobez and P. Bouthemy, "Robust Multiresolution Estimation of Parametric Motion Models in Complex linage Sequences," Proc. Seventh EUSIPCO European CoJ. Signal Processing, pp. 411-414, Edinburgh, Sept. 1994.
32. A. Pentland, R.W. Picard, and S. Sclaroff, "Photobook: Tools for Content-Based Manipulation of Image Databases," Proc. Storage and Retrieval for Image and Video Databases II. SPIE, 1994.
33. J. Rissanen, "A Universal Prior for Integers and Estimation by Minimum Description Length," Annals of Statistics, vol. 11, no. 2, pp. 416-431,1983.
34. P.J. Rousseeuw and A.M. Leroy, Robust Regression & Outlier Detection. New York: J. Wiley & Sons, 1987.
35. H.S. Sawhney, "Simplifying Motion and Structure Analysis Using Planar Parallax and Image Warping," Proc. Int'l ConJ. Pattern Recognition, pp. A403-A408,1994.
36. H.S. Sawhney, S.Aycr, and M. Gorkani, "Model-Based 2D & 3D Dominant Motion Estimation for Mosaicing and Video Represenlation," Proc. Int'l Ccnf. Computer Vision, pp. 583-590,1995.
37. G.A.F. Seber and C.I. Wild, Nonlinear Regression. New York: Wiley, 1989.
38. A. Sliashua and N. Navab, "Relative Affine Structure: Theory and Application to 3D Reconstruction from Perspective Views," Proc. Computer Vision & Pattern Recognition ConJ., pp. 483-489,1994.
39. R. Szelski, "Image Mosaicing for Tele-Reality Applications," Proc. IEEE Workshop Applications of Computer Vision, pp. 44-53, 1994.
40. R. Szeliski and S.B. Kang, "Direct Methods for Visual Scene Reconstruction," Proc. IEEE Workshop Representation of Visual Seems, 1995.
41. L.A. Teodosio and W. Bender, "Salient Video Stills: Content and Context Preserved," Proc. ACM Int'l Conf. Multimedia, 1993.
42. Y. Tonomura, A. Akutsu, K. Otsuji, and T. Sadakata, "VidcoMAP and VideoSpacelcon: Tools for Anatomizing Video Content," Proc. ACM INTERCHI, pp. 131-136,1993.
43. J.Y.A. Wang and E.H. Adplson, "Layered Representation for Motion Analysis," Proc. Computer Vision & Pattern Recognition Conf., pp. 361-366, New York, June 1993.