Recognition of dynamic video contents with global probabilistic models of visual motion

IEEE Transactions on Image Processing

Volumn 15, Issue 11, 2006, Pages 3417-3430

  Piriou, Gwenaëlle ^a   Bouthemy, Patrick ^a   Yao, Jian Feng ^b  

^a CAMPUS DE BEAULIEU   (France)

^b UNIVERSITÉ DE RENNES 1   (France)

Author keywords

Motion learning; Motion recognition; Probabilistic models; Video analysis

Indexed keywords

FEATURE EXTRACTION; MATHEMATICAL MODELS; MAXIMUM LIKELIHOOD ESTIMATION; MOTION ESTIMATION; MOTION PICTURE CAMERAS; PATTERN RECOGNITION SYSTEMS; PROBABILITY; STATISTICAL METHODS;

GLOBAL PROBABILISTIC MODELS; MOTION LEARNING; MOTION RECOGNITION;

VIDEO SIGNAL PROCESSING;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; COMPUTER ASSISTED DIAGNOSIS; COMPUTER SIMULATION; EVALUATION; IMAGE ENHANCEMENT; INFORMATION RETRIEVAL; METHODOLOGY; MOTION; MOVEMENT PERCEPTION; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; STATISTICAL MODEL; THREE DIMENSIONAL IMAGING; VIDEORECORDING;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; COMPUTER SIMULATION; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; IMAGING, THREE-DIMENSIONAL; INFORMATION STORAGE AND RETRIEVAL; MODELS, STATISTICAL; MOTION; MOTION PERCEPTION; PATTERN RECOGNITION, AUTOMATED; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY; VIDEO RECORDING;

EID: 33750311690     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2006.881963     Document Type: Article

References (41)

1. N. Haering and N. da Vitoria Lobo, Visual Event Detection, ser. The International Series in Video Computing. New York: Springer, 2001, vol. 2.
2. O. Faugeras, Three-Dimensional Computer Vision, a Geometric Viewpoint. Cambridge, MA: MIT Press, 1993.
3. D. Gavrila, "The visual analysis of human movement: A survey," Comput. Vis. Image Understand., vol. 73, no. 1, pp. 82-98, 1999.
4. G. Doretto, A. Chiuso, Y. Wu, and S. Soatto, "Dynamic textures," Int. J. Comput. Vis., vol. 51, no. 2, pp. 91-109, 2003.
5. P. Bouthemy,M. Gelgon, and F. Ganansia, "A unified approach to shot change detection and camera motion characterization," IEEE Trans. Circuits Syst. Video Technol., vol. 9, no. 7, pp. 1030-1044, Jul. 1999.
6. H. Greenspan, J. Goldberger, and A. Mayer, "Probabilistic space-time video modeling via piecewise GMM," IEEE Trans. Pattern Anal. Mach. Intell., vol. 26, no. 3, pp. 384-396, Mar. 2004.
7. E. Bruno and D. Pellerin, "Video structuring, indexing and retrieval based on global motion wavelet coefficients," in Proc. 16th Int. Conf. Pattern Recognition, Quebec City, QC, Canada, Aug. 2002, vol. 3, pp. 287-290.
8. C.-W. Ngo, T.-C. Pong, and H.-J. Zhang, "On clustering and retrieval of video shots through temporal slices analysis," IEEE Trans. Multimedia, vol. 4, no. 4, pp. 446-458, Aug. 2002.
9. L. Zelnik-Manor and M. Irani, "Event-based video analysis," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, Kauai, HI, Dec. 2001, vol. 2, pp. 123-130.
10. I. Laptev and T. Lindeberg, "Local descriptors for spatio-temporal recognition," presented at the Int. Workshop Spatial Coherence for Visual Motion Analysis, Prague, Czech Republic, May 2004.
11. Y. Rui and P. Anandan, "Segmenting visual actions based on spatiotemporal motion patterns," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, Hilton Head, SC, Jun. 2000, vol. 1, pp. 111-118.
12. E. Ardizzone, M. L. Cascia, A. Avanzato, and A. Bruna, "Video indexing using MPEG motion compensation vectors," in Proc. IEEE Int. Conf. Multimedia Computing and Systems, Florence, Italy, Jun. 1999, vol. 2, pp. 725-729.
13. Y. Deng and B. Manjunath, "Content-based search of video using color, texture and motion," in Proc. 4th IEEE Int. Conf. Image Processing, Santa Barbara, CA, Oct. 1997, pp. 543-547.
14. F. Bashir, A. Khokhar, and D. Schonfeld, "Object trajectory-based activity classification and recognition using hidden Markov models," IEEE Trans. Image Process., 2005, to be published.
15. A. Ekin, A. Tekalp, and R. Mehrotra, "Automatic soccer video analysis and summarization," IEEE Trans. Image Process., vol. 12, no. 7, pp. 796-807, Jul. 2003.
16. H. Denman, N. Rea, and A. Kokaram, "Content-based analysis for video from snooker broadcasts," Comput. Vis. Image Understand., vol. 92, pp. 176-195, 2003.
17. A. Hanjalic, "Generic approach to highlights extraction from a sport video," presented at the 10th IEEE Int. Conf. Image Processing, Barcelona, Spain, Sep. 2003.
18. R. Leonardi, P. Migliorati, and M. Prandini, "Semantic indexing of soccer audio-visual sequences: A multi-modal approach based on controlled Markov chains," IEEE Trans. Circuits Syst. Video Technol., vol. 14, no. 5, pp. 634-643, May 2004.
19. F. Coldefy and P. Bouthemy, "Unsupervised soccer video abstraction based on pitch, dominant color and camera motion analysis," presented at the 12th ACM Int. Conf. Multimedia, New York, Oct. 2004.
20. N. Babaguchi, Y. Kawai, T. Ogura, and T. Kitahashi, "Personalized abstraction of broadcasted american football video by highlight selection," IEEE Trans. Multimedia, vol. 6, no. 4, pp. 575-585, Aug. 2004.
21. J. Fan, H. Luo, and A. Elmagarmid, "Concept-oriented indexing of video databases: Toward semantic sensitive retrieval and browsing," IEEE Trans. Image Process., vol. 13, no. 7, pp. 974-992, Jul. 2004.
22. J. Assfalg, M. Bertini, A. D. Bimbo, W. Nunziati, and P. Pala, "Soccer highlights detection and recognition using HMMs," in IEEE Int. Conf. Multimedia and Expo, Lausanne, Switzerland, Aug. 2002.
23. P. Chang, M. Han, and Y. Gong, "Extract highlights from baseball game video with hidden Markov models," presented at the 9th IEEE Int. Conf. Image Processing, Rochester, NY, Sep. 2002.
24. X. Gibert, H. Li, and D. Doermann, "Sports video classification using HMMs," presented at the IEEE Int. Conf. Multimedia and Expo, Baltimore, MD, 2003.
25. R. Leonardi and P. Migliorati, "Semantic indexing of multimedia documents," IEEE Trans. Multimedia, vol. 9, no. 2, pp. 44-51, Apr. 2002.
26. Y. Wang, Z. Liu, and J. Huang, "Multimedia content analysis using both audio and visual clues," IEEE Signal Process. Mag., vol. 17, no. 6, pp. 12-36, Jun. 2000.
27. N. Vasconcelos and A. Lippman, "Statistical models of video structure for content analysis and characterization," IEEE Trans. Image Process., vol. 9, no. 1, pp. 3-19, Jan. 2000.
28. N. Vasconcelos and A. Lippman, "A bayesian framework for semantic content characterization," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, Santa Barbara, CA, Jun. 1998, pp. 566-571.
29. J. Hoey and J. Little, "Bayesian clustering of optical flow fields," in Proc. 9th IEEE Int. Conf. Computer Vision, Nice, France, Oct. 2003, pp. 1086-1093.
30. F. Wang, Y.-F. Ma, H.-J. Zhang, and J.-T. Li, "A generic framework for semantic sports video analysis using dynamic bayesian networks," presented at the 11th Int. Multimedia Modelling Conf., Melbourne, Australia, Jan. 2005.
31. M. Barnard and J.-M. Odobez, "Sports event recognition using layered HMMs," presented at the Int. Conf. Multimedia and Expo, Amsterdam, The Netherlands, 2005.
32. G. Piriou, P. Bouthemy, and J.-F. Yao, "Extraction of semantic dynamic content from videos with probabilistic motion models," presented at the 8th Eur. Conf. Computer Vision, Prague, Czech Republic, May 2004.
33. R. Fablet and P. Bouthemy, "Motion recognition using non parametric image motion models estimated from temporal and multiscale cooccurrence statistics," IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 12, pp. 1619-1624, Dec. 2003.
34. J.-M. Odobez and P. Bouthemy, "Robust multiresolution estimation of parametric motion models," J. Vis. Commun. Image Represent., vol. 6, no. 4, pp. 348-365, 1995.
35. M. Irani, B. Rousso, and S. Peleg, "Detecting and tracking multiple moving objects using temporal integration," in Proc. 2nd Eur. Conf. Computer Vision, May 1992, vol. 588, pp. 282-287.
36. J.-M. Odobez and P. Bouthemy, "Detection of multiple moving objects using multiscale MRF with camera motion compensation," presented at the 1st IEEE Conf. Image Processing, Austin, TX, Nov. 1994.
37. N. Peyrard and P. Bouthemy, "Detection of meaningful events in videos based on a supervised classification approach," presented at the 10th IEEE Int. Conf. Image Processing, Barcelona, Spain, Sep. 2003.
38. C. Biernacki, G. Celeux, and G. Govaert, "Assessing a mixture model for clustering with the integrated completed likelihood," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 3, pp. 719-725, Mar. 2000.
39. F. Coldefy, P. Bouthemy,M. Betser, and G. Gravier, "Tennis video abstraction from audio and visual cues," presented at the IEEE Int. Workshop Multimedia Signal Processing, Sep. 2004.
40. P. Bouthemy, C. Hardouin, G. Piriou, and J.-F. Yao, "Mixed-state automodels and motion texture modeling," J. Math. Imag. Vis., to be published.
41. G. Piriou, P. Bouthemy, and J.-F. Yao, "Motion content recognition in video database with mixed-state probabilistic causal models," presented at the Workshop on Content-Based Multimedia Indexing, Aug. 2006, online.