Nonparametric motion characterization for robust classification of camera motion patterns

IEEE Transactions on Multimedia

Volumn 8, Issue 2, 2006, Pages 323-340

  Duan, Ling Yu ^a,b,c   Jin, Jesse S ^a,c,d,e   Tian, Qi ^a,b,f   Xu, Chang Sheng ^a,b  

^a IEEE   (Singapore)

^b INSTITUTE FOR INFOCOMM RESEARCH   (Singapore)

^c UNIVERSITY OF NEWCASTLE   (Australia)

^d ACM   (Australia)

^e ASTS ^*  (Australia)

^f PEKING UNIVERSITY   (China)

Author keywords

Camera motion; Nonparametric motion analysis; Video databases; Video indexing

Indexed keywords

CAMERA MOTION PATTERN; NONPARAMETRIC MOTION CHARACTERIZATION; SPACE ANALYSIS; SPATIO-TEMPORAL; VECTOR HISTOGRAMS; VIDEO DATABASES; VIDEO INDEXING;

CLASSIFICATION (OF INFORMATION); INDEXING (OF INFORMATION); INFORMATION RETRIEVAL; MOTION COMPENSATION; OPTICAL FLOWS;

MULTIMEDIA SYSTEMS;

EID: 33645145636     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2005.864344     Document Type: Article

References (53)

1. S.-F. Chang, W. Chen, H. J. Meng, H. Sundaram, and D. Zhong, "A fully automated content-based video search engine supporting spatiotemporal queries," IEEE Trans. Circuits Syst. Video Technol., vol. 8, no. 5, pp. 602-615, May 1998.
2. A. Hamrapur et al., "Virage video engine," in Proc. SPIE Storage and Retrieval for Image and Video Databases, San Jose, CA, Jan. 1997, pp. 188-197.
3. H. Wactlar, S. Stevens, M. Smith, and T. Kanade, "Intelligent access to digital video: The informedia project," IEEE Computer, vol. 29, no. 3, pp. 46-52, 1996.
4. M. Flickner et al., "Query by image and video content: The QBIC system," IEEE Computer, vol. 28, no. 9, pp. 23-32, 1995.
5. A. Pentland, R. W. Picard, and S. Sclaroff, "Photobook: Tools for content-based manipulation of image databases," in Proc. SPIE Storage and Retrieval for Image & Video Databases II, San Jose, CA, 1994, pp. 34-47.
6. P. Bouthemy, M. Gelgon, and F. Ganansia, "A unified approach to shot change detection and camera motion characterization," IEEE Trans. Circuits Syst. Video Technol., vol. 9, no. 7, pp. 1030-1044, Jul. 1999.
7. W. Xiong and J. C. M. Lee, "Efficient scene change detection and camera motion annotation for video classification," Comput. Vis. Image Understand., vol. 71, no. 2, pp. 166-181, 1998.
8. A. K. Jain, A. Vailaya, and W. Xiong, "Query by video clip," Multimedia Syst., vol. 7, no. 5, pp. 369-384, 1999.
9. R. Fablet, P. Bouthemy, and P. Perez, "Nonparametric motion characterization using casual probabilistic models for video indexing and retrieval," IEEE Trans. Image Process., vol. 11, no. 4, pp. 393-407, Apr. 2002.
10. M. Szummer and R. W. Picard, "Temporal texture modeling," in Proc. Int. Conf. Image Processing, Lausanne, Switzerland, 1996, pp. 823-826.
11. H.-J. Zhang, C. Y. Low, S. W. Smoliar, and J. H. Wu, "Video parsing, retrieval, and browsing: An integrated and content-based solution," in Proc. ACM Multimedia, San Francisco, CA, 1995, pp. 15-24.
12. Y.-F. Ma, L. Lu, H.-J. Zhang, and M. Li, "An attention model for video summarization," in Proc. ACM Multimedia, France, 2002, pp. 533-542.
13. W. Wolf, "Key frame selection by motion analysis," in Proc. Int. Conf. Acoustics, Speech, and Signal Processing (ICASSP), Atlanta, GA, 1996, pp. 1228-1231.
14. S. Jeannin and A. Divakaran, "MPEG-7 visual motion descriptors," IEEE Trans. Circuits Syst. Video Technol., vol. 11, no. 6, pp. 720-724, Jun. 2001.
15. L.-Y. Duan, M. Xu, Q. Tian, and C.-S. Xu, "Mean shift based nonparametric motion characterization," in Proc. Int. Conf. Image Processing (ICIP), Singapore, 2004, pp. 1597-1600.
16. L.-Y. Duan, M. Xu, T.-S. Chua, Q. Tian, and C.-S. Xu, "A mid-level representation framework for semantic sports video analysis," in Proc. ACM Multimedia, Berkeley, CA, 2003, pp. 33-44.
17. Y. Cheng, "Mean shift, mode seeking, and clustering," IEEE Trans. Pattern Anal. Mach. Intell., vol. 17, no. 8, pp. 790-799, Aug. 1995.
18. D. Comaniciu and P. Meer, "Mean shift: A robust approach toward feature space analysis," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 5, pp. 603-619, May 2002.
19. L. Xie, P. Xu, S.-F. Chang, A. Divakaran, and H. Sun, "Structure analysis of soccer video with domain knowledge and hidden markov models," Pattern Recognit. Lett., vol. 25, no. 7, pp. 767-775, 2004.
20. C.-W. Ngo, T.-C. Pong, and H.-J. Zhang, "Motion-based video representation for scene change detection," Int. J. Comput. Vis., vol. 50, no. 2, pp. 127-142, 2002.
21. N. Patel and I. K. Sethi, "Video shot detection and characterization for video databases," Pattern Recognit., vol. 30, no. 4, pp. 583-592, 1997.
22. Y.-F. Ma and H.-J. Zhang, "Motion pattern based video classification and retrieval," EURASIP J. Appl. Signal Process., vol. 2003, no. 2, pp. 199-208, 2003.
23. Y.-P. Tan, D. D. Saur, S. R. Kulkarni, and P. J. Ramadge, "Rapid estimation of camera motion from compressed video with application to video annotation," IEEE Trans. Circuits Syst. Video Technol., vol. 10, no. 1, pp. 133-146, Jan. 2000.
24. G. Sudhir and J. C. M. Lee, "Video annotation by motion interpretation using optical flow streams," J. Vis. Commun. Image Represent., vol. 7, no. 4, pp. 354-368, 1996.
25. S. K. Lee and M. H. Hayes, "Real-time camera motion classification for content-based indexing and retrieval using templates," in Proc. ICASSP, Orlando, FL, 2002, pp. 3664-3667.
26. J.-G. Kim, H. S. Chang, J. Kim, and H.-M. Kim, "Efficient camera motion characterization for MPEG video indexing," in Proc. Int. Conf. Multimedia & Expo, New York, 2000, pp. 1171-1174.
27. X. Yu et al., "Trajectory-based ball detection and tracking with applications to semantic analysis of broadcast soccer video," in Proc. ACM Multimedia, Berkeley, CA, 2003, pp. 11-20.
28. K. A. Peker and A. Divakaran, "Framework for measurements of the intensity of motion activity of video segments," J. Vis. Commun. Image. Represent., vol. 14, no. 4, p. 2003.
29. K. W. Lee, W. S. You, and J. Kim, Quantitative Analysis for the Motion Trajectory Descriptor in MPEG-7, Dec. 1999. ISO/ICE MPEG99/m5400.
30. A. Divaranran et al., Report on the MPEG-7 Core Experiments on the Motion Activity Feature, Melbourne, Australia, Oct. 2000. ISO/ICE MPEG99/m5030.
31. C.-W. Ngo, T.-C. Pong, and H.-J. Zhang, "On clustering and retrieval of video shots," in Proc. ACM Multimedia, Ottawa, ON, Canada, 2001, pp. 51-60.
32. M. Irani and P. Anandan, "Video indexing based on mosaic representations," Proc. IEEE, vol. 86, no. 5, pp. 905-921, May 1998.
33. M. Naphade et al., The IBM TRECVID Concept Detection: Some New Directions and Results.
34. T. Caelli and W. F. Bischof, Machine Learning and Image Interpretation. New York: Plenum, 1997, pp. 189-224.
35. ACM SIGMM Retreat Report on Future Directions in Multimedia Research, L. A. Rowe and R. Jain. [Online]. Available: www.acm.org/sigmm/main/events/ sigmm_retreat/sigmm-retreat03-final.pdf
36. R. Wang, H. J. Zhang, and Y. Q. Zhang, "A confidence measure based moving object extraction system built for compressed domain," in Proc. Int. Symp. Circuits and Systems, Geneva, Switzerland, 2000, pp. 21-24.
37. Y. Rubner, C. Tomasi, and L. J. Guibas, "A metric for distribution with applications to image databases," in Proc. Int. Conf. Computer Vision, Bombay, India, 1998, pp. 59-64.
38. A. Mojsilovic, J. Hu, and E. Soljanin, "Extraction of perceptually important colors and similarity measurement for image matching, retrieval, and analysis," IEEE Trans. Image Process., vol. 11, no. 11, pp. 1238-1248, Nov. 2002.
39. A. Mojsilovic, J. Kovacevic, J. Hu, R. J. Safranek, and K. Ganapathy, "Matching and retrieval based on the vocabulary and grammar of color patterns," IEEE Trans. Image Process., vol. 9, no. 1, pp. 38-54, Jan. 2000.
40. L.-Y. Duan, M. Xu, Q. Tian, and C.-S. Xu, "Nonparametric motion model," in Proc. ACM Multimedia, New York, 2004, pp. 754-755.
41. L.-Y. Duan, M. Xu, Q. Tian, C.-S. Xu, and J. S. Jin, "A unified frame-work for semantic shot classification in sports video," IEEE Trans. Multimedia, vol. 7, no. 6, pp. 1066-1083, Dec. 2005.
42. L.-Y. Duan, M. Xu, Q. Tian, and C.-S. Xu, "Nonparametric color characterization using mean shift," in Proc. ACM Multimedia, Berkeley, CA, 2003, pp. 243-246.
43. V. Vapnik, The Nature of Statistical Learning Theory. New York: Springer-Verlag, 1995.
44. C. Cortes and V. Vapnik, "Support-vector network," Mach. Learn., vol. 20, no. 3, pp. 273-297, 1995.
45. C.-W. Hsu and C.-J. Lin, "A comparison of methods for multi-class support vector machines," IEEE Trans. Neural Networks, vol. 13, no. 2, pp. 415-425, Mar. 2002.
46. L.-Y. Duan, M. Xu, Q. Tian, and C.-S. Xu, "Nonparametric motion model with applications to camera motion pattern classification," in Proc. ACM Multimedia, New York, 2004, pp. 328-331.
47. J. S. Jin, Z. Zhu, and G. Y. Xu, "A stable vision system for moving vehicles," IEEE Trans. Intell. Transport. Syst., vol. 1, no. 1, pp. 32-39, Mar. 2000.
48. Z. Duric and A. Rosenfeld, "Stabilization of Image Sequences," Univ. Maryland, College Park, 1995. Tech. Rep. CAR-TR-778.
49. Y. S. Yao and R. Chellappa, "Electronic Stabilization and Feature Tracking in Long Image Sequences," Univ. Maryland, College Park, 1995. Tech. Rep. CAR-TR-790.
50. B. W. Silverman, Density Estimation for Statistics and Data Analysis. New York: Chapman and Hall, 1986.
51. D. DeMenthon and D. Doermann, "Video retrieval using spatio-temporal descriptors," in Proc. ACM Multimedia, Berkeley, CA, 2003, pp. 508-517.
52. V. Kobla, D. DeMenthon, and D. Doermann, "Identification of sports videos using replay, text, and camera motion features," in Proc. SPIE Storage and Retrieval for Media Databases, San Jose, CA, 2000, pp. 332-343.
53. (2005, Feb.) I2R Tech. Rep.. Inst. Infocomm Research. [Online]. Available: http://wwwl.i2r.a-star.edu.sg/lingyu/reports/cameramotion.pdf