Statistical models of video structure for content analysis and characterization

IEEE Transactions on Image Processing

Volumn 9, Issue 1, 2000, Pages 3-19

  Vasconcelos, Nuno ^a,b   Lippman, Andrew ^a,b  

^a IEEE   (United States)

^b MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BAYESIAN FORMULATION; CONTENT ANALYSIS; VIDEO DATABASE; VIDEO REPRESENTATION; VIDEO SEGMENTATION; VIDEO SEMANTICS; VIDEO STRUCTURE;

DATABASE SYSTEMS; IMAGE ANALYSIS; LINGUISTICS; MATHEMATICAL MODELS; MOTION PICTURES; PROBABILITY DISTRIBUTIONS; STATISTICAL METHODS; VIDEO SIGNAL PROCESSING; WEIBULL DISTRIBUTION;

IMAGE SEGMENTATION;

EID: 0033888731     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/83.817595     Document Type: Article

References (59)

1. Internet Movie Database at http://us.imdb.com/.
2. P. Anandan, J. Bergen, K. Hanna, and R. Hingorani, "Hierarchical model-based motion estimation," in Motion Analysis and Image Sequence Processing, M. Sezan and R. Lagendijk, Eds. Boston, MA: Kluwer, 1993, ch. 1.
3. Y. Ariki and Y. Saito, "Extraction of TV news articles based on scene cut detection using DCT clustering," in IEEE Int. Conf. Image Processing, Lausanne, Switzerland, 1996, pp. 847-850.
4. D. Bertsekas, Nonlinear Programming. Belmont, MA: Athena Scientific, 1995.
5. D. Bordwell and K. Thompson, Film Art: An Introduction, New York: McGraw-Hill, 1986.
6. J. Boreczky and L. Rowe, "Comparison of video shot boundary detection techniques," in Proc. SPIE Conf. on Visual Communication and Image Processing, 1996.
7. V. Bove, J. Dakss, S. Agamanolis, and E. Chalom, "Adding hyperlinks to digital television," in Proc. SMPTE 140th Technical Conf., 1998.
8. C. Carson, S. Belongie, H. Greenspan, and J. Malik, "Region-based image querying," in Workshop in Content-Based Access to Image and Video Libraries, San Juan, P R., 1997, pp. 42-49.
9. R. Castagno, T. Ebrahimi, and M. Kunt, "Video segmentation based on multiple features for interactive multimedia applications," IEEE Trans. Circuits Syst. Video Technol., vol. 8, pp. 562-571, Sept. 1998.
10. E. Chalom, "Statistical image sequence segmentation using multidimensional attributes," Ph.D. dissertation, Mass. Inst. Technol., Cambridge, 1998.
11. S. Chang, W. Chen, H. Meng, H. Sundaram, and D. Zhong, "A fully automated content-based video search engine supporting spatiotemporal queries,"IEEE Trans. Circuits Syst. Video Technol., vol. 8, pp. 602-615, Sept. 1998.
12. A. Dempster, N. Laird, and D. Rubin, "Maximum-likelihood from incomplete data via the EM algorithm," J. R. Stat. Soc. B, vol. 39, pp. 1-22, 1977.
13. Y. Deng and B. Majunath, "NeTra-V: Toward an object-based video representation," IEEE Trans. Circuits Syst. Video Technol., vol. 8, pp. 616-627, Sept. 1998.
14. A. Drake, Fundamentals of Applied Probability Theory, New York: Mc-Graw-Hill, 1987.
15. W. Niblack et al., "The QBIC project: Querying images by content using color, texture, and shape," in Proc. Conf. Storage and Retrieval for Image and Video Databases. San Jose, CA, Feb. 1993, pp. 173-181.
16. D. Forsyth and M. Fleck, "Body plans," in Proc. IEEE Computer Society Conf. Computer Vision and Pattern Recognition, San Juan, PR, 1997, pp. 678-683.
17. B. Funt and G. Finlayson, "Color constant color indexing," IEEE Trans. Pattern. Anal. Machine Intell., vol. 17, pp. 522-529, May 1995.
18. U. Gargi, R. Kasturi, and S. Antani, "Performance characterization and comparison of video indexing algorithms," in IEEE Computer Society Conf. Computer Vision and Pattern Recognition, Santa Barbara, CA, 1997, pp. 559-565.
19. A. Gelman, J. Carlin, H. Stern, and D. Rubin, Bayesian Data Analysis. London, U.K.: Chapman & Hall, 1995.
20. B. Gunsel and M. Tekalp, "Content-based video abstraction," in IEEE Int. Conf. Image Processing, Chicago, IL, 1998, pp. 128-132.
21. A. Hanjalic, R. Lagendijk, and J. Biemond, "Template-based detection of anchorperson shots in news programs," in IEEE Int. Conf. Image Processing, Chicago, IL, 1998, pp. 148-152.
22. R. Hogg and E. Tanis, Probability and Statistical Inference, New York: Macmillan, 1993.
23. G. Iyengar and A. Lippman, "Semantically controlled content-based retrieval of video sequences," in Proc. SPIE Conf. Multimedia Storage and Archiving Systems III, Boston, MA, 1998, pp. 216-227.
24. A. Jain and A. Vailaya, "Image retrieval using color and shape," Pattern Recognit., vol. 29, pp. 1233-1244, Aug. 1996.
25. J. Render and B. Yeo, "Video scene segmentation via continuous video coherence," in IEEE Computer Society Conf. Computer Vision and Pattern Recognition, Santa Barbara, CA, 1998, pp. 367-373.
26. A. Lippman, N. Vasconcelos, and G. Iyengar, "Human interfaces to video," in 32nd Asilomar Conf. Signals, Systems, and Computers, Asilomar, CA, 1998.
27. C. Low, Q. Tian, and H. Zhang, "An automatic news video parsing, indexing, and browsing system," in Proc. ACM Multimedia Conf., Boston, MA, 1996.
28. W. Ma and H. Zhang, "Benchmarking of image features for content-based retrieval," in 32nd Asilomar Conf. Signals, Systems, and Computers, Asilomar, CA, 1998.
29. W. Martin, Recent Theories of Narrative. Ithaca, NY: Cornell Univ. Press, 1986, ch. 5.
30. J. Monaco, How to Read a Movie. Oxford, U.K.: Oxford Univ. Press, 1981.
31. A. Nagasaka and Y. Tanaka, "Automatic video indexing and full-video search for object appearances," in Visual Database Systems II, E. Knuth and L. Wegner, Eds. Amsterdam, The Netherlands: Elsevier, 1992, pp. 173-127.
32. W. Niblack et al., "The QBIC project: Querying images by content using color, texture, and shape," in Storage and Retrieval for Image and Video Databases II. San Jose, CA, Feb. 1993, pp. 173-181.
33. G. Pass, R. Zabih, and J. Miller, "Comparing images using color coherence vectors," in Proc. ACM Int. Multimedia Conf., Nov. 1996, pp. 65-73.
34. A. Pentland, R. Picard, and S. Sclaroff, "Photobook: Content-based manipulation of image databases," Int. J. Comput. Vis., vol. 18, pp. 233-254, June 1996.
35. L. Rabiner and B. Juang, Eds., Fundamentals of Speech Recognition. Englewood Cliffs, NJ: Prentice-Hall, 1993.
36. R. Redner and H. Walker, "Mixture densities, maximum likelihood and the EM algorithm," SIAM Rev., vol. 26, pp. 195-239, Apr. 1984.
37. K. Reisz and G. Millar, The Technique of Film Editing. Oxford, U.K.: Focal Press, 1968.
38. P. Rousseeuw and A. Leroy, Robust Regression and Outlier Detection, New York: Wiley, 1987.
39. P. Salembier and M. Pardas, "Hierachical morphological segmentation for image sequence coding," IEEE Trans. Image Processing, vol. 3, pp. 639-651, Sept. 1994.
40. P. Simard, Y Le Cun, and J. Denker, "Efficient pattern recognition using a new transformation distance," in Proc. Neural Information Processing Systems, Denver, CO, 1994.
41. J. Smith and S. Chang, "VisualSEEk: A fully automated content-based image query system," in ACM Multimedia, Boston, 1996, pp. 87-98.
42. S. Smoliar and H. Zhang, "Video indexing and retrieval," in Multimedia Systems and Techniques, B. Furth, Ed. Boston, MA: KAP, 1996.
43. M. Swain and D. Ballard, "Color indexing," Int. J. Comput. Vis., vol. 7, pp. 11-32, 1991.
44. M. Szummer and R. Picard, "Indoor-outdoor image classification," in Proc. Workshop in Content-Based Access to Image and Video Databases, Bombay, India, 1998.
45. D. Titterington, A. Smith, and U. Makov, Statistical Analysis of Finite Mixture Distributions, New York: Wiley, 1985.
46. M. Turk and A. Pentland, "Eigenfaces for recognition," J. Cogn. Neurosci., vol. 3, pp. 71-86, 1991.
47. N. Vasconcelos and A. Lippman, "A Bayesian video modeling framework for shot segmentation and content characterization," in Proc. IEEE Workshop on Content-based Access to Image and Video Libraries. San Juan, PR, 1997.
48. _, "Multiresolution tangent distance for affine invariant classification," in Proc. Conf. Neural Information Processing Systems, Denver, CO, 1977.
49. _, "Empirical Bayesian EM-based motion segmentation," in Proc. IEEE Computer Vision and Pattern Recognition Conf., San Juan, PR, 1997.
50. _, "Toward semantically meaningful feature spaces for the characterization of video content," in Proc. Int. Conf. Image Processing, Santa Barbara, CA, 1997.
51. _, "A Bayesian framework for semantic content characterization," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, Santa Barbara, CA, 1998.
52. J. Wang and E. Adelson, "Representing moving images with layers," IEEE Trans. Image Processing, vol. 3, pp. 625-638, Sept. 1994.
53. Y. Weiss, "Smoothness in layers: Motion segmentation using nonparametric mixture estimation," in Proc. Conf. Computer Vision and Pattern Recognition , San Juan, P.R., 1997.
54. B. Yeo and B. Liu, "Rapid scene analysis on compressed video," IEEE Trans. Circuits Syst. Video Technol., vol. 5, pp. 533-544, Dec. 1995.
55. M. Yeung and B. Yeo, "Time-constrained clustering for segmentation of video into story units," in ICPA '96, 1996, pp. 375-380.
56. H. Zhang, Y Gong, S. Smoliar, and S. Tan, "Automatic parsing of news video," in Proc. Int. Conf. Multimedia Computing and Systems, Boston, MA, May 1994.
57. H. Zhang, S. Smoliar, and J. Wu, "Content-based video browsing tools," in Proc. Symp. Electronic Imaging Science and Technology: Multimedia Computing and Networking, A. Rodriguez and J. Maitan, Eds. San Jose, CA: SPIE, Feb. 1995, vol. 2417, pp. 389-398.
58. H. Zhang, J. Wang, and Y Altunbasak, "Content-based video retrieval and compression: A unified solution," in Proc. IEEE Int. Conf. Image Processing, Santa Barbara, CA, 1997, pp. 13-16.
59. J. Zhang, J. Modestino, and D. Langan, "Maximum-likelihood parameter estimation for unsupervised stochastic model-based image segmentation," IEEE Trans. Image Processing, vol. 3, pp. 404-420, July 1994.