Automatic video annotation via hierarchical topic trajectory model considering cross-modal correlations

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn , Issue , 2011, Pages 2380-2383

  Nakano, Takuho ^a   Kimura, Akisato ^b   Kameoka, Hirokazu ^b   Miyabe, Shigeki ^a   Sagayama, Shigeki ^a   Ono, Nobutaka ^a   Kashino, Kunio ^b   Nishimoto, Takuya ^a  

^a UNIVERSITY OF TOKYO   (Japan)

^b NTT Communication Science Laboratories   (Japan)

Author keywords

canonical correlation analysis; generative approach; hidden Markov model; topic model; Video annotation

Indexed keywords

AUDIO SIGNAL; AUTOMATIC VIDEO ANNOTATION; CANONICAL CORRELATION ANALYSIS; CROSS-MODAL CORRELATION; DATA SETS; GENERATIVE APPROACH; GEO-TAGS; MODEL PARAMETER ESTIMATION; STATISTICAL MODELS; TEXT LABELS; TOPIC MODEL; TRAJECTORY MODELS; UNIFIED FRAMEWORK; VIDEO ANNOTATIONS; VIDEO FRAME;

HIDDEN MARKOV MODELS; PARAMETER ESTIMATION; SIGNAL PROCESSING; SPEECH COMMUNICATION;

MODELS;

EID: 80051603439     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2011.5946962     Document Type: Conference Paper

References (24)

1. J. S. Downie, "The music information retrieval evaluation exchange (2005-2007): A window into music information retrieval research," Acoustical Science and Technology, vol. 29, no. 4, pp. 247-255, 2008.
2. K. Kashino, T. Kurozumi, and H. Murase, "A quick search method for audio and video signals based on histogram pruning," IEEE Trans. MM, vol. 5, no. 3, pp. 348-357, 2003.
3. A. F. Smeaton, P. Over, and W. Kraaij, "Evaluation campaigns and TRECVid," in Proc. MIR, pp. 321-330, 2006.
4. S. Lazebnik, C. Schmid, and J. Ponce, "Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories," in Proc. CVPR, pp. 2169-2178, October 2006.
5. K. Grauman and T. Darrell, "The pyramid match kernel: Efficient learning with sets of features," Journal of Machine Learning Research, vol. 8, pp. 725-760, April 2007.
6. G. Carneiro, A. Chan, P. Moreno, and N. Vasconcelos, "Supervised learning of semantic classes for image annotation and retrieval," IEEE Trans. PAMI, vol. 29, pp. 394-410, March 2007.
7. G. Wang and D. Forsyth, "Joint learning of visual attributes, object classes and visual saliency," in Proc. ICCV, pp. 537 -544, sep 2009.
8. T. Hastie, R. Tibshirani, and J. Friedman, The elements of statistical learning: Data mining, inference, and prediction. Springer, February 2009.
9. T. Hofmann, "Unsupervised learning by probabilistic latent semantic analysis," Mach. Learn., vol. 42, no. 1-2, pp. 177-196, 2001.
10. D. M. Blei, A. Y. Ng, and M. I. Jordan, "Latent dirichlet allocation," J. Mach. Learn. Res., vol. 3, pp. 993-1022, January 2003.
11. K. Barnard, P. Duygulu, D. Forsyth, N. de Freitas, D. M. Blei, and M. I. Jordan, "Matching words and pictures," J. Mach. Learn. Res., vol. 3, pp. 1107-1135, 2003.
12. J. Sivic, B. C. Russell, A. A. Efros, A. Zisserman, and W. T. Freeman, "Discovering objects and their location in images," in Proc. ICCV, vol. 1, pp. 370-377, 2005.
13. L. Fei-Fei and P. Perona, "A Bayesian hierarchical model for learning natural scene categories," in Proc. CVPR, vol. 2, pp. 524-531 vol. 2, jun 2005.
14. F. Monay and D. Gatica-Perez, "Modeling semantic aspects for cross-media image indexing," IEEE Trans. PAMI, vol. 29, pp. 1802-1817, August 2007.
15. H. Hotelling, "Analysis of a complex of statistical variables into principal components," Journal of Educational Psychology, vol. 24, 1933.
16. F. R. Bach and M. I. Jordan, "A probabilistic interpretation of canonical correlation analysis," Technical Report 688, Department of Statistics, University of California, Berkeley, 2005.
17. C. Wang, "Variational bayesian approach to canonical correlation analysis," IEEE Trans. NN, vol. 18, no. 3, pp. 905 -910, 2007.
18. T. Bailloeul, C. Zhu, and Y. Xu, "Automatic image tagging as a random walk with priors on the canonical correlation subspace," in Proc. MIR, pp. 75-82, 2008.
19. T. Harada, H. Nakayama, and Y. Kuniyoshi, "Image annotation and retrieval based on efficient learning of contextual latent space," in Proc. ICME, pp. 858-861, August 2009.
20. L. Xie, L. Kennedy, S.-F. Chang, A. Divakaran, H. Sun, and C.-Y. Lin, "Layered dynamic mixture model for pattern discovery in asynchronous multi-modal streams," in Proc. ICASSP, vol. 2, pp. 1053-1056, mar. 2005.
21. L. E. Baum and T. Petrie, "Statistical inference for probabilistic functions of finite state Markov chains," The Annals of Mathematical Statistics, vol. 37, no. 6, pp. 1554-1563, 1966.
22. Y.-G. Jiang, C.-W. Ngo, and J. Yang, "Towards optimal bag-of-features for object categorization and semantic video retrieval," Proc. CIVR, 2007.
23. M. R. Naphade, L. Kennedy, J. R. Kender, S.-F. Chang, J. R. Smith, P. Over, and A. Hauptmann, "A light scale concept ontology for multimedia understanding for trecvid 2005," IBM Research Technical Report, 2005.
24. M. Naphade, J. R. Smith, J. Tesic, S. F. Chang, W. Hsu, L. Kennedy, A. Hauptmann, and J. Curtis, "Large-scale concept ontology for multimedia," in IEEE Trans. MM, vol. 13, pp. 86-91, 2006.