Video concept detection by audio-visual grouplets

International Journal of Multimedia Information Retrieval

Volumn 1, Issue 4, 2012, Pages 223-238

  Jiang, Wei ^a   Loui, Alexander C ^a  

^a EASTMAN KODAK COMPANY   (United States)

Author keywords

Audio visual grouplet; Video concept detection

Indexed keywords

EID: 85013965986     PISSN: 21926611     EISSN: 2192662X     Source Type: Journal    
DOI: 10.1007/s13735-012-0020-6     Document Type: Article

References (45)

1. Aach T, Kaup A (1995) Bayesian algorithms for adaptive change detection in image sequences using Markov random fields. Signal Process: Image Commun 7:147–160
2. Akutsu A, Tonomura Y (1994) Video tomography: an efficient method for camerawork extraction and motion analysis. In: ACM multimedia, pp 349–356
3. Barzelay Z, Schechner Y (2007) Harmony in motion. In: IEEE CVPR, pp 1–8
4. Beal MJ, Jojic N, Attias H (2003) A graphical model for audiovisual object tracking. IEEE PAMI 25(7):828–836
5. Chang S et al (2007) Large-scale multimodal semantic concept detection for consumer video. In: ACM MIR, pp 255–264
6. Cotton C, Ellis D, Loui A (2011) Soundtrack classification by transient events. In: IEEE ICASSP, Czech Republic
7. Cristani M, Manuele B, Vittorio M (2007) Audio-visual event recognition in surveillance video sequences. IEEE Trans Multimedia 9(2):257–267
8. Dalal N, Triggs B (2005) Histograms of oriented gradients for human detection. In: IEEE CVPR, pp 886–893
9. Davis J et al (2007) Information-theoretic metric learning. In: ICML, pp 209–216
10. Ding M, Chen Y, Bressler SL (2006) Granger causality: basic theory and applications to neuroscience. In: Schelter S et al (eds) Handbook of time series analysis. Wiley, Wienheim
11. Divvala S et al (2009) An empirical study of context in object detection. In: IEEE CVPR, Miami
12. Elhabian SY, El-Sayed KM (2008) Moving object detection in spatial domain using background removal techniques: state-of-art. Recent Patents Comput Sci 1(1):32–54
13. Enqvist O, Josephson K, Kahl F (2009) Optimal correspondences from pairwise constraints. In: IEEE ICCV, Kyoto
14. Globerson A, Roweis S (2006) Metric learning by collapsing classes. In: NIPS, pp 451–458
15. Granger C (1969) Investigating causal relations by econometric models and cross-spectral methods. Econometrica 37(3):424–438
16. Iwano K et al (2007) Audio-visual speech recognition using lip information extracted from side-face images. EURASIP J ASMP 2007(1):4–12
17. Jiang W et al (2010) Audio-visual atoms for generic video concept classification. ACM TOMCCAP 6:1–19
18. Jiang Y, Ngo CW, Yang J (2007) Towards optimal bag-of-features for object categorization and semantic video retrieval. In: ACM CIVR, pp 494–501
19. Jiang Y et al (2011) Consumer video understanding: a benchmark database and an evaluation of human and machine performance. ACM ICMR, Trento
20. Joly P, Kim HK (1996) Efficient automatic analysis of camera work and microsegmentation of video using spatiotemporal images. Signal Process: Image Commun 8(4):295–307
21. Ke Y, Sukthankar R, Hebert M (2007) Event detection in crowded videos. IEEE ICCV, Brazil
22. Laptev I et al (2008) Learning realistic human actions from movies. IEEE CVPR, Alaska
23. Lin WH, Hauptmann A (2002) News video classification using svm-based multimodal classifiers and combination strategies. In: Proc ACM multimedia, pp 323–326
24. Lowe DG (2004) Distinctive image features from scale-invariant keypoints. IJCV 60(2):91–110
25. Marszalek M, Laptev I, Schmid C (2009) Actions in context. In: IEEE CVPR, Miami
26. Mihalcea R, Corley C, Strapparava C (2006) Corpus-based and knowledge-based measures of text semantic similarity. In: National conference on artificial intelligence, pp 775–780
27. Nedungadi A et al (2009) Analyzing multiple spike trains with nonparametric granger causality. J Comput Neurosci 27(1):55–64
28. Ng A, Jordan M, Weiss Y (2001) On spectral clustering: analysis and an algorithm. NIPS
29. Pham DT, Cardoso JF (2001) Blind separation of instantaneous mixtures of non stationary sources. IEEE Trans Signal Process 49(9):1837–1848
30. Prabhakar K et al (2010) Temporal causality for the analysis of visual events. In: IEEE CVPR, San Francisco
31. Roweis ST (2001) One microphone source separation. NIPS
32. Sargin M et al (2009) Audiovisual celebrity recognition in unconstrained web videos. In: IEEE ICASSP, Taipei
33. Schölkopf B, Smola AJ (2002) Learning with kernels: support vector machines, regularization, optimization, and beyond. MIT, Cambridge
34. Smeaton AF, Over P, Kraaij W (2006) Evaluation campaigns and TRECVid. In: ACM MIR, pp 321–330
35. Stauffer C, Grimson E (2000) Learning patterns of activity using realtime tracking. IEEE PAMI 22(8):747–757
36. Varma M, Babu BR (2009) More generality in efficient multiple kernel learning. In: ICML, pp 1065–1072
37. Walden A (2000) A unified view of multitaper multivariate spectral estimation. Biometrika 87(4):767–788
38. Wang B, Plumbley MD (2006) Investigating single-channel audio source separation methods based on non-negative matrix factorization. In: ICArn, pp 17–20
39. Wang W et al (2005) Video assisted speech source separation. In: IEEE ICASSP, pp 425–428
40. Weinberger K, Saul L (2009) Distance metric learning for large margin nearest neighbor classification. JMLR 10(12):207–244
41. Wu L et al (2009) Scale-invariant visual language modeling for object categorization. IEEE TMM 11(2):286–294
42. Wu L et al (2010) Semantics-preserving bag-of-words models and applications. IEEE TIP 19(7):1908–1920
43. Wu Y et al (2004) Multimodal information fusion for video concept detection. IEEE ICIP, pp 2391–2394
44. Yang J et al (2007) Evaluating bag-of-visual-words representations in scene classification. ACM MIR, pp 197–206
45. Yao B, Fei-Fei L (2010) Grouplet: a structured image representation for recognizing human and object interactions. IEEE CVPR, San Francisco