Smooth nonnegative matrix factorization for unsupervised audiovisual document structuring

IEEE Transactions on Multimedia

Volumn 15, Issue 2, 2013, Pages 415-425

  Essid, Slim ^a   Févotte, Cédric ^a  

^a INSTITUT TELECOM   (France)

Author keywords

Bag of features; Content structuring; Indexing; Machine learning; Matrix factorization; Unsupervised classification; Videos

Indexed keywords

BAG OF FEATURES; CONTENT STRUCTURING; MATRIX FACTORIZATIONS; UNSUPERVISED CLASSIFICATION; VIDEOS;

HIDDEN MARKOV MODELS; INDEXING (OF INFORMATION); LEARNING SYSTEMS;

MATRIX ALGEBRA;

EID: 84872728539     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2012.2228474     Document Type: Article

References (40)

1. A. Smeaton, P. Over, and A. Doherty, "Video shot boundary detection: Seven years of TRECVid activity," Comput. Vis. Image Understand., vol. 114, no. 4, pp. 411-418, 2010.
2. P. Aigrain, P. Joly, and V. Longueville, Intelligent Multimedia Information Retrieval, M. T. Maybury, Ed. Cambridge, MA:MIT Press, 1997, ch.Medium knowledge-based macro-segmentation of video into sequences, pp. 159-173.
3. M. Yeung and B. Yeo, "Time-constrained clustering for segmentation of video into story units," in Proc. IEEE 13th Int. Conf. Pattern Recognition, 1996, 1996, vol. 3, pp. 375-380.
4. J. Vendrig andM.Worring, "Systematic evaluation of logical story unit segmentation," IEEE Trans. Multimedia, vol. 4, no. 4, pp. 492-499, 2002.
5. J. Assfalg, M. Bertini, C. Colombo, and A. Bimbo, "Semantic annotation of sports videos," IEEEMultimedia, vol. 9, no. 2, pp. 52-60, 2002. (Pubitemid 34550451)
6. F. Vallet, S. Essid, J. Carrive, and G. Richard, TV Content Analysis: Techniques and Applications. Boca Raton, FL: CRC/Taylor Francis, 2011, ch. High-level TV talk show structuring centered on speakers' interventions.
7. M. Yeung and B. Liu, "Efficient matching and clustering of video shots," in Proc. IEEE Int. Conf. Image Processing (ICIP), Hong Kong, 1995, pp. 338-338. [Online]. Available: http://www.computer.org/portal/web/csdl/doi/ 10.1109/ICIP.1995.529715.
8. D. A. Reynolds and P. Torres-Carrasquillo, "Approaches and applications of audio diarization," in Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Processing, 2005, vol. 5. [Online]. Available: http://ieeexplore. ieee.org/xpls/abs-all.jsp?arnumber=1416463.
9. T. Hofmann, "Probabilistic latent semantic indexing," in Proc. 22nd Int. Conf. Research and Development in Information Retrieval (SIGIR), 1999. [Online]. Available: http://www.cs.brown.edu/th/papers/ Hofmann-SIGIR99.pdf.
10. E. Gaussier and C. Goutte, "Relation between PLSA and NMF and implications," in Proc. 28th Annual Int. ACM SIGIR Conf. Research and Development in Information Retrieval (SIGIR'05), New York, 2005, pp. 601-602.
11. C. H. Q. Ding, T. Li, and M. I. Jordan, "Convex and semi-nonnegative matrix factorizations," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 1, pp. 45-55, 2010.
12. D. D. Lee and H. S. Seung, "Learning the parts of objects with nonnegative matrix factorization," Nature, vol. 401, pp. 788-791, 1999.
13. S. Z. Li,X.Hou, H. Zhang, andQ. Cheng, "Learning spatially localized parts-based representations," in Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), Kauai, HI, 2001, pp. 207-212.
14. D. Guillamet, B. Schiele, and J. Vitria, "Analyzing non-negative matrix factorization for image classification," in Proc. 16th Int. Pattern Recognition Conf. (ICPR), 2002, vol. 2, pp. 116-119. (Pubitemid 44844694)
15. C. M. Bishop, Pattern Recognition And Machine Learning. New York: Springer, 2008.
16. A. C. Cameron and P. K. Trivedi, Regression Analysis of Count Data, ser. Econometric Society Monographs. Cambridge, U.K.: Cambridge Univ. Press, 1998.
17. T. Virtanen, A. T. Cemgil, and S. Godsill, "Bayesian extensions to non-negative matrix factorisation for audio signal modelling," in Proc. Int. Conf. Acoustics, Speech and Signal Processing (ICASSP'08), Las Vegas, NV, Apr. 2008, pp. 1825-1828.
18. J. Eggert and E. Körner, "Sparse coding and NMF," in Proc. IEEE Int. Joint Conf. Neural Networks, 2004, pp. 2529-2533. (Pubitemid 40011434)
19. A. Lefèvre, F. Bach, and C. Févotte, "Itakura-Saito nonnegative matrix factorization with group sparsity," in Proc. Int. Conf. Acoustics, Speech and Signal Processing (ICASSP), Prague, Czech Republic, May 2011. [Online]. Available: http://perso.telecom-paristech.fr/fevotte/ Proceedings/ icassp11c.pdf.
20. D. R. Hunter and K. Lange, "A tutorial on MM algorithms," Amer. Statistician, vol. 58, pp. 30-37, 2004. (Pubitemid 38260327)
21. A. R. De Pierro, "On the relation between the ISRA and the EM algorithm for positron emission tomography," IEEE Trans. Med. Imag., vol. 12, no. 2, pp. 328-333, 1993.
22. D. D. Lee and H. S. Seung, "Algorithms for non-negative matrix factorization," in Advances in Neural and Information Processing Systems 13, 2001, pp. 556-562.
23. C. Févotte and J. Idier, "Algorithms for nonnegative matrix factorization with the beta-divergence," Neural Computat., vol. 23, no. 9, pp. 2421-2456, Sep. 2011.
24. A. Vinciarelli, A. Dielmann, S. Favre, and H. Salamin, "Canal9: A database of political debates for analysis of social interactions," in Proc. IEEE Int. Workshop Social Signal Processing, Amsterdam, The Netherlands, 2009. [Online]. Available: http://ieeexplore.ieee.org/lpdocs/ epic03/wrapper.htm?arnumber=5349466.
25. J. Sivic, M. Everingham, and A. Zisserman, ""Who are you?": Learning person specific classifiers from video," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, CVPR, Miami, FL, 2009, pp. 1145-1152. [Online]. Available: http://ieeexplore. ieee.org/xpls/abs-all.jsp? arnumber=5206513.
26. E. E. Khoury, C. Senac, and P. Joly, "Face-and-clothing based people clustering in video content," in Proc. Int. Conf.Multimedia Information Retrieval, Philadelphia, PA, 2010, pp. 295-295. [Online]. Available: http://dblp.uni-trier.de/rec/bibtex/conf/mir/KhourySJ10.
27. A. Bosch, A. Zisserman, and X. Munoz, "Image classification using random forests and ferns," in Proc. IEEE 11th Int. Conf. Computer Vision, 2007. [Online]. Available: http://www.computer.org/portal/web/ csdl/doi/10.1109/ICCV.2007.4409066.
28. A. Vedaldi and B. Fulkerson, VLFeat: An Open and Portable Library of Computer Vision Algorithms, 2008. [Online]. Available: http://www. vlfeat.org/.
29. P. Viola and M. Jones, "Rapid object detection using a boosted cascade of simple features," in Proc. 2001 IEEE Computer Society Conf. Computer Vision and Pattern Recognition, CVPR 2001, 2001, pp. I-511-I-518. [Online]. Available: http://ieeexplore.ieee.org/lpdocs/ epic03/wrapper.htm? arnumber=990517.
30. F. Vallet, S. Essid, J. Carrive, and G. Richard, "Robust visual features for the multimodal identification of unregistered speakers in TV talkshows," in Proc. IEEE Int. Conf. Image Processing (ICIP),HongKong, 2010.
31. L. R. Rabiner, "A tutorial on hidden Markov models and selected applications in speech recognition," Proc. IEEE, vol. 77, pp. 257-286, 1989.
32. J. Assfalg,M. Bertini, A. Del Bimbo,W. Nunziati, and P. Pala, "Soccer highlights detection and recognition using hmms," in Proc. 2002 IEEE Int. Conf. Multimedia and Expo, 2002 (ICME'02), 2002, vol. 1, pp. 825-828.
33. V. Y. F. Tan and C. Févotte, "Automatic relevance determination in nonnegative matrix factorization," in Proc. Workshop Signal Processing With Adaptive Sparse Structured Representations (SPARS), St. Malo, France, Apr. 2009. [Online]. Available: http://www.tsi.enst.fr/fevotte/ Proceedings/spars09.pdf.
34. The NIST Rich Transcription 2009 (RT'09) Evaluation, NIST, 2009. [Online]. Available: http://www.itl.nist.gov/iad/mig/tests/rt/2009/ docs/rt09-meeting-eval-planv2.pdf.
35. M. Zelenák and J. Hernando, "On the improvement of speaker diarization by detecting overlapped speech," in VI Jornadas en Tecnología del Habla and II Iberian SLTech Workshop, 2010. [Online]. Available: http://lorien.die.upm.es/~lapiz/rtth/JORNADAS/VI/pdfs/0032.pdf.
36. S. Meignier, J. Bonastre, and S. Igounet, "E-HMM approach for learning and adapting sound models for speaker indexing," in Proc. 2001: A Speaker Odyssey - The Speaker Recognition Workshop, Crete, Greece, 2001.
37. M. Levy, M. Sandler, and M. Casey, "Extraction of high-level musical structure from audio data and its application to thumbnail generation," in Proc. IEEE Int. Conf. Acoustics, Speech and Signal Processing, 2006, vol. 5.
38. S. Meignier and T. Merlin, "LIUM SPKDIARIZATION: An open source toolkit for diarization," in Proc. CMU SPUD Workshop, Dallas, TX, 2010. [Online]. Available: http://lium3.univ-lemans.fr/diarization/ doku.php/welcome.
39. A. T. Cemgil, "Bayesian inference for nonnegativematrix factorisation models," Computational Intelligence and Neuroscience, vol. 2009, no. Article ID 785152, 2009, 17 pp.
40. J.Mairal, F. Bach, J. Ponce, andG. Sapiro, "Online learning for matrix factorization and sparse coding," J. Mach. Learn. Res., vol. 11, pp. 10-60, 2010.