Speakers role recognition in multiparty audio recordings using social network analysis and duration distribution modeling

IEEE Transactions on Multimedia

Volumn 9, Issue 6, 2007, Pages 1215-1225

  Vinciarelli, Alessandro ^a,b,c  

^a IEEE

^b IDIAP RESEARCH INSTITUTE   (Switzerland)

^c EPFL   (Switzerland)

Author keywords

Audio indexing; Social network analysis; Sociometry; Speaker clustering; Speaker segmentation; Stochastic processes

Indexed keywords

AUDIO RECORDINGS; RANDOM PROCESSES; SOCIAL ASPECTS;

AUDIO INDEXING; SOCIAL NETWORK ANALYSIS; SOCIOMETRY; SPEAKER CLUSTERING; SPEAKER SEGMENTATION;

SPEECH RECOGNITION;

EID: 34648854438     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2007.902882     Document Type: Article

References (29)

1. C. Snoek and M. Woning, "Multimedia event-based video indexing using time intervals," IEEE Trans. Multimedia, vol. 7, no. 4, pp. 638-647, Aug. 2005.
2. J. Ajmera and C. Wooters, "A robust speaker clustering algorithm," in Proc. IEEE Workshop on Automatic. Speech Recognition Understanding, 2003.
3. I. McCowan, D. Gatica-Perez, S. Bengio, G. Lathoud, M. Barnard, and D. Zhang, "Automatic analysis of multimodal group actions in meetings," IEEE Trans. Pattern Anal. Machine Intell., vol. 27, no. 3, pp. 305-317, Mar. 2005.
4. K. Koumpis and S. Renals, "Content-based access to spoken audio," IEEE Signal Processing Mag., vol. 22, no. 5, pp. 61-69, May 2005.
5. S. Wasserman and K. Faust, Social Network Analysis. New York: Cambridge Univ. Press, 1994.
6. F. Jelinek, Statistical Methods for Speech Recognition. Cambridge, MA: MIT Press, 1997.
7. A. Papoulis, Pmbability, Random Variables, and Stochastic Processes. New York: McGraw-Hill, 1991.
8. C. Snoek and M. Worring, "Multimodal video indexing: A review of the state-of-the-art," Multimedia Tools Applicat., vol. 25, no. 1, pp. 5-35, 2005.
9. R. Barzilay, M. Collins, J. Hirschberg, and S. Whittaker, "The rules behind die roles: Identifying speaker roles in radio broadcasts," in Proc. Amer: Association of Artificial Intelligence Symp., 2000.
10. D. Javed, Z. Rasheed, and M. Shah, "A framework for segmentation of talk and game shows," in Proc. Int. Conf. Computer Vision, 2001.
11. R. Baeza-Yates and B. Ribeiro-Neto, Modern Information Retrieval. Reading, MA: Addison-Wesley, 1999.
12. S. L. Lee and B. Chen, "Spoken document understanding and organization," IEEE Signal Processing Mag., vol. 22, no. 5, pp. 42-60, May. 2005.
13. N. Babaguchi, Y. Kawai, and T. Kitahashi, "Event based indexing of broadcasted sports video by intermodal collaboration," IEEE Trans. Multimedia, vol. 4, no. 1, pp. 68-75, Feb. 2002.
14. F. Coldefy and P. Bouthemy, "Unsupervised soccer video abstraction based on pitch, dominant color and camera motion analysis," in Proc. ACM Conf. Multimedia, 2004, pp. 268-271.
15. D. Zhang, D. Gatica-Perez, S. Bengio, and I. McCowan, "Modeling individual and group actions in meetings with layered HMMs," IEEE Trans. Multimedia, accepted for publication.
16. D. Gatica-Perez, D. Zhang, and S. Bengio, "Extracting information from multimedia meeting collections," in Proc. 7th ACM SIGMM Int. Workshop on Multimedia Information Retrieval, 2005, pp. 242-252.
17. S. N. Wrigley, G. J. Brown, V. Wan, and S. Renals, "Speech and crosstalk detection in multichannel audio," IEEE Trans. Speech Audio Processing, vol. 13, no. 1, pp. 84-91, Jan. 2005.
18. C. M. Lee and S.S. Narayanan, "Toward detecting emotions in spoken dialogs," IEEE Trans. Multimedia, vol. 7, no. 2, pp. 293-303, Apr. 2005.
19. T. Zhang and C. J. Kuo, "Audio content analysis for online audiovisual data segmentation and classification," IEEE Trans. Multimedia, vol. 9, no. 4, pp. 441-457, Oct. 2001.
20. Y.-F. Ma, X.-S Hua, L. Lu, and H.-J. Zhang, "A generic framework for user attention model and its application in video summarization," IEEE Trans. Multimedia, vol. 7, no. 5, pp. 907-919, Oct. 2005.
21. A. Hanjalic and L.-Q. Xu, "Affective video content representation and modeling," IEEE Trans. Multimedia, vol. 7, no. 1, pp. 143-154, Feb. 2005.
22. A. Hanjalic, "Adaptive extraction of highlights from a sport video based on excitement modeling," IEEE Trans. Multimedia, vol. 7, no. 6, pp. 1114-1122, Dec. 2005.
23. C. H. Chan and G. J. F. Jones, "Affect-based indexing and retrieval of films," in Proc. ACM Conf. Multimedia, 2005, pp. 427-430.
24. J. Ajmera, "Robust Audio Segmentation," Ph.D. thesis, École Polytechnique Fédérale de Lausanne (EPFL), Lausanne, Switzerland, 2004.
25. X. Huang, A. Acero, and H.-W. Hon, Spoken Language Processing: A Guide to Theory, Algorithm and System Development. Englewood Cliffs, NJ: Prentice-Hall, 2001.
26. J. Scott, Social Network Analysis - A. Handbook. New York: Sage, 1991.
27. N. Fay, S. Garrod, and J. Carletta, "Group discussion as interactive dialogue or as serial monologue," Psychol. Sci., vol. 11, no. 6, pp. 481-486, 2000.
28. C. Bishop, Pattern Recognition and Machine Learning. New York: Springer-Verlag, 2006.
29. L. Pevzner and M. Hearst, "A critique and improvement of an evaluation metric for the text segmentation," Comput. Linguist., vol. 28, no. 1, pp. 19-36, 2002.