Automatic role recognition in multiparty recordings: Using social affiliation networks for feature extraction

IEEE Transactions on Multimedia

Volumn 11, Issue 7, 2009, Pages 1373-1380

  Salamin, Hugues ^a   Favre, Sarah ^b,c   Vinciarelli, Alessandro ^a  

^a UNIVERSITY OF GLASGOW   (United Kingdom)

^b IDIAP RESEARCH INSTITUTE   (Switzerland)

^c EPFL   (Switzerland)

Author keywords

Broadcast data; Meeting recordings; Role recognition; Social network analysis

Indexed keywords

AUTOMATIC ANALYSIS; BROADCAST DATA; MEETING RECORDINGS; MULTIMEDIA COMMUNITY; PRODUCTION ENVIRONMENTS; RECOGNITION PERFORMANCE; ROLE RECOGNITION; SOCIAL INTERACTIONS; SOCIAL NETWORK ANALYSIS;

ELECTRIC NETWORK ANALYSIS; FEATURE EXTRACTION; MULTIMEDIA SYSTEMS;

BROADCASTING;

EID: 70350266257     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2009.2030740     Document Type: Article

References (25)

1. A. Vinciarelli, M. Pantic, and H. Bourlard, "Social signal processing: Survey of an emerging domain," Image Vis. Comput., vol.27, no.12, 2009.
2. A. Vinciarelli, M. Pantic, H. Bourlard, and A. Pentland, "Social signal processing: State-of-the-art and future perspectives of an emerging domain," in Proc. ACM Int. Conf. Multimedia, 2008, pp. 1061-1070.
3. D. Gatica-Perez, "Automatic nonverbal analysis of social interaction in small groups: A review," Image Vis. Comput., to be published.
4. H. Tischler, Introduction to Sociology. Fort Worth, TX: Harcourt Brace College, 1990.
5. S. Wasserman and K. Faust, Social Network Analysis. Cambridge, U.K.: Cambridge Univ. Press, 1994.
6. C. Bishop, Pattern Recognition and Machine Learning. New York: Springer-Verlag, 2006.
7. J. Carletta, S. Ashby, S. Bourban, M. Flynn, M. Guillemot, T. Hain, J. Kadlec, V. Karaiskos, W. Kraaij, and M. Kronenthal, et al., The AMI Meeting Corpus: A Pre-Announcement, ser. Lecture Notes in Computer Science. Berlin, Germany: Springer, 2005, vol.3869, pp. 28-39.
8. Y. Liu, "Initial study on automatic identification of speaker role in broadcast news speech," in Proc. Human Language Technology Conf. NAACL, Companion Volume: Short Papers, Jun. 2006, pp. 81-84.
9. S. Maskey and J. Hirschberg, "Automatic summarization of broadcast news using structural features," in Proc. Eur. Conf. Speech Communication and Technology, 2003, pp. 1173-1176.
10. A. Vinciarelli, "Sociometry based multiparty audio recordings summarization," in Proc .Int. Conf. Pattern Recognition, 2006, pp. 1154-1157. (Pubitemid 46532408)
11. A. Vinciarelli and S. Favre, "Broadcast news story segmentation using social network analysis and hidden Markov models," in Proc. ACMInt. Conf. Multimedia, 2007, pp. 261-264.
12. C. Weng, W. Chu, and J. Wu, "Movie analysis based on roles social network," in Proc. IEEE Int. Conf. Multimedia and Expo, 2007, pp. 1403-1406.
13. A. Vinciarelli, "Speakers role recognition in multiparty audio recordings using social network analysis and duration distribution modeling," IEEE Trans. Multimedia, vol.9, pp. 1215-1226, 2007.
14. J. Levine and R. Moreland, "Small groups," in The Handbook of Social Psychology, D. Gilbert and G. Lindzey, Eds. Oxford, U.K.: Oxford Univ. Press, 1998, vol.2, pp. 415-469.
15. R. Barzilay, M. Collins, J. Hirschberg, and S. Whittaker, "The rules behind the roles: Identifying speaker roles in radio broadcasts," in Proc. 17th Nat. Conf. Artificial Intelligence, 2000, pp. 679-684.
16. C. Weng, W. Chu, and J. Wu, "Rolenet: Movie analysis from the perspective of social networks," IEEE Trans. Multimedia, vol.11, pp. 256-271, 2009.
17. F. Pianesi, M. Zancanaro, E. Not, C. Leonardi, V. Falcon, and B. Lepri, "A multimodal annotated corpus of consensus decision making meetings," J. Lang. Res. Eval., vol.41, no.3-4, pp. 409-429, 2008.
18. K. Laskowski, M. Ostendorf, and T. Schultz, "Modeling vocal interaction for text-independent participant characterization in multi-party conversation," in Proc. 9th ISCA/ACL SIGdial Workshop Discourse and Dialogue, Jun. 2008, pp. 148-155.
19. N. Garg, S. Favre, H. Salamin, D. Hakkani-Tür, and A. Vinciarelli, "Role recognition for meeting participants: An approach based on lexical information and social network analysis," in Proc. ACM Int. Conf. Multimedia, 2008, pp. 693-696.
20. D. Jayagopi, H. Hung, C. Yeo, and D. Gatica-Perez, "Predicting the dominant clique in meetings through fusion of nonverbal cues," in Proc. ACM Int. Conf. Multimedia, 2008, pp. 809-812.
21. D. Jayagopi, S. Ba, J. Odobez, and D. Gatica-Perez, "Predicting two facets of social verticality in meetings from five-minute time slices and nonverbal cues," in Proc. Int. Conf. Multimodal Interfaces, 2008, pp. 45-52.
22. J. Ajmera, "Robust audio segmentation," Ph.D. dissertation, École Polytechnique Fédérale de Lausanne (EPFL), Lausanne, Switzerland, 2004.
23. J. Dines, J. Vepa, and T. Hain, "The segmentation of multi-channel meeting recordings for automatic speech recognition," in Proc. Interspeech, 2006, pp. 1213-1216.
24. S. Kirkpatrick, C. D. Gelatt, and M. P. Vecchi, "Optimization by simulated annealing," Science, vol.220, pp. 671-680, 1983.
25. F. Massey Jr., "The Kolmogorov-Smirnov test for goodness of fit," J. Amer. Statist. Assoc., pp. 68-78, 1951.