RoleNet: Movie analysis from the perspective of social networks

IEEE Transactions on Multimedia

Volumn 11, Issue 2, 2009, Pages 256-271

  Weng, Chung Yi ^a   Chu, Wei Ta ^b   Wu, Ja Ling ^a  

^a NATIONAL TAIWAN UNIVERSITY   (Taiwan)

^b NATIONAL CHUNG CHENG UNIVERSITY   (Taiwan)

Author keywords

Community analysis; Movie understanding; Social network analysis; Story segmentation

Indexed keywords

ELECTRIC NETWORK ANALYSIS; INFORMATION MANAGEMENT; INFORMATION THEORY;

AUDIO-VISUAL FEATURES; COMMUNITY ANALYSIS; COMMUNITY IDENTIFICATIONS; CONTEXT INFORMATIONS; CONTEXT-BASED; FEATURE-BASED; MEDIA MANAGEMENTS; MOVIE ANALYSIS; MOVIE UNDERSTANDING; SEMANTIC ANALYSIS; SOCIAL NETWORK ANALYSIS; SOCIAL NETWORKS; SOCIAL RELATIONS; SOCIAL RELATIONSHIPS; SOCIAL-BASED; STORY SEGMENTATION; VIDEO ANALYSIS; VIDEO SCENES;

MOTION PICTURES;

EID: 59149085671     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2008.2009684     Document Type: Article

References (39)

1. Z. Rasheed, Y. Sheikh, and M. Shall, "On the use of computable features for film classification," IEEE Trans. Circuits Syst. Video Technol., vol. 15, no. 1, pp. 52-64, Jan. 2005.
2. B. Adams, C. Dorai, and S. Venkatesh. "Toward automatic extraction and expression of expressive elements from motion pictures: Tempo," IEEE Trans. Multimedia, vol. 4, no. 4, pp. 472-481, 2002.
3. J. Vendrig and M. Worring, "Systematic evaluation of logical story unit segmentation," IEEE Trans. Multimedia, vol. 4, no. 4, pp. 492-499, 2002.
4. Y. Li, S.-H. Lee, C.-H. Yeh, and C.-C. J. Kuo, "Techniques for movie content analysis and skimming: Tutorial and overview on video abstraction techniques," IEEE Signal Process. Mag., vol. 23, no. 2, pp. 79-89, 2006.
5. B.T. Truong and S. Venkatesh, "Video abstraction: A systematic review and classification," ACM Trans. Multimedia Comput., Commun., and Applic., vol. 3, no. 1, 2007.
6. B. Jung, T. Kwak, J. Song, and Y. Lee, "Narrative abstraction model for story-oriented video," in Proce. ACM Multimedia Conf., 2004, pp. 828-835.
7. A.F. Smeaton, B. Lehane, N.E. O'Connor, C. Brady, and G. Craig, "Automatically selecting shots for action movie trailers," in Proc. ACM Int. Workshop on Multimedia Information Retrieval, 2006, pp. 231-238.
8. H.-W. Chen, J.-H. Kuo, W.-T. Chu, and J.-L. Wu, "Action movies segmentation and summarization based on tempo analysis," in Proc. ACM SIGMM Int. Workshop on Multimedia Information Retrieval, 2004, pp. 251-258.
9. H.L. Wang and L.-F. Cheong, "Affective understanding in film," IEEE Trans. Circuits Syst. Video Technol., vol. 16, no. 6, pp. 689-704, Jun. 2006.
10. A. Hanjalic and L.-Q. Xu, "Affective video content representation and modeling," IEEE Transactions on Multimedia, vol. 7, no. 1, pp. 143-154, 2005.
11. J. Scott, Social Network Analysis: A Handbook.: Newbury Park, 1991.
12. R. Guimera, L. Danon, A. Diaz-Guilera, F. Giralt, and A. Arenas, "Selfsimilar community structure in a network of human interactions," Phys. Rev., vol. 68, p. 065103(R), 2003.
13. A.E. Krause, K.A. Frank, D.M. Mason, R.E. Ulanowicz, and W.W. Taylor, "Compartments revealed in food-web structure," Nature, vol. 426, pp. 282-285, 2003.
14. Y. Boykov and V. Kolmogorov, "An experimental comparison of min-cut/max-flow algorithms for energy minimization in vision," IEEE Trans. Pattern Anal. Mach. Intell., vol. 26, no. 9, pp. 1124-1137, Sep. 2004.
15. Z. Rasheed and M. Shall, "Scene detection in Hollywood movies and TV shows," in Proc. IEEE Computer Society Confe. Computer Vision and Pattern Recognition, 2003, vol. 2, pp. 343-348.
16. X. Zhu, A.K. Elmagarmid, X. Xue, L. Wu, and A.C. Catlin, "InsightVideo: Toward hierarchical video content organization for efficient browsing, summarization and retrieval," IEEE Trans. Multimedia, vol. 7, no. 4, pp. 648-666, Aug. 2005.
17. M. Yeung, B.-L. Yeo, and B. Liu, "Segmentation of video by clustering and graph analysis," Comput. Vis. Image Understand., vol. 71, no. 1, pp. 94-109, 1998.
18. W. H. Hsu and S.-F. Chang, "A statistical framework for fusing midlevel perceptual features in news story segmentation," in Proc. IEEE Int. Conf. Multimedia & Expo, 2003, vol. 2, pp. 413-416.
19. C. Dorai and S. Venkatesh, "Computational media aesthetics: Finding meaning beautiful," IEEE Multimedia, vol. 8, no. 4, pp. 10-12, 2001.
20. C.-Y. Weng, W.-T. Chu, and J.-L. Wu, "Movie analysis based on roles' social network," in Proc. IEEE Int. Conf. Multimedia & Expo., 2006, pp. 1403-1406.
21. C.-Y. Weng, W.-T. Chu, and J.-L. Wu, "RoleNet: Treat a movie as a small society," in Proc. ACM SIGMM Int. Workshop on Multimedia Information Retrieval, 2007, pp. 51-60.
22. A. Vinciarelli, F. Fernandez, and S. Favre, "Semantic segmentation of radio programs using social network analysis and duration distribution modeling," in Proc. IEEE Int. Conf. Multimedia & Expo., 2006, pp. 779-782.
23. A. Vinciarelli and S. Favre, "Broadcast news story segmentation using social network analysis and hidden Markov models," in Proc. ACM Multimedia, 2007, pp. 261-264.
24. R. Rienks, D. Zhang, and W. Post, "Detection and application of influence rankings in small group meetings," in Proc. Int. Conf. Multimodal Interfaces, 2006, pp. 257-264.
25. Open Source Computer Vision Library, [Online]. Available: http://www.intel.com/technology/computing/opencv/
26. A. V. Nefian, M. H., and III. Hayes, "An embedded HMM-based approach for face detection and recognition," in Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Processing, 1999, vol. 6, pp. 3553-3556.
27. Y. Li, S. Narayanan, and C.-C. J. Kuo, "Content-based movie analysis and indexing based on audiovisual cues," IEEE Trans. Circuits Syst. Video Technol., vol. 14, no. 8, pp. 1073-1085, Aug. 2004.
28. W.-T. Chu, W.-H. Cheng, J. Y.-J. Hsu, and J.-L. Wu. "Towards semantic indexing and retrieval using hierarchical audio models," ACM Multimedia Syst. J., vol. 10, no. 6, pp. 570-583, 2005.
29. H.J. Zhang, C.Y. Low, S.W. Smoliar, and J.H. Wu, "Video parsing, retrieval and browsing: An integrated and content-based solution," in Proc. ACM Multimedia Conf., 1995, pp. 15-24.
30. R. Lienhart, "Comparison of automatic shot boundary detection algorithms," in Proc. SPIE, 1999, vol. 3656, pp. 290-301.
31. C. G. M. Snoek, M. Worring, J.-M. Geusebroek, D. C. Koelma, F. J. Seinstra, and A. W. M. Smeulders, "The semantic pathfinder: Using an authoring metaphor for generic multimedia indexing," IEEE Trans. Pattern Anal. Mack Intell., vol. 28, no. 10, pp. 1678-1689, Oct. 2006.
32. M. Naphade, J. R. Smith, J. Tesic, S.-F. Chang, W. Hsu, L. Kennedy, A. Hauptmann, and J. Curtis, "Large-scale concept ontology for multimedia," IEEE Multimedia Mag., vol. 13, no. 3, pp. 86-91, 2006.
33. L.D. Giannetti, Understanding Movies. Englewood Cliffs, NJ: Prentice-Hall, 1999.
34. D. Bordwell, Narration In The Fiction Film. Madison, WI: Univ. Wisconsin Press, 1985.
35. N.P. Garg, S. Favre, H. Salamin, D. Hakkani Tur, and A. Vinciarelli, "Role recognition for meeting participants: An approach based on lexical information and social network analysis," in Pwc. ACM Multimedia Conf., 2008, pp. 693-696.
36. H. Hung, D. Jayagopi, C. Yeo, G. Friendland, S. Ba, J. Ramchandran, N. Mirghafori, and D. Gatica-Perez, "Using audio and video features to classify the most dominant person in a group meeting," in Proc. ACM Multimedia Conf., 2007, pp. 835-838.
37. K. Albrecht, Social Intelligence: The New Science of Success. New York: Wiley, 2005.
38. A. Pentland, "Social signal processing," IEEE Signal Process. Mag., vol. 24, no. 4, pp. 108-111, Jul. 2007.
39. A. Vinciarelli, M. Pantic, H. Bourlard, and A. Pentland, "Social signal processing: State-of-the-art and future perspectives of an emerging domain," in Pwc. ACM Multimedia Conf., 2008, pp. 1061-1070.