A narrative-based abstraction framework for story-oriented video

ACM Transactions on Multimedia Computing, Communications and Applications

Volumn 3, Issue 2, 2007, Pages

  Jung, Byunghee ^a,b   Song, Junehwa ^b   Lee, Yoonjoon ^b  

^a Korean Broadcasting System (KBS)   (South Korea)

^b Korea Advanced Institute of Science and Technology (KAIST)   (South Korea)

Author keywords

Film; Narrative structure; Online review services; Story understanding; Story oriented; Video abstraction; Video abstraction system

Indexed keywords

COMPUTATIONAL METHODS; GRAPHIC METHODS; MULTIMEDIA SERVICES; ONLINE SYSTEMS; TELEVISION;

NARRATIVE STRUCTURE GRAPH (NSG); ONLINE REVIEW SERVICES; VIDEO ABSTRACTION; VIDEO PRODUCTION;

VIDEO STREAMING;

EID: 34250157033     PISSN: 15516857     EISSN: 15516865     Source Type: Journal    
DOI: 10.1145/1230812.1230817     Document Type: Article

References (42)

1. ADAMS, B., DORAI, C., AND VENKATESH, S. 2002. Toward automatic extraction of expressive elements from motion pictures: Tempo. IEEE Trans. Multimedia 4, 4 (Dec.), 472-481.
2. ARAI, H. 1987. Fundamental Techniques for Scenario Writing. Da-Bo Munhwa (in Korean).
3. ARLJON, D. 1991. Grammar of The Film Language. Silman-James Press.
4. BABAGUCHI, N., KAWAI, Y., AND KITAHASHI, T. 2002. Event based indexing of broadcasted sports video by intermodal collaboration. IEEE Trans. Multimedia 4, 1 (Dec.), 68-75.
5. BORDWELL, D. AND THOMPSON, K. 1996. Film Art: An Introduction. McGraw-Hill Companies.
6. BORECZKY, J. S. AND ROWE, L. A. 1996. Comparison of video shot boundary detection techniques. In Proceedings of SPIE Storage and Retrieval for Still Image and Video Databases IV (Feb.). San Jose, CA, 170-179.
7. BBANIGAN, E. 1992. Narrative Comprehension and Film (Sightlines Series). Routledge.
8. BROOKS, K. M. 1996. Do story agents use rocking chairs? The theory and implementation of one model for computational narrative, la. Proceedings of the ACM International Conference on Multimedia. Boston, MA, 317-828.
9. CHATMAN, S. 1980. Story and Discourse-Narrative Structure in Fiction and Film. Cornell University Press.
10. HANJALIC, A., KAKES, G., LAGENDIJK, R. L., AND BIEMOND, J. 2001. Indexing and retrieval of broadcast news programs using DANCERS. SPIE Journal of Electronic Imaging, Special Issue on Storage, Processing and Retrieval of Digital Media, 10, 4 (Oct.), 871-882.
11. HANJALIC, A., LAGENDIJK, R. L., AND BIEMOND, J. 1999. Automated high-level movie segmentation for advanced video-retrieval systems. IEEE Trans. Circuits Syst. Video Tech. 9, 4 (June), 580-588.
12. HANJALIC, A. AND ZHANG, H. J. 1999. An integrated scheme for automated video abstraction based on unsupervised cluster-validity analysis. IEEE Trans. Circuits Syst. Video Tech. 9, 8 (Dec.), 1280-1289.
13. HE, L., SANOCKI, E., GUPTA, A., AND GRUDIN, J. 1999. Auto-summarization of audio-video presentations. In Proceedings of ACM Multimedia. Orlando, Florida, 489-498.
14. JUNG, B., HA, M., KIM, H., PARK, K., LEE, H., AND KIM, W. 2004a. A component-based DCT/LDA face recognition method for character retrieval in TV programs. In Proceedings of the International Workshop on Image Analysis for Multimedia Interactive Services. WedAmPol (April).
15. JUNG, B., KWAK, T., SONG, J., AND LEE, Y. 2004b. Narrative abstraction model for story-oriented video. In Proceedings of the ACM International Conference on Multimedia (Oct.). New York, NY, 828-885.
16. KBS ACCESS STATISTICS, http://access.kbs.co.kr/.
17. KENDER, J. R. AND YEO, B. L. 1998. Video scene segmentation via continuous video coherence. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (June). Santa Barbara, CA, 867-373.
18. KUPIEC, J., PEDERSEN, J., AND CHEN, F. 1995. A trainable document summarizer. In Proceedings of the 18th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (July). Seattle, Washington, 68-73.
19. LIENHART, R., PFEIFFER, S., AND EFFELSBERG, W. 1999. Scene determination based on video and audio features. In Proceedings of IEEE International Conference on Multimedia Computing and Systems (June). Florence, Italy, 685-690.
20. MENG, J., JUAN, Y., AND CHANG, S. F. 1995. Scene change detection in a MPEG compressed video sequences. In Proceedings of IS&T/SPIE Symposium Electronic Imaging (Feb.). San Jose, CA, 14-25.
21. NANG, J., JEONG, J., HA, M., JUNG, B., AND KIM, K. 2002. An authoring tool generating various video abstractions semi-automatically. In Proceedings of the Third IEEE Pacific Rim Conference on Multimedia: Advances in Multimedia Information Processing (Dec.). Hsinchu, Taiwan, 311-318.
22. NAM, J. AND TEWTIK, A. H. 1999. Video Abstract of Video. In Proceedings of the Third IEEE Workshop on Multimedia Signal Processing (Sep.). Copenhagen, Denmark, 117-122.
23. OMOIGUI, N., HE, L., GUPTA, A., GRUDIN, J. AND SANOCKI, E. 1999. Time-compression: Systems concerns, usage, and benefits. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (May). Pittsburgh, 136-143.
24. PATEL, N. V. AND SETHI, I. K. 1996. Audio characterization for video indexing. In Proceedings of IS&T SPIE on Storage and Retrieval for Still Image and Video Databases IV (Mar.). San Jose, CA, 373-384.
25. PFEIFFER, S., LIENHART, R., FISCHER, S., AND EEFELSBERG, W. 1996. Abstracting digital movies automatically. J. Visual Comm. Image Repres. 7, 4 (July), 345-353.
26. SHARFF, S. 1982. The Elements of Cinema: Towards a Theory of Cinesthetic Impact. Columbia University Press.
27. SMITH, M. A. AND KANADE, T. 1997. Video skimming and characterization through the combination of image and language understanding techniques. In Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, (June). Puerto Rico, 775-781.
28. SONG, J. AND YEO, B. L. 1999. Fast extraction of spatially reduced image sequences from MPEG-2 compressed video. IEEE Trans. Circuits Syst. Video Tech. 9, 7 (Oct.). 1100-1114.
29. SONG, J. AND YEO, B. L. 2000. A fast algorithm for DCT-domain inverse motion compensation based on shared information in a macroblock. IEEE Trans. Circuits Syst. Video Tech. 10, 5 (Aug.), 767-775.
30. SUNDARAM, H. AND CHANG, S. F. 2002. Computable scenes and structures in films. IEEE Trans. Multimedia 4, 4 (Dec.), 482-491.
31. SUNDAHAM, H., XIE, L., AND CHANG, S. F. 2002. A Utility framework for the automatic generation of audio-visual skims. In Proceedings of the ACM International Conference on Multimedia (Dec.). Juan-les-Pins, France, 189-198.
32. SYEDA-MAHMOOD, T. AND PONCELEON, D. 2001. Learning video browsing behavior and its application in the generation of video previews. In Proceedings of the ACM International Conference on Multimedia (Sept.). Ottawa, Canada, 119-128.
33. UCHIHASHI, S. AND FOOTE, J. 1999. Summarizing video using a shot importance measure and a frame-packing algorithm. In Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (Mar.). Phoenix, AZ, 3041-3044.
34. VASCONCELOS, N. AND LIPPMAN, A. 1998. A spatiotemporal motion model for video summarization. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (June). Santa Barbara, CA, 861-366.
35. YEO, B. L. AND LIU, B. 1995a. A unified approach to temporal segmentation of motion JPEG and MPEG compressed video. In Proceedings of the International Conference on Multimedia Computing and Systems (May). Washington, DC, 81-88.
36. YEO, B. L. AND LIU, B. 1995b. Rapid scene analysis on compressed video. IEEE Trans. Circuits Syst. Video Tech. 5, 6 (Dec.), 533-544.
37. YEO, B. L. AND LIU, B. 1995c. On the extraction of DC sequence from MPEG compressed video. In Proceedings of the IEEE International Conference on Image Processing, vol II (Oct.). Washington, DC, 260-263.
38. YEUNG, M. M. AND YEO, B. L. 1997. Video visualization for compact presentation and fast browsing of pictorial content. IEEE Trans. Circuits Syst. Video Tech. 7, 5 (Oct.), 771-785.
39. YEUNG, M. M., YEO, B. L., AND LIU, B. 1996. Extracting story units from long programs for video browsing and navigation. In Proceedings of the IEEE International Conference on Multimedia Computing and Systems (June). Hiroshima, Japan, 296-305.
40. YEUNG, M. M., YEO, B. L., WOLF, W., AND LIU, B. 1995. Video browsing using clustering and scene transitions on compressed sequences. In Proceedings of IS&T SPIE Multimedia Computing and Networking (Feb.). San Jose, CA, 399-413.
41. YOSHITAKA, A., ISHII, T., HIRAKAWA, M., AND ICHIKAWA, T. 1997. Content-based retrieval of video data by the grammar of film. In Proceedings of the IEEE Symposium on Visual Languages (Sept.). Capri, Italy, 310-317.
42. ZHANG, H. J., LOW, C. Y., SMOLIAR, S. W., AND WU, J. H. 1995. Video parsing, retrieval and browsing: An integrated and content-based solution. In Proceedings of the ACM International Conference on Multimedia (Nov.). New York, NY, 15-24.