Discovery and fusion of salient multi-modal features towards news story segmentation

Proceedings of SPIE - The International Society for Optical Engineering

Volumn 5307, Issue , 2004, Pages 244-258

  Hsu, Winston ^a   Chang, Shih Fu ^a   Huang, Chih Wei ^a   Kennedy, Lyndon ^a   Lin, Ching Yung ^b   Iyengar, Giridharan ^b  

^a Columbia University ^*  (United States)

^b IBM T J WATSON RESEARCH CENTER   (United States)

Author keywords

Exponential model; Face detection; Maximum Entropy Model; Multi modal fusion; Prosody; Story segmentation; TRECVID

Indexed keywords

FACE DETECTION; MULTI-MODAL FUSION; STORY SEGMENTATION;

ALGORITHMS; FEATURE EXTRACTION; HEURISTIC METHODS; PROBABILITY; SPEECH SYNTHESIS;

IMAGE SEGMENTATION;

EID: 8844259704     PISSN: 0277786X     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1117/12.533037     Document Type: Conference Paper

References (16)

1. A. G. Hauptmann and M. J. Witbrock, "Story segmentation and detection of commercials in broadcast news video," in Advances in Digital Libraries, pp. 168-179, 1998.
2. W. Qi, L. Gu, H. Jiang, X.-R. Chen, and H.-J. Zhang, "Integrating visual, audio and text analysis for news video," in 7th IEEE Intn'l Conference on Image Processing, 2000.
3. Z. Liu and Q. Huang, "Adaptive anchor detection using on-line trained audio/visual model," in SPIE Conf. Storage and Retrieval for Media Database, (San Jose), 2000.
4. L. Chaisorn, T.-S. Chua, and C.-H. Lee, "The segmentation and classification of story boundaries in news video," in IEEE International Conference on Multimedia and Expo, 2002.
5. W. H.-M. Hsu and S.-F. Chang, "A statistical framework for fusing mid-level perceptual features in news story segmentation," in IEEE International Conference on Multimedia and Expo, 2003.
6. S. Boykin and A. Merlino, "Machine learning of event segmentation for news on demands," Communication of the ACM 43, February 2000.
7. D. Beeferman, A. Berger, and J. Lafferty, "Statistical models for text segmentation," Machine Learning 34(special issue on Natural Language Learning), pp. 177-210, 1999.
8. H. Wang and S.-F. Chang, "A highly efficient system for automatic face region detection in mpeg video," IEEE Transactions on Circuits and Systems for Video Technology (CSVT) 7(4), 1997.
9. D. Zhang, "Face detection in news video with gemoetric active contours," tech. rep., IBM T. J. Watsom Research Center, 2003.
10. B. Arons, "Pitch-based emphasis detection for segmenting speech recordings," in International Conference on Spoken Language Processing, (Yokohama, Japan), 1994.
11. J. Vaissiere, "Language-independent prosodie features," in Prosody: Models and Measurements, A. Cutler and D. R. Ladd, eds., pp. 53-66, Springer, Berlin, 1983.
12. E. Shriberg, A. Stolcke, D. Hakkani-Tur, and G. Tur, "Prosody-based automatic segmentation of speech into sentences and topics," Speech Communication 32, pp. 127-154, 2000.
13. H. Sundaram, Segmentation, Structure Detection and Summarization of Multimedia Sequences. PhD thesis, Columbia University, 2002.
14. M. Franz, J. S. McCarley, S. Roukos, T. Ward, and W.-J. Zhu, "Segmentation and detection at ibm: Hybrid statistical models and two-tiered clustering broadcast news domain," in Proceedings of TDT-3 Workshop, 2000.
15. S. D. M. Franz, J. S. McCarley, S. Roukos, and T. Ward, "Story segmentation and topic detection in the broadcast news domain," in 1999 DARPA Broadcast News Workshop, 1999.
16. G. Wu and E. Chang, "Adaptive feature-space conformal transformation for imbalanced-data learning," in The Twentieth International Conference on Machine Learning (ICML-2003), (Washington DC), 2003.