Dynamic captioning: Video accessibility enhancement for hearing impairment

MM'10 - Proceedings of the ACM Multimedia 2010 International Conference

Volumn , Issue , 2010, Pages 421-430

  Hong, Richang ^a   Wang, Meng ^a   Xu, Mengdi ^a   Yan, Shuicheng ^a   Chua, Tat Seng ^a  

^a NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

Author keywords

accessibility; dynamic captioning; hearing impairment

Indexed keywords

ACCESSIBILITY; AUDIO INFORMATION; EXISTING METHOD; FACE DETECTION AND RECOGNITION; HEARING IMPAIRED; HEARING IMPAIRMENTS; HEARING-IMPAIRED USERS; IN-DEPTH STUDY; SPEECH SIGNALS; VIDEO CLIPS; VIDEO CONTENTS; VISUAL SALIENCY;

CHARACTER RECOGNITION; FACE RECOGNITION; HANDICAPPED PERSONS; SPEECH RECOGNITION; VISUALIZATION;

AUDITION;

EID: 78650993562     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1873951.1874013     Document Type: Conference Paper

References (44)

1. Deaf. http://en.wikipedia.org/wiki/Deaf
2. J. Nielsen (ed). Advances in human-computer interaction. vol 5. Intellect Publishers, Bristol, UK., 1995.
3. E.M. Finney and K.R. Dobkins. Visual contrast sensitivity in hearing impaired versus hearing populations: exploring the perceptual consequences of auditory deprivation and experience with a visual language. Brain Res Cognit Brain Res, vol.11, no.1, pp.171-183, 2007.
4. S.R. Gulliver and G. Ghinea. How level and type of deafness affect user perception of multimedia video clips. Springer, 2003.
5. S.R. Gulliver and G. Ghinea. Impact of captions on hearing impaired and hearing perception of multimedia video clips. ICME, 2003.
6. G. Ghinea and J.P. Thomas. QoS impact on user perception and understanding of multimedia video clips. ACM Multimedia, pp. 49-54, 1998.
7. K. Hapeshi and D. Jones. Interactive multimedia for instruction: a cognitive analysis of the role of audition and vision. Int J Hum Comp Interact, vol.4, no.1, pp.49-54, 1992.
8. A brief history of captioned television. http://www.ncicap.org/caphist. asp.
9. S. Cox, M. Lincoln, J. Tryggvason, J. Nakisa, M. Wells, M. Tutt and S. Abbot. TESSA: a system to aid communication with hearing impaired people. ACM SIGCAPH conference on assistive technologies, 2002.
10. J. Boyd and E.A. Vader. Captioned television for the deaf. Am Ann Hearing impaired, vol.117, no.1, pp.32-37, 1972.
11. B.B. Braveman and M. Hertzog. The effects of caption rate and language level on comprehension of a captioned video presentation. Am Ann Hearing impaired, vol.125, no.7, pp.943-948, 1980.
12. L. Jelinek and D.W. Jackson. Television literacy: comprehension of program content using closed captions for the deaf. J Hearing impaired Stud Hearing impaired Educat, vol.6, no.1, pp.43-53, 2001.
13. W. Garrison, G. Long and F. Dowaliby. Working memory capacity and comprehension processes in hearing impaired reader.. J Hearing impaired Stud Hearing impaired Educat, vol.2, no.2, pp.78-94, 1997.
14. Accessibility. www.wikipedia.org/wiki/Accessibility .
15. Web Accessibility Initiative. http://www.w3.org/WAI/.
16. M. Wang. Accessible Image Search. Proceedings of the ACM Multimedia (MM'09). Beijing, China.
17. P. Viola and M. Jones. Rapid object detection using a boosted cascaded of simple features. CVPR 2001
18. T. Yang, Q. Pan, J. Li and S. Li. Real-time multiple objects tracking with occlusion handling in dynamic scenes. CVPR2 005.
19. K. Saenko, K. Liverscu, M. Siracusa, K. Wilson, J. Glass and T. Darrell. Visual speech recognition with loosely synchronized feature streams. ICCV 2005.
20. J. Wright, A. Yang, A. Ganesh, S. Sastry and Y. Ma. Robust face recognition via sparse representation. IEEE TPAMI. 31(2):210-227. 2009
21. M. Bowman, S.K. Debray and L.L. Peterson. Reasoning about naming system. ACM Transactions on Programming Languages and Systems, vol.15, no.5, pp.795-825, 1993.
22. M. Everinghan, J. Siviv and A. Zisserman. Hello! My name is .. Buffy. Automatic naming of characters in TV videos. BMVC2006
23. Y.F. Ma and H.J. Zhang. Contrast-based image attention analysis by using fuzzy growing. ACM Multimedia, 2003.
24. M. Cu, L.T. Chia, H. Yi and D. Rajan. Affective content detection in sitcom using subtitle and audio. The International Conference on Multi-Media Modeling 2006.
25. M. Wang and H. J. Zhang. Video Content Structuring. Scholarpedia, 4(8):9431.
26. M. Wang, X. S. Hua, J. Tang, R. Hong. Beyond Distance Measurement: Constructing Neighborhood Similarity for Video Annotation. IEEE TMM, 11(3), 2009.
27. M. Xu, J.S. Jin, S. Luo and L. Duan. Hierarchical movie affective content analysis based on arousal and valence feature. ACM Multimedia 2008.
28. http://www.scholarpedia.org/article/Speech emotion analysis.
29. M. Wang, X. S. Hua, R. Hong, J. Tang, G. J. Qi, Y. Song. Unified Video Annotation via Multi-Graph Learning. IEEE TCSVT, 19(5), 2009.
30. P. N. Juslin and P. Laukka. Communication of emotions in vocal expression and music performance: Different channels, same code?. Psychological Bulletin, vol.129, pp.770-814, 2003.
31. K. R. Scherer. Vocal communication of emotion: A review of research paradigms. Speech Communication, vol.40, pp.227-256, 2003.
32. T. J. Hazen. Automatic Alignment and error correction of human generated transcripts for long speech recordings.. Intl Conf. on Spoken Language Processing 2006.
33. P. J. Moreno. A recursive algorithm for the forced alignment of very long audio segments. International Conference on Spoken Language Processing 1998.
34. W. Daelons and V.D. Bosch. TabTalk : Reusability in dataoriented grapheme-to-phoneme conversion. European Conference on Speech Communication and Technology 1993.
35. X. Huang, F. Alleva, H. Hon, M.Y. Hwuang, K.F. Lee and R. Rosenfeld. The SPHINX II Speech Recognition System: An Overview. Computer Speech and Language, 1993.
36. R. A. Fisher. Statistical methods for research workers. Macmillan Pub Co, 1970.
37. G. Obozinski, B. Taskar and M.I. Jordan. Joint covariate selection and joint subspace selection for multiple classification problems. Journal of Statistics and Computing, 2009.
38. P. Tseng. On accelerated proximal gradient methods for convex-concave optimization. SIAM J. of Optimization 2008.
39. O. Arandjelovic and A. Zisserman Automatic face recognition for film character retrieval in feature-length films. CVPR'05, pp.860-867, 2005.
40. J. Aimera and C. Wooters. A Robust Speaker Clustering Algorithm. IEEE workshop on automatic speech recognition and understanding. 2003.
41. T. Stadelmann, B. Freisleben. Unfolding speaking clustering potential: a biomimetic approach. ACM MM 2009.
42. D. A. Reynolds, T. F. Quatieri and R. B. Dunn. Speaker verification using adapted Gaussian mixture models. Digital Signal Processing. 2000(10): 14-91.
43. J. Tang, S. Yan, R. Hong, G. J. Qi and T. S. Chua. Inferring Semantic Concepts from Community-Contributed Images and Noisy Tags. ACM Multimedia MM'09. Beijing, China.
44. V. Wan, W. M. Campbell. Support vector machines for speaker verification and ideantification. IEEE proceedings, 2000