Application of information retrieval technologies to presentation slides

IEEE Transactions on Multimedia

Volumn 8, Issue 5, 2006, Pages 981-995

  Vinciarelli, Alessandro ^b   Odobez, Jean Marc ^a,b  

^a IEEE   (Switzerland)

^b IDIAP RESEARCH INSTITUTE   (Switzerland)

Author keywords

Indexing; Information retrieval; Noisy text; Optical character recognition; Presentations; Slides

Indexed keywords

MANUAL TRANSCRIPTION; NOISY TEXT; PRESENTATIONS; SLIDES;

COMPUTER SOFTWARE; FEATURE EXTRACTION; INDEXING (OF INFORMATION); OPTICAL CHARACTER RECOGNITION; TECHNICAL PRESENTATIONS; TEXT PROCESSING;

INFORMATION RETRIEVAL SYSTEMS;

EID: 33749511001     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2006.879870     Document Type: Article

References (45)

1. Z. Zhu, C. McKittrick, and W. Li, "Virtualized classroom - automated production, media integration and user-customized presentation," in Proc. 4th Int. Workshop on Multimedia Data and Document Engineering, 2004.
2. W. Li, H. Tang, and Z. Zhu, "Automated registration of high-resolution images from slide presentations and whiteboard handwritings via a low-cost digital video camera," in Proc. 2nd IEEE Int. Workshop on Image and Video Registration, 2004.
3. D. Zhang and J. F. Nunamaker, "A natural language approach to content based video indexing and retrieval for interactive e-learning," IEEE Trans. Multimedia, vol. 6, no. 3, pp. 450-458, Sep. 2004.
4. G. Abowd, "Classroom 2000: An experiment with the instrumentation of a living educational environment," IBM Syst. J., vol. 38, no. 4, pp. 508-530, 1999.
5. A. Amir, G. Ashour, and S. Srinivasan, "Toward automatic real time preparation of online video proceedings for conference talks and presentations," in Proc. 34th Hawaii Int. Conf. System Sciences, 2001, pp. 1662-1669.
6. H. Bourlard and S. Bengio, Eds., Machine Learning for Multimodal Interaction : First International Workshop, MLMI' 2004 vol. 3361, Lecture Notes in Computer Science, Springer-Verlag, 2005.
7. W. Hurst and G. Götz, "Interface issues for interactive navigation and browsing of recorded lectures and presentations," in Proc. ED-MEDIA 2004, 2004.
8. A. K. Jain and B. Yu, "Automatic text localisation in images and video frames," Pattern Recognit., vol. 12, no. 31, pp. 2055-2076, 1998.
9. T. Sato, T. Kanade, E. K. Hughes, M. A. Smith, and S. Satoh, "Video OCR: indexing digital news libraries by recognition of superimposed caption," Multimedia Syst., vol. 7, no. 5, pp. 385-395, Sep. 1999.
10. V. Wu, R. Manmatha, and E. M. Riseman, "Textfinder: an automatic system to detect and recognize text in images," IEEE Trans. Pattern Anal. Mach. Intell., vol. 21, no. 11, pp. 1224-1229, Nov. 1999.
11. H. Li, D. Doermann, and O. Kia, "Automatic text detection and tracking in digital videos," IEEE Trans. Image Process., vol. 9, no. 1, pp. 47-156, Jan. 2000.
12. R. Lienhart and A. Wernicke, "Localizing and segmenting text in images and videos," IEEE Trans. Circuits Syst. Video Technol., vol. 12, no. 4, pp. 256-268, Apr. 2002.
13. D. Chen, J.-M. Odobez, and H. Bourlard, "Text detection and recognition in images and videos," Pattern Recognit., vol. 37, no. 3, pp. 595-609, Mar. 2004.
14. T. Kawahara, M. Hasagawa, K. Shitaoka, T. Kitade, and H. Nanjo, "Automatic indexing of lecture presentations using unsupervised learning of presumed discourse markers," IEEE Trans. Speech Audio Process., vol. 12, no. 4, pp. 409-419, Jul. 2004.
15. M. Hearst, "TextTiling: Segmenting text into multi-paragraph subtopic passages," Comput. Linguist., vol. 23, no. 1, pp. 33-64, 1997.
16. F. Wang, C. W. Ngo, and T. C. Pong, "Synchronization of lecture videos and electronic slides by video text analysis," in Proc. ACM Int. Conf. Multimedia, 2003, pp. 315-318.
17. C. W. Ngo, T. C. Pong, and T. S. Huang, "Detection of slide transition for topic indexing," in Proc. IEEE Conf. Multimedia and Expo, 2002, pp. 533-536.
18. S. Mukhopadhyay and B. Smith, "Passive capture and structuring of lectures," in Proc. ACM Int. Conf. Multimedia. 1999, pp. 477-187.
19. S. X. Ju, M. J. Black, S. Minneman, and D. Kimber, "Summarization of videotaped presentations: automatic analysis of motion and gesture," IEEE Trans. Circuits Syst. Video Technol., vol. 8, no. 5, pp. 686-696, Aug. 1998.
20. T. Syeda-Mahmood and S. Srinivasan, "Detecting topical events in digital video," in Proc. ACM Int. Conf. Multimedia, 2000, pp. 85-94.
21. C. F. Li, A. Gupta, E. Sanocki, L. He, and Y. Rui, "Browsing digital video," in Proc. SIGCHI Conf. Human Factors in Computing Systems, 2000, pp. 169-176.
22. G. Cohen, A. Amir, D. Ponceleon, B. Blanchard, D. Petkovic, and S. Srinivasan, "Using audio time scale modification for video browsing," in Proc. 33 Hawaii Int. Conf. System Sciences, 2000, pp. 3046-3055.
23. B. Zupancic and H. Horz, "Lecture recordings an its use in a traditional university course," in Proc. 7th Int. Conf. Innovation and Technology in Computer Science Education (ITiCSE), 2002, pp. 24-28.
24. M. G. Pimentel, Y. Ishiguro, G. Abowd, B. Kerimbaev, and M. Guzdial, "Supporting educational activities through dynamic web interfaces," Interact. wComput. J., vol. 13, no. 3, pp. 353-374, 2001.
25. S. G. Deshpande and J. N. Hwang, "A real-time interactive virtual classroom multimedia distance learning system," IEEE Trans. Multimedia, vol. 3, no. 4, pp. 432-444, Dec. 2001.
26. P. Ziewer, "Navigational indices in full text search by automated analyses of screen recorded data," in Proc. E-Learn 2004, 2004.
27. C. K. Gan and R. W. Donaldson, "Adaptive silence deletion for speech storage and voicemail application," IEEE Trans. Acoust., Speech, Signal Process., vol. 36, no. 6, pp. 924-927, Jun. 1988.
28. L. He, E. Sanocki, A. Gupta, and J. Grudin, "Audio-summarization of audio-video presentations," in Proc. ACM Int. Conf. Multimedia, 1999, pp. 489-498.
29. W. Niblack, "Slidefinder: a tool for browsing presentation graphics using content-based retrieval," in Proc. IEEE Workshop on Content-Based Access of Image and Video Libraries, 1999, pp. 114-118.
30. W. Hurst and R. Müller, "A synchronization model for recorded presentations and its relevance for information retrieval," in Proc. ACM Int. Conf. Multimedia, 1999, pp. 333-342.
31. C. Wolf, J.-M. Jolion, and F. Chassaing, "Text localization, enhancement and binarization in multimedia documents," in Proc. Int. Conf. Pattern Recognition, Quebec City, QC, Canada, Aug. 2002, pp. 1037-1040.
32. R. Baeza-Yates and B. Ribeiro-Neto, Modern Information Retrieval. Reading, MA: Addison-Wesley, 1999.
33. C. Fox, "Lexical analysis and stoplists," in Information Retrieval. Data Structures and Algorithms, W. B. Frakes and R. Baeza-Yates, Eds. Englewood Cliffs, NJ: Prentice-Hall, 1992, pp. 102-130.
34. W. B. Frakes, "Stemming algorithms," in Information Retrieval. Data Structures and Algorithms, W. B. Frakes and R. Baeza-Yates, Eds. Englewood Cliffs, NJ: Prentice-Hall, 1992, pp. 131-160.
35. M. F. Porter, "An algorithm for suffix stripping," Program, vol. 14, no. 3, pp. 130-137, 1980.
36. S. T. Dumais, "Improving the retrieval of information from external sources," Beh. Res. Meth., Instrum. Comput., vol. 23, pp. 229-236, 1991.
37. G. Salton and C. Buckley, "Term-weighting approaches in automatic text retrieval," Inform. Process. Manag., vol. 24, pp. 513-523, 1988.
38. S. E. Robertson, S. Walker, and M. Beaulieu, "Experimentation as a way of life: Okapi at TREC," Inform. Process. Manag., vol. 36, pp. 95-108, 2000.
39. A. Singhal, G. Salton, M. Mitra, and C. Buckley, "Document length normalization," Inform. Process. Manag., vol. 32, pp. 619-633, 1996.
40. D. B. Paul and J. M. Baker, "The design for the wall street journal-based CSR corpus," in Proc. DARPA SLS Workshop, 1992.
41. E. Tufte, The Visual Display of Quantitative Information. Cheshire, CT: Graphics Press, 2001.
42. I. Rogina and T. Schaaf, "Lecture and presentation tracking in an intelligent meeting room," in Proc. Int. Conf. Speech and Language Processing, 2002, pp. 333-342.
43. J. Garofolo, C. Auzanne, and E. Voorhees, "The TREC spoken document retrieval track: A success story," in Proc. 8th Text Retrieval Conf., 1999, pp. 107-130.
44. W. Hurst, "A qualitative study towards using large vocabulary automatic speech recognition to index recorded presentations for search and access over the web," Int. J. WWW/Internet, vol. 1, no. 1, pp. 43-58, 2003.
45. R. Anderson, C. Hoyer, C. Prince, J. Su, F. Videon, and S. Wolfman, "Speech, ink and slides: the interaction of content channels," in Proc. ACM Int. Conf. Multimedia, 2004, pp. 796-803.