A robust passage retrieval algorithm for video question answering

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 18, Issue 10, 2008, Pages 1411-1421

  Wu, Yu Chieh ^a   Yang, Jie Chi ^a  

^a NATIONAL CENTRAL UNIVERSITY   (Taiwan)

Author keywords

Multimedia retrieval; Question answering (Q A); Video question answering (videoQ A)

Indexed keywords

COMPUTATIONAL LINGUISTICS; LINGUISTICS; QUERY LANGUAGES;

CHINESE WORD SEGMENTATIONS; DO-MAINS; LANGUAGE MODELS; MEAN RECIPROCAL RANKS; MULTIMEDIA RETRIEVAL; NATURAL LANGUAGE QUERIES; PASSAGE RETRIEVALS; PERFORMANCE RANKINGS; QUESTION ANSWERING; QUESTION ANSWERING (Q/A); RETRIEVAL MODELS; TOKENIZER; VIDEO CLIPS; VIDEO QUESTION ANSWERING (VIDEOQ/A);

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 55149086325     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2008.2002831     Document Type: Article

References (54)

1. D. Zhang and J. Nunamaker, "A natural language approach to content-based video indexing and retrieval for interactive E-learning," IEEE Trans. Multimedia, vol. 6, no. 3, pp. 450-458, Jul.-Sep. 2004.
2. M. R. Lyu, J. Song, and M. Cai, "A comprehensive method for multilingual video text detection, localization, and extraction," IEEE Trans. Circuits Syst. Video Technol., vol. 15, no. 2, pp. 243-255, Feb. 2005.
3. T. Sato, T. Kanade, E. K. Hughes, M. A. Smith, and S. Satoh, "Video OCR: Indexing digital news libraries by recognition of superimposed captions."Multimedia Syst., vol. 7, no. 5, pp. 385-395, 1999.
4. R. Lienhart and A. Wernicke, "Localizing and segmenting text in images and videos," IEEE Trans Circuits Syst. Video Technol., vol. 12, no. 4, pp. 256-268, Apr. 2002.
5. C. J. Lin, C. C. Liu, and H. H. Chen, "A simple method for Chinese video OCR and its application to question answering," Computational Linguistics and Chinese Language Processing, vol. 6, no. 2, pp. 11 -30, 2001.
6. Y. C. Wu, Y. S. Lee, and C. H. Chang, "CLVQ: Cross-language video question/answering system," in Proc. 6th IEEE Int. Symp. Multimedia Software Eng., 2004, pp. 294-301.
7. H. D. Wactlar, "Informedia search and summarization in the video medium," in Proc. Imagina Conf., 2000, pp. 1-10.
8. P. Over, T. Ianeva, W. Kraaij, and A. F. Smeaton, "TRECVID 2005-An overview," presented at the 14th Text Retrieval Conf., 2005.
9. A. Amir, J. Argillander, M. Campbell, A. Haubold, G. Tyengar, S. Ebadollahi, F. Kang, M. R. Naphade, A. Natsev, J. R. Smith, J. Tei, and T. Volkmer, "IBM research trecvid 2005 video retrieval system," presented at the 14th Text Retrieval Conf., 2005.
10. E. M. Voorhees, "The TREC-8 question answering track report," in Pmc. 8th Text Retrieval Conf., 1999, pp. 77-83.
11. E. M. Voorhees, "Overview of the TREC-9 question answering track," in Proc. 9th Text Retrieval Conf., 2000, pp. 71-80.
12. E. M. Voorhees, "Overview of the TREC 2001 question answering track," in Proc. 10th Text Retrieval Conf., 2001, pp. 42-52.
13. E. Hovy, U. Hermjakob, and C. Y. Lin, "The use of external knowledge in factoid QA," in Proc. 10th Text Retrieval Conf., 2001, pp. 644-652.
14. A. Ittycheriah, M. Franz, and S. Roukos, "IBM's statistical question answering system TREC-10," in Proc. 10th Text Retrieval Conf., 2001, pp. 258-264.
15. S. Harabagiu, D. Moldovan, M. Pasca, M. Surdeanu, R. Mihalcea, R. Girju, V. Rus, F. Lacatusu, P. Morarescu, and R. Bunescu, "Answering complex, list and context questions with LCC's question-answering server," in Proc. 10th Text Retrieval Conf., 2001, pp. 355-362.
16. H. Yang, T. S. Chua, S. G. Wang, and C. K. Koh, "Structural use of external knowledge for event-based open domain question answering," in Pmc. 26th ACM SIGIR Conf. Rex. Devel. Inf. Retrieval, 2003, pp. 33-40.
17. E. Charniak, "A maximum-entropy-inspired parser," in Proc. Conf. North Amer. Chapter Assoc. Computational Linguistics, 2000, pp. 132-139.
18. M. Collins, "Head-driven statistical models for natural language processing," Ph.D. dissertation, Dept. Comp. Inf. Sci., Univ. Pennsylvania, Philadelphia, 1998.
19. Y. C. Wu, Y. S. Lee, and J. C. Yang, "The exploration of deterministic and efficient dependency parsing," in Proc. 10th Conf. Natural Language Learning, 2006, pp. 241-245.
20. R. Florian, A. Ittycheriah, H. Jing, and T. Zhang, "Named entity recognition through classifier combination," in Proc. 7th Conf. Natural Language Learning, 2003, pp. 168-171.
21. Y. Sasaki, "Question answering as question-biased term extraction: A new approach toward multilingual QA," in Proc. 40th Annu. Meet. Assoc. Computational Linguistics, 2005, pp. 215-222.
22. H. Yang, L. Chaison, Y. Zhao, S. Y. Neo, and T. S. Chua, "Video QA: Question answering on news video," in Proc. 11th ACM Int. Conf. Multimedia, 2003, pp. 632-641.
23. M. Pasca and S. Harabagiu, "High-performance question answering," in Proc. 24th ACM SIGIR Conf. Res. Develop. Inf. Retrieval, 2001, pp. 366-374.
24. G. A. Levow, "The third international Chinese language processing Bakeoff: Word segmentation and named entity recognition," in Proc. 5th SIGHAN Workshop Chinese Language Process., 2006, pp. 108-117.
25. J. Cao and J. F. Nunamaker, "Question answering on lecture videos: A multifaceted approach," in Proc. Joint Conf. Digit. Libraries, 2004, pp. 214-215.
26. J. Cao, D. Roussinov, J. Robles, and J. F. Nunamaker, "Automated question answering from videos: NLP vs. pattern matching," in Proc. Hawaii Int. Conf. Syst. Sci., 2005, pp. 43(b)-43(b).
27. E. Robertson, S. Walker, and M. Beaulieu, "Experimentation as a way of life: Okapi at TREC," Inf. Process. Management, vol. 36, no. 1, pp. 95-108, 2000.
28. C. Zhai and J. Lafferty, "A study of smoothing methods for language models applied to ad hoc information retrieval," in Proc. 24th Annu. Int. ACM Conf. Res. Develop. Inf. Retrieval (SIGIR), 2001, pp. 334-342.
29. X. Liu and W. B. Croft, "Passage retrieval based on language models," in Proc. 11th Int. Conf. Inf. Knowledge Management, 2002, pp. 375-382.
30. J. Lin, D. Quan, V. Sinha, K. Bakshi, D. Huynh, B. Katz, and D. R. Karger, "What makes a good answer? the role of context in question answering," in Proc. 9th Int. Conf. Human-Comput. Interaction, 2003, pp. 25-32.
31. Y. C. Wu and J. C. Yang, "Toward multimedia: A String pattern-based passage ranking model for video question answering," in Proc. Annu. Conf. North Amer. Chapter Assoc. Computational Linguistics, 2007, pp. 540-547.
32. Y. C. Wu, J. C. Yang, and Y. S. Lee, "A new passage ranking algorithm for multimedia question answering," in Proc. Pacific-Rim Symp. Image Video Technol., 2006, pp. 563-572.
33. J. Broglio, W. B. Croft, J. Callan, and D. Nachbar, "Document retrieval and routing using the INQUERY system," in Proc. 3rd Text Retrieval Conf., 1995, pp. 500-225.
34. J. M. Ponte and W. B. Croft, "A language modeling approach to information retrieval," in Proc. 21st ACM SIGIR Conf. Res. Develop. Inf. Retrieval, 1998, pp. 275-281.
35. G. G. Lee, J. Seo, S. Lee, H. Jung, B. H. Cho, C. Lee, B. K. Kwak, J. Cha, D. Kim, J. An, H. Kim, and K. Kim, "SiteQ: Engineering high performance QA system using lexico-semantic pattern matching and shallow NLP," in Proc. 10th Text Retrieval Conf., 2001, pp. 437-446.
36. Y. C. Wu, J. C. Yang, and Q. X. Lin, "Description of the NCU chinese word segmentation and named entity recognition system for SIOHAN bakeoff 2006," in Proc. 5th SIGHAN Workshop on Chinese Language Process., 2006, pp. 209-212.
37. M. Cai, J. Song, and M. R. Lyu, "A new approach for video text detection," in Proc. Int. Conf. Image Process., 2002, pp. 117-120.
38. J. Fan, D. K. Y. Yau, A. K. Elmagarmid, and W. G. Aref, "Automatic image segmentation by integrating color-edge extraction and seeded region growing," IEEE Trans. Image Process., vol. 10, no. 10, pp. 1454-1464, Oct. 2001.
39. F. Chang, G. C. Chen, C. C. Lin, and W. H. Lin, "Caption analysis and recognition for building video indexing systems," Multimedia Syst., vol. 10, no. 4, pp. 344-355, 2005.
40. T. Hong, S. W. Lam, J. J. Hull, and S. N. Srihari, "he design of a nearest-neighbor classifier and its use for Japanese character recognition," in Proc. 3rd Int. Conf. Document Anal. Recogn., 1995, pp. 270-291.
41. M. Pasca and S. Harabagiu, "High-performance question answering," in Proc. 24th ACM SIGIR Conf. Res. Develop. Inf. Retrieval, 2001, pp. 366-374.
42. S. Tellex, B. Katz, J. Lin, A. Fernandes, and G. Marton, "Quantitative evaluation of passage retrieval algorithms for question answering," in Proc. 26th ACM SIGIR Conf. Res. Develop. Inf. Retrieval, 2003, pp. 41-47.
43. H. Cui, R. Sun, K. Li, M. Kan, and T. Chua, "Question answering passage retrieval using dependency relations," in Proc. 28th ACM SIGIR Conf. Res. Develop. Inf. Retrieval, 2005, pp. 400-407.
44. Y. S. Lee and Y. C. Wu, "A robust multilingual portable phrase chunking system," Expert Syst. Applications, vol. 33, no. 3, pp. 1-26, 2007.
45. S. Buchholz and E. Marsi, "CoNLL-X shared task on multilingual dependency parsing," in Proc. 10th Conf. Natural Language Learning, 2006, pp. 149-164.
46. J. Savoy, "Comparative study on monolingual and multilingual search models for use with asian languages," ACM Trans. Asian Language Inf. Process., vol. 4, no. 2, pp. 163-189, 2005.
47. T. H. Cormen, C. E. Leiserson, R. L. Rivest, and C. Stein, Introduction to Algorithms, 2nd ed. New York: McGraw-Hill, 2002.
48. Y. S. Lee, Y. C. Wu, and C. H. Chang, "Integrating web information to generate Chinese video summaries," in Proc. I7th Int. Conf. Software Eng. Knowledge Eng., 2005, pp. 514-519.
49. J. Chen, R. Li, and F. Li, "Chinese information retrieval using Lemur," in Proc. 5th NTCIR Workshop Meet. Evaluation Inf. Access Technologies, 2005, pp. 161-171.
50. J. Min, L. Sun, and J. Zhang, "ISCAS in English-Chinese CLIR at NTCIR-5," in Proc. 5th NTCIR Workshop Meet. Eval. Inf. Access Technol., 2005, pp. 131-137.
51. Yahoo Knowledge [Online]. Available: http://tw.knowledge.yahoo.com/
52. "The united daily news," Yahoo Knowledge [Online]. Available: http://tw.knowledge.yahoo.com/
53. Onix Text Retrieval Toolkit [Online]. Available: http://www.lextek.com/ manual s/onix/stopwords2.html
54. The Lemur Toolkit for Language Modeling and Information Retrieval [Online]. Available: http://www.lemurproject.org/