Beyond text QA: Multimedia answer generation by harvesting web information

IEEE Transactions on Multimedia

Volumn 15, Issue 2, 2013, Pages 426-441

  Nie, Liqiang ^a   Wang, Meng ^b   Gao, Yue ^a   Zha, Zheng Jun ^a   Chua, Tat Seng ^a  

^a NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

^b HEFEI UNIVERSITY OF TECHNOLOGY   (China)

Author keywords

CQA; Medium selection; Question answering; Reranking

Indexed keywords

COMPLEX QUESTIONS; CQA; DATA SETS; MEDIUM SELECTION; MULTIMEDIA DATA; MULTIMEDIA SEARCH; MULTISOURCES; QUERY GENERATION; QUESTION ANSWERING; RE-RANKING; RESEARCH EFFORTS; THREE COMPONENT; VIDEO DATA; WEB INFORMATION;

DATA REDUCTION; LAKES;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 84872710355     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2012.2229971     Document Type: Article

References (59)

1. S. A. Quarteroni and S. Manandhar, "Designing an interactive open domain question answering system," J. Natural Lang. Eng., vol. 15, no. 1, pp. 73-95, 2008.
2. D. Mollá and J. L. Vicedo, "Question answering in restricted domains: An overview," Computat. Linguist., vol. 13, no. 1, pp. 41-61, 2007.
3. H. Cui, M.-Y. Kan, and T.-S. Chua, "Soft pattern matching models for definitional question answering," ACM Trans. Inf. Syst., vol. 25, no. 2, pp. 30-30, 2007.
4. R. C. Wang, N. Schlaefer, W. W. Cohen, and E. Nyberg, "Automatic set expansion for list question answering," in Proc. Int. Conf. Empirical Methods in Natural Language Processing, 2008.
5. L. A. Adamic, J. Zhang, E. Bakshy, andM. S. Ackerman, "Knowledge sharing and Yahoo answers: Everyone knows something," in Proc. Int. World Wide Web Conf., 2008.
6. G. Zoltan, K. Georgia, P. Jan, and G.-M. Hector, Questioning Yahoo! Answers, Stanford InfoLab, 2007, Tech. Rep.
7. H. Yang, T.-S. Chua, S. Wang, and C.-K. Koh, "Structured use of external knowledge for event-based open domain question answering," in Proc. ACM Int. SIGIR Conf., 2003.
8. T. Yeh, J. J. Lee, and T. Darrell, "Photo-based question answering," in Proc. ACM Int. Conf. Multimedia, 2008.
9. G. Li, R. Hong, Y.-T. Zheng, S. Yan, and T.-S. Chua, "Learning cooking techniques from youtube," in Proc. Int. Conf. Advances in Multimedia Modeling, 2010.
10. L. Nie, M. Wang, Z. Zha, G. Li, and T.-S. Chua, "Multimedia answering: Enriching text QA with media information," in Proc. ACM Int. SIGIR Conf., 2011.
11. Trec: The Text Retrieval Conf. [Online]. Available: http://trec.nist. gov/.
12. J. Cao, F. Jay, and J. Nunamaker, "Question answering on lecture videos: A multifaceted approach," in Proc. Int. Joint Conf. Digital Libraries, 2004.
13. Y.-C.Wu, C.-H. Chang, and Y.-S. Lee, "Cross-Language Video Question/ Answering System," in Proc. IEEE Int. Symp. Multimedia Software Engineering, 2004, pp. 294-301. (Pubitemid 40858955)
14. Y.-S. Lee, Y.-C. Wu, and J.-C. Yang, "Bvideoqa: Online English/Chinese bilingual video question answering,"Amer. Soc. Inf. Sci. Technol., vol. 60, no. 3, pp. 509-525, 2009.
15. Y.-C. Wu and J.-C. Yang, "A robust passage retrieval algorithm for video question answering," IEEE Trans. Circuits Syst. Video Technol., vol. 18, no. 10, pp. 1411-1421, 2008.
16. G. Li, H. Li, Z. Ming, R. Hong, S. Tang, and T.-S. Chua, "Question answering over community contributed web video," IEEEMultimedia, vol. 17, no. 4, pp. 46-57, 2010.
17. G. Kacmarcik, Multi-Modal Question-Answering: Questions Without Keyboards, Asia Federation of Natural Language Processing, 2005.
18. T.-S. Chua, R.Hong, G. Li, and J. Tang, "From text question-answering tomultimedia QA on web-scalemedia resources," in Proc. ACMWorkshop Large-Scale Multimedia Retrieval and Mining, 2009.
19. H. Tamura and N. Yokoya, "Image database systems: A survey," Pattern Recognit., pp. 29-43, 1984.
20. V. Kobla, D. Doermann, and K.-I. D. Lin, "Archiving, indexing, and retrieval of video in the compressed domain," in Proc. SPIE Conf., 1996.
21. A. Ghias, J. Logan, D. Chamberlin, and B. C. Smith, "Query by humming: Musical information retrieval in an audio database," in Proc. ACM Int. Conf. Multimedia, 1995.
22. M. Wang and X. S. Hua, "Active learning in multimedia annotation and retrieval: A survey," ACM Trans. Intell. Syst. Technol., vol. 2, no. 2, pp. 10-31, 2011.
23. Y. Gao, M. Wang, Z. J. Zha, Q. Tian, Q. Dai, and N. Zhang, "Less is more: Efficient 3d object retrieval with query view selection," IEEE Trans. Multimedia, vol. 13, no. 5, pp. 1007-1018, 2011.
24. Z.-J. Zha, M. Wang, Y.-T. Zheng, Y. Yang, R. Hong, and T.-S. Chua, "Interactive video indexing with statistical active learning," IEEE Trans. Multimedia, vol. 14, no. 1, pp. 17-27, 2012.
25. I. Ahmad and T.-S. Jang, "Old fashion text-based image retrieval using FCA," in Proc. ICIP, 2003.
26. M. Wang, X. S. Hua, R. Hong, J. Tang, G. J. Qi, Y. Song, and L. R. Dai, "Unified video annotation via multi-graph learning," IEEE Trans. Circuits Syst. Video Technol., vol. 19, no. 5, pp. 733-749, 2009.
27. M. Wang, X. S. Hua, T. Mei, R. Hong, G. J. Qi, Y. Song, and L. R. Dai, "Semi-supervised kernel density estimation for video annotation," Comput. Vision Image Understand., vol. 113, no. 3, pp. 384-396, 2009.
28. J. Tang, R. Hong, S. Yan, T. S. Chua, G. J. Qi, and R. Jain, "Image annotation by KNN-sparse graph-based label propagation over noisytagged web images," ACM Trans. Intell. Syst. Technol., vol. 2, no. 2, pp. 1-15, 2011.
29. J. Tang, X. S. Hua,M. Wang, Z.Gu, G. J.Qi, and X. Wu, "Correlative linear neighborhood propagation for video annotation," IEEE Trans. Syst., Man, Cybern. B, vol. 39, no. 2, pp. 409-416, 2009.
30. Z.-J. Zha, X.-S. Hua, T. Mei, J. Wang, G.-J. Qi, and Z. Wang, "Joint multi-label multi-instance learning for image classification," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2008, pp. 1-8.
31. S. K. Shandilya and N. Singhai, "Article: A survey on: Content based image retrieval systems," Int. J. Comput. Appl., vol. 4, no. 2, pp. 22-26, 2010.
32. X. Tian, L. Yang, J. Wang, Y. Yang, X. Wu, and X.-S. Hua, "Bayesian video search reranking," in Proc. ACM Int. Conf. Multimedia, 2008.
33. A. P. Natsev, M. R. Naphade, and J. TešiĆ, "Learning the semantics of multimedia queries and concepts from a small number of examples," in Proc. ACM Int. Conf. Multimedia, 2005.
34. R. Yan, A. Hauptmann, and R. Jin, "Multimedia search with pseudorelevance feedback," in Proc. Int. Conf. Image and Video Retrieval, 2003.
35. Y. Liu, T. Mei, X.-S.Hua, J. Tang, X.Wu, and S. Li, "Learning to video search rerank via pseudo preference feedback," in Proc. Int. Conf. Multimedia & Expo, 2008.
36. M. Wang, K. Yang, X.-S. Hua, and H.-J. Zhang, "Towards a relevant and diverse search of social images," IEEE Trans. Multimedia, vol. 12, no. 8, pp. 829-842, 2010.
37. W. H. Hsu, L. S. Kennedy, and S.-F. Chang, "Video search reranking through random walk over document-level context graph," in Proc. ACM Int. Conf. Multimedia, 2007.
38. Z.-J. Zha, L. Yang, T. Mei, M.Wang, and Z.Wang, "Visual query suggestion," in Proc. ACM Int. Conf. Multimedia, 2009.
39. Z.-J. Zha, L. Yang, T. Mei, M. Wang, Z. Wang, T.-S. Chua, and X.-S. Hua, "Visual query suggestion: Towards capturing user intent in Internet image search," ACM Trans. Multimedia Comput., Commun., Appl., vol. 6, no. 3, pp. 1-19, 2010.
40. L. Nie, M. Wang, Z. Zha, and T.-S. Chua, "Oracle in image search: A content-based approach to performance prediction," ACM Trans. Inf. Syst., vol. 30, no. 2, pp. 13-13, 2012.
41. X. Li and D. Roth, "Learning question classifiers," in Proc. Int. Conf. Computational Linguistics, 2002.
42. J. Zhang, R. Lee, and Y. J. Wang, "Support vector machine classifications for microarray expression data set," in Proc. Int. Conf. Computational Intelligence and Multimedia Applications, 2003.
43. J. Arguello, F. Diaz, J. Callan, and J. F. Crespo, "Sources of evidence for vertical selection," in Proc. ACM Int. SIGIR Conf., 2009.
44. A. Tamura, H. Takamura, and M. Okumura, "Classification of multiple- sentence questions," in Proc. Int. Joint Conf. Natural Language Processing, 2005.
45. Z. Huang, M. Thint, and Z. Qin, "Question classification using head words and their hypernyms," in Proc. Int. Conf. Empirical Methods in Natural Language Processing, 2008.
46. S. Cronen-Townsend, Y. Zhou, andW. B. Croft, "Predicting query performance," in Proc. ACM Int. SIGIR Conf., 2002.
47. F. Song and W. B. Croft, "A general language model for information retrieval," in Proc. ACM Int. CIKM Conf., 1999.
48. L. Nie, S. Yan, M.Wang, R. Hong, and T.-S. Chua, "Harvesting visual concepts for image search with complex queries," in Proc. ACM Int. Conf. Multimedia, 2012.
49. E. Agichtein, S. Lawrence, and L. Gravano, "Learning search engine specific query transformations for question answering," in Proc. Int. World Wide Web Conf., 2001.
50. M. Bendersky and W. B. Croft, "Discovering key concepts in verbose queries," in Proc. ACM Int. SIGIR Conf., 2008.
51. H. Zhang, A. Kankanhalli, and S.W. Smoliar, "Automatic partitioning of full-motion video," Multimedia Syst., vol. 1, no. 1, pp. 10-28, 1993.
52. M. Wang, X.-S. Hua, J. Tang, and R. Hong, "Beyond distance measurement: Constructing neighborhood similarity for video annotation," IEEE Trans. Multimedia, vol. 11, no. 3, pp. 465-476, 2009.
53. T. Ahonen, A. Hadid, andM. Pietikainen, "Face recognition with local binary patterns," in Proc. Eur. Conf. Computer Vision, 2004.
54. M. Surdeanu, M. Ciaramita, and H. Zaragoza, "Learning to rank answers on large online QA collections," in Proc. Association for Computational Linguistics, 2008.
55. F. M. Harper, D. Raban, S. Rafaeli, and J. A. Konstan, "Predictors of answer quality in online QA sites," in Proc. Int. Conf. Human Factors in Computing Systems, 2008.
56. E. Agichtein, C. Castillo, D. Donato, A. Gionis, and G. Mishne, "Finding high-quality content in social media," in Proc. Int. Conf. Web Search and Web Data Mining, 2008.
57. B. Li, Y. Liu, A. Ram, E. V. Garcia, and E. Agichtein, "Exploring question subjectivity prediction in community QA," in Proc. ACM Int. SIGIR Conf., 2008.
58. F. M. Harper, D. Moy, and J. A. Konstan, "Facts or friends?: Distinguishing informational and conversational questions in social QA sites," in Proc. Int. Conf. Human Factors in Computing Systems, 2009.
59. S. SiegelCastellan, Nonparametric Statistics for the Social Sciences, 2nd ed. New York: McGraw-Hill, 1988.