Topic models for image annotation and text illustration

NAACL HLT 2010 - Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics, Proceedings of the Main Conference

Volumn , Issue , 2010, Pages 831-839

  Feng, Yansong ^a   Lapata, Mirella ^a  

^a UNIVERSITY OF EDINBURGH   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

DATA SETS; IMAGE ANNOTATION; IMAGE DATABASE; IMAGE SEARCH; MODEL DEVELOPMENT; PROBABILISTIC MODELS; TEXTUAL DATA; TOPIC MODEL;

COMPUTATIONAL LINGUISTICS; IMAGE ANALYSIS;

IMAGE RETRIEVAL;

EID: 80053231413     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (27)

1. Barnard, K., P. Duygulu, D. Forsyth, N. de Freitas, D. Blei, and M. Jordan. 2002. Matching words and pictures. Journal of Machine Learning Research 3:1107-1135.
2. Barnard, K. and D. Forsyth. 2001. Learning the semantics of words and pictures. In Proceedings of the 8th International Conference on Computer Vision. Vancouver, BC, pages 408-415. (Pubitemid 32795085)
3. Blei, D. 2004. Probabilistic Models of Text and Images. Ph.D. thesis, U.C. Berkeley, Division of Computer Science.
4. Blei, D. and M. Jordan. 2003. Modeling annotated data. In Proceedings of the 26th Annual International ACM SIGIR Conference. Toronto, ON, pages 127-134.
5. Blei, D., A. Ng, and M. Jordan. 2003. Latent Dirichlet allocation. Journal of Machine Learning Research 3:993-1022.
6. Bosch, A., A. Zisserman, and X. Munoz. 2008. Scene classification using a hybrid generative/discriminative approach. IEEE Transactions on Pattern Analysis and Machine Intelligence 30(4):712-727. (Pubitemid 351559723)
7. Boyd-Graber, J. and D. Blei. 2009. Syntactic topic models. In Proceedings of the 22nd Conference on Advances in Neural Information Processing Systems. MIT, Press, Cambridge, MA, pages 185-192.
8. Chai, C. and C. Hung. 2008. Automatically annotating images with keywords: A review of image annotation systems. Recent Patents on Computer Science 1:55-68.
9. Duygulu, P., K. Barnard, J. de Freitas, and D. Forsyth. 2002. Object recognition as machine translation: Learning a lexicon for a fixed image vocabulary. In Proceedings of the 7th European Conference on Computer Vision. Copenhagen, Danemark, pages 97-112.
10. Fei-Fei, L. and P. Perona. 2005. A Bayesian hierarchical model for learning natural scene categories. In Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. IEEE Computer Society Washington, DC, volume 2, pages 524-531.
11. Feng, S., V. Lavrenko, and R. Manmatha. 2004. Multiple Bernoulli relevance models for image and video annotation. In Proceedings of the International Conference on Computer Vision and Pattern Recognition. Washington, DC, pages 1002-1009.
12. Feng, Y. and M. Lapata. 2008. Automatic image annotation using auxiliary text information. In Proceedings of ACL-08: HLT. Columbus, OH, pages 272-280.
13. Hawking, D., N. Craswell, P. Thistlewaite, and D. Harman. 1999. Results and challenges in web search evaluation. Computer Networks 31(11):1321-1330.
14. Hofmann, T. 2001. Unsupervised learning by probabilistic latent semantic analysis. Machine Learning 41(2):177-196. (Pubitemid 32872403)
15. Joshi, D., J.Z. Wang, and J. Li. 2006. The story picturing engine - a system for automatic text illustration. ACM Transactions on Multimedia Computing, Communications, and Applications 2(1):68-89. (Pubitemid 43890696)
16. Lavrenko, V., R. Manmatha, and J. Jeon. 2003. A model for learning the semantics of pictures. In Proceedings of the 17th Conference on Advances in Neural Information Processing Systems. MIT, Press, Cambridge, MA.
17. Lowe, D. 1999. Object recognition from local scaleinvariant features. In Proceedings of International Conference on Computer Vision. IEEE Computer Society, pages 1150-1157. (Pubitemid 32079997)
18. Monay, F. and D. Gatica-Perez. 2007. Modeling semantic aspects for cross-media image indexing. IEEE Transactions on Pattern Analysis and Machine Intelligence 29(10):1802-1817.
19. Pan, J., H. Yang, P. Duygulu, and C. Faloutsos. 2004. Automatic image captioning. In Proceedings of the 2004 International Conference on Multimedia and Expo. Taipei, pages 1987-1990. (Pubitemid 40063450)
20. Salton, G. and M.J. McGill. 1983. Introduction to Modern Information Retrieval. McGraw-Hill, New York.
21. Schmid, H. 1994. Probabilistic part-of-speech tagging using decision trees. In Proceedings of the International Conference on New Methods in Language Processing. Manchester, UK, pages 44-49.
22. Smeulders, A. W., M. Worring, S. Santini, A. Gupta, and R. Jain. 2000. Content-based image retrieval at the end of the early years. IEEE Transactions on Pattern Analysis and Machine Intelligence 22(12):1349-1380. (Pubitemid 32088465)
23. Tang, J. and P. H. Lewis. 2007. A study of quality issues for image auto-annotation with the Corel data-set. IEEE Transactions on Circuits and Systems for Video Technology 17(3):384-389. (Pubitemid 46393337)
24. Vailaya, A., M. Figueiredo, A. Jain, and H. Zhang. 2001. Image classification for content-based indexing. IEEE Transactions on Image Processing 10:117-130. (Pubitemid 32136886)
25. Wang, C., D. Blei, and L. Fei-Fei. 2009. Simultaneous image classification and annotation. In Proceedings of CVPR. Miami, FL, pages 1903-1910.
26. Westerveld, T. and A. P. de Vries. 2003. Experimental evaluation of a generative probabilistic image retrieval model on 'easy' data. In Proceedings of the SIGIR Multimedia Information Retrieval Workshop. Toronto, ON.
27. Zhao, R. and W. I. Grosky. 2003. Video shot detection using color anglogram and latent semantic indexing: From contents to semantics. In B. Furht and O. Marques, editors, Handbook of Video Databases: Design and Applications, CRC Press, pages 371-392.