Semantic classification and annotation of images

Semantic Mining Technologies for Multimedia Databases

Volumn , Issue , 2009, Pages 350-377

  Tian, Yonghong ^a   Jiang, Shuqiang ^b   Huang, Tiejun ^a   Gao, Wen ^a  

^a PEKING UNIVERSITY   (China)

^b INSTITUTE OF GEOLOGY AND GEOPHYSICS   (China)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84898533022     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.4018/978-1-60566-188-9.ch015     Document Type: Chapter

References (66)

1. Aksoy, S., Koperski, K., Tusk, C., Marchisio, G., & Tilton, J.C. (2005). Learning Bayesian classifiers for scene classification with a visual grammar. IEEE Transactions on Geoscience and Remote Sensing, 43(3), 581-589. doi:10.1109/TGRS.2004.839547.
2. Barnard, K., & Forsyth, D.A. (2001). Learning the semantics of words and pictures. In Proc. Int'l Conf. Computer Vision, 408-415. doi:10.1109/ICCV.2001.937654.
3. Barnard, K., Duygulu, P., Freitas, N., Forsyth, D., Blei, D., & Jordan, M.I. (2003). Matching words and pictures. Journal of Machine Learning Research, 3, 1107-1135. doi:10.1162/jmlr.2003.3.4-5.1107.
4. Blei, D., Ng, A., & Jordan, M. (2003). Latent Dirichlet allocation. Journal of Machine Learning Research, 3, 993-1022. doi:10.1162/jmlr.2003.3.4-5.993.
5. Blei, D., & Jordan, M. (2003). Modeling annotated data. Proc. Int'l Conf Research and Development in Information Retrieval, (pp. 127-134). doi:10.1145/860435.860460.
6. Bosch, A., Zisserman, A., & Muňoz, X. (2006). Scene classification via plsa. Proc. European Conf. Computer Vision, 4, 517-530. doi:10.1007/11744085_40.
7. Bosch, A., Muňoz, X., & Marti, R. (2007). A review: Which is the best way to organize/classify images by content? Image and Vision Computing, 25(6), 778-791. doi:10.1016/j.imavis.2006.07.015.
8. Bosch, A., Zisserman, A., & Muyyoz, X. (2008). Scene classification using a hybrid generative/discriminative approach. IEEE Transactions on Pattern Analysis and Machine Intelligence, 30(4), 712-727. doi:10.1109/TPAMI.2007.70716.
9. Boutell, M., Brown, C., & Luo, J. (2002). Survey on the state of the art in semantic scene classification (Technical Report 799). Rochester, NY: University of Rochester.
10. Boutell, M., Shen, X.P., Luo, J., & Brown, C. (2004). Learning multi-label semantic scene classification. Pattern Recognition, 37(9), 1757-1771. doi:10.1016/j.patcog.2004.03.009.
11. Cai, D., He, X.F., Li, Z.W., Ma, W.Y., & Wen, J.R. (2004). Hierarchical clustering of WWW image search results using visual, textual and link analysis. In Proc. 2th ACM Int'l Conf Multimedia, (pp. 952-959). doi:10.1145/1027527.1027747.
12. Carneiro, G., Chan, A.B., Moreno, P., & Vasconcelos, N. (2006). Supervised learning of semantic classes for image annotation and retrieval. IEEE Transactions on Pattern Analysis Machine Intelligence, 29(3), 394-410. doi:10.1109/TPAMI.2007.61.
13. Chang, E.Y., Goh, K., Sychay, G., & Wu, G. (2003). CBSA: Content-based soft annotation for multimodal image retrieval using Bayes Point Machines. IEEE Transactions on Circuits System Video Technology, 13, 26-38. doi:10.1109/TCSVT.2002.808079.
14. Datta, R., Joshi, D., Li, J., & Wang, J.Z. (2007). Tagging over time: Real-world image annotation by lightweight meta-learning. In Proc. 15th Ann' ACM int'l Conf. Multimedia, (pp. 393-402). doi:10.1145/1291233.1291328.
15. Datta, R., Ge, W., Li, J., & Wang, J. Z. (2007). Toward bridging the annotation-retrieval gap in image search. IEEE Multimedia, 14(3), 24-35. doi:10.1109/MMUL.2007.67.
16. Duygulu, P., Barnard, K., Fretias, N., & Forsyth, D. (2002). Object recognition as machine translation: Learning a lexicon for a fixed image vocabulary. In Proc. European Conf. Computer Vision, 97-112. doi:10.1007/3-540-47979-1_7.
17. Fan, J., Gao, Y., Luo, H., & Xu, G. (2005). Statistical modeling and conceptualization of natural images. Pattern Recognition, 38, 865-885. doi:10.1016/j.patcog.2004.07.011.
18. Feng, S., Manmatha, R., & Lavrenko, V. (2004). Multiple Bernoulli relevance models for image and video annotation. Proc. IEEE Conf. Computer Vision and Pattern Recognition, (pp. 1002-1009). doi:10.1109/CVPR.2004.1315274.
19. Fergus, R., Li, F.-F., Perona, P., & Zisserman, A. (2005). Learning object categories from Google's image search. Proc. Int'l Conf. Computer Vision, II 1816-1823, 2005. doi:10.1109/ICCV.2005.142.
20. Fredembach, C., Schröder, M., & Süsstrunk, S. (2004). Eigenregions for image classification. IEEE Transactions on Pattern Analysis Machine Intelligence, 26(12), 1645-1649. doi:10.1109/TPAMI.2004.123.
21. Ghoshal, A., Ircing, P., & Khudanpur, S. (2005). Hidden Markov models for automatic annotation and content-based retrieval of images and video. In Proc. 28th Ann. Int'l ACM SIGIR Conf., (pp. 544-551). doi:10.1145/1076034.1076127.
22. Goh, K.-S., Chang, E.Y., & Li, B.T. (2005). Using one-class and two-class SVMs for multiclass image annotation. IEEE Transactions on Knowledge and Data Engineering, 17(10), 1333-1346. doi:10.1109/TKDE.2005.170.
23. Grauman, K. & Darrell, T. (2005). Pyramid match kernels: Discriminative classification with sets of images features. In Proc. Int'l Conf Computer Vision, 2, 1458-1465. doi:10.1109/ICCV.2005.239.
24. Hofmann, T. (2001). Unsupervised learning by probabilistic latent semantic analysis. Machine Learning, 42, 177-196. doi:10.1023/A:1007617005950.
25. Hu, J., & Bagga, A. (2004). Categorizing images in Web documents. IEEE Multimedia, 11(1), 22-30. doi:10.1109/MMUL.2004.1261103.
26. Jeon, J., Lavrenko, V., & Manmatha, R. (2003). Automatic image annotation and retrieval using crossmedia relevance models. In Proc ACM SIGIR Conf. on Research and Development in Information Retrieval, (pp. 119-126). doi:10.1145/860435.860459.
27. Jin, Y., Khan, L., Wang, L., & Awad, M. (2005). Image annotations by combining multiple evidence & wordNet In Proc. 13th Ann. ACM int'l Conf. Multimedia, (pp. 706-715). doi:10.1145/1101149.1101305.
28. Kalva, P., Enembreck, F., & Koerich, A. (2007). Web image classification based on the fusion of image and text classifiers. In Proc. 9th Int'l Conf Document Analysis and Recognition, 1, 561-568. doi:10.1109/ICDAR.2007.4378772.
29. Lazebnik, S., Schmid, C., & Ponce, J. (2006). Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories. In Proc IEEE Conf. Computer Vision and Pattern Recognition, 2, 2169-2178. doi:10.1109/CVPR.2006.68.
30. Lempel, R., & Soffer, A. (2002). PicASHOW: pictorial authority search by hyperlinks on the web. ACM Transactions on Information Systems, 20(1), 1-24. doi:10.1145/503104.503105.
31. Li, F.-F., & Perona, P. (2005). A Bayesian hierarchical model for learning natural scene categories. Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition, 2, 524-531. doi:10.1109/CVPR.2005.16.
32. Li, J., & Wang, J.Z. (2003). Automatic linguistic indexing of pictures by a statistical modeling approach. IEEE Transactions on Pattern Analysis and Machine Intelligence, 29(9), 1075-1088. doi:10.1109/CVPR.2005.16.
33. Li, X.R., Chen, L., Zhang, L., Lin, F.Z., & Ma, W.-Y. (2006). Image annotation by large-scale contentbased image retrieval. Proc. Int'l Conf. Multimedia, (pp. 607-610). doi:10.1145/1180639.1180764.
34. Lowe, D. (1999). Object recognition from local scale-invariant feature. Proc. Int'l Conf. Computer Vision (ICCV 1999), (pp. 1150-1157). doi:10.1109/ICCV.1999.790410.
35. Luo, J., Savakis, A.E., & Singhal, A. (2005). A Bayesian network-based framework for semantic image understanding. Pattern Recognition, 38, 919-934. doi:10.1016/j.patcog.2004.11.001.
36. Mojsilovic, A., Gomes, J., & Rogowitz, B. (2002). Isee: Perceptual features for image library navigation. In Proc SPIE Human Vision and Electronic Imaging, 4662, 266-277. doi:10.1117/12.469523.
37. Monay, F., & Gatica-Perez, D., (2003). On Image Auto-Annotation with Latent Space Models. In Proc. ACM Int'l Conf. Multimedia, 275-278. doi:10.1145/957013.957070.
38. Monay, F., & Gatica-Perez, D., (2007). Modeling semantic aspects for cross-media image indexing. IEEE Transactions on Pattern Analysis and Machine Intelligence, 29(10), 1802-1917. doi:10.1109/TPAMI.2007.1097.
39. Mori, Y., Takahashi, H., & Oka, R. (1999). Image-to-word transformation based on dividing and vector quantizing images with words. In Proc. Int'l Workshop Multimedia Intelligent Storage and Retrieval Management. From http://citeseer.ist.psu.edu/368129.html.
40. Oliva, A., & Torralba, A. (2001). Modeling the shape of the scene: a holistic representation of the spatial envelope. International Journal of Computer Vision, 42, 145-175. doi:10.1023/A:1011139631724.
41. Paek, S., & Chang, S.-F. (2000). A knowledge engineering approach for image classification based on probabilistic reasoning systems. In Proc IEEE Int'l Conf. Multimedia and Expo, II, 1133-1136. doi:10.1109/ICME.2000.871560.
42. Pan, J. Y., Yang, H.-J., Duygulu, P., & Faloutsos, C. (2004). Automatic image captioning. Proc. 2004 IEEE Int'l Conf. Multimedia and Expo (ICME'04), III, 1987-1990. doi:10.1109/ICME.2004.1394652.
43. Pappas, T. N., Chen, J.Q., & Depalov, D. (2007). Perceptually based techniques for image segmentation and semantic classification. IEEE Communications Magazine, 45(1), 44-51. doi:10.1109/MCOM.2007.284537.
44. Perronin, F. (2007). Universal and adapted vocabularies for generic visual categorization. IEEE Transactions on Pattern Analysis and Machine Intelligence, 30(7), 1243-1256.doi:10.1109/TPAMI.2007.70755.
45. Quelhas, P., Monay, F., Odobez, J.-M., Gatica-Perez, D., Tuytelaars, T. & Gool, L.V. (2005). Modeling scenes with local descriptors and latent aspects. In Proc IEEE Int'l Conf. Computer Vision, I, 883-890. doi:10.1109/ICCV.2005.152.
46. Serrano, N., Savakis, A., & Luo, J. (2004). Improved scene classification using efficient low-level features and semantic cues. Pattern Recognition, 37, 1773-1784. doi:10.1016/j.patcog.2004.03.003.
47. Shen, J., Shepherd, J., & Ngu, A.H.H. (2005). Semantic-sensitive classification for large image libraries. In Proc Int'l Multimedia Modeling Conf., (pp. 340-345). doi:10.1109/MMMC.2005.66.
48. Shi, J., & Malik, J. (2000). Normalized cuts and image segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(8), 888-905. doi:10.1109/34.868688.
49. Sivic, J., Russell, B.C., Efros, A.A., Zisserman, A., & Freeman, W. T. (2005). Discovering objects and their locations in images. In Proc. Int'l Conf. Computer Vision, (pp. 370-377). doi:10.1109/ICCV.2005.77.
50. Smeulders, A. W.M., Worring, M., Santini, S., Gupta, A., & Jain, R. (2000). Content-based image retrieval at the end of the early years. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(12), 1349-1380. doi:10.1109/34.895972.
51. Smith, J., Lin, C., Naphade, M., Natsev, A., & Tseng, B. (2003). Multimedia semantic indexing using model vectors. In Proc. IEEE Int'l Conf. Multimedia and Expo, 2, 445-448. doi:10.1109/ICME.2003.1221649.
52. Song, Y. Q., Wang, W., & Zhang, A. D. (2003). Automatic annotation and retrieval of images. World Wide Web, 6, 209-231. doi:10.1023/A:1023674722438.
53. Szummer, M., & Picard, R. W. (1998). Indoor-outdoor image classification. In Proc. ICCV Workshop on Content-based Access of Image and Video Databases, 42-50. doi:10.1109/CAIVD.1998.646032.
54. Tian, Y.H., Huang, T.J., & Gao, W. (2005). Exploiting multi-context analysis in semantic image classification. Journal of Zhejiang University SCIENCE, 6A(11), 1268-1283. doi:10.1631/jzus.2005.A1268.
55. Vailaya, A., Figueiredo, A., Jain, A., & Zhang, H. (2001). Image classification for content-based indexing. IEEE Transactions on Image Processing, 10, 117-129. doi:10.1109/83.892448.
56. Vogel, J. (2004). Semantic scene modeling and retrieval. No. 33 in Selected Readings in Vision and Graphics, Houghton Hartung-Gorre Verlag Konstanz, from http://www.vision.ethz.ch/vogel/documents/diss_final_neu.pdf.
57. Vogel, J., & Schiele, B. (2004). Natural scene retrieval based on a semantic modeling step. Proc. Int'l Conf. Image and Video Retrieval, LNCS, 3115, 207-215. doi:10.1007/b98923.
58. Vogel, J., & Schiele, B. (2007). Semantic modeling of natural scenes for content-based image retrieval. International Journal of Computer Vision, 72(2), 133-157. doi:10.1007/s11263-006-8614-1.
59. Wang, C., Jing, F., Zhang, L., & Zhang, H. J. (2006). Image annotation refinement using random walk with restarts. In Proc. 14th Ann' ACM int'l Conf. Multimedia, (pp. 647-652). doi:10.1145/1180639.1180774.
60. Wang, C., Jing, F., Zhang, L., & Zhang, H. J. (2007). Content-based image annotation refinement. In Proc IEEE Computer Vision and Pattern Recognition, (pp. 1-8). doi:10.1109/CVPR.2007.383221.
61. Wang, J.Z., Li, J., & Wiederhold, G. (2001). SIMPLIcity: Semantics-sensitive Integrated Matching for Picture Libraries. IEEE Transactions on Pattern Analysis and Machine Intelligence, 23(9), 947-963. doi:10.1109/34.955109.
62. Wang, J.Z., & Li, J. (2002). Learning-based linguistic indexing of pictures with 2-D MHMMs. In Proc ACM Multimedia, (pp. 436-445). doi:10.1145/641007.641104.
63. Wang, G., Zhang, Y., & Li, F.-F. (2006). Using dependent regions for object categorization in a generative framework. In Proc IEEE Conf. Computer Vision and Pattern Recognition, (pp. 1597-1604). doi:10.1109/CVPR.2006.324.
64. Wang, X.J., Ma, W.Y., Xue, G.R., & Li, X. (2004). Multi-model similarity propagation and its application for Web image retrieval. In Proc. 12th ACM Int'l Conf. Multimedia, (pp. 944-951). doi:10.1145/1027527.1027746.
65. Yang, S., Kim, S.-K., & Ro, Y.M. (2007). Semantic home photo categorization. IEEE Transactions on Circuits System and Video Technology, 17(3), 324-335. doi:10.1109/TCSVT.2007.890829.
66. Zhang, H., Berg, A.C., Maire, M., & Malik, J. (2006). Svm-knn: Discriminative nearest neighbor classification for visual category recognition. In Proc IEEE Conf. Computer Vision and Pattern Recognition, 2126-2136. doi:10.1109/CVPR.2006.301.