Automatic image annotation and retrieval using group sparsity

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 42, Issue 3, 2012, Pages 838-849

  Zhang, Shaoting ^a   Huang, Junzhou ^b   Li, Hongsheng ^c   Metaxas, Dimitris N ^a  

^a RUTGERS UNIVERSITY   (United States)

^b The University of Texas at Arlington   (United States)

^c Lehigh University   (United States)

Author keywords

Corel5K; feature selection; group sparsity; IAPR TC12; image annotation; image retrieval; regularization

Indexed keywords

COREL5K; GROUP SPARSITY; IAPR TC12; IMAGE ANNOTATION; REGULARIZATION;

ALGORITHMS; FEATURE EXTRACTION; IMAGE ANALYSIS;

IMAGE RETRIEVAL;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; DECISION SUPPORT SYSTEM; DOCUMENTATION; HOSPITAL INFORMATION SYSTEM; INFORMATION RETRIEVAL; METHODOLOGY; NATURAL LANGUAGE PROCESSING;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; DECISION SUPPORT TECHNIQUES; DOCUMENTATION; INFORMATION STORAGE AND RETRIEVAL; NATURAL LANGUAGE PROCESSING; PATTERN RECOGNITION, AUTOMATED; RADIOLOGY INFORMATION SYSTEMS;

EID: 84862808427     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2011.2179533     Document Type: Article

References (57)

1. A. Argyriou, T. Evgeniou, and M. Pontil, "Multi-task feature learning," in Proc. Annual Conf. Neural Inf. Process. Syst., 2007, pp. 41-48.
2. K. Barnard, P. Duygulu, D. Forsyth, N. D. Freitas, D. M. Blei, J. K and ola, T. Hofmann, T. Poggio, and J. Shawe-Taylor, "Matching words and pictures," J. Mach. Learn. Res., vol. 3, pp. 1107-1135, 2003.
3. E. Berg, M. Schmidt, M. Friedl and er, and K. Murphy, "Group sparsity via linear-time projection," Univ. British Columbia, Vancouver, BC, Canada, Tech. Rep. TR-2008-09, 2008.
4. E. C and ès, J. Romberg, and T. Tao, "Robust uncertainty principles: Exact signal reconstruction from highly incomplete frequency information," IEEE Trans. Inf. Theory, vol. 52, no. 2, pp. 489-509, Feb. 2006. (Pubitemid 43174093)
5. G. Carneiro, A. B. Chan, P. J. Moreno, and N. Vasconcelos, "Supervised learning of semantic classes for image annotation and retrieval," IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 3, pp. 394-410, Mar. 2007. (Pubitemid 46336416)
6. S. S. Chen, D. L. Donoho, and M. A. Saunders, "Atomic decomposition by basis pursuit," SIAM Rev., vol. 43, no. 1, pp. 129-159, 2001. (Pubitemid 32406896)
7. C. Cusano, G. Ciocca, and R. Schettini, "Image annotation using SVM," in Proc. Internet Imag. IV, vol. 5304, SPIE, 2004, pp. 330-338.
8. N. Dalal and B. Triggs, "Histograms of oriented gradients for human detection," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2005, pp. 886-893. (Pubitemid 43897286)
9. R. Datta, D. Joshi, J. Li, and J. Z. Wang, "Image retrieval: Ideas, influences, and trends of the new age," ACM Comput. Surv., vol. 40, no. 2, pp. 1-60, Apr. 2008.
10. D. Donoho, "Compressed sensing," IEEE Trans. Inf. Theory, vol. 52, no. 4, pp. 1289-1306, Apr. 2006.
11. D. L. Donoho, Y. Tsaig, I. Drori, and J. luc Starck, "Sparse solution of underdetermined linear equations by stagewise orthogonal matching pursuit," Dept. Statistics, Stanford Univ., Stanford, CA, Tech. Rep., 2006.
12. P. Duygulu, K. Barnard, J. F. G. de Freitas, and D. A. Forsyth, "Object recognition as machine translation: Learning a lexicon for a fixed image vocabulary," in Proc. Eur. Conf. Comput. Vis., 2002, pp. 97-112.
13. B. Efron, T. Hastie, I. Johnstone, and R. Tibshirani, "Least angle regression," Ann. Stat., vol. 32, no. 2, pp. 407-451, Apr. 2004.
14. S. L. Feng, R. Manmatha, and V. Lavrenko, "Multiple Bernoulli relevance models for image and video annotation," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2004, pp. II-1002-II-1009.
15. M. Figueiredo, R. Nowak, and S. Wright, "Gradient projection for sparse reconstruction: Application to compressed sensing and other inverse problems," IEEE J. Sel. Topics Signal Process., vol. 1, no. 4, pp. 586-597, Dec. 2007. (Pubitemid 351276802)
16. W. J. Fu, "Penalized regressions: The bridge versus the lasso," J. Comput. Graph. Stat., vol. 7, no. 3, pp. 397-416, Sep. 1998.
17. S. Gao, L.-T. Chia, and I. W.-H. Tsang, "Multi-layer group sparse coding for concurrent image classification and annotation," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2011, pp. 2809-2816.
18. D. Grangier and S. Bengio, "A discriminative kernel-based approach to rank images from text queries," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 8, pp. 1371-1384, Aug. 2008.
19. M. Grubinger, P. D. Clough, H. Muller, and T. Deselaers, "The IAPR TC-12 benchmark-A new evaluation resource for visual information systems," in Proc. Int. Workshop OntoImage, 2006, pp. 13-23.
20. M. Guillaumin, T. Mensink, J. Verbeek, and C. Schmid, "TagProp: Discriminative metric learning in nearest neighbor models for image autoannotation," in Proc. Int. Conf. Comput. Vis., 2009, pp. 309-316.
21. T. Hertz, A. Bar-hillel, and D. Weinshall, "Learning distance functions for image retrieval," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2004, pp. II-570-II-577.
22. X. Hou and L. Zhang, "Saliency detection: A spectral residual approach," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2007, pp. 1-8.
23. J. Huang, X. Huang, and D. Metaxas, "Learning with dynamic group sparsity," in Proc. Int. Conf. Comput. Vis., 2009, pp. 64-71.
24. J. Huang and T. Zhang, "The benefit of group sparsity," Inst. Math. Stat., vol. 38, no. 4, pp. 1978-2004, 2010.
25. J. Jeon, V. Lavrenko, and R. Manmatha, "Automatic image annotation and retrieval using cross-media relevance models," in Proc. ACM Special Interest Group Inf. Retrieval, 2003, pp. 119-126.
26. S. Ji, D. Dunson, and L. Carin, "Multi-task compressive sensing," IEEE Trans. Signal Process., vol. 57, no. 1, pp. 92-106, Jan. 2009.
27. S. Kim, K. Koh, M. Lustig, S. Boyd, and D. Gorinevsky, "An interiorpoint method for large-scale l1-regularized least squares," IEEE J. Sel. Topics Signal Process., vol. 1, no. 4, pp. 606-617, Dec. 2007. (Pubitemid 351266626)
28. V. Lavrenko, R. Manmatha, and J. Jeon, "A model for learning the semantics of pictures," in Proc. Annu. Conf. Neural Inf. Process. Syst., 2003.
29. J. Li and J. Wang, "Real-time computerized annotation of pictures," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 6, pp. 985-1002, Jun. 2008. (Pubitemid 351650103)
30. J. Liu, M. Li, Q. Liu, H. Lu, and S. Ma, "Image annotation via graph learning," Pattern Recognit., vol. 42, no. 2, pp. 218-228, Feb. 2009.
31. N. Loeff and A. Farhadi, "Scene discovery by matrix factorization," in Proc. Eur. Conf. Comput. Vis., 2008, pp. 451-464.
32. D. G. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-110, Nov. 2004.
33. J. Mairal, F. Bach, J. Ponce, G. Sapiro, and A. Zisserman, "Non-local sparse models for image restoration," in Proc. Int. Conf. Comput. Vis., 2009, pp. 2272-2279.
34. A. Makadia, V. Pavlovic, and S. Kumar, "A new baseline for image annotation," in Proc. Eur. Conf. Comput. Vis., 2008, pp. 316-329.
35. S. Mallat and Z. Zhang, "Matching pursuits with time-frequency dictionaries," IEEE Trans. Signal Process., vol. 41, no. 12, pp. 3397-3415, Dec. 1993.
36. D. Metzler and R. Manmatha, "An inference network approach to image," in Proc. ACM Int. Conf. Image Video Retrieval, 2004, pp. 42-50.
37. F. Monay and D. Gatica-Perez, "PLSA-based image autoannotation: Constraining the latent space," in Proc. ACM Multimedia, 2004, pp. 348-351. (Pubitemid 40211780)
38. J. Pan, H. Yang, C. Faloutsos, and P. Duygulu, "Automatic Multimedia Cross-Modal Correlation Discovery," in Proc. KDD, 2004, pp. 653-658. (Pubitemid 40114986)
39. D. Putthividhya, H. Attias, and S. Nagarajan, "Topic-regression multimodal latent dirichlet allocation for image annotation," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2010, pp. 3408-3415.
40. R. Schapire, "Theoretical views of boosting and applications," in Algorithmic Learning Theory. New York: Springer-Verlag, 1999, pp. 13-25.
41. M. Schmidt, K. Murphy, G. Fung, and R. Rosales, "Structure learning in r and om fields for heart motion abnormality detection," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2008, pp. 1-8.
42. R. Socher and F.-F. Li, "Connecting modalities: Semi-supervised segmentation and annotation of images using unaligned text corpora," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2010, pp. 966-973.
43. R. Tibshirani, "Regression shrinkage and selection via the LASSO," J. Royal Stat. Soc., vol. 58, no. 1, pp. 267-288, 1994.
44. J. A. Tropp and C. Anna, "Signal recovery from r and om measurements via orthogonal matching pursuit," IEEE Trans. Inf. Theory, vol. 53, no. 12, pp. 4655-4666, Dec. 2007.
45. K. van de S and e, T. Gevers, and C. Snoek, "Evaluating color descriptors for object and scene recognition," IEEE Trans. Pattern Anal.Mach. Intell., vol. 32, no. 9, pp. 1582-1596, Sep. 2010.
46. C. Wang, S. Yan, L. Zhang, and H.-J. Zhang, "Multi-label sparse coding for automatic image annotation," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2009, pp. 1643-1650.
47. D. Wipf and B. Rao, "An empirical Bayesian strategy for solving the simultaneous sparse approximation problem," IEEE Trans. Signal Process., vol. 55, no. 7, pp. 3704-3716, Jul. 2007. (Pubitemid 47018850)
48. J. Wright, A. Yang, A. Ganesh, S. Sastry, and Y. Ma, "Robust face recognition via sparse representation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 2, pp. 210-227, Feb. 2009.
49. F. Wu, Y. Han, Q. Tian, and Y. Zhuang, "Multi-label boosting for image annotation by structural grouping sparsity," in Proc. Int. Conf. Multimedia, 2010, pp. 15-24.
50. O. Yakhnenko and V. Honavar, "Annotating images and image objects using a hierarchical dirichlet process model," in Proc. Int. Conf. Mobile Data Manage., 2008, pp. 1-7.
51. Y. Yang, Y. Yang, Z. Huang, H. T. Shen, and F. Nie, "Tag localization with spatial correlations and joint group sparsity," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2011, pp. 881-888.
52. A. Yavlinsky, E. Schofield, and S. Ruger, "Automated image annotation using global features and robust nonparametric density estimation," in Proc. ACM Int. Conf. Image Video Retrieval, 2005, pp. 507-517. (Pubitemid 41425589)
53. M. Yuan and Y. Lin, "Model selection and estimation in regression with grouped variables," J. Roy. Stat. Soc. Ser. B, vol. 68, no. 1, pp. 49-67, Feb. 2006. (Pubitemid 43415335)
54. X. Yuan and S. Yan, "Visual classification with multi-task joint sparse representation," in Proc. IEEE Conf. CVPR, 2010, pp. 3493-3500.
55. H. Zhang, A. C. Berg, M. Maire, and J. Malik, "SVM-KNN: Discriminative nearest neighbor classification for visual category recognition," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2006, pp. 2126-2136. (Pubitemid 44931577)
56. S. Zhang, J. Huang, Y. Huang, Y. Yu, H. Li, and D. Metaxas, "Automatic image annotation using group sparsity," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2010, pp. 3312-3319.
57. S. Zhang, Y. Zhan, M. Dewan, J. Huang, D. N. Metaxas, and X. S. Zhou, "Towards robust and effective shape modeling: Sparse shape composition," Med. Image Anal., vol. 16, no. 1, pp. 265-277, Jan. 2012.