SNMFCA: Supervised NMF-based image classification and annotation

IEEE Transactions on Image Processing

Volumn 21, Issue 11, 2012, Pages 4508-4521

  Jing, Liping ^a   Zhang, Chao ^a   Ng, Michael K ^b  

^a BEIJING JIAOTONG UNIVERSITY   (China)

^b HONG KONG BAPTIST UNIVERSITY   (Hong Kong)

Author keywords

Image annotation; image classification; latent image bases; nonnegative matrix factorization; supervised learning

Indexed keywords

CLASS LABELS; COMPUTATIONALLY EFFICIENT; DESCRIPTORS; IMAGE ANNOTATION; IMAGE DESCRIPTORS; LATENT IMAGES; LINEAR LEAST SQUARES PROBLEMS; MAPPING MODEL; NON-NEGATIVE MATRIX; NONNEGATIVE LEAST SQUARES; NONNEGATIVE MATRIX FACTORIZATION; REAL-WORLD IMAGE DATA; TEST IMAGES; TRAINING IMAGE; TRAINING PHASE;

ALGORITHMS; FACTORIZATION; FORECASTING; MATRIX ALGEBRA; SUPERVISED LEARNING;

IMAGE CLASSIFICATION;

EID: 84867863394     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2012.2206040     Document Type: Article

References (58)

1. S. Thorpe, D. Fize, and C. Marlot, "Speed of processing in the human visual system," Nature, vol. 381, no. 6582, pp. 520-522, 1996. (Pubitemid 26170929)
2. L. Fei-Fei and P. Perona, "A Bayesian hierarchical model for learning natural scene categories," in Proc. Comput. Vis. Pattern Recognit., Jun. 2005, pp. 524-531.
3. L. Li, R. Socher, and F. Li, "Toward total scene understanding: Classification, annotation and segmentation in an automatic framework," in Proc. Comput. Vis. Pattern Recognit., 2009, pp. 2036-2043.
4. C. Wang, D. Blei, and F. Li, "Simultaneous image classification and annotation," in Proc. Comput. Vis. Pattern Recognit., 2009, pp. 1903-1910.
5. S. Lazebnik, C. Schmid, and J. Ponce, "Beyond bags offeatures: Spatial pyramid matching for recognizing natural scene categories," in Proc. Comput. Vis. Pattern Recognit., 2006, pp. 2169-2178. (Pubitemid 44931582)
6. S. Maji, A. Berg, and J. Malik, "Classification using intersection kernel support vector machines is efficient," in Proc. Comput. Vis. Pattern Recognit., 2008, pp. 1-8.
7. A. Bosch, A. Zisserman, and X. Munoz, "Scene classification via pLSA," in Proc. Eur. Conf. Comput. Vis., 2005, pp. 517-530. (Pubitemid 44029655)
8. S. Karayev, M. Fritz, S. Fidler, and T. Darrell, "A probabilistic model for recursive factorized image features," in Proc. Comput. Vis. Pattern Recognit., 2011, pp. 401-408.
9. J. Yang, K. Yu, Y. Gong, and T. Huang, "Linear spatial pyramid matching using sparse coding for image classification," in Proc. Comput. Vis. Pattern Recognit., 2009, pp. 1794-1801.
10. J. Yang, K. Yu, and T. Huang, "Efficietn highly over-complete sparse coding using a mixture model," in Proc. Eur. Conf. Comput. Vis., 2010, pp. 113-126.
11. J. Wang, J. Yang, K. Yu, F. Lv, T. Huang, and Y. Gong, "Locality-constrained linear coding for image classification," in Proc. Comput. Vis. Pattern Recognit., 2010, pp. 3360-3367.
12. M. Lan, C. Tan, J. Su, and Y. Lu, "Supervised and traditional term weighting methods for automatic text categorization," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 4, pp. 721-735, Apr. 2009.
13. Y Boureau, F. Bach, Y LeCun, and J. Ponce, "Learning mid-level features for recognition," in Proc. Comput. Vis. Pattern Recognit., 2010, pp. 2559-2566.
14. N. Ho, "Nonnegative matrix factorization algorithms and applications," Ph.D. thesis, Dépt. D'Ingénierie Math., Univ. Catholique De Louvain, Ottignies-Louvain-la-Neuve, Belgium, 2008.
15. D. Lee and H. Seung, "Learning the parts of objects by nonnegative matrix factorization," Nature, vol. 401, pp. 788-791, Oct. 1999.
16. F. Wang, T. Li, and C. Zhang, "Semi-supervised clustering via matrix factorization," in Proc. SIAM Conf. Data Mining, 2008, pp. 1-12.
17. Y Chen, L. Wang, and M. Dong, "Non-negative matrix factorization for semisupervised heterogeneous data coclustering," IEEE Trans. Knowl. Data Eng., vol. 22, no. 10, pp. 1459-1474, Oct. 2010.
18. Y Liu, R. Jin, and L. Yang, "Semi-supervised multi-label learning by constrained non-negative matrix factorization," in Proc. 21st Nat Conf. Artif. Intell., 2006, pp. 421-426. (Pubitemid 44705320)
19. H. Liu and Z. Wu, "Non-negative matrix factorization with constraints," in Proc. AAAI, 2010, pp. 506-511.
20. H. Lee, J. Yoo, and S. Choi, "Semi-supervised nonnegative matrix factorization," IEEE Signal Process. Lett., vol. 17, no. 1, pp. 4-7, Jan. 2010.
21. B. Russell, A. Torralba, K. Murphy, and W. Freeman, "LabelMe: A database and web-based tool for image annotation," Int. J. Comput. Vis., vol. 77, nos. 1-3, pp. 157-173, 2008.
22. G. Wang, D. Hoiem, and D. Forsyth, "Building text features for object image classification," in Proc. Comput. Vis. Pattern Recognit, 2009, pp. 1367-1374.
23. M. Guillaumin, J. Verbeek, and C. Schmid, "Multimodal semi-supervised learning for image classification," in Proc. Comput. Vis. Pattern Recognit., 2010, pp. 902-909.
24. S. Portilla and E. Simoncelli, "A parametric texture model based onjoint statistics of complex wavelet coefficients," Int. J. Comput. Vis., vol. 40, no. 1, pp. 49-70, 2000.
25. A. Vailaya, M. Figueiredo, A. Jain, and H. Zhang, "Image classification for content-based indexing," IEEE Trans. Image Process., vol. 10, no. 1, pp. 117-130, Jan. 2001. (Pubitemid 32136886)
26. M. Varma and A. Zisserman, "Texture classification: Are filter banks necessary?" in Proc. Comput. Vis. Pattern Recognit., 2003, pp. 691-698.
27. A. Bosch, A. Zisserman, and X. Munoz, "Image classification using random forests and ferns," in Proc. 11th Int. Conf. Comput. Vis., Oct. 2007, pp. 1-8.
28. L. Li and L. Fei-Fei, "What, where and who? Classifying event by scene and object recognition," in Proc. Int. Conf. Comput. Vis., 2007, pp. 1-8.
29. J. Zhang, M. Marszalek, C. Lazebnik, and S. Schmid, "Local features and kernels for classification of texture and object categories: A com-parehensive study," Int. J. Comput. Vis., vol. 73, no. 2, pp. 213-238, Jun. 2007. (Pubitemid 46181625)
30. I. Ramirez, P. Sprechmann, and G. Sapiro, "Classification and clustering via dictionary learning with structured incoherence and shared features," in Proc. Comput. Vis. Pattern Recognit., 2010, pp. 3501-3508.
31. J. Gemert, J. Geusebroek, C. Veenman, and A. Smeulders, "Kernel codebooks for scene categorization," in Proc. Eur. Conf. Comput. Vis., 2008, pp. 696-709.
32. F. Moosmann, E. Nowak, and F. Jurie, "Randomized clustering forests for images classification," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 9, pp. 1632-1646, Sep. 2008.
33. H. Cai, F. Yan, and K. Mikolajczyk, "Learning weights for codebook in image classification and retrieval," in Proc. Comput. Vis. Pattern Recognit., 2010, pp. 2320-2327.
34. H. Lee, A. Battle, R. Raina, and A. Ng, "Efficient sparse coding algorithms," in Proc. Neural Image Process. Syst., 2006, pp. 1-8.
35. R. Datta, D. Joshi, J. Li, and J. Wang, "Image retrieval: Ideas, influences and trends of the new age," ACM Comput. Surveys, vol. 40, no. 2, pp. 5-64, Apr. 2008.
36. N. Zhou, W. Cheung, G. Qiu, and X. Xue, "A hybrid probabilistic model for unified collaborative and content-based image tagging," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 7, pp. 1281-1294, Jul. 2011.
37. S. Zhang, J. Huang, H. Li, and D. Metaxas, "Automatic image annotation and retrieval using group sparsity," IEEE Trans. Syst. Man Cybern., Part B, Cybern, vol. 42, no. 3, pp. 838-849, Jun. 2012.
38. F. Monay and D. Gatica-Perez, "Plsa-based image annotation: Constrain-ing the latent space," in Proc. ACM Multimedia, 2004, pp. 348-351. (Pubitemid 40211780)
39. D. Blei and M. Jordan, "Modeling annotated data," in Proc. ACM SIGIR, 2003, pp. 127-134.
40. Y. Feng and M. Lapata, "Topic models for image annotation and text illustration," in Proc. Annu. Conf. North Amer. Assoc. Comput. Linguist., 2010, pp. 831-839.
41. D. Putthividhya, H. Attias, and S. Nagarajan, "Topic-regression multi-modal latent dirichlet allocation for image annotation," in Proc. Comput. Vis. Pattern Recognit., 2010, pp. 3408-3415.
42. Z. Wi, M. Yang, Z. Zhang, and Z. Zhang, "Mining partially annotated images," in Proc. Int. Conf. Knowl. Discovery Data Mining, 2011, pp. 1199-1207.
43. C. Cusano, G. Ciocca, and R. Schettini, "Image annotation using SVM," in Proc. Internet Imag., 2004, pp. 330-338.
44. G. Carneiro, A. Chan, P. Moreno, and N. Vasconcelos, "Supervised learning of semantic classes for image annotation and retrieval," IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 3, pp. 394-410, Mar. 2007. (Pubitemid 46336416)
45. A. Makadia, V. Pavlovic, and S. Kumar, "Baselines for image annota-tion," Int. J. Comput. Vis., vol. 90, no. 1, pp. 88-105, Oct. 2010.
46. M. Guillaumin, T. Mensink, J. Verbeek, and C. Schmid, "TagProp: Discriminative metric learning in nearest neighbor models for image auto-annotation," in Proc. Comput. Vis. Pattern Recognit., 2009, pp. 309-316.
47. Y. Jin, L. Khan, L. Wang, and M. Awad, "Image annotation by combining multiple evidence and wordnet," in Proc. ACM Int. Conf. Multimedia, 2005, pp. 7-12.
48. C. Leong, R. Mihalcea, and S. Hassan, "Text mining for automatic image tagging," in Proc. 23rdInt. Conf. Comput. Linguist., 2010, pp. 647-655.
49. D. Sontag and D. Roy, "Complexity of inference in topic models," in Proc. Neural Inf. Process. Syst., 2009, pp. 1-5.
50. D. Cai, X. He, J. Han, and T. Huang, "Graph regularized non-negative matrix factorization for data representation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 8, pp. 1548-1560, Aug. 2011.
51. P. Paatero, "The multilinear engine: A table-driven, least squares pro-gram for solving multilinear problems, including the n-way parallel factor analysis model," J. Comput. Graph. Stat., vol. 8, no. 4, pp. 854-888, 1999.
52. C. Ding, T. Li, W. Peng, and H. Park, "Orthogonal nonnegative matrix trifactorizations for clustering," in Proc. ACM SIGKDD, 2006, pp. 126-135. (Pubitemid 44535510)
53. C. Lin, "Projected gradient methods for nonnegative matrix fac-torization," Neural Comput., vol. 19, no. 10, pp. 2756-2779, 2007.
54. L. Grippo and M. Sciandrone, "On the convergence of the block nonlinear Gauss-Seidel method under convex constraints," Oper. Res. Lett., vol. 26, no. 3, pp. 127-136, 2000. (Pubitemid 30564332)
55. M. Everingham, L. Gool, C. Williams, J. Winn, and A. Zisserman. (2007). The Pascal Visual Object Classes Challenge 2007 Results [Online]. Available: http://homepages.inf.ed.ac.uk/ckiw/postscript/ijcv- voc09.pdf
56. L. Fei-Fei, R. Fergus, and P. Perona, "Learning generative visual models from few training examples: An incremental Bayesian approach tested on 101 categories," in Proc. Workshop Generat.-Model Based Comput. Vis. Pattern Recognit., 2004, pp. 178-186.
57. M. Zhang and Z. Zhou, "M3MIML: A maximum margin method for multi-instance multi-label learning," in Proc. Int. Conf. Data Mining, 2008, pp. 688-697.
58. Y. Wang and G. Mori, "A discriminative latent model of image region and object tag correspondence," in Proc. Neural Inf. Process. Syst., 2010, pp. 2397-2405.