Label-Embedding for Image Classification

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 38, Issue 7, 2016, Pages 1425-1438

  Akata, Zeynep ^a   Perronnin, Florent ^b   Harchaoui, Zaid ^c   Schmid, Cordelia ^c  

^a MAX PLANCK INSTITUTE FOR INFORMATICS   (Germany)

^b FACEBOOK AI RESEARCH   (United States)

^c INRIA RHÔNE ALPES   (France)

Author keywords

Attributes; Fine Grained Image Classification; Image classification; Label Embedding; Subspace Learning

Indexed keywords

VECTOR SPACES;

ALTERNATIVE SOURCE; ATTRIBUTES; EMBEDDING PROBLEMS; FINE GRAINED; INTERMEDIATE REPRESENTATIONS; LEARNING SCENARIOS; SUBSPACE LEARNING; TEXTUAL DESCRIPTION;

IMAGE CLASSIFICATION;

EID: 84976520273     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2015.2487986     Document Type: Article

References (71)

1. A. Farhadi, I. Endres, D. Hoiem, D. Forsyth, "Describing objects by their attributes," in Proc. IEEE Conf. Comput. Vis., Pattern Recog. (CVPR), 2009, pp. 1778-1785.
2. C. Lampert, H. Nickisch, S. Harmeling, "Learning to detect unseen object classes by between-class attribute transfer," in Proc. IEEE Conf. Comput. Vis., Pattern Recog. (CVPR), 2009, pp. 951-958.
3. H. Larochelle, D. Erhan, Y. Bengio, "Zero-data learning of new tasks," in Proc. 23rd Nat. Conf. Artif. Intell. (AAAI), 2008, pp. 646-651.
4. M. Palatucci, D. Pomerleau, G. Hinton, T. Mitchell, "Zeroshot learning with semantic output codes," in Proc. Neural Inf. Process. Syst. (NIPS), 2009, pp. 1410-1418.
5. C. Wah, S. Branson, P. Perona, S. Belongie, "Multiclass recognition and part localization with humans in the loop," in Proc. IEEE Int. Conf. Comput. Vis. (ICCV), 2011, pp. 2524-2531.
6. Z. Akata, F. Perronnin, Z. Harchaoui, C. Schmid, "Labelembedding for attribute-based classification," in Proc. IEEE Conf. Comput. Vis., Pattern Recog. (CVPR), 2013, pp. 819-826.
7. T. G. Dietterich and G. Bakiri, "Solving multiclass learning problems via error-correcting output codes," J. Artif. Intell. Res., vol. 2, pp. 263-286, 1995.
8. T. Mikolov, I. Sutskever, K. Chen, G. S. Corrado, J. Dean, "Distributed representations of words and phrases and their compositionality," in Proc. Neural Inf. Process. Syst., 2013, pp. 3111-3119.
9. A. Frome, G. Corrado, J. Shlens, S. Bengio, J. Dean, M.-A. Ranzato, T. Mikolov, "DeViSE: A deep visual-semantic embedding model," in Proc. Neural Inf. Process. Syst., 2013, pp. 2121-2129.
10. V. Ferrari and A. Zisserman, "Learning visual attributes," in Proc. Neural Inf. Process. Syst., 2007.
11. H. Chen, A. Gallagher, B. Girod, "Describing clothing by semantic attributes," in Proc. 12th Eur. Conf. Comput. Vis., 2012, pp. 609-623.
12. G. Kulkarni, V. Premraj, S. Dhar, S. Li, Y. choi, A. Berg, T. Berg, "Baby talk: Understanding and generating simple image descriptions," in Proc. IEEE Conf. Comput. Vis., Pattern Recog. (CVPR), 2011, pp. 1601-1608.
13. V. Ordonez, G. Kulkarni, T. Berg, "Im2Text: Describing images using 1 million captioned photographs," in Proc. Neural Inf. Process. Syst. (NIPS), 2011, pp. 1143-1151.
14. N. Kumar, A. C. Berg, P. N. Belhumeur, S. K. Nayar, "Attribute and simile classifiers for face verification," in Proc. IEEE Int. Conf. Comput. Vis. (ICCV), 2009.
15. W. J. Scheirer, N. Kumar, P. N. Belhumeur, T. E. Boult, "Multi-attribute spaces: Calibration for attribute fusion and similarity search," in Proc. IEEE Conf. Comput. Vis., Pattern Recog. (CVPR), 2012, pp. 2933-2940.
16. H. Chen, A. Gallagher, B. Girod, "What's in a name? first names as facial attributes," in Proc. IEEE Conf. Comput. Vis., Pattern Recog. (CVPR), 2013, pp. 3366-3373.
17. N. Kumar, P. Belhummeur, S. Nayar, "FaceTracer: A search engine for large collections of images with faces," in Proc. 10th Eur. Conf. Comput. Vis. (ECCV), 2008, pp. 340-353.
18. B. Siddiquie, R. Feris, L. Davis, "Image ranking and retrieval based on multi-attribute queries," in Proc. IEEE Conf. Comput. Vis., Pattern Recog. (CVPR), 2011, pp. 801-808.
19. M. Douze, A. Ramisa, C. Schmid, "Combining attributes and Fisher vectors for efficient image retrieval," in Proc. IEEE Conf. Comput. Vis., Pattern Recog. (CVPR), 2011, pp. 745-752.
20. J. Liu, B. Kuipers, S. Savarese, "Recognizing human actions by attributes," in Proc. IEEE Conf. Comput. Vis., Pattern Recog. (CVPR), 2011, pp. 3337-3344.
21. B. Yao, X. Jiang, A. Khosla, A. L. Lin, L. J. Guibas, F.-F. Li, "Human action recognition by learning bases of action attributes and parts," in Proc. IEEE Int. Conf. Comput. Vis. (ICCV), 2011, pp. 1331-1338.
22. C. Wah and S. Belongie, "Attribute-based detection of unfamiliar classes with humans in the loop," in Proc. IEEE Conf. Comput. Vis., Pattern Recog. (CVPR), 2013, pp. 779-786.
23. G. Wang and D. Forsyth, "Joint learning of visual attributes, object classes and visual saliency," in Proc. IEEE 12th Int. Conf. Comput. Vis. (ICCV), 2009, pp. 537-544.
24. Y. Wang and G. Mori, "A discriminative latent model of object classes and attributes," in Proc. 11th Eur. Conf. Computer Vis. (ECCV), 2010, pp. 155-168.
25. D. Mahajan, S. Sellamanickam, V. Nair, "A joint learning framework for attribute models and object descriptions," in Proc. IEEE Int. Conf. Comput. Vis. (ICCV), 2011, pp. 1227-1234.
26. V. Sharmanska, N. Quadrianto, C. H. Lampert, "Augmented attribute representations," in Proc. 12th Eur. Conf. Computer Vis. (ECCV), 2012, pp. 242-255.
27. T. Mensink, J. Verbeek, G. Csurka, "Tree-structured CRF models for interactive image labeling," IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 2, pp. 476-489, Feb. 2012.
28. X. Yu and Y. Aloimonos, "Attribute-based transfer learning for object categorization with zero or one training example," in Proc. 11th Eur. Conf. Computer Vis. (ECCV), 2010, pp. 127-140.
29. J. Sanchez, F. Perronnin, T. Mensink, J. Verbeek, "Image classification with the Fisher vector: Theory and practice," Int. J. Comput. Vis., vol. 105, pp. 222-245 2013.
30. T. Berg, A. Berg, J. Shih, "Automatic attribute discovery and characterization from noisy web data," in Proc. 11th Eur. Conf. Computer Vis. (ECCV), 2010, pp. 663-676.
31. K. Duan, D. Parikh, D. J. Crandall, K. Grauman, "Discovering localized attributes for fine-grained recognition," in Proc. IEEE Comput. Vis. Pattern Recog., 2012, pp. 3474-3481.
32. L. Marchesotti and F. Perronnin, "Learning beautiful (and ugly) attributes," in Proc. Brit. Mach. Vis. Conf., 2013.
33. M. Rohrbach, M. Stark, G. Szarvas, I. Gurevych, B. Schiele, "What helps here-and why? Semantic relatedness for knowledge transfer," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2010.
34. M. Rohrbach, M. Stark, B. Schiele, "Evaluating knowledge transfer and zero-shot learning in a large-scale setting," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2011, pp. 1641-1648.
35. T. Mensink, J. Verbeek, F. Perronnin, G. Csurka, "Metric learning for large scale image classification: Generalizing to new classes at near-zero cost," in Proc. 12th Eur. Conf. Computer Vis. (ECCV), 2012.
36. F. Yu, L. Cao, R. Feris, J. Smith, S.-F. Chang, "Designing category-level attributes for discriminative visual recognition," in Proc. IEEE Comput. Soc. Conf. Comput. Vis., Pattern Recog. (CVPR), Portland, OR, Jun. 2013, pp. 771-778.
37. R. Socher, M. Ganjoo, H. Sridhar, O. Bastani, C. Manning, A. Ng, "Zero-shot learning through cross-modal transfer," in Proc. Neural Inf. Process. Syst., 2013, pp. 935-943.
38. T. Mensink, E. Gavves, C. Snoek, "COSTA: Co-occurrence statistics for zero-shot classification," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2014, pp. 2441-2448.
39. Z. Akata, S. Reed, D. Walter, H. Lee, B. Schiele, "Evaluation of output embeddings for fine-grained image classification," in Proc. IEEE Comput. Vis. Pattern Recog., 2015.
40. K. Chatfield, V. Lempitsky, A. Vedaldi, A. Zisserman, "The devil is in the details: An evaluation of recent feature encoding methods," in Proc. Brit. Mach. Vis. Conf., 2011, pp. 76.1-76.12.
41. J. Shawe-Taylor and N. Cristianini, Kernel Methods for Pattern Analysis, Cambridge Univ. Press, 2004.
42. S. Maji and A. Berg, "Max-margin additive classifiers for detection," in Proc. IEEE 12th Int. Conf. Comput. Vis., 2009, pp. 1550-5499.
43. A. Vedaldi and A. Zisserman, "Efficient additive kernels via explicit feature maps," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2010, pp. 3539-3546.
44. H. Jegou, M. Douze, C. Schmid, "Product quantization for nearest neighbor search," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 1, pp. 117-128, Jan. 2011.
45. J. Sanchez and F. Perronnin, "High-dimensional signature compression for large-scale image classification," in Proc. IEEE Conf. Comput.Vis. Pattern Recog., 2011, pp. 1665-1672.
46. A. Vedaldi and A. Zisserman, "Sparse kernel approximations for efficient classification and detection," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2012, pp. 2320-2327.
47. Y. Amit, M. Fink, N. Srebro, S. Ullman, "Uncovering shared structures in multiclass classification," in Proc. 24th Int. Conf. Machine Learning (ICML), 2007, pp. 17-24.
48. K. Weinberger and O. Chapelle, "Large margin taxonomy embedding for document categorization," in Proc. Neural Inform. Process. Syst., 2008, pp. 1737-1744.
49. J. Weston, S. Bengio, N. Usunier, "Large scale image annotation: Learning to rank with joint word-image embeddings," J. Mech. Learning, vol. 81, pp. 21-35, 2010.
50. S. Bengio, J. Weston, D. Grangier, "Label embedding trees for large multi-class tasks," in Proc. Neural Inform. Process. Syst., 2010, pp. 163-171.
51. J. Weston, O. Chapelle, A. Elisseeff, B. Scholkopf, V. Vapnik, "Kernel dependency estimation," in Proc. Neural Inform. Process. Syst., 2002, pp. 873-880.
52. D. Hsu, S. Kakade, J. Langford, T. Zhang, "Multi-label prediction via compressed sensing," in Proc. Neural Inform. Process. Syst., 2009, pp. 772-780.
53. R. Hamming, "Error detecting and error correcting codes," Bell Syst. Technical J., vol. 26, pp. 147-160, 1950.
54. S. Escalera, O. Pujol, P. Radeva, "Error-correcting ouput codes library," J. Mach. Learning Res., vol. 11, pp. 661-664, 2010.
55. T. Hastie, R. Tibshirani, J. Friedman, The Elements of Statistical Learning, 2nd ed. Springer, 2008.
56. I. Tsochantaridis, T. Joachims, T. Hofmann, Y. Altun, "Large margin methods for structured and interdependent output variables," J. Mach. Learning Res., vol. 6, pp. 1453-1484, 2005.
57. N. Usunier, D. Buffoni, P. Gallinari, "Ranking with ordered weighted pairwise classification," in Proc. 26th Ann. Int. Conf. Mach. Learning, 2009, pp. 1057-1064.
58. F. Perronnin, Z. Akata, Z. Harchaoui, C. Schmid, "Towards good practice in large-scale learning for image classification," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2012, pp. 3482-3489.
59. B. Geng, L. Yang, C. Xu, X.-S. Hua, "Ranking model adaptation for domain-specific search," IEEE Trans. Knowledge Data Eng., vol. 24, no. 4, pp. 745-758, Apr. 2012.
60. M. Saerens, F. Fouss, L. Yen, P. Dupont, "The principal components analysis of a graph, its relationships to spectral clustering," in Proc. 15th Eur. Conf. Mach. Learning, 2004.
61. S. Deerwester, "Improving information retrieval with latent semantic indexing," in Proc. 51st ASIS Ann. Meeting (ASIS), 1988.
62. T. Hofmann, "Probabilistic latent semantic indexing," in Proc. 22nd Ann. Int. ACM SIGIR Conf. Res., Develop. Inform. Retrieval, 1999, pp. 50-57.
63. D. Blei, A. Ng, M. Jordan, "Latent Dirichlet allocation," J. Mach. Learning Res., vol. 3, pp. 993-1022, 2003.
64. D. G. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vis., vol. 60, pp. 91-110, 2004.
65. S. Clinchant, G. Csurka, F. Perronnin, J.-M. Renders, "XRCE participation to ImageEval," in Proc. ImageEval Workshop, CVIR, 2007.
66. F. Perronnin, J. Sanchez, T. Mensink, "Improving the Fisher kernel for large-scale image classification," in Proc. 11th Eur. Conf. Comput. Vis., 2010, pp. 143-156.
67. D. Osherson, J. Stern, O. Wilkie, M. Stob, E. Smith, "Default probability," Cognitive Science, vol. 15, pp. 251-269, 1991.
68. R. A. DeVore, "Deterministic constructions of compressed sensing matrices," J. Complex., vol. 23, no. 4-6, pp. 918-925, 2007.
69. S. Branson, C. Wah, B. Babenko, F. Schroff, P. Welinder, P. Perona, S. Belongie, "Visual recognition with humans in the loop," in Proc. 11th Eur. Conf. Comput. Vis., 2010, pp. 438-451.
70. S. Shalev-Shwartz, Y. Singer, N. Srebro, A. Cotter, "Pegasos: Primal estimated sub-gradient solver for SVM," Math. Program., vol. 127, no. 1, pp. 3-30, 2011.
71. S. Shalev-Shwartz and S. Ben-David, Understanding Machine Learning: From Theory to Algorithms. Cambridge University Press, 2014.