Enhanced representation and multi-task learning for image annotation

Computer Vision and Image Understanding

Volumn 117, Issue 5, 2013, Pages 466-478

  Binder, Alexander ^a,c   Samek, Wojciech ^a,c   Müller, Klaus Robert ^a,d,e   Kawanabe, Motoaki ^b,c  

^a TECHNISCHE UNIVERSITÄT BERLIN   (Germany)

^b ADVANCED TELECOMMUNICATIONS RESEARCH INSTITUTE INTERNATIONAL   (Japan)

^c FRAUNHOFER FIRST   (Germany)

^d Bernstein Focus: Neurotechnology Berlin   (Germany)

^e Korea University   (South Korea)

Author keywords

Bag of Words representation; Biased random sampling; Image classification; Image ranking; ImageCLEF; Multi task learning; Multiple kernel learning; Mutual information

Indexed keywords

BAG OF WORDS; IMAGE RANKINGS; IMAGECLEF; MULTIPLE KERNEL LEARNING; MULTITASK LEARNING; MUTUAL INFORMATIONS; RANDOM SAMPLING;

IMAGE ANALYSIS; LINEARIZATION; QUALITY CONTROL; SEMANTICS;

IMAGE CLASSIFICATION;

EID: 84875913890     PISSN: 10773142     EISSN: 1090235X     Source Type: Journal    
DOI: 10.1016/j.cviu.2012.09.006     Document Type: Article

References (50)

1. S. Nowak, K. Nagel, J. Liebetrau, The CLEF 2011 photo annotation and concept-based retrieval tasks, in: V. Petras, P. Forner, P.D. Clough (Eds.), CLEF (Notebook Papers/Labs/Workshop), 2011.
2. M.J. Huiskes, B. Thomee, and M.S. Lew New trends and ideas in visual concept detection: the MIR flickr retrieval evaluation initiative J.Z. Wang, N. Boujemaa, N.O. Ramirez, A. Natsev, Multimedia Information Retrieval 2010 ACM 527 536
3. L. Itti, C. Koch, and E. Niebur A model of saliency-based visual attention for rapid scene analysis IEEE Trans. Pattern Anal. Mach. Intell. 20 11 1998 1254 1259
4. E. Vazquez, T. Gevers, M. Lucassen, J. van de Weijer, and R. Baldrich Saliency of color image derivatives: a comparison between computational models and human perception J. Opt. Soc. Am. A 27 3 2010 613 621
5. T. Liu, J. Sun, N. Zheng, X. Tang, and H.-Y. Shum Learning to detect a salient object CVPR 2007 IEEE Computer Society
6. T. Kadir, and M. Brady Saliency, scale and image description Int. J. Comput. Vision 45 2001 83 105 10.1023/A:1012460413855
7. N. Rao, J. Harrison, T. Karrels, R. Nowak, T. Rogers, Using machines to improve human saliency detection, in: Signals, Systems and Computers (ASILOMAR), 2010 Conference Record of the Forty Fourth Asilomar Conference on, 2010, pp. 80-84. doi: 10.1109/ACSSC.2010.5757471.
8. F. Moosmann, D. Larlus, and F. Jurie Learning saliency maps for object categorization ECCV International Workshop on The Representation and Use of Prior Knowledge in Vision 2006 Springer < http://lear.inrialpes.fr/pubs/2006/ MLJ06 >
9. L. Yang, N. Zheng, J. Yang, M. Chen, H. Chen, A biased sampling strategy for object categorization, in: ICCV, 2009, pp. 1141-1148.
10. D.G. Lowe Distinctive image features from scale-invariant keypoints Int. J. Comput. Vision 60 2 2004 91 110
11. H. Bay, A. Ess, T. Tuytelaars, and L. Van Gool Speeded-up robust features (surf) Comput. Vision Image Underst. 110 2008 346 359 10.1016/j.cviu.2007.09. 014
12. A. Torralba, K.P. Murphy, and W.T. Freeman Sharing visual features for multiclass and multiview object detection IEEE Trans. Pattern Anal. Mach. Intell. 29 5 2007 854 869 10.1109/TPAMI.2007.1055
13. C.H. Lampert, H. Nickisch, S. Harmeling, Learning to detect unseen object classes by between-class attribute transfer, in: CVPR, 2009.
14. L. Torresani, M. Szummer, A. Fitzgibbon, Efficient object category recognition using classemes, in: European Conference on Computer Vision (ECCV), 2010, pp. 776-789.
15. X.-T. Yuan, S. Yan, Visual classification with multi-task joint sparse representation, in: IEEE Conf. on Comp. Vision & Pat. Rec., 2010, pp. 3493-3500.
16. Y. Wang, G. Mori, A discriminative latent model of object classes and attributes, in: European Conference on Computer Vision, 2010.
17. M. Fink Object classification from a single example utilizing class relevance metrics In Advances in Neural Information Processing Systems NIPS 2004 MIT Press 449 456
18. E. Bart, S. Ullman, Single-example learning of novel classes using representation by similarity, in: British Machine Vision Conference BMVC, 2005.
19. L. Fei-Fei, Knowledge Transfer in Learning to Recognize Visual Object Classes, ICDL.
20. T. Tommasi, B. Caputo, The more you know, the less you learn: from knowledge transfer to one-shot learning of object categories, in: BMVC, 2009.
21. M. Rohrbach, M. Stark, and B. Schiele Evaluating knowledge transfer and zero-shot learning in a large-scale setting 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2011 IEEE Colorado Springs, USA 1641 1648
22. T. Evgeniou, C.A. Micchelli, and M. Pontil Learning multiple tasks with kernel methods J. Mach. Learn. Res. 6 2005 615 637
23. I. Tsochantaridis, T. Joachims, T. Hofmann, and Y. Altun Large margin methods for structured and interdependent output variables J. Mach. Learn. Res. 6 2005 1453 1484
24. Z. Song, Q. Chen, Z. Huang, Y. Hua, and S. Yan Contextualizing object detection and classification CVPR 2011 IEEE 1585 1592
25. K. Ming, A. Chai, C.K.I. Williams, S. Klanke, S. Vijayakumar, Multi-task gaussian process learning of robot inverse dynamics, in: Neural Inf. Proc. Syst., 2008.
26. M. Kloft, U. Brefeld, S. Sonnenburg, and A. Zien Lp-norm multiple kernel learning J. Mach. Learn. Res. 12 2011 953 997
27. W. Samek, A. Binder, and M. Kawanabe Multi-task learning via non-sparse multiple kernel learning P. Real, D. Díaz-Pernil, H. Molina-Abril, A. Berciano, W.G. Kropatsch, CAIP (1) Lecture Notes in Computer Science Vol. 6854 2011 Springer 335 342
28. C. Lampert, M. Blaschko, A multiple kernel learning approach to joint multi-class object detection, in: DAGM, 2008, pp. 31-40.
29. Y.-G. Jiang, J. Wang, S.-F. Chang, C.-W. Ngo, Domain adaptive semantic diffusion for large scale context-based video annotation, in: ICCV, 2009, pp. 1420-1427.
30. M.-F. Weng, and Y.-Y. Chuang Multi-cue fusion for semantic video indexing Proceedings of the 16th ACM International Conference on Multimedia MM '08 2008 ACM New York, NY, USA 71 80 doi: 10.1145/1459359.1459370
31. L. Fei-Fei, R. Fergus, P. Perona, Learning generative visual models from few training examples: an incremental Bayesian approach tested on 101 object categories, in: Workshop on Generative-Model Based Vision, 2004.
32. K.-R. Müller, S. Mika, G. Rätsch, K. Tsuda, and B. Schölkopf An introduction to kernel-based learning algorithms IEEE Trans. Neural Netw. 12 2 2001 181 201
33. C. Dance, J. Willamowski, L. Fan, C. Bray, G. Csurka, Visual categorization with bags of keypoints, in: ECCV International Workshop on Statistical Learning in Computer Vision, 2004. < http://www.xrce.xerox.com/ Research-Development/Publications/2004-0104/(language)/eng-GB >.
34. M. Marszalek, C. Schmid, Learning Representations for Visual Object Class Recognition. < http://pascallin.ecs.soton.ac.uk/challenges/VOC/voc2007/ workshop/marszalek.pdf >.
35. K.E.A. van de Sande, T. Gevers, and C.G.M. Snoek Evaluating color descriptors for object and scene recognition IEEE Trans. Pattern Anal. Mach. Intell. 32 9 2010 1582 1596
36. J. van Gemert, J.-M. Geusebroek, C.J. Veenman, and A.W.M. Smeulders Kernel codebooks for scene categorization D.A. Forsyth, P.H.S. Torr, A. Zisserman, ECCV (3) Lecture Notes in Computer Science vol. 5304 2008 Springer 696 709
37. F. Moosmann, E. Nowak, and F. Jurie Randomized clustering forests for image classification IEEE Trans. Pattern Anal. Mach. Intell. 30 9 2008 1632 1646
38. J.R.R. Uijlings, A.W.M. Smeulders, and R.J.H. Scha Real-time visual concept classification IEEE Trans. Multimedia 12 7 2010 665 681
39. K.E.A. van de Sande, T. Gevers, and C.G.M. Snoek Empowering visual categorization with the GPU IEEE Trans. Multimedia 13 1 2011 60 70
40. E. Nowak, F. Jurie, and B. Triggs Sampling strategies for bag-of-features image classification A. Leonardis, H. Bischof, A. Pinz, ECCV (4) Lecture Notes in Computer Science vol. 3954 2006 Springer 490 503
41. K.E.A. van de Sande, T. Gevers, The University of Amsterdam's concept detection system at ImageCLEF 2010, in: M. Braschler, D. Harman, E. Pianta (Eds.), CLEF (Notebook Papers/LABs/Workshops), 2010.
42. T.E. de Campos, G. Csurka, and F. Perronnin Images as sets of locally weighted features Comput. Vision Image Underst. 116 1 2012 68 85
43. N. Cristianini, J. Shawe-Taylor, A. Elisseeff, and J.S. Kandola On kernel-target alignment T.G. Dietterich, S. Becker, Z. Ghahramani, NIPS 2001 MIT Press 367 373
44. C. Cortes, M. Mohri, and A. Rostamizadeh Two-stage learning kernel algorithms J. Fürnkranz, T. Joachims, ICML 2010 Omnipress 239 246
45. S. Sonnenburg, G. Rätsch, S. Henschel, C. Widmer, J. Behr, A. Zien, F.D. Bona, A. Binder, C. Gehl, and V. Franc The shogun machine learning toolbox J. Mach. Learn. Res. 11 2010 1799 1802
46. A. Binder, S. Nakajima, M. Kloft, C. Müller, W. Samek, U. Brefeld, K.-R. Müller, M. Kawanabe, Insights from classifying visual concepts with multiple kernel learning, PLoS ONE (2012), http://dx.doi.org/10.1371/journal. pone.0038897.
47. S. Sonnenburg, G. Rätsch, C. Schäfer, and B. Schölkopf Large scale multiple kernel learning J. Mach. Learn. Res. 7 2006 1531 1565
48. A. Rahimi, and B. Recht Random features for large-scale kernel machines J.C. Platt, D. Koller, Y. Singer, S.T. Roweis, NIPS 2007 MIT Press
49. A. Vedaldi, and A. Zisserman Efficient additive kernels via explicit feature maps IEEE Trans. Pattern Anal. Mach. Intell. 34 3 2012 480 492
50. A. Binder, K.-R. Müller, and M. Kawanabe On taxonomies for multi-class image categorization Int. J. Comput. Vision 2011 1 21 10.1007/s11263-010-0417-8