Multiple kernel learning for visual object recognition: A review

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 36, Issue 7, 2014, Pages 1354-1369

  Bucak, Serhat S ^a   Jin, Rong ^a   Jain, Anil K ^a,b  

^a Michigan State University   (United States)

^b Korea University   (South Korea)

Author keywords

Feature evaluation and selection; Introductory and Survey; Machine learning; Object recognition

Indexed keywords

ARTIFICIAL INTELLIGENCE; DATA PROCESSING; LEARNING SYSTEMS; MATHEMATICAL PROGRAMMING;

EFFECTIVENESS AND EFFICIENCIES; FEATURE EVALUATION AND SELECTION; INTRODUCTORY AND SURVEY; MULTIPLE KERNEL LEARNING; OPTIMIZATION PROBLEMS; SEMI INFINITE PROGRAMMING; SEQUENTIAL MINIMAL OPTIMIZATION; VISUAL OBJECT RECOGNITION;

OBJECT RECOGNITION;

ALGORITHM; AUTOMATED PATTERN RECOGNITION; COMPUTER ASSISTED DIAGNOSIS; IMAGE ENHANCEMENT; IMAGE SUBTRACTION; MACHINE LEARNING; PROCEDURES; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY;

ALGORITHMS; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; MACHINE LEARNING; PATTERN RECOGNITION, AUTOMATED; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY; SUBTRACTION TECHNIQUE;

EID: 84903197687     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2013.212     Document Type: Review

References (96)

1. B. Scholkopf and A. J. Smola, Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond. Cambridge, MA, USA: MIT Press, 2001.
2. J. Zhang, S. Lazebnik, and C. Schmid, "Local features and kernels for classification of texture and object categories: A comprehensive study," Int. J. Comput. Vis., vol. 73, no. 2, pp. 213-238, Jun. 2007. (Pubitemid 46181625)
3. Q. Chen et al., "Boosting classification with exclusive context," in Proc. PASCAL Visual Object Classes Challenge Workshop, 2010.
4. M. A. Tahir et al., "SurreyUVA-SRKDA method," in Proc. PASCAL Visual Object Classes Challenge Workshop, 2008.
5. L. Fei-Fei, R. Fergus, S. Member, and P. Perona, "One-shot learning of object categories," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 4, pp. 594-611, Apr. 2006. (Pubitemid 43264657)
6. J. Yang, Y. Li, Y. Tian, L. Duan, and W. Gao, "Group-sensitive multiple kernel learning for object categorization," in Proc. 12th ICCV, Kyoto, Japan, 2009.
7. A. Vedaldi, V. Gulshan, M. Varma, and A. Zisserman, "Multiple kernels for object detection," in Proc. 12th ICCV, Kyoto, Japan, 2009.
8. Z. Xu, R. Jin, H. Yang, I. King, and M. R. Lyu, "Simple and efficient multiple kernel learning by group lasso," in Proc. 27th ICML, Haifa, Israel, 2010.
9. S. Vishwanathan, Z. Sun, N. Ampornpunt, and M. Varma, "Multiple kernel learning and the SMO algorithm," in Proc. NIPS, Nottingham, U.K., 2010, pp. 2361-2369.
10. M. Kloft, U. Brefeld, S. Sonnenburg, and A. Zien, "lp-Norm multiple kernel learning," J. Mach. Learn. Res., vol. 12, pp. 953-997, Mar. 2011.
11. M. Kloft et al., "Efficient and accurate lp-norm multiple kernel learning," in Proc. NIPS, 2009, pp. 997-1005.
12. M. Varma and B. R. Babu, "More generality in efficient multiple kernel learning," in Proc. 26th ICML, New York, NY, USA, Jun. 2009, pp. 1065-1072.
13. F. Yan, K. Mikolajczyk, M. Barnard, H. Cai, and J. Kittler, "-p norm multiple Kernel Fisher discriminant analysis for object and image categorisation," in Proc. IEEE CVPR, San Francisco, CA, USA, 2010, pp. 3626-3632.
14. T. Damoulas and M. A. Girolami, "Probabilistic multi-class multikernel learning," Bioinformatics, vol. 24, no. 10, pp. 1264-1270, Mar. 2008.
15. C. Longworth and M. J. Gales, "Multiple kernel learning for speaker verification," in Proc. ICASSP, Las Vegas, NV, USA, 2008, pp. 1581-1584.
16. F. R. Bach, G. R. G. Lanckriet, and M. I. Jordan, "Multiple kernel learning, conic duality, and the SMO algorithm," in Proc. 21st ICML, New York, NY, USA, 2004.
17. D. P. Lewis, T. Jebara, and W. S. Noble, "Nonstationary kernel combination," in Proc. 23rd ICML, New York, NY, USA, 2006, pp. 553-560.
18. P. V. G. Person and S. Nowozin, "Infinite kernel learning," Max Planck Inst. Biol. Cybernet., Spemannstrasse, Germany, Tech. Rep. TR-178, 2008.
19. Z. Wang, S. Chen, and T. Sun, "MultiK-MHKS: A novel multiple kernel learning algorithm," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 2, pp. 348-353, Feb. 2008.
20. H. Do, A. Kalousis, A. Woznica, and M. Hilario, "Margin and radius based multiple kernel learning," in Proc. ECML PKDD, Bled, Slovenia, 2009, pp. 330-343.
21. L. Jie, F. Orabona, M. Fornoni, B. Caputo, and N. Cesa-Bianchi, "OM-2: An online multi-class multi-kernel learning algorithm," in Proc. IEEE CVPRW, San Francisco, CA, USA, 2010, pp. 43-50.
22. S. Bucak, R. Jin, and A. Jain, "Multi-label multiple kernel learning by stochastic approximation: Application to visual object recognition," in Proc. NIPS, 2010, pp. 325-333.
23. J. Saketha Nath et al., "On the algorithmics and applications of a mixed-norm based kernel learning formulation," in Proc. NIPS, 2009.
24. P. V. Gehler and S. Nowozin, "Let the kernel figure it out: Principled learning of pre-processing for kernel classifiers," in Proc. IEEE CVPR, FL, USA, 2009.
25. P. V. Gehler and S. Nowozin, "On feature combination for multiclass object classification," in Proc. ICCV, Kyoto, Japan, 2009.
26. S. Nakajima et al., "Multiple kernel learning for object classification," Technical Report on Information-based Induction Sciences (IBIS2009), 2009.
27. J. Ren, Z. Liang, and S. Hu, "Multiple kernel learning improved by MMD," in Proc. 6th Int. Conf. ADMA, Chongqing, China, 2010, pp. 63-74.
28. C. Cortes, M. Mohri, and A. Rostamizadeh, "Learning non-linear combinations of kernels," in Proc. NIPS, 2009, pp. 396-404.
29. C. Cortes, M. Mohri, and A. Rostamizadeh, "L2 Regularization for learning kernels," in Proc. Conf. Uncertain. Artif. Intell., 2009.
30. Z. Xu, R. Jin, S. Zhu, M. Lyu, and I. King, "Smooth optimization for effective multiple kernel learning," in Proc. AAAI Artif. Intell., 2010.
31. R. Tomioka and T. Suzuki, "Sparsity-accuracy trade-off in MKL," in Proc. NIPS Workshop Understanding Multiple Kernel Learning Methods, 2009.
32. M. Gönen and E. Alpaydin, "Multiple kernel learning algorithms," J. Mach. Learn. Res., vol. 12, pp. 2211-2268, Jul. 2011.
33. G. Lanckriet, N. Cristianini, P. Bartlett, and L. E. Ghaoui, "Learning the kernel matrix with semi-definite programming," J. Mach. Learn. Res., vol. 5, pp. 27-72, Jan. 2004.
34. S. Sonnenburg, G. Rätsch, and C. Schäfer, "A general and efficient multiple kernel learning algorithm," in Proc. NIPS, 2006, pp. 1273-1280.
35. M. Kowalski, M. Szafranski, and L. Ralaivola, "Multiple indefinite kernel learning with mixed norm regularization," in Proc. 26th ICML, Montreal, QC, Canada, 2009, pp. 545-552.
36. C. Cortes, M. Mohri, and A. Rostamizadeh, "Generalization bounds for learning kernels," in Proc. 27th ICML, Haifa, Israel, 2010.
37. Z. Hussain and J. Shawe-Taylor, "A note on improved loss bounds for multiple kernel learning," CoRR abs/1106.6258, 2011.
38. M. Kloft, U. Rückert, and P. L. Bartlett, "A unifying view of multiple kernel learning," in Proc. ECML PKDD, Barcelona, Spain, 2010, pp. 66-81.
39. K. Gai, G. Chen, and C. Zhang, "Learning kernels with radiuses of minimum enclosing balls," in Proc. NIPS, 2010, pp. 649-657.
40. F. Yan, K. Mikolajczyk, J. Kittler, and A. Tahir, "A comparison of L1 norm and L2 norm multiple kernel SVMs in image and video classification, " in Proc. Int. Workshop CBMI, 2009.
41. A. Rakotomamonjy, F. Bach, S. Canu, and Y. Grandvalet, "More efficiency in multiple kernel learning," in Proc. 24th ICML, Corvallis, OR, USA, 2007.
42. Z. Xu, R. Jin, I. King, and M. R. Lyu, "An extended level method for efficient multiple kernel learning," in Proc. NIPS, 2009, pp. 1825-1832.
43. A. Rakotomamonjy, F. Bach, Y. Grandvalet, and S. Canu, "SimpleMKL," J. Mach. Learn. Res., 9(11), pp. 2491-2521, 2008.
44. J. Aflalo, A. Ben-Tal, C. Bhattacharyya, J. S. Nath, and S. Raman, "Variable sparsity kernel learning," J. Mach. Learn. Res., vol. 12, pp. 565-592, Feb. 2011.
45. F. Bach, "Exploring large feature spaces with hierarchical multiple kernel learning," in Proc. NIPS, 2009.
46. J. Yang, Y. Li, Y. Tian, L.-Y. Duan, and W. Gao, "Per-Sample multiple kernel approach for visual concept learning," EURASIP J. Image Video Process., vol. 2010, pp. 1-13, Jan. 2010.
47. M. Gönen and E. Alpaydin, "Localized multiple kernel learning," in Proc. 25th ICML, New York, NY, USA, 2008.
48. S. Ji, L. Sun, R. Jin, and J. Ye, "Multi-label multiple kernel learning," in Proc. NIPS, 2009.
49. M. Varma and D. Ray, "Learning the discriminative powerinvariance trade-Off," in Proc. 11th IEEE ICCV, Rio de Janeiro, Brazil, 2007.
50. S. Sonnenburg, G. Rätsch, C. Schäfer, and B. Schölkopf, "Large scale multiple kernel learning," J. Mach. Learn. Res., vol. 7, pp. 1531-1565, Jul. 2006. (Pubitemid 44373694)
51. H. Liu and L. Yu, "Toward integrating feature selection algorithms for classification and clustering," IEEE Trans. Knowl. Data Eng., vol. 17, no. 4, pp. 491-502, Apr. 2005. (Pubitemid 40495592)
52. F. R. Bach, "Consistency of the group Lasso and multiple kernel learning," J. Mach. Learn. Res., vol. 9, pp. 1179-1225, Jun. 2008.
53. T. Hertz, "Learning distance functions: Algorithms and applications," Ph.D. dissertation, Hebrew Univ. Jerusalem, Jerusalem, Israel, 2006.
54. N. Cristianini, J. Kandola, A. Elisseeff, and J. Shawe-Taylor, "On kernel-target alignment," in Proc. NIPS, 2002, pp. 367-373.
55. O. Chapelle, J. Weston, and B. Schölkopf, "Cluster kernels for semi-supervised learning," in Proc. NIPS, 2003, pp. 585-592.
56. R. I. Kondor and J. Lafferty, "Diffusion kernels on graphs and other discrete structures," in Proc. ICML, 2002, pp. 315-322.
57. J. Zhuang, I. W. Tsang, and S. C. H. Hoi, "SimpleNPKL: Simple non-parametric kernel learning," in Proc. 26th ICML, Montreal, QC, Canada, 2009.
58. B. Kulis, M. Sustik, and I. Dhillon, "Learning low-rank kernel matrices," in Proc. 23rd ICML, Pittsburgh, PA, USA, 2006, pp. 505-512.
59. S. C. H. Hoi and R. Jin, "Active kernel learning," in Proc. 25th ICML, Helsinki, Finland, 2008, pp. 400-407.
60. S. Dickinson, "The evolution of object categorization and the challenge of image abstraction," in Object Categorization: Computer and Human Vision Perspectives, S. Dickinson, A. Leonardis, B. Schiele, and M. Tarr, Eds. Cambridge, NY, USA: Cambridge University Press, 2009, pp. 1-37.
61. J. Ponce et al., "Dataset issues in object recognition," in Proc. Toward Category-Level Object Recognit., 2006, pp. 29-48.
62. C. Harris and M. Stephens, "A combined corner and edge detector," in Proc. Alvey Vision Conf., 1988.
63. K. Mikolajczyk and C. Schmid, "Indexing based on scale invariant interest points," in Proc. 8th IEEE ICCV, Vancouver, BC, Canada, 2001, pp. 525-531. (Pubitemid 32794998)
64. D. G. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-110, 2004.
65. T. Ojala, M. Pietikainen, and T. Maenpaa, "Multiresolution grayscale and rotation invariant texture classification with local binary patterns," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 7, pp. 971-987, Jul. 2002. (Pubitemid 34835471)
66. N. Dalal and B. Triggs, "Histograms of oriented gradients for human detection," in Proc. CVPR, vol. 1. San Diego, CA, USA, 2005, pp. 886-893. (Pubitemid 43897286)
67. F. Perronnin, J. Sánchez, and T. Mensink, "Improving the Fisher Kernel for large-scale image classification," in Proc. 11th ECCV, Heraklion, Greece, 2010.
68. C. Schmid, "Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories," in Proc. CVPR, Washington, DC, USA, 2006, pp. 2169-2178. (Pubitemid 44931582)
69. A. Oliva and A. Torralba, "Modeling the shape of the scene: A holistic representation of the spatial envelope," Int. J. Comput. Vis., vol. 42, no. 3, pp. 145-175, 2001. (Pubitemid 32680801)
70. N. Pinto, D. D. Cox, and J. J. Dicarlo, "Why is real-world visual object recognition hard," PLoS Computational Biology, vol. 4, no. 1, e27, 2008.
71. A. Berg and J. Malik, "Geometric blur for template matching," in Proc. CVPR, 2001, pp. 607-614.
72. V. Sindhwani and A. C. Lozano, "Non-parametric group orthogonal matching pursuit for sparse learning with multiple kernels," in Proc. NIPS, 2011, pp. 414-431.
73. Y. Nesterov, Introductory Lectures on Convex Optimization: A Basic Course. Vol. 87. Springer, 2004.
74. L. Tang, J. Chen, and J. Ye, "On multiple kernel learning with multiple labels," in Proc. IJCAI, 2009.
75. A. Zien and S. Cheng, "Multiclass multiple kernel learning," in Proc. 24th ICML, Corvallis, OR, USA, 2007.
76. [Online]. Available: http://www.mosek.com
77. J. C. Platt, Fast Training of Support Vector Machines Using Sequential Minimal Optimization. Cambridge, MA, USA: MIT Press, 1999, pp. 185-208.
78. R. Jin, S. C. H. Hoi, and T. Yang, "Online multiple kernel learning: Algorithms and mistake bounds," in Proc. Int. Conf. ALT, Canberra, ACT, Australia, 2010, pp. 390-404.
79. F. Rosenblatt, "The perceptron: A probabilistic model for information storage and organization in the brain," Psychological Rev., vol. 65, no. 6, pp. 386-408, 1958.
80. Y. Freund and R. E. Schapire, "A decision-theoretic generalization of on-line learning and an application to boosting," J. Comput. Syst. Sci., vol. 55, no. 1, pp. 119-139, 1997. (Pubitemid 127433398)
81. M. Everingham, L. Van Gool, C. K. I. Williams, J. Winn, and A. Zisserman. (VOC2007). The PASCAL Visual Object Classes Challenge Results [Online]. Available: http://www.pascalnetwork. org/challenges/VOC/voc2007/workshop/index. html
82. S. Belongie, J. Malik, and J. Puzicha, "Shape matching and object recognition using shape contexts," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 4, pp. 509-522, Apr. 2002. (Pubitemid 34448769)
83. O. Tuzel, F. Porikli, and P. Meer, "Human detection via classification on Riemannian manifolds," in Proc. CVPR, Minneapolis, MN, USA, 2007, pp. 1-8.
84. E. Shechtman andM. Irani, "Matching local self-similarities across images and videos," in Proc. CVPR, Minneapolis, MN, USA, 2007, pp. 607-614.
85. M. Guillaumin, T. Mensink, J. Verbeek, and C. Schmid, "TagProp: Discriminative metric learning in nearest neighbor models for image auto-annotation," in Proc. 12th IEEE ICCV, Kyoto, Japan, Sept. 2009, pp. 309-316.
86. J. van de Weijer and C. Schmid, "Coloring local feature extraction," in Proc. 9th ECCV, Graz, Austria, 2006, pp. 334-348. (Pubitemid 44029738)
87. F. Perronnin, J. Sanchez, and Y. Liu, "Large-scale image categorization with explicit data embedding," in Proc. CVPR, San Francisco, CA, USA, 2010, pp. 2297-2304.
88. C.-C. Chang and C.-J. Lin, "LIBSVM: A library for support vector machines," ACM Trans. Intell. Syst. Technol., vol. 2, pp. 27:1-27:27, 2011.
89. M. Grant and S. Boyd. CVX: Matlab Software for Disciplined Convex Programming, Version 1.21 [Online]. Available: http://cvxr.com/cvx, Apr. 2011.
90. F. Bach, R. Thibaux, and M. I. Jordan, "Computing regularization paths for learning multiple kernels," in Proc. NIPS, 2005.
91. F. Li, J. Carreira, and C. Sminchisescu, "Object recognition as ranking holistic figure-ground hypotheses," in Proc. CVPR, San Francisco, CA, USA, 2010, pp. 1712-1719.
92. G. L. Oliveira, E. R. Nascimento, A. W. Vieira, and M. F. M. Campos, "Sparse spatial coding: A novel approach for efficient and accurate object recognition," in Proc. IEEE ICRA, Saint Paul, MN, USA, 2012, pp. 2592-2598.
93. Z. Song, Q. Chen, Z. Huang, Y. Hua, and S. Yan, "Contextualizing object detection and classification," in Proc. IEEE CVPR, Providence, RI, USA, 2011, pp. 1585-1592.
94. H. Harzallah, F. Jurie, and C. Schmid, "Combining efficient object localization and image classification," in Proc. 12th ICCV, Kyoto, Japan, 2009, pp. 237-244.
95. K. Chatfield, V. Lempitsky, A. Vedaldi, and A. Zisserman, "The devil is in the details: An evaluation of recent feature encoding methods," in Proc. BMVC, 2011.
96. S. Sonnenburg et al., "The SHOGUN machine learning toolbox," J. Mach. Learn. Res., vol. 11, pp. 1799-1802, Jun. 2010.